2024-01-23T08:33:18.932 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-23T08:33:18.932 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} --archive /home/teuthworker/archive/cbodley-2024-01-22_19:46:51-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7527402 --owner scheduled_cbodley@teuthology --name cbodley-2024-01-22_19:46:51-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi -- /home/teuthworker/archive/cbodley-2024-01-22_19:46:51-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7527402/orig.config.yaml 2024-01-23T08:33:18.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:33:19.063 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-01-22_19:46:51-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7527402 branch: wip-yuri8-testing-2024-01-18-0823 description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} email: null first_in_suite: false job_id: '7527402' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: cbodley-2024-01-22_19:46:51-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-yuri8-testing-2024-01-18-0823 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd crush smoke test: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow request - SLOW_OPS - MON_DOWN sha1: 0edf41a622739843d6b978b179ff3227b476dd9d valgrind: exit_on_first_error: false mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes check-counter: counters: mds: - mds.exported - mds.imported install: ceph: debuginfo: true flavor: default sha1: 0edf41a622739843d6b978b179ff3227b476dd9d thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri8-testing-2024-01-18-0823-plus-55233 sha1: 9db6bac5568c8be6cfd98da20bd2b62582f0776f owner: scheduled_cbodley@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 6631 sha1: 0edf41a622739843d6b978b179ff3227b476dd9d sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri8-testing-2024-01-18-0823-plus-55233 suite_path: /home/teuthworker/src/github.com_cbodley_ceph_9db6bac5568c8be6cfd98da20bd2b62582f0776f/qa suite_relpath: qa suite_repo: https://github.com/cbodley/ceph.git suite_sha1: 9db6bac5568c8be6cfd98da20bd2b62582f0776f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi046.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOBg1hcnBuGx7jM7i325dTMohQb3/NxqEgH4TkiCDEurU1rMgwiIew0H5aqftIlUd8slseNALE2EVbg4l2VAyuw= smithi175.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMs8YH4mKA99SvOyE1azd3KjV93HQxKIp4TgOO8kSIy+8wn9J4vdlCcOL9MZ5gC7XzKUJI7bOrtMI6hyrXJj/3c= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: cd45576300487d997e5a85abed65500b9f5d143b timestamp: 2024-01-22_19:46:51 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-01-23T08:33:19.063 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_cbodley_ceph_9db6bac5568c8be6cfd98da20bd2b62582f0776f/qa; will attempt to use it 2024-01-23T08:33:19.063 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_cbodley_ceph_9db6bac5568c8be6cfd98da20bd2b62582f0776f/qa/tasks 2024-01-23T08:33:19.064 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-01-23T08:33:19.065 INFO:teuthology.task.internal:Checking packages... 2024-01-23T08:33:19.089 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '0edf41a622739843d6b978b179ff3227b476dd9d' 2024-01-23T08:33:19.089 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-23T08:33:19.089 INFO:teuthology.packaging:ref: None 2024-01-23T08:33:19.089 INFO:teuthology.packaging:tag: None 2024-01-23T08:33:19.089 INFO:teuthology.packaging:branch: wip-yuri8-testing-2024-01-18-0823 2024-01-23T08:33:19.089 INFO:teuthology.packaging:sha1: 0edf41a622739843d6b978b179ff3227b476dd9d 2024-01-23T08:33:19.090 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-yuri8-testing-2024-01-18-0823 2024-01-23T08:33:19.230 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-766-g0edf41a6-1jammy 2024-01-23T08:33:19.232 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-01-23T08:33:19.238 INFO:teuthology.task.internal:no buildpackages task found 2024-01-23T08:33:19.239 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-01-23T08:33:19.276 INFO:teuthology.task.internal:Saving configuration 2024-01-23T08:33:19.292 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-01-23T08:33:19.300 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-23T08:33:19.326 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-01-22_19:46:51-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7527402', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-23 08:27:40.841995', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAKULBhfW61G4UL+MvKIuTcPekfX7mrPIvobXx/cwviL'} 2024-01-23T08:33:19.350 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-01-22_19:46:51-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7527402', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-23 08:27:40.843736', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILtUoMxMEdi7YRlm2RDoe6HQVs5mFllszkgA0AIpg40c'} 2024-01-23T08:33:19.350 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-01-23T08:33:19.356 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-01-23T08:33:19.357 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-01-23T08:33:19.357 INFO:teuthology.run_tasks:Running task console_log... 2024-01-23T08:33:19.439 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f04b7b07430>, signals=[15]) 2024-01-23T08:33:19.440 INFO:teuthology.run_tasks:Running task internal.connect... 2024-01-23T08:33:19.446 INFO:teuthology.task.internal:Opening connections... 2024-01-23T08:33:19.446 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi046.front.sepia.ceph.com 2024-01-23T08:33:19.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T08:33:19.529 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi175.front.sepia.ceph.com 2024-01-23T08:33:19.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T08:33:19.609 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-01-23T08:33:19.616 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2024-01-23T08:33:19.621 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2024-01-23T08:33:19.621 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2024-01-23T08:33:19.669 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-23T08:33:19.669 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Ubuntu" 2024-01-23T08:33:19.669 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="22.04" 2024-01-23T08:33:19.669 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-23T08:33:19.669 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_CODENAME=jammy 2024-01-23T08:33:19.669 INFO:teuthology.orchestra.run.smithi046.stdout:ID=ubuntu 2024-01-23T08:33:19.669 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE=debian 2024-01-23T08:33:19.669 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-23T08:33:19.669 INFO:teuthology.orchestra.run.smithi046.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-23T08:33:19.669 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-23T08:33:19.669 INFO:teuthology.orchestra.run.smithi046.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-23T08:33:19.670 INFO:teuthology.orchestra.run.smithi046.stdout:UBUNTU_CODENAME=jammy 2024-01-23T08:33:19.670 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2024-01-23T08:33:19.701 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2024-01-23T08:33:19.706 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2024-01-23T08:33:19.706 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-01-23T08:33:19.754 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-23T08:33:19.754 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Ubuntu" 2024-01-23T08:33:19.754 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="22.04" 2024-01-23T08:33:19.754 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-23T08:33:19.754 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_CODENAME=jammy 2024-01-23T08:33:19.754 INFO:teuthology.orchestra.run.smithi175.stdout:ID=ubuntu 2024-01-23T08:33:19.754 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE=debian 2024-01-23T08:33:19.755 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-23T08:33:19.755 INFO:teuthology.orchestra.run.smithi175.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-23T08:33:19.755 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-23T08:33:19.755 INFO:teuthology.orchestra.run.smithi175.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-23T08:33:19.755 INFO:teuthology.orchestra.run.smithi175.stdout:UBUNTU_CODENAME=jammy 2024-01-23T08:33:19.755 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-01-23T08:33:19.784 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-01-23T08:33:19.794 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-01-23T08:33:19.810 INFO:teuthology.task.internal:Checking for old test directory... 2024-01-23T08:33:19.810 DEBUG:teuthology.orchestra.run.smithi046:> test '!' -e /home/ubuntu/cephtest 2024-01-23T08:33:19.813 DEBUG:teuthology.orchestra.run.smithi175:> test '!' -e /home/ubuntu/cephtest 2024-01-23T08:33:19.817 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-01-23T08:33:19.851 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-01-23T08:33:19.851 DEBUG:teuthology.orchestra.run.smithi046:> test -z $(ls -A /var/lib/ceph) 2024-01-23T08:33:19.859 DEBUG:teuthology.orchestra.run.smithi175:> test -z $(ls -A /var/lib/ceph) 2024-01-23T08:33:19.866 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-01-23T08:33:19.923 INFO:teuthology.run_tasks:Running task kernel... 2024-01-23T08:33:19.937 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-01-23T08:33:19.937 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-01-23T08:33:19.937 DEBUG:teuthology.orchestra.run.smithi046:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-23T08:33:19.938 DEBUG:teuthology.orchestra.run.smithi175:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-23T08:33:19.943 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-23T08:33:19.944 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-23T08:33:19.944 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-01-23T08:33:19.945 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2024-01-23T08:33:19.990 INFO:teuthology.orchestra.run.smithi046.stdout:5.15.0-56-generic 2024-01-23T08:33:19.990 INFO:teuthology.task.kernel:Running kernel on smithi046: 5.15.0-56-generic 2024-01-23T08:33:19.990 DEBUG:teuthology.orchestra.run.smithi046:> sudo apt-get clean 2024-01-23T08:33:19.991 INFO:teuthology.orchestra.run.smithi175.stdout:5.15.0-56-generic 2024-01-23T08:33:19.992 INFO:teuthology.task.kernel:Running kernel on smithi175: 5.15.0-56-generic 2024-01-23T08:33:19.992 DEBUG:teuthology.orchestra.run.smithi175:> sudo apt-get clean 2024-01-23T08:33:20.110 DEBUG:teuthology.orchestra.run.smithi046:> sudo apt-get update 2024-01-23T08:33:20.130 DEBUG:teuthology.orchestra.run.smithi175:> sudo apt-get update 2024-01-23T08:33:20.285 INFO:teuthology.orchestra.run.smithi046.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-01-23T08:33:20.403 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-23T08:33:20.405 INFO:teuthology.orchestra.run.smithi175.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-01-23T08:33:20.467 INFO:teuthology.orchestra.run.smithi175.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-01-23T08:33:20.527 INFO:teuthology.orchestra.run.smithi046.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [386 kB] 2024-01-23T08:33:20.623 INFO:teuthology.orchestra.run.smithi046.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,067 kB] 2024-01-23T08:33:20.674 INFO:teuthology.orchestra.run.smithi046.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [202 kB] 2024-01-23T08:33:20.680 INFO:teuthology.orchestra.run.smithi046.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-01-23T08:33:20.681 INFO:teuthology.orchestra.run.smithi046.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,260 kB] 2024-01-23T08:33:20.710 INFO:teuthology.orchestra.run.smithi046.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.2 kB] 2024-01-23T08:33:20.711 INFO:teuthology.orchestra.run.smithi046.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [206 kB] 2024-01-23T08:33:20.716 INFO:teuthology.orchestra.run.smithi046.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-01-23T08:33:20.716 INFO:teuthology.orchestra.run.smithi046.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [832 kB] 2024-01-23T08:33:20.731 INFO:teuthology.orchestra.run.smithi046.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [585 kB] 2024-01-23T08:33:20.740 INFO:teuthology.orchestra.run.smithi046.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [158 kB] 2024-01-23T08:33:20.742 INFO:teuthology.orchestra.run.smithi046.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-01-23T08:33:20.743 INFO:teuthology.orchestra.run.smithi046.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-01-23T08:33:20.743 INFO:teuthology.orchestra.run.smithi046.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-01-23T08:33:20.763 INFO:teuthology.orchestra.run.smithi046.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-01-23T08:33:20.764 INFO:teuthology.orchestra.run.smithi046.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-01-23T08:33:20.772 INFO:teuthology.orchestra.run.smithi046.stdout:Hit:18 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-23T08:33:20.794 INFO:teuthology.orchestra.run.smithi046.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-01-23T08:33:20.829 INFO:teuthology.orchestra.run.smithi175.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,067 kB] 2024-01-23T08:33:20.829 INFO:teuthology.orchestra.run.smithi175.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-01-23T08:33:20.887 INFO:teuthology.orchestra.run.smithi046.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-01-23T08:33:20.960 INFO:teuthology.orchestra.run.smithi046.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [552 kB] 2024-01-23T08:33:20.968 INFO:teuthology.orchestra.run.smithi175.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [552 kB] 2024-01-23T08:33:21.031 INFO:teuthology.orchestra.run.smithi046.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,282 kB] 2024-01-23T08:33:21.083 INFO:teuthology.orchestra.run.smithi046.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [262 kB] 2024-01-23T08:33:21.089 INFO:teuthology.orchestra.run.smithi046.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-01-23T08:33:21.090 INFO:teuthology.orchestra.run.smithi046.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [33.6 kB] 2024-01-23T08:33:21.091 INFO:teuthology.orchestra.run.smithi046.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,280 kB] 2024-01-23T08:33:21.122 INFO:teuthology.orchestra.run.smithi046.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [209 kB] 2024-01-23T08:33:21.126 INFO:teuthology.orchestra.run.smithi046.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-01-23T08:33:21.127 INFO:teuthology.orchestra.run.smithi046.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [681 kB] 2024-01-23T08:33:21.139 INFO:teuthology.orchestra.run.smithi046.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,032 kB] 2024-01-23T08:33:21.157 INFO:teuthology.orchestra.run.smithi175.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,282 kB] 2024-01-23T08:33:21.158 INFO:teuthology.orchestra.run.smithi046.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [231 kB] 2024-01-23T08:33:21.162 INFO:teuthology.orchestra.run.smithi046.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-01-23T08:33:21.166 INFO:teuthology.orchestra.run.smithi046.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.1 kB] 2024-01-23T08:33:21.167 INFO:teuthology.orchestra.run.smithi046.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,164 B] 2024-01-23T08:33:21.167 INFO:teuthology.orchestra.run.smithi046.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.1 kB] 2024-01-23T08:33:21.196 INFO:teuthology.orchestra.run.smithi046.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-01-23T08:33:21.196 INFO:teuthology.orchestra.run.smithi046.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2024-01-23T08:33:21.197 INFO:teuthology.orchestra.run.smithi046.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2024-01-23T08:33:21.198 INFO:teuthology.orchestra.run.smithi046.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2024-01-23T08:33:21.198 INFO:teuthology.orchestra.run.smithi046.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-01-23T08:33:21.199 INFO:teuthology.orchestra.run.smithi046.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2024-01-23T08:33:21.199 INFO:teuthology.orchestra.run.smithi046.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.2 kB] 2024-01-23T08:33:21.221 INFO:teuthology.orchestra.run.smithi175.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [386 kB] 2024-01-23T08:33:21.226 INFO:teuthology.orchestra.run.smithi046.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-01-23T08:33:21.227 INFO:teuthology.orchestra.run.smithi046.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-01-23T08:33:21.241 INFO:teuthology.orchestra.run.smithi175.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [202 kB] 2024-01-23T08:33:21.251 INFO:teuthology.orchestra.run.smithi175.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-01-23T08:33:21.252 INFO:teuthology.orchestra.run.smithi175.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.2 kB] 2024-01-23T08:33:21.253 INFO:teuthology.orchestra.run.smithi175.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,260 kB] 2024-01-23T08:33:21.292 INFO:teuthology.orchestra.run.smithi175.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [262 kB] 2024-01-23T08:33:21.310 INFO:teuthology.orchestra.run.smithi175.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-01-23T08:33:21.311 INFO:teuthology.orchestra.run.smithi175.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,280 kB] 2024-01-23T08:33:21.363 INFO:teuthology.orchestra.run.smithi175.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [206 kB] 2024-01-23T08:33:21.367 INFO:teuthology.orchestra.run.smithi175.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [33.6 kB] 2024-01-23T08:33:21.367 INFO:teuthology.orchestra.run.smithi175.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-01-23T08:33:21.368 INFO:teuthology.orchestra.run.smithi175.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [585 kB] 2024-01-23T08:33:21.368 INFO:teuthology.orchestra.run.smithi175.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [209 kB] 2024-01-23T08:33:21.374 INFO:teuthology.orchestra.run.smithi175.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-01-23T08:33:21.378 INFO:teuthology.orchestra.run.smithi175.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [832 kB] 2024-01-23T08:33:21.538 INFO:teuthology.orchestra.run.smithi175.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,032 kB] 2024-01-23T08:33:21.566 INFO:teuthology.orchestra.run.smithi175.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [158 kB] 2024-01-23T08:33:21.968 INFO:teuthology.orchestra.run.smithi175.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-01-23T08:33:21.973 INFO:teuthology.orchestra.run.smithi175.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-01-23T08:33:21.974 INFO:teuthology.orchestra.run.smithi175.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-01-23T08:33:21.988 INFO:teuthology.orchestra.run.smithi175.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-01-23T08:33:21.991 INFO:teuthology.orchestra.run.smithi175.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-01-23T08:33:22.164 INFO:teuthology.orchestra.run.smithi175.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [681 kB] 2024-01-23T08:33:22.202 INFO:teuthology.orchestra.run.smithi175.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [231 kB] 2024-01-23T08:33:22.214 INFO:teuthology.orchestra.run.smithi175.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-01-23T08:33:22.216 INFO:teuthology.orchestra.run.smithi175.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,164 B] 2024-01-23T08:33:22.216 INFO:teuthology.orchestra.run.smithi175.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.1 kB] 2024-01-23T08:33:22.218 INFO:teuthology.orchestra.run.smithi175.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.1 kB] 2024-01-23T08:33:22.219 INFO:teuthology.orchestra.run.smithi175.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-01-23T08:33:22.219 INFO:teuthology.orchestra.run.smithi175.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2024-01-23T08:33:22.245 INFO:teuthology.orchestra.run.smithi175.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2024-01-23T08:33:22.246 INFO:teuthology.orchestra.run.smithi175.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2024-01-23T08:33:22.411 INFO:teuthology.orchestra.run.smithi175.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-01-23T08:33:22.494 INFO:teuthology.orchestra.run.smithi175.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.2 kB] 2024-01-23T08:33:22.598 INFO:teuthology.orchestra.run.smithi175.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2024-01-23T08:33:22.627 INFO:teuthology.orchestra.run.smithi175.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-01-23T08:33:22.677 INFO:teuthology.orchestra.run.smithi175.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-01-23T08:33:26.519 INFO:teuthology.orchestra.run.smithi046.stdout:Fetched 10.9 MB in 2s (6,519 kB/s) 2024-01-23T08:33:26.885 INFO:teuthology.orchestra.run.smithi175.stdout:Fetched 10.9 MB in 2s (4,392 kB/s) 2024-01-23T08:33:27.784 INFO:teuthology.orchestra.run.smithi046.stdout:Reading package lists... 2024-01-23T08:33:27.801 DEBUG:teuthology.orchestra.run.smithi046:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-01-23T08:33:27.860 INFO:teuthology.orchestra.run.smithi046.stdout:Reading package lists... 2024-01-23T08:33:28.048 INFO:teuthology.orchestra.run.smithi046.stdout:Building dependency tree... 2024-01-23T08:33:28.049 INFO:teuthology.orchestra.run.smithi046.stdout:Reading state information... 2024-01-23T08:33:28.194 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-01-23T08:33:28.211 DEBUG:teuthology.orchestra.run.smithi175:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-01-23T08:33:28.218 INFO:teuthology.orchestra.run.smithi046.stdout:The following packages were automatically installed and are no longer required: 2024-01-23T08:33:28.218 INFO:teuthology.orchestra.run.smithi046.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-23T08:33:28.218 INFO:teuthology.orchestra.run.smithi046.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-23T08:33:28.218 INFO:teuthology.orchestra.run.smithi046.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-23T08:33:28.219 INFO:teuthology.orchestra.run.smithi046.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-01-23T08:33:28.219 INFO:teuthology.orchestra.run.smithi046.stdout: python2.7-minimal 2024-01-23T08:33:28.219 INFO:teuthology.orchestra.run.smithi046.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-23T08:33:28.220 INFO:teuthology.orchestra.run.smithi046.stdout:The following additional packages will be installed: 2024-01-23T08:33:28.220 INFO:teuthology.orchestra.run.smithi046.stdout: linux-generic linux-headers-5.15.0-91 linux-headers-5.15.0-91-generic 2024-01-23T08:33:28.220 INFO:teuthology.orchestra.run.smithi046.stdout: linux-headers-generic linux-image-5.15.0-91-generic 2024-01-23T08:33:28.220 INFO:teuthology.orchestra.run.smithi046.stdout: linux-modules-5.15.0-91-generic linux-modules-extra-5.15.0-91-generic 2024-01-23T08:33:28.222 INFO:teuthology.orchestra.run.smithi046.stdout:Suggested packages: 2024-01-23T08:33:28.222 INFO:teuthology.orchestra.run.smithi046.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-01-23T08:33:28.222 INFO:teuthology.orchestra.run.smithi046.stdout:Recommended packages: 2024-01-23T08:33:28.222 INFO:teuthology.orchestra.run.smithi046.stdout: thermald 2024-01-23T08:33:28.262 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-01-23T08:33:28.271 INFO:teuthology.orchestra.run.smithi046.stdout:The following NEW packages will be installed: 2024-01-23T08:33:28.272 INFO:teuthology.orchestra.run.smithi046.stdout: linux-headers-5.15.0-91 linux-headers-5.15.0-91-generic 2024-01-23T08:33:28.272 INFO:teuthology.orchestra.run.smithi046.stdout: linux-image-5.15.0-91-generic linux-modules-5.15.0-91-generic 2024-01-23T08:33:28.272 INFO:teuthology.orchestra.run.smithi046.stdout: linux-modules-extra-5.15.0-91-generic 2024-01-23T08:33:28.273 INFO:teuthology.orchestra.run.smithi046.stdout:The following packages will be upgraded: 2024-01-23T08:33:28.273 INFO:teuthology.orchestra.run.smithi046.stdout: linux-generic linux-headers-generic linux-image-generic 2024-01-23T08:33:28.334 INFO:teuthology.orchestra.run.smithi046.stdout:3 upgraded, 5 newly installed, 0 to remove and 278 not upgraded. 2024-01-23T08:33:28.334 INFO:teuthology.orchestra.run.smithi046.stdout:Need to get 113 MB of archives. 2024-01-23T08:33:28.334 INFO:teuthology.orchestra.run.smithi046.stdout:After this operation, 582 MB of additional disk space will be used. 2024-01-23T08:33:28.334 INFO:teuthology.orchestra.run.smithi046.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-91-generic amd64 5.15.0-91.101 [22.5 MB] 2024-01-23T08:33:28.431 INFO:teuthology.orchestra.run.smithi175.stdout:Building dependency tree... 2024-01-23T08:33:28.431 INFO:teuthology.orchestra.run.smithi175.stdout:Reading state information... 2024-01-23T08:33:28.577 INFO:teuthology.orchestra.run.smithi175.stdout:The following packages were automatically installed and are no longer required: 2024-01-23T08:33:28.577 INFO:teuthology.orchestra.run.smithi175.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-23T08:33:28.577 INFO:teuthology.orchestra.run.smithi175.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-23T08:33:28.578 INFO:teuthology.orchestra.run.smithi175.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-23T08:33:28.578 INFO:teuthology.orchestra.run.smithi175.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-01-23T08:33:28.578 INFO:teuthology.orchestra.run.smithi175.stdout: python2.7-minimal 2024-01-23T08:33:28.578 INFO:teuthology.orchestra.run.smithi175.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-23T08:33:28.579 INFO:teuthology.orchestra.run.smithi175.stdout:The following additional packages will be installed: 2024-01-23T08:33:28.579 INFO:teuthology.orchestra.run.smithi175.stdout: linux-generic linux-headers-5.15.0-91 linux-headers-5.15.0-91-generic 2024-01-23T08:33:28.579 INFO:teuthology.orchestra.run.smithi175.stdout: linux-headers-generic linux-image-5.15.0-91-generic 2024-01-23T08:33:28.579 INFO:teuthology.orchestra.run.smithi175.stdout: linux-modules-5.15.0-91-generic linux-modules-extra-5.15.0-91-generic 2024-01-23T08:33:28.581 INFO:teuthology.orchestra.run.smithi175.stdout:Suggested packages: 2024-01-23T08:33:28.581 INFO:teuthology.orchestra.run.smithi175.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-01-23T08:33:28.581 INFO:teuthology.orchestra.run.smithi175.stdout:Recommended packages: 2024-01-23T08:33:28.581 INFO:teuthology.orchestra.run.smithi175.stdout: thermald 2024-01-23T08:33:28.631 INFO:teuthology.orchestra.run.smithi175.stdout:The following NEW packages will be installed: 2024-01-23T08:33:28.631 INFO:teuthology.orchestra.run.smithi175.stdout: linux-headers-5.15.0-91 linux-headers-5.15.0-91-generic 2024-01-23T08:33:28.632 INFO:teuthology.orchestra.run.smithi175.stdout: linux-image-5.15.0-91-generic linux-modules-5.15.0-91-generic 2024-01-23T08:33:28.632 INFO:teuthology.orchestra.run.smithi175.stdout: linux-modules-extra-5.15.0-91-generic 2024-01-23T08:33:28.633 INFO:teuthology.orchestra.run.smithi175.stdout:The following packages will be upgraded: 2024-01-23T08:33:28.633 INFO:teuthology.orchestra.run.smithi175.stdout: linux-generic linux-headers-generic linux-image-generic 2024-01-23T08:33:28.812 INFO:teuthology.orchestra.run.smithi175.stdout:3 upgraded, 5 newly installed, 0 to remove and 278 not upgraded. 2024-01-23T08:33:28.812 INFO:teuthology.orchestra.run.smithi175.stdout:Need to get 113 MB of archives. 2024-01-23T08:33:28.812 INFO:teuthology.orchestra.run.smithi175.stdout:After this operation, 582 MB of additional disk space will be used. 2024-01-23T08:33:28.812 INFO:teuthology.orchestra.run.smithi175.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-91-generic amd64 5.15.0-91.101 [22.5 MB] 2024-01-23T08:33:28.862 INFO:teuthology.orchestra.run.smithi046.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-91-generic amd64 5.15.0-91.101 [11.5 MB] 2024-01-23T08:33:28.984 INFO:teuthology.orchestra.run.smithi046.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-91-generic amd64 5.15.0-91.101 [63.8 MB] 2024-01-23T08:33:30.080 INFO:teuthology.orchestra.run.smithi046.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.91.88 [1,700 B] 2024-01-23T08:33:30.080 INFO:teuthology.orchestra.run.smithi046.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.91.88 [2,488 B] 2024-01-23T08:33:30.081 INFO:teuthology.orchestra.run.smithi046.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-91 all 5.15.0-91.101 [12.3 MB] 2024-01-23T08:33:30.230 INFO:teuthology.orchestra.run.smithi175.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-91-generic amd64 5.15.0-91.101 [11.5 MB] 2024-01-23T08:33:30.349 INFO:teuthology.orchestra.run.smithi046.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-91-generic amd64 5.15.0-91.101 [2,860 kB] 2024-01-23T08:33:30.386 INFO:teuthology.orchestra.run.smithi046.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.91.88 [2,342 B] 2024-01-23T08:33:30.554 INFO:teuthology.orchestra.run.smithi175.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-91-generic amd64 5.15.0-91.101 [63.8 MB] 2024-01-23T08:33:30.798 INFO:teuthology.orchestra.run.smithi046.stdout:Fetched 113 MB in 2s (53.7 MB/s) 2024-01-23T08:33:30.947 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package linux-modules-5.15.0-91-generic. 2024-01-23T08:33:32.681 INFO:teuthology.orchestra.run.smithi175.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.91.88 [1,700 B] 2024-01-23T08:33:32.682 INFO:teuthology.orchestra.run.smithi175.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.91.88 [2,488 B] 2024-01-23T08:33:32.682 INFO:teuthology.orchestra.run.smithi175.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-91 all 5.15.0-91.101 [12.3 MB] 2024-01-23T08:33:32.867 INFO:teuthology.orchestra.run.smithi046.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-01-23T08:33:32.871 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../0-linux-modules-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2024-01-23T08:33:32.962 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking linux-modules-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-23T08:33:33.375 INFO:teuthology.orchestra.run.smithi175.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-91-generic amd64 5.15.0-91.101 [2,860 kB] 2024-01-23T08:33:33.486 INFO:teuthology.orchestra.run.smithi175.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.91.88 [2,342 B] 2024-01-23T08:33:33.891 INFO:teuthology.orchestra.run.smithi175.stdout:Fetched 113 MB in 5s (23.3 MB/s) 2024-01-23T08:33:34.075 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package linux-modules-5.15.0-91-generic. 2024-01-23T08:33:35.271 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package linux-image-5.15.0-91-generic. 2024-01-23T08:33:35.293 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../1-linux-image-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2024-01-23T08:33:35.371 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-23T08:33:35.840 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-91-generic. 2024-01-23T08:33:35.861 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2024-01-23T08:33:35.899 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking linux-modules-extra-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-23T08:33:36.035 INFO:teuthology.orchestra.run.smithi175.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-01-23T08:33:36.039 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../0-linux-modules-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2024-01-23T08:33:36.105 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-modules-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-23T08:33:38.114 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package linux-image-5.15.0-91-generic. 2024-01-23T08:33:38.135 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../1-linux-image-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2024-01-23T08:33:38.238 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-23T08:33:38.675 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-91-generic. 2024-01-23T08:33:38.695 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2024-01-23T08:33:38.733 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-modules-extra-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-23T08:33:41.746 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../3-linux-generic_5.15.0.91.88_amd64.deb ... 2024-01-23T08:33:41.848 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking linux-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2024-01-23T08:33:42.180 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.91.88_amd64.deb ... 2024-01-23T08:33:42.301 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking linux-image-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2024-01-23T08:33:42.613 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package linux-headers-5.15.0-91. 2024-01-23T08:33:42.635 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../5-linux-headers-5.15.0-91_5.15.0-91.101_all.deb ... 2024-01-23T08:33:42.712 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking linux-headers-5.15.0-91 (5.15.0-91.101) ... 2024-01-23T08:33:45.098 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../3-linux-generic_5.15.0.91.88_amd64.deb ... 2024-01-23T08:33:45.225 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2024-01-23T08:33:45.676 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.91.88_amd64.deb ... 2024-01-23T08:33:45.804 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-image-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2024-01-23T08:33:46.115 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package linux-headers-5.15.0-91. 2024-01-23T08:33:46.126 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../5-linux-headers-5.15.0-91_5.15.0-91.101_all.deb ... 2024-01-23T08:33:46.165 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-headers-5.15.0-91 (5.15.0-91.101) ... 2024-01-23T08:33:48.382 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package linux-headers-5.15.0-91-generic. 2024-01-23T08:33:48.419 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../6-linux-headers-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2024-01-23T08:33:48.456 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking linux-headers-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-23T08:33:51.100 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.91.88_amd64.deb ... 2024-01-23T08:33:51.224 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking linux-headers-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2024-01-23T08:33:51.550 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up linux-headers-5.15.0-91 (5.15.0-91.101) ... 2024-01-23T08:33:51.646 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up linux-headers-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-23T08:33:51.772 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up linux-headers-generic (5.15.0.91.88) ... 2024-01-23T08:33:51.900 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-23T08:33:51.940 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package linux-headers-5.15.0-91-generic. 2024-01-23T08:33:51.976 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../6-linux-headers-5.15.0-91-generic_5.15.0-91.101_amd64.deb ... 2024-01-23T08:33:52.014 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-headers-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-23T08:33:53.226 INFO:teuthology.orchestra.run.smithi046.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-01-23T08:33:53.226 INFO:teuthology.orchestra.run.smithi046.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-01-23T08:33:53.226 INFO:teuthology.orchestra.run.smithi046.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-91-generic 2024-01-23T08:33:53.226 INFO:teuthology.orchestra.run.smithi046.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-91-generic 2024-01-23T08:33:53.378 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up linux-modules-extra-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-23T08:33:54.602 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.91.88_amd64.deb ... 2024-01-23T08:33:54.727 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-headers-generic (5.15.0.91.88) over (5.15.0.56.54) ... 2024-01-23T08:33:54.795 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up linux-image-generic (5.15.0.91.88) ... 2024-01-23T08:33:54.904 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up linux-modules-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-23T08:33:55.034 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-headers-5.15.0-91 (5.15.0-91.101) ... 2024-01-23T08:33:55.156 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-headers-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-23T08:33:55.282 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-headers-generic (5.15.0.91.88) ... 2024-01-23T08:33:55.411 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-23T08:33:56.754 INFO:teuthology.orchestra.run.smithi175.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-01-23T08:33:56.755 INFO:teuthology.orchestra.run.smithi175.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-01-23T08:33:56.755 INFO:teuthology.orchestra.run.smithi175.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-91-generic 2024-01-23T08:33:56.755 INFO:teuthology.orchestra.run.smithi175.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-91-generic 2024-01-23T08:33:56.772 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up linux-generic (5.15.0.91.88) ... 2024-01-23T08:33:56.898 INFO:teuthology.orchestra.run.smithi046.stdout:Processing triggers for linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-23T08:33:56.904 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-modules-extra-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-23T08:33:56.959 INFO:teuthology.orchestra.run.smithi046.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-01-23T08:33:56.959 INFO:teuthology.orchestra.run.smithi046.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-91-generic 2024-01-23T08:33:58.306 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-image-generic (5.15.0.91.88) ... 2024-01-23T08:33:58.440 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-modules-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-23T08:33:59.850 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-generic (5.15.0.91.88) ... 2024-01-23T08:33:59.976 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for linux-image-5.15.0-91-generic (5.15.0-91.101) ... 2024-01-23T08:34:00.044 INFO:teuthology.orchestra.run.smithi175.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-01-23T08:34:00.044 INFO:teuthology.orchestra.run.smithi175.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-91-generic 2024-01-23T08:34:12.351 INFO:teuthology.orchestra.run.smithi046.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-01-23T08:34:12.351 INFO:teuthology.orchestra.run.smithi046.stdout:Sourcing file `/etc/default/grub' 2024-01-23T08:34:12.368 INFO:teuthology.orchestra.run.smithi046.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-23T08:34:12.436 INFO:teuthology.orchestra.run.smithi046.stdout:Generating grub configuration file ... 2024-01-23T08:34:12.770 INFO:teuthology.orchestra.run.smithi046.stdout:Found linux image: /boot/vmlinuz-5.15.0-91-generic 2024-01-23T08:34:12.795 INFO:teuthology.orchestra.run.smithi046.stdout:Found initrd image: /boot/initrd.img-5.15.0-91-generic 2024-01-23T08:34:13.196 INFO:teuthology.orchestra.run.smithi046.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-23T08:34:13.202 INFO:teuthology.orchestra.run.smithi046.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-23T08:34:13.274 INFO:teuthology.orchestra.run.smithi046.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-23T08:34:13.280 INFO:teuthology.orchestra.run.smithi046.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-23T08:34:13.436 INFO:teuthology.orchestra.run.smithi046.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-23T08:34:13.436 INFO:teuthology.orchestra.run.smithi046.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-01-23T08:34:13.436 INFO:teuthology.orchestra.run.smithi046.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-23T08:34:13.486 INFO:teuthology.orchestra.run.smithi046.stdout:done 2024-01-23T08:34:13.841 INFO:teuthology.orchestra.run.smithi175.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-01-23T08:34:13.841 INFO:teuthology.orchestra.run.smithi175.stdout:Sourcing file `/etc/default/grub' 2024-01-23T08:34:13.862 INFO:teuthology.orchestra.run.smithi175.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-23T08:34:13.884 INFO:teuthology.orchestra.run.smithi175.stdout:Generating grub configuration file ... 2024-01-23T08:34:13.997 DEBUG:teuthology.orchestra.run.smithi046:> dpkg -s linux-image-generic 2024-01-23T08:34:14.015 INFO:teuthology.orchestra.run.smithi046.stdout:Package: linux-image-generic 2024-01-23T08:34:14.015 INFO:teuthology.orchestra.run.smithi046.stdout:Status: install ok installed 2024-01-23T08:34:14.015 INFO:teuthology.orchestra.run.smithi046.stdout:Priority: optional 2024-01-23T08:34:14.015 INFO:teuthology.orchestra.run.smithi046.stdout:Section: kernel 2024-01-23T08:34:14.015 INFO:teuthology.orchestra.run.smithi046.stdout:Installed-Size: 20 2024-01-23T08:34:14.016 INFO:teuthology.orchestra.run.smithi046.stdout:Maintainer: Ubuntu Kernel Team 2024-01-23T08:34:14.016 INFO:teuthology.orchestra.run.smithi046.stdout:Architecture: amd64 2024-01-23T08:34:14.016 INFO:teuthology.orchestra.run.smithi046.stdout:Source: linux-meta 2024-01-23T08:34:14.016 INFO:teuthology.orchestra.run.smithi046.stdout:Version: 5.15.0.91.88 2024-01-23T08:34:14.016 INFO:teuthology.orchestra.run.smithi046.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-91), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2024-01-23T08:34:14.016 INFO:teuthology.orchestra.run.smithi046.stdout:Depends: linux-image-5.15.0-91-generic, linux-modules-extra-5.15.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2024-01-23T08:34:14.016 INFO:teuthology.orchestra.run.smithi046.stdout:Recommends: thermald 2024-01-23T08:34:14.016 INFO:teuthology.orchestra.run.smithi046.stdout:Description: Generic Linux kernel image 2024-01-23T08:34:14.016 INFO:teuthology.orchestra.run.smithi046.stdout: This package will always depend on the latest generic kernel image 2024-01-23T08:34:14.016 INFO:teuthology.orchestra.run.smithi046.stdout: available. 2024-01-23T08:34:14.016 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-91-generic 2024-01-23T08:34:14.017 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-01-23T08:34:14.017 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-01-23T08:34:14.017 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-01-23T08:34:14.017 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi046.front.sepia.ceph.com, path=None, version=distro) 2024-01-23T08:34:14.017 DEBUG:teuthology.orchestra.run.smithi046:> sudo apt-get clean 2024-01-23T08:34:14.174 DEBUG:teuthology.orchestra.run.smithi046:> sudo apt-get update 2024-01-23T08:34:14.200 INFO:teuthology.orchestra.run.smithi175.stdout:Found linux image: /boot/vmlinuz-5.15.0-91-generic 2024-01-23T08:34:14.213 INFO:teuthology.orchestra.run.smithi175.stdout:Found initrd image: /boot/initrd.img-5.15.0-91-generic 2024-01-23T08:34:14.299 INFO:teuthology.orchestra.run.smithi046.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-23T08:34:14.310 INFO:teuthology.orchestra.run.smithi046.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-23T08:34:14.329 INFO:teuthology.orchestra.run.smithi046.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-23T08:34:14.414 INFO:teuthology.orchestra.run.smithi046.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-23T08:34:14.573 INFO:teuthology.orchestra.run.smithi175.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-23T08:34:14.578 INFO:teuthology.orchestra.run.smithi175.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-23T08:34:14.657 INFO:teuthology.orchestra.run.smithi175.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-23T08:34:14.663 INFO:teuthology.orchestra.run.smithi175.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-23T08:34:14.834 INFO:teuthology.orchestra.run.smithi175.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-23T08:34:14.834 INFO:teuthology.orchestra.run.smithi175.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-01-23T08:34:14.834 INFO:teuthology.orchestra.run.smithi175.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-23T08:34:14.870 INFO:teuthology.orchestra.run.smithi175.stdout:done 2024-01-23T08:34:15.404 DEBUG:teuthology.orchestra.run.smithi175:> dpkg -s linux-image-generic 2024-01-23T08:34:15.477 INFO:teuthology.orchestra.run.smithi175.stdout:Package: linux-image-generic 2024-01-23T08:34:15.477 INFO:teuthology.orchestra.run.smithi175.stdout:Status: install ok installed 2024-01-23T08:34:15.477 INFO:teuthology.orchestra.run.smithi175.stdout:Priority: optional 2024-01-23T08:34:15.477 INFO:teuthology.orchestra.run.smithi175.stdout:Section: kernel 2024-01-23T08:34:15.477 INFO:teuthology.orchestra.run.smithi175.stdout:Installed-Size: 20 2024-01-23T08:34:15.477 INFO:teuthology.orchestra.run.smithi175.stdout:Maintainer: Ubuntu Kernel Team 2024-01-23T08:34:15.477 INFO:teuthology.orchestra.run.smithi175.stdout:Architecture: amd64 2024-01-23T08:34:15.477 INFO:teuthology.orchestra.run.smithi175.stdout:Source: linux-meta 2024-01-23T08:34:15.477 INFO:teuthology.orchestra.run.smithi175.stdout:Version: 5.15.0.91.88 2024-01-23T08:34:15.477 INFO:teuthology.orchestra.run.smithi175.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-91), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2024-01-23T08:34:15.477 INFO:teuthology.orchestra.run.smithi175.stdout:Depends: linux-image-5.15.0-91-generic, linux-modules-extra-5.15.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2024-01-23T08:34:15.478 INFO:teuthology.orchestra.run.smithi175.stdout:Recommends: thermald 2024-01-23T08:34:15.478 INFO:teuthology.orchestra.run.smithi175.stdout:Description: Generic Linux kernel image 2024-01-23T08:34:15.478 INFO:teuthology.orchestra.run.smithi175.stdout: This package will always depend on the latest generic kernel image 2024-01-23T08:34:15.478 INFO:teuthology.orchestra.run.smithi175.stdout: available. 2024-01-23T08:34:15.478 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-91-generic 2024-01-23T08:34:15.478 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-01-23T08:34:15.478 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-01-23T08:34:15.478 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-01-23T08:34:15.478 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi175.front.sepia.ceph.com, path=None, version=distro) 2024-01-23T08:34:15.478 DEBUG:teuthology.orchestra.run.smithi175:> sudo apt-get clean 2024-01-23T08:34:15.644 DEBUG:teuthology.orchestra.run.smithi175:> sudo apt-get update 2024-01-23T08:34:15.666 INFO:teuthology.orchestra.run.smithi046.stdout:Reading package lists... 2024-01-23T08:34:15.684 DEBUG:teuthology.orchestra.run.smithi046:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-01-23T08:34:15.748 INFO:teuthology.orchestra.run.smithi046.stdout:Reading package lists... 2024-01-23T08:34:15.900 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-23T08:34:15.900 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-23T08:34:15.940 INFO:teuthology.orchestra.run.smithi046.stdout:Building dependency tree... 2024-01-23T08:34:15.941 INFO:teuthology.orchestra.run.smithi046.stdout:Reading state information... 2024-01-23T08:34:15.970 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-23T08:34:16.051 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-23T08:34:16.114 INFO:teuthology.orchestra.run.smithi046.stdout:linux-image-generic is already the newest version (5.15.0.91.88). 2024-01-23T08:34:16.114 INFO:teuthology.orchestra.run.smithi046.stdout:The following packages were automatically installed and are no longer required: 2024-01-23T08:34:16.114 INFO:teuthology.orchestra.run.smithi046.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-23T08:34:16.114 INFO:teuthology.orchestra.run.smithi046.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-23T08:34:16.114 INFO:teuthology.orchestra.run.smithi046.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-23T08:34:16.115 INFO:teuthology.orchestra.run.smithi046.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-23T08:34:16.115 INFO:teuthology.orchestra.run.smithi046.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-23T08:34:16.115 INFO:teuthology.orchestra.run.smithi046.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-23T08:34:16.155 INFO:teuthology.orchestra.run.smithi046.stdout:0 upgraded, 0 newly installed, 0 to remove and 278 not upgraded. 2024-01-23T08:34:16.157 DEBUG:teuthology.orchestra.run.smithi046:> dpkg -s linux-image-generic 2024-01-23T08:34:16.173 INFO:teuthology.orchestra.run.smithi046.stdout:Package: linux-image-generic 2024-01-23T08:34:16.173 INFO:teuthology.orchestra.run.smithi046.stdout:Status: install ok installed 2024-01-23T08:34:16.173 INFO:teuthology.orchestra.run.smithi046.stdout:Priority: optional 2024-01-23T08:34:16.173 INFO:teuthology.orchestra.run.smithi046.stdout:Section: kernel 2024-01-23T08:34:16.173 INFO:teuthology.orchestra.run.smithi046.stdout:Installed-Size: 20 2024-01-23T08:34:16.173 INFO:teuthology.orchestra.run.smithi046.stdout:Maintainer: Ubuntu Kernel Team 2024-01-23T08:34:16.173 INFO:teuthology.orchestra.run.smithi046.stdout:Architecture: amd64 2024-01-23T08:34:16.173 INFO:teuthology.orchestra.run.smithi046.stdout:Source: linux-meta 2024-01-23T08:34:16.173 INFO:teuthology.orchestra.run.smithi046.stdout:Version: 5.15.0.91.88 2024-01-23T08:34:16.173 INFO:teuthology.orchestra.run.smithi046.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-91), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2024-01-23T08:34:16.173 INFO:teuthology.orchestra.run.smithi046.stdout:Depends: linux-image-5.15.0-91-generic, linux-modules-extra-5.15.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2024-01-23T08:34:16.174 INFO:teuthology.orchestra.run.smithi046.stdout:Recommends: thermald 2024-01-23T08:34:16.174 INFO:teuthology.orchestra.run.smithi046.stdout:Description: Generic Linux kernel image 2024-01-23T08:34:16.174 INFO:teuthology.orchestra.run.smithi046.stdout: This package will always depend on the latest generic kernel image 2024-01-23T08:34:16.174 INFO:teuthology.orchestra.run.smithi046.stdout: available. 2024-01-23T08:34:16.174 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-01-23T08:34:16.221 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.MKKcM6AkzY 2024-01-23T08:34:16.222 DEBUG:teuthology.orchestra.run.smithi046:> sudo cp /boot/grub/grub.cfg /tmp/tmp.MKKcM6AkzY 2024-01-23T08:34:16.278 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.MKKcM6AkzY 2024-01-23T08:34:16.403 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.MKKcM6AkzY is 10KB 2024-01-23T08:34:16.417 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.MKKcM6AkzY 2024-01-23T08:34:16.422 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-01-23T08:34:16.478 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:34:16.478 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-01-23T08:34:16.478 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-01-23T08:34:16.545 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-91-generic 2024-01-23T08:34:16.545 DEBUG:teuthology.orchestra.run.smithi046:> sudo update-grub 2024-01-23T08:34:17.227 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-01-23T08:34:17.245 DEBUG:teuthology.orchestra.run.smithi175:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-01-23T08:34:17.297 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-01-23T08:34:17.467 INFO:teuthology.orchestra.run.smithi175.stdout:Building dependency tree... 2024-01-23T08:34:17.467 INFO:teuthology.orchestra.run.smithi175.stdout:Reading state information... 2024-01-23T08:34:17.614 INFO:teuthology.orchestra.run.smithi175.stdout:linux-image-generic is already the newest version (5.15.0.91.88). 2024-01-23T08:34:17.614 INFO:teuthology.orchestra.run.smithi175.stdout:The following packages were automatically installed and are no longer required: 2024-01-23T08:34:17.614 INFO:teuthology.orchestra.run.smithi175.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-23T08:34:17.614 INFO:teuthology.orchestra.run.smithi175.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-23T08:34:17.614 INFO:teuthology.orchestra.run.smithi175.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-23T08:34:17.614 INFO:teuthology.orchestra.run.smithi175.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-23T08:34:17.615 INFO:teuthology.orchestra.run.smithi175.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-23T08:34:17.615 INFO:teuthology.orchestra.run.smithi175.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-23T08:34:17.652 INFO:teuthology.orchestra.run.smithi175.stdout:0 upgraded, 0 newly installed, 0 to remove and 278 not upgraded. 2024-01-23T08:34:17.654 DEBUG:teuthology.orchestra.run.smithi175:> dpkg -s linux-image-generic 2024-01-23T08:34:17.665 INFO:teuthology.orchestra.run.smithi046.stderr:Sourcing file `/etc/default/grub' 2024-01-23T08:34:17.666 INFO:teuthology.orchestra.run.smithi046.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-23T08:34:17.668 INFO:teuthology.orchestra.run.smithi046.stderr:Generating grub configuration file ... 2024-01-23T08:34:17.709 INFO:teuthology.orchestra.run.smithi175.stdout:Package: linux-image-generic 2024-01-23T08:34:17.710 INFO:teuthology.orchestra.run.smithi175.stdout:Status: install ok installed 2024-01-23T08:34:17.710 INFO:teuthology.orchestra.run.smithi175.stdout:Priority: optional 2024-01-23T08:34:17.710 INFO:teuthology.orchestra.run.smithi175.stdout:Section: kernel 2024-01-23T08:34:17.710 INFO:teuthology.orchestra.run.smithi175.stdout:Installed-Size: 20 2024-01-23T08:34:17.710 INFO:teuthology.orchestra.run.smithi175.stdout:Maintainer: Ubuntu Kernel Team 2024-01-23T08:34:17.710 INFO:teuthology.orchestra.run.smithi175.stdout:Architecture: amd64 2024-01-23T08:34:17.710 INFO:teuthology.orchestra.run.smithi175.stdout:Source: linux-meta 2024-01-23T08:34:17.710 INFO:teuthology.orchestra.run.smithi175.stdout:Version: 5.15.0.91.88 2024-01-23T08:34:17.710 INFO:teuthology.orchestra.run.smithi175.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-91), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2024-01-23T08:34:17.710 INFO:teuthology.orchestra.run.smithi175.stdout:Depends: linux-image-5.15.0-91-generic, linux-modules-extra-5.15.0-91-generic, linux-firmware, intel-microcode, amd64-microcode 2024-01-23T08:34:17.710 INFO:teuthology.orchestra.run.smithi175.stdout:Recommends: thermald 2024-01-23T08:34:17.710 INFO:teuthology.orchestra.run.smithi175.stdout:Description: Generic Linux kernel image 2024-01-23T08:34:17.710 INFO:teuthology.orchestra.run.smithi175.stdout: This package will always depend on the latest generic kernel image 2024-01-23T08:34:17.710 INFO:teuthology.orchestra.run.smithi175.stdout: available. 2024-01-23T08:34:17.711 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2024-01-23T08:34:17.759 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.v840f4ELdE 2024-01-23T08:34:17.759 DEBUG:teuthology.orchestra.run.smithi175:> sudo cp /boot/grub/grub.cfg /tmp/tmp.v840f4ELdE 2024-01-23T08:34:17.815 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.v840f4ELdE 2024-01-23T08:34:17.944 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.v840f4ELdE is 10KB 2024-01-23T08:34:17.948 INFO:teuthology.orchestra.run.smithi046.stderr:Found linux image: /boot/vmlinuz-5.15.0-91-generic 2024-01-23T08:34:17.954 INFO:teuthology.orchestra.run.smithi046.stderr:Found initrd image: /boot/initrd.img-5.15.0-91-generic 2024-01-23T08:34:17.956 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.v840f4ELdE 2024-01-23T08:34:17.961 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-01-23T08:34:18.017 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-01-23T08:34:18.017 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-01-23T08:34:18.017 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-01-23T08:34:18.084 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-91-generic 2024-01-23T08:34:18.085 DEBUG:teuthology.orchestra.run.smithi175:> sudo update-grub 2024-01-23T08:34:18.250 INFO:teuthology.orchestra.run.smithi046.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-23T08:34:18.256 INFO:teuthology.orchestra.run.smithi046.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-23T08:34:18.301 INFO:teuthology.orchestra.run.smithi046.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-23T08:34:18.306 INFO:teuthology.orchestra.run.smithi046.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-23T08:34:18.435 INFO:teuthology.orchestra.run.smithi046.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-23T08:34:18.436 INFO:teuthology.orchestra.run.smithi046.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-23T08:34:18.436 INFO:teuthology.orchestra.run.smithi046.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-23T08:34:18.450 INFO:teuthology.orchestra.run.smithi046.stderr:done 2024-01-23T08:34:18.452 DEBUG:teuthology.orchestra.run.smithi046:> sudo shutdown -r now 2024-01-23T08:34:19.182 INFO:teuthology.orchestra.run.smithi175.stderr:Sourcing file `/etc/default/grub' 2024-01-23T08:34:19.183 INFO:teuthology.orchestra.run.smithi175.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-23T08:34:19.185 INFO:teuthology.orchestra.run.smithi175.stderr:Generating grub configuration file ... 2024-01-23T08:34:19.423 INFO:teuthology.orchestra.run.smithi175.stderr:Found linux image: /boot/vmlinuz-5.15.0-91-generic 2024-01-23T08:34:19.429 INFO:teuthology.orchestra.run.smithi175.stderr:Found initrd image: /boot/initrd.img-5.15.0-91-generic 2024-01-23T08:34:19.721 INFO:teuthology.orchestra.run.smithi175.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-23T08:34:19.727 INFO:teuthology.orchestra.run.smithi175.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-23T08:34:19.769 INFO:teuthology.orchestra.run.smithi175.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-23T08:34:19.774 INFO:teuthology.orchestra.run.smithi175.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-23T08:34:19.943 INFO:teuthology.orchestra.run.smithi175.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-23T08:34:19.943 INFO:teuthology.orchestra.run.smithi175.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-23T08:34:19.943 INFO:teuthology.orchestra.run.smithi175.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-23T08:34:19.960 INFO:teuthology.orchestra.run.smithi175.stderr:done 2024-01-23T08:34:19.973 DEBUG:teuthology.orchestra.run.smithi175:> sudo shutdown -r now 2024-01-23T08:34:48.480 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-01-23T08:34:48.481 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-01-23T08:34:48.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T08:34:49.978 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-01-23T08:34:49.978 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-01-23T08:34:49.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T08:35:06.944 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-01-23T08:35:08.476 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-01-23T08:35:15.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-01-23T08:35:15.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T08:35:17.478 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-01-23T08:35:17.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T08:35:19.004 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-01-23T08:35:20.540 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-01-23T08:35:31.014 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-01-23T08:35:31.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T08:35:32.542 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-01-23T08:35:32.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T08:36:04.276 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-01-23T08:36:04.792 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-01-23T08:36:04.792 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-91-generic"... 2024-01-23T08:36:04.793 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2024-01-23T08:36:04.839 INFO:teuthology.orchestra.run.smithi175.stdout:5.15.0-91-generic 2024-01-23T08:36:04.839 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-91-generic vs 5.15.0-91-generic 2024-01-23T08:36:04.839 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-23T08:36:04.839 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-01-23T08:36:05.840 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-01-23T08:36:05.840 DEBUG:teuthology.orchestra.run.smithi175:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-01-23T08:36:06.185 INFO:teuthology.orchestra.run.smithi175.stdout:ttyS1 2024-01-23T08:36:06.205 DEBUG:teuthology.parallel:result is None 2024-01-23T08:36:31.018 DEBUG:teuthology.orchestra.remote:timed out 2024-01-23T08:36:46.019 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-01-23T08:36:46.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T08:36:46.246 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-01-23T08:36:46.818 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-01-23T08:36:46.819 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-91-generic"... 2024-01-23T08:36:46.819 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-01-23T08:36:46.864 INFO:teuthology.orchestra.run.smithi046.stdout:5.15.0-91-generic 2024-01-23T08:36:46.864 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-91-generic vs 5.15.0-91-generic 2024-01-23T08:36:46.864 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-23T08:36:46.864 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-01-23T08:36:47.865 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-01-23T08:36:47.865 DEBUG:teuthology.orchestra.run.smithi046:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-01-23T08:36:47.934 INFO:teuthology.orchestra.run.smithi046.stdout:ttyS1 2024-01-23T08:36:47.965 DEBUG:teuthology.parallel:result is None 2024-01-23T08:36:47.966 INFO:teuthology.run_tasks:Running task internal.base... 2024-01-23T08:36:47.974 INFO:teuthology.task.internal:Creating test directory... 2024-01-23T08:36:47.975 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-23T08:36:47.977 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-23T08:36:47.983 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-01-23T08:36:48.009 INFO:teuthology.run_tasks:Running task internal.archive... 2024-01-23T08:36:48.043 INFO:teuthology.task.internal:Creating archive directory... 2024-01-23T08:36:48.043 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-23T08:36:48.045 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-23T08:36:48.155 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-01-23T08:36:48.164 INFO:teuthology.task.internal:Enabling coredump saving... 2024-01-23T08:36:48.165 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-23T08:36:48.167 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-23T08:36:48.183 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-23T08:36:48.187 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-23T08:36:48.192 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-23T08:36:48.195 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-23T08:36:48.196 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-01-23T08:36:48.205 INFO:teuthology.task.internal:Configuring sudo... 2024-01-23T08:36:48.205 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-23T08:36:48.241 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-23T08:36:48.270 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-01-23T08:36:48.279 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-01-23T08:36:48.279 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-23T08:36:48.301 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-23T08:36:48.318 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-23T08:36:48.352 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-23T08:36:48.400 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:36:48.400 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-23T08:36:48.471 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-23T08:36:48.476 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-23T08:36:48.522 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-01-23T08:36:48.522 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-23T08:36:48.587 DEBUG:teuthology.orchestra.run.smithi046:> sudo service rsyslog restart 2024-01-23T08:36:48.590 DEBUG:teuthology.orchestra.run.smithi175:> sudo service rsyslog restart 2024-01-23T08:36:48.661 INFO:teuthology.run_tasks:Running task internal.timer... 2024-01-23T08:36:48.670 INFO:teuthology.task.internal:Starting timer... 2024-01-23T08:36:48.670 INFO:teuthology.run_tasks:Running task pcp... 2024-01-23T08:36:48.704 INFO:teuthology.run_tasks:Running task selinux... 2024-01-23T08:36:48.735 DEBUG:teuthology.task.selinux:Excluding smithi046: OS 'ubuntu' does not support SELinux 2024-01-23T08:36:48.735 DEBUG:teuthology.task.selinux:Excluding smithi175: OS 'ubuntu' does not support SELinux 2024-01-23T08:36:48.735 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-01-23T08:36:48.735 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-01-23T08:36:48.736 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-01-23T08:36:48.736 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-01-23T08:36:48.769 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-01-23T08:36:48.785 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-01-23T08:36:48.787 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi046.front.sepia.ceph.com,smithi175.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-01-23T08:43:34.693 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi046.front.sepia.ceph.com'), Remote(name='ubuntu@smithi175.front.sepia.ceph.com')] 2024-01-23T08:43:34.694 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-01-23T08:43:34.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T08:43:34.782 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-01-23T08:43:34.864 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-01-23T08:43:34.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-01-23T08:43:34.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T08:43:34.943 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-01-23T08:43:35.019 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-01-23T08:43:35.020 INFO:teuthology.run_tasks:Running task clock... 2024-01-23T08:43:35.029 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-01-23T08:43:35.029 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-23T08:43:35.030 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-23T08:43:35.032 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-23T08:43:35.032 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-23T08:43:35.058 INFO:teuthology.orchestra.run.smithi046.stdout:23 Jan 08:43:35 ntpd[16772]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-01-23T08:43:35.059 INFO:teuthology.orchestra.run.smithi046.stdout:23 Jan 08:43:35 ntpd[16772]: Command line: ntpd -gq 2024-01-23T08:43:35.059 INFO:teuthology.orchestra.run.smithi046.stdout:23 Jan 08:43:35 ntpd[16772]: ---------------------------------------------------- 2024-01-23T08:43:35.059 INFO:teuthology.orchestra.run.smithi046.stdout:23 Jan 08:43:35 ntpd[16772]: ntp-4 is maintained by Network Time Foundation, 2024-01-23T08:43:35.059 INFO:teuthology.orchestra.run.smithi046.stdout:23 Jan 08:43:35 ntpd[16772]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-01-23T08:43:35.059 INFO:teuthology.orchestra.run.smithi046.stdout:23 Jan 08:43:35 ntpd[16772]: corporation. Support and training for ntp-4 are 2024-01-23T08:43:35.059 INFO:teuthology.orchestra.run.smithi046.stdout:23 Jan 08:43:35 ntpd[16772]: available at https://www.nwtime.org/support 2024-01-23T08:43:35.059 INFO:teuthology.orchestra.run.smithi046.stdout:23 Jan 08:43:35 ntpd[16772]: ---------------------------------------------------- 2024-01-23T08:43:35.060 INFO:teuthology.orchestra.run.smithi046.stdout:23 Jan 08:43:35 ntpd[16772]: proto: precision = 0.069 usec (-24) 2024-01-23T08:43:35.060 INFO:teuthology.orchestra.run.smithi046.stdout:23 Jan 08:43:35 ntpd[16772]: basedate set to 2022-02-04 2024-01-23T08:43:35.060 INFO:teuthology.orchestra.run.smithi046.stdout:23 Jan 08:43:35 ntpd[16772]: gps base set to 2022-02-06 (week 2196) 2024-01-23T08:43:35.060 INFO:teuthology.orchestra.run.smithi046.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-23T08:43:35.060 INFO:teuthology.orchestra.run.smithi046.stdout:23 Jan 08:43:35 ntpd[16772]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-23T08:43:35.061 INFO:teuthology.orchestra.run.smithi046.stdout:23 Jan 08:43:35 ntpd[16772]: restrict ::: KOD does nothing without LIMITED. 2024-01-23T08:43:35.061 INFO:teuthology.orchestra.run.smithi046.stderr:restrict ::: KOD does nothing without LIMITED. 2024-01-23T08:43:35.062 INFO:teuthology.orchestra.run.smithi046.stdout:23 Jan 08:43:35 ntpd[16772]: Listen and drop on 0 v6wildcard [::]:123 2024-01-23T08:43:35.062 INFO:teuthology.orchestra.run.smithi046.stdout:23 Jan 08:43:35 ntpd[16772]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-01-23T08:43:35.062 INFO:teuthology.orchestra.run.smithi046.stdout:23 Jan 08:43:35 ntpd[16772]: Listen normally on 2 lo 127.0.0.1:123 2024-01-23T08:43:35.062 INFO:teuthology.orchestra.run.smithi046.stdout:23 Jan 08:43:35 ntpd[16772]: Listen normally on 3 ens1f0 172.21.15.46:123 2024-01-23T08:43:35.062 INFO:teuthology.orchestra.run.smithi046.stdout:23 Jan 08:43:35 ntpd[16772]: Listen normally on 4 lo [::1]:123 2024-01-23T08:43:35.062 INFO:teuthology.orchestra.run.smithi046.stdout:23 Jan 08:43:35 ntpd[16772]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:15f8%4]:123 2024-01-23T08:43:35.062 INFO:teuthology.orchestra.run.smithi046.stdout:23 Jan 08:43:35 ntpd[16772]: Listening on routing socket on fd #22 for interface updates 2024-01-23T08:43:35.093 INFO:teuthology.orchestra.run.smithi175.stdout:23 Jan 08:43:35 ntpd[16843]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-01-23T08:43:35.093 INFO:teuthology.orchestra.run.smithi175.stdout:23 Jan 08:43:35 ntpd[16843]: Command line: ntpd -gq 2024-01-23T08:43:35.093 INFO:teuthology.orchestra.run.smithi175.stdout:23 Jan 08:43:35 ntpd[16843]: ---------------------------------------------------- 2024-01-23T08:43:35.093 INFO:teuthology.orchestra.run.smithi175.stdout:23 Jan 08:43:35 ntpd[16843]: ntp-4 is maintained by Network Time Foundation, 2024-01-23T08:43:35.093 INFO:teuthology.orchestra.run.smithi175.stdout:23 Jan 08:43:35 ntpd[16843]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-01-23T08:43:35.093 INFO:teuthology.orchestra.run.smithi175.stdout:23 Jan 08:43:35 ntpd[16843]: corporation. Support and training for ntp-4 are 2024-01-23T08:43:35.093 INFO:teuthology.orchestra.run.smithi175.stdout:23 Jan 08:43:35 ntpd[16843]: available at https://www.nwtime.org/support 2024-01-23T08:43:35.093 INFO:teuthology.orchestra.run.smithi175.stdout:23 Jan 08:43:35 ntpd[16843]: ---------------------------------------------------- 2024-01-23T08:43:35.094 INFO:teuthology.orchestra.run.smithi175.stdout:23 Jan 08:43:35 ntpd[16843]: proto: precision = 0.044 usec (-24) 2024-01-23T08:43:35.094 INFO:teuthology.orchestra.run.smithi175.stdout:23 Jan 08:43:35 ntpd[16843]: basedate set to 2022-02-04 2024-01-23T08:43:35.094 INFO:teuthology.orchestra.run.smithi175.stdout:23 Jan 08:43:35 ntpd[16843]: gps base set to 2022-02-06 (week 2196) 2024-01-23T08:43:35.094 INFO:teuthology.orchestra.run.smithi175.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-23T08:43:35.095 INFO:teuthology.orchestra.run.smithi175.stdout:23 Jan 08:43:35 ntpd[16843]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-23T08:43:35.095 INFO:teuthology.orchestra.run.smithi175.stdout:23 Jan 08:43:35 ntpd[16843]: restrict ::: KOD does nothing without LIMITED. 2024-01-23T08:43:35.095 INFO:teuthology.orchestra.run.smithi175.stderr:restrict ::: KOD does nothing without LIMITED. 2024-01-23T08:43:35.096 INFO:teuthology.orchestra.run.smithi175.stdout:23 Jan 08:43:35 ntpd[16843]: Listen and drop on 0 v6wildcard [::]:123 2024-01-23T08:43:35.096 INFO:teuthology.orchestra.run.smithi175.stdout:23 Jan 08:43:35 ntpd[16843]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-01-23T08:43:35.096 INFO:teuthology.orchestra.run.smithi175.stdout:23 Jan 08:43:35 ntpd[16843]: Listen normally on 2 lo 127.0.0.1:123 2024-01-23T08:43:35.096 INFO:teuthology.orchestra.run.smithi175.stdout:23 Jan 08:43:35 ntpd[16843]: Listen normally on 3 enp3s0f1 172.21.15.175:123 2024-01-23T08:43:35.096 INFO:teuthology.orchestra.run.smithi175.stdout:23 Jan 08:43:35 ntpd[16843]: Listen normally on 4 lo [::1]:123 2024-01-23T08:43:35.096 INFO:teuthology.orchestra.run.smithi175.stdout:23 Jan 08:43:35 ntpd[16843]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:71f1%5]:123 2024-01-23T08:43:35.096 INFO:teuthology.orchestra.run.smithi175.stdout:23 Jan 08:43:35 ntpd[16843]: Listening on routing socket on fd #22 for interface updates 2024-01-23T08:43:36.060 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:36 ntpd[16772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:36.060 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:36 ntpd[16772]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:36.060 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:36 ntpd[16772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:36.060 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:36 ntpd[16772]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:36.060 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:36 ntpd[16772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:36.060 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:36 ntpd[16772]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:36.060 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:36 ntpd[16772]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-23T08:43:36.060 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:36 ntpd[16772]: can't open /var/log/ntpstats/peerstats.20240123: Permission denied 2024-01-23T08:43:36.060 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:36 ntpd[16772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:36.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:36 ntpd[16772]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:36.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:36 ntpd[16772]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-23T08:43:36.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:36 ntpd[16772]: can't open /var/log/ntpstats/peerstats.20240123: Permission denied 2024-01-23T08:43:36.094 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:36 ntpd[16843]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:36.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:36 ntpd[16843]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:36.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:36 ntpd[16843]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:36.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:36 ntpd[16843]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:36.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:36 ntpd[16843]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:36.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:36 ntpd[16843]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:36.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:36 ntpd[16843]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:36.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:36 ntpd[16843]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:36.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:36 ntpd[16843]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-23T08:43:36.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:36 ntpd[16843]: can't open /var/log/ntpstats/peerstats.20240123: Permission denied 2024-01-23T08:43:36.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:36 ntpd[16843]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:36.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:36 ntpd[16843]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:36.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:36 ntpd[16843]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-23T08:43:36.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:36 ntpd[16843]: can't open /var/log/ntpstats/peerstats.20240123: Permission denied 2024-01-23T08:43:37.059 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:37 ntpd[16772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:37.059 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:37 ntpd[16772]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:38.060 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:38 ntpd[16772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:38.060 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:38 ntpd[16772]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:38.060 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:38 ntpd[16772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:38.060 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:38 ntpd[16772]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:38.060 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:38 ntpd[16772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:38.060 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:38 ntpd[16772]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:38.060 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:38 ntpd[16772]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-23T08:43:38.060 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:38 ntpd[16772]: can't open /var/log/ntpstats/peerstats.20240123: Permission denied 2024-01-23T08:43:38.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:38 ntpd[16772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:38.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:38 ntpd[16772]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:38.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:38 ntpd[16772]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-23T08:43:38.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:38 ntpd[16772]: can't open /var/log/ntpstats/peerstats.20240123: Permission denied 2024-01-23T08:43:38.094 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:38 ntpd[16843]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:38.094 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:38 ntpd[16843]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:38.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:38 ntpd[16843]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:38.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:38 ntpd[16843]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:38.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:38 ntpd[16843]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:38.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:38 ntpd[16843]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:38.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:38 ntpd[16843]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-23T08:43:38.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:38 ntpd[16843]: can't open /var/log/ntpstats/peerstats.20240123: Permission denied 2024-01-23T08:43:38.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:38 ntpd[16843]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:38.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:38 ntpd[16843]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:38.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:38 ntpd[16843]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-23T08:43:38.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:38 ntpd[16843]: can't open /var/log/ntpstats/peerstats.20240123: Permission denied 2024-01-23T08:43:40.060 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:40 ntpd[16772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:40.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:40 ntpd[16772]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:40.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:40 ntpd[16772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:40.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:40 ntpd[16772]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:40.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:40 ntpd[16772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:40.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:40 ntpd[16772]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:40.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:40 ntpd[16772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:40.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:40 ntpd[16772]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:40.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:40 ntpd[16772]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-23T08:43:40.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:40 ntpd[16772]: can't open /var/log/ntpstats/peerstats.20240123: Permission denied 2024-01-23T08:43:40.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:40 ntpd[16772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:40.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:40 ntpd[16772]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:40.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:40 ntpd[16772]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-23T08:43:40.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:40 ntpd[16772]: can't open /var/log/ntpstats/peerstats.20240123: Permission denied 2024-01-23T08:43:40.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:40 ntpd[16772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:40.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:40 ntpd[16772]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:40.062 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:40 ntpd[16772]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-23T08:43:40.062 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:40 ntpd[16772]: can't open /var/log/ntpstats/peerstats.20240123: Permission denied 2024-01-23T08:43:40.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:40 ntpd[16843]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:40.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:40 ntpd[16843]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:40.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:40 ntpd[16843]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:40.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:40 ntpd[16843]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:40.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:40 ntpd[16843]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:40.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:40 ntpd[16843]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:40.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:40 ntpd[16843]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:40.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:40 ntpd[16843]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:40.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:40 ntpd[16843]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-23T08:43:40.096 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:40 ntpd[16843]: can't open /var/log/ntpstats/peerstats.20240123: Permission denied 2024-01-23T08:43:40.096 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:40 ntpd[16843]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:40.096 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:40 ntpd[16843]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:40.096 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:40 ntpd[16843]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-23T08:43:40.096 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:40 ntpd[16843]: can't open /var/log/ntpstats/peerstats.20240123: Permission denied 2024-01-23T08:43:40.096 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:40 ntpd[16843]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:40.096 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:40 ntpd[16843]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:40.096 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:40 ntpd[16843]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-23T08:43:40.096 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:40 ntpd[16843]: can't open /var/log/ntpstats/peerstats.20240123: Permission denied 2024-01-23T08:43:42.060 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:42 ntpd[16772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:42.060 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:42 ntpd[16772]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:42.060 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:42 ntpd[16772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:42.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:42 ntpd[16772]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:42.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:42 ntpd[16772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:42.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:42 ntpd[16772]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:42.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:42 ntpd[16772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:42.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:42 ntpd[16772]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:42.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:42 ntpd[16772]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-23T08:43:42.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:42 ntpd[16772]: can't open /var/log/ntpstats/peerstats.20240123: Permission denied 2024-01-23T08:43:42.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:42 ntpd[16772]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:42.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:42 ntpd[16772]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:42.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:42 ntpd[16772]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-23T08:43:42.061 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:42 ntpd[16772]: can't open /var/log/ntpstats/peerstats.20240123: Permission denied 2024-01-23T08:43:42.061 INFO:teuthology.orchestra.run.smithi046.stdout:23 Jan 08:43:42 ntpd[16772]: ntpd: time slew +0.000393 s 2024-01-23T08:43:42.062 INFO:teuthology.orchestra.run.smithi046.stdout:ntpd: time slew +0.000393s 2024-01-23T08:43:42.062 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:42 ntpd[16772]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-01-23T08:43:42.062 INFO:teuthology.orchestra.run.smithi046.stderr:23 Jan 08:43:42 ntpd[16772]: can't open /var/log/ntpstats/loopstats.20240123: Permission denied 2024-01-23T08:43:42.094 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:42 ntpd[16843]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:42.094 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:42 ntpd[16843]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:42.094 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:42 ntpd[16843]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:42.094 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:42 ntpd[16843]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:42.094 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:42 ntpd[16843]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:42.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:42 ntpd[16843]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:42.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:42 ntpd[16843]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-23T08:43:42.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:42 ntpd[16843]: can't open /var/log/ntpstats/rawstats.20240123: Permission denied 2024-01-23T08:43:42.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:42 ntpd[16843]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-23T08:43:42.095 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:42 ntpd[16843]: can't open /var/log/ntpstats/peerstats.20240123: Permission denied 2024-01-23T08:43:42.095 INFO:teuthology.orchestra.run.smithi175.stdout:23 Jan 08:43:42 ntpd[16843]: ntpd: time slew -0.001432 s 2024-01-23T08:43:42.095 INFO:teuthology.orchestra.run.smithi175.stdout:ntpd: time slew -0.001432s 2024-01-23T08:43:42.096 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:42 ntpd[16843]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-01-23T08:43:42.096 INFO:teuthology.orchestra.run.smithi175.stderr:23 Jan 08:43:42 ntpd[16843]: can't open /var/log/ntpstats/loopstats.20240123: Permission denied 2024-01-23T08:43:42.109 INFO:teuthology.orchestra.run.smithi046.stdout: remote refid st t when poll reach delay offset jitter 2024-01-23T08:43:42.109 INFO:teuthology.orchestra.run.smithi046.stdout:============================================================================== 2024-01-23T08:43:42.109 INFO:teuthology.orchestra.run.smithi046.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-23T08:43:42.109 INFO:teuthology.orchestra.run.smithi046.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-23T08:43:42.109 INFO:teuthology.orchestra.run.smithi046.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-23T08:43:42.109 INFO:teuthology.orchestra.run.smithi046.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-23T08:43:42.143 INFO:teuthology.orchestra.run.smithi175.stdout: remote refid st t when poll reach delay offset jitter 2024-01-23T08:43:42.143 INFO:teuthology.orchestra.run.smithi175.stdout:============================================================================== 2024-01-23T08:43:42.144 INFO:teuthology.orchestra.run.smithi175.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-23T08:43:42.144 INFO:teuthology.orchestra.run.smithi175.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-23T08:43:42.144 INFO:teuthology.orchestra.run.smithi175.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-23T08:43:42.144 INFO:teuthology.orchestra.run.smithi175.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-23T08:43:42.145 INFO:teuthology.run_tasks:Running task install... 2024-01-23T08:43:42.153 DEBUG:teuthology.task.install:project ceph 2024-01-23T08:43:42.153 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d'}} 2024-01-23T08:43:42.154 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d'} 2024-01-23T08:43:42.154 INFO:teuthology.task.install:Using flavor: default 2024-01-23T08:43:42.159 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2024-01-23T08:43:42.159 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-01-23T08:43:42.159 DEBUG:teuthology.orchestra.run.smithi046:> sudo apt-key list | grep Ceph 2024-01-23T08:43:42.160 DEBUG:teuthology.orchestra.run.smithi175:> sudo apt-key list | grep Ceph 2024-01-23T08:43:42.218 INFO:teuthology.orchestra.run.smithi046.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-01-23T08:43:42.240 INFO:teuthology.orchestra.run.smithi175.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-01-23T08:43:42.247 INFO:teuthology.orchestra.run.smithi046.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-01-23T08:43:42.247 INFO:teuthology.orchestra.run.smithi046.stdout:uid [ unknown] Ceph.com (release key) 2024-01-23T08:43:42.248 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-01-23T08:43:42.248 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-01-23T08:43:42.249 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0edf41a622739843d6b978b179ff3227b476dd9d 2024-01-23T08:43:42.267 INFO:teuthology.orchestra.run.smithi175.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-01-23T08:43:42.267 INFO:teuthology.orchestra.run.smithi175.stdout:uid [ unknown] Ceph.com (release key) 2024-01-23T08:43:42.267 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-01-23T08:43:42.268 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-01-23T08:43:42.268 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0edf41a622739843d6b978b179ff3227b476dd9d 2024-01-23T08:43:42.415 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default/ 2024-01-23T08:43:42.415 INFO:teuthology.task.install.deb:Package version is 19.0.0-766-g0edf41a6-1jammy 2024-01-23T08:43:42.571 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default/ 2024-01-23T08:43:42.571 INFO:teuthology.task.install.deb:Package version is 19.0.0-766-g0edf41a6-1jammy 2024-01-23T08:43:42.627 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-01-23T08:43:42.628 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-01-23T08:43:42.642 DEBUG:teuthology.orchestra.run.smithi175:> sudo apt-get update 2024-01-23T08:43:42.680 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:43:42.680 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-01-23T08:43:42.695 DEBUG:teuthology.orchestra.run.smithi046:> sudo apt-get update 2024-01-23T08:43:42.812 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-23T08:43:42.870 INFO:teuthology.orchestra.run.smithi046.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-23T08:43:42.870 INFO:teuthology.orchestra.run.smithi046.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-23T08:43:42.888 INFO:teuthology.orchestra.run.smithi046.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-23T08:43:42.918 INFO:teuthology.orchestra.run.smithi046.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-23T08:43:42.920 INFO:teuthology.orchestra.run.smithi046.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy InRelease 2024-01-23T08:43:42.926 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-23T08:43:42.943 INFO:teuthology.orchestra.run.smithi175.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy InRelease 2024-01-23T08:43:42.975 INFO:teuthology.orchestra.run.smithi046.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-01-23T08:43:42.996 INFO:teuthology.orchestra.run.smithi046.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy Release.gpg 2024-01-23T08:43:43.004 INFO:teuthology.orchestra.run.smithi175.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-01-23T08:43:43.006 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-23T08:43:43.031 INFO:teuthology.orchestra.run.smithi046.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,419 B] 2024-01-23T08:43:43.048 INFO:teuthology.orchestra.run.smithi175.stdout:Ign:6 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy Release.gpg 2024-01-23T08:43:43.071 INFO:teuthology.orchestra.run.smithi046.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-01-23T08:43:43.088 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-23T08:43:43.095 INFO:teuthology.orchestra.run.smithi175.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,419 B] 2024-01-23T08:43:43.137 INFO:teuthology.orchestra.run.smithi175.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-01-23T08:43:43.221 INFO:teuthology.orchestra.run.smithi175.stdout:Fetched 28.9 kB in 0s (71.3 kB/s) 2024-01-23T08:43:43.239 INFO:teuthology.orchestra.run.smithi046.stdout:Fetched 28.9 kB in 0s (79.5 kB/s) 2024-01-23T08:43:44.146 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-01-23T08:43:44.161 DEBUG:teuthology.orchestra.run.smithi175:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-766-g0edf41a6-1jammy cephadm=19.0.0-766-g0edf41a6-1jammy ceph-mds=19.0.0-766-g0edf41a6-1jammy ceph-mgr=19.0.0-766-g0edf41a6-1jammy ceph-common=19.0.0-766-g0edf41a6-1jammy ceph-fuse=19.0.0-766-g0edf41a6-1jammy ceph-test=19.0.0-766-g0edf41a6-1jammy ceph-volume=19.0.0-766-g0edf41a6-1jammy radosgw=19.0.0-766-g0edf41a6-1jammy python3-rados=19.0.0-766-g0edf41a6-1jammy python3-rgw=19.0.0-766-g0edf41a6-1jammy python3-cephfs=19.0.0-766-g0edf41a6-1jammy python3-rbd=19.0.0-766-g0edf41a6-1jammy libcephfs2=19.0.0-766-g0edf41a6-1jammy libcephfs-dev=19.0.0-766-g0edf41a6-1jammy librados2=19.0.0-766-g0edf41a6-1jammy librbd1=19.0.0-766-g0edf41a6-1jammy rbd-fuse=19.0.0-766-g0edf41a6-1jammy ceph-common-dbg=19.0.0-766-g0edf41a6-1jammy ceph-fuse-dbg=19.0.0-766-g0edf41a6-1jammy ceph-mds-dbg=19.0.0-766-g0edf41a6-1jammy ceph-mgr-dbg=19.0.0-766-g0edf41a6-1jammy ceph-mon-dbg=19.0.0-766-g0edf41a6-1jammy ceph-osd-dbg=19.0.0-766-g0edf41a6-1jammy ceph-test-dbg=19.0.0-766-g0edf41a6-1jammy libcephfs2-dbg=19.0.0-766-g0edf41a6-1jammy librados2-dbg=19.0.0-766-g0edf41a6-1jammy libradosstriper1-dbg=19.0.0-766-g0edf41a6-1jammy librbd1-dbg=19.0.0-766-g0edf41a6-1jammy librgw2-dbg=19.0.0-766-g0edf41a6-1jammy radosgw-dbg=19.0.0-766-g0edf41a6-1jammy rbd-fuse-dbg=19.0.0-766-g0edf41a6-1jammy rbd-mirror-dbg=19.0.0-766-g0edf41a6-1jammy rbd-nbd-dbg=19.0.0-766-g0edf41a6-1jammy python3-cephfs=19.0.0-766-g0edf41a6-1jammy cephfs-shell=19.0.0-766-g0edf41a6-1jammy cephfs-top=19.0.0-766-g0edf41a6-1jammy cephfs-mirror=19.0.0-766-g0edf41a6-1jammy 2024-01-23T08:43:44.164 INFO:teuthology.orchestra.run.smithi046.stdout:Reading package lists... 2024-01-23T08:43:44.180 DEBUG:teuthology.orchestra.run.smithi046:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-766-g0edf41a6-1jammy cephadm=19.0.0-766-g0edf41a6-1jammy ceph-mds=19.0.0-766-g0edf41a6-1jammy ceph-mgr=19.0.0-766-g0edf41a6-1jammy ceph-common=19.0.0-766-g0edf41a6-1jammy ceph-fuse=19.0.0-766-g0edf41a6-1jammy ceph-test=19.0.0-766-g0edf41a6-1jammy ceph-volume=19.0.0-766-g0edf41a6-1jammy radosgw=19.0.0-766-g0edf41a6-1jammy python3-rados=19.0.0-766-g0edf41a6-1jammy python3-rgw=19.0.0-766-g0edf41a6-1jammy python3-cephfs=19.0.0-766-g0edf41a6-1jammy python3-rbd=19.0.0-766-g0edf41a6-1jammy libcephfs2=19.0.0-766-g0edf41a6-1jammy libcephfs-dev=19.0.0-766-g0edf41a6-1jammy librados2=19.0.0-766-g0edf41a6-1jammy librbd1=19.0.0-766-g0edf41a6-1jammy rbd-fuse=19.0.0-766-g0edf41a6-1jammy ceph-common-dbg=19.0.0-766-g0edf41a6-1jammy ceph-fuse-dbg=19.0.0-766-g0edf41a6-1jammy ceph-mds-dbg=19.0.0-766-g0edf41a6-1jammy ceph-mgr-dbg=19.0.0-766-g0edf41a6-1jammy ceph-mon-dbg=19.0.0-766-g0edf41a6-1jammy ceph-osd-dbg=19.0.0-766-g0edf41a6-1jammy ceph-test-dbg=19.0.0-766-g0edf41a6-1jammy libcephfs2-dbg=19.0.0-766-g0edf41a6-1jammy librados2-dbg=19.0.0-766-g0edf41a6-1jammy libradosstriper1-dbg=19.0.0-766-g0edf41a6-1jammy librbd1-dbg=19.0.0-766-g0edf41a6-1jammy librgw2-dbg=19.0.0-766-g0edf41a6-1jammy radosgw-dbg=19.0.0-766-g0edf41a6-1jammy rbd-fuse-dbg=19.0.0-766-g0edf41a6-1jammy rbd-mirror-dbg=19.0.0-766-g0edf41a6-1jammy rbd-nbd-dbg=19.0.0-766-g0edf41a6-1jammy python3-cephfs=19.0.0-766-g0edf41a6-1jammy cephfs-shell=19.0.0-766-g0edf41a6-1jammy cephfs-top=19.0.0-766-g0edf41a6-1jammy cephfs-mirror=19.0.0-766-g0edf41a6-1jammy 2024-01-23T08:43:44.221 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-01-23T08:43:44.244 INFO:teuthology.orchestra.run.smithi046.stdout:Reading package lists... 2024-01-23T08:43:44.409 INFO:teuthology.orchestra.run.smithi175.stdout:Building dependency tree... 2024-01-23T08:43:44.410 INFO:teuthology.orchestra.run.smithi175.stdout:Reading state information... 2024-01-23T08:43:44.438 INFO:teuthology.orchestra.run.smithi046.stdout:Building dependency tree... 2024-01-23T08:43:44.439 INFO:teuthology.orchestra.run.smithi046.stdout:Reading state information... 2024-01-23T08:43:44.586 INFO:teuthology.orchestra.run.smithi175.stdout:The following packages were automatically installed and are no longer required: 2024-01-23T08:43:44.586 INFO:teuthology.orchestra.run.smithi175.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-23T08:43:44.586 INFO:teuthology.orchestra.run.smithi175.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-23T08:43:44.586 INFO:teuthology.orchestra.run.smithi175.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-23T08:43:44.587 INFO:teuthology.orchestra.run.smithi175.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-23T08:43:44.587 INFO:teuthology.orchestra.run.smithi175.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-23T08:43:44.587 INFO:teuthology.orchestra.run.smithi175.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-23T08:43:44.588 INFO:teuthology.orchestra.run.smithi175.stdout:The following additional packages will be installed: 2024-01-23T08:43:44.588 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-01-23T08:43:44.588 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-01-23T08:43:44.588 INFO:teuthology.orchestra.run.smithi175.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-23T08:43:44.588 INFO:teuthology.orchestra.run.smithi175.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-01-23T08:43:44.589 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-01-23T08:43:44.589 INFO:teuthology.orchestra.run.smithi175.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-01-23T08:43:44.589 INFO:teuthology.orchestra.run.smithi175.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-01-23T08:43:44.589 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-01-23T08:43:44.590 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-01-23T08:43:44.590 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-01-23T08:43:44.590 INFO:teuthology.orchestra.run.smithi175.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-01-23T08:43:44.590 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-01-23T08:43:44.590 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-01-23T08:43:44.590 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-01-23T08:43:44.590 INFO:teuthology.orchestra.run.smithi175.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-01-23T08:43:44.590 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-01-23T08:43:44.590 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-01-23T08:43:44.590 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-01-23T08:43:44.590 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-01-23T08:43:44.590 INFO:teuthology.orchestra.run.smithi175.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-01-23T08:43:44.590 INFO:teuthology.orchestra.run.smithi175.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-01-23T08:43:44.591 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-01-23T08:43:44.591 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-01-23T08:43:44.591 INFO:teuthology.orchestra.run.smithi175.stdout: qttranslations5-l10n rbd-mirror rbd-nbd socat unzip xmlstarlet zip 2024-01-23T08:43:44.591 INFO:teuthology.orchestra.run.smithi175.stdout:Suggested packages: 2024-01-23T08:43:44.591 INFO:teuthology.orchestra.run.smithi175.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-01-23T08:43:44.591 INFO:teuthology.orchestra.run.smithi175.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-01-23T08:43:44.591 INFO:teuthology.orchestra.run.smithi175.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-01-23T08:43:44.591 INFO:teuthology.orchestra.run.smithi175.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-01-23T08:43:44.591 INFO:teuthology.orchestra.run.smithi175.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-01-23T08:43:44.592 INFO:teuthology.orchestra.run.smithi175.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-01-23T08:43:44.592 INFO:teuthology.orchestra.run.smithi175.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-01-23T08:43:44.592 INFO:teuthology.orchestra.run.smithi175.stdout:Recommended packages: 2024-01-23T08:43:44.592 INFO:teuthology.orchestra.run.smithi175.stdout: btrfs-tools 2024-01-23T08:43:44.620 INFO:teuthology.orchestra.run.smithi046.stdout:The following packages were automatically installed and are no longer required: 2024-01-23T08:43:44.620 INFO:teuthology.orchestra.run.smithi046.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-23T08:43:44.620 INFO:teuthology.orchestra.run.smithi046.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-23T08:43:44.620 INFO:teuthology.orchestra.run.smithi046.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-23T08:43:44.621 INFO:teuthology.orchestra.run.smithi046.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-23T08:43:44.621 INFO:teuthology.orchestra.run.smithi046.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-23T08:43:44.621 INFO:teuthology.orchestra.run.smithi046.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-23T08:43:44.622 INFO:teuthology.orchestra.run.smithi046.stdout:The following additional packages will be installed: 2024-01-23T08:43:44.623 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-01-23T08:43:44.623 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-01-23T08:43:44.623 INFO:teuthology.orchestra.run.smithi046.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-23T08:43:44.623 INFO:teuthology.orchestra.run.smithi046.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-01-23T08:43:44.623 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-01-23T08:43:44.623 INFO:teuthology.orchestra.run.smithi046.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-01-23T08:43:44.623 INFO:teuthology.orchestra.run.smithi046.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-01-23T08:43:44.623 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-01-23T08:43:44.623 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-01-23T08:43:44.623 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-01-23T08:43:44.623 INFO:teuthology.orchestra.run.smithi046.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-01-23T08:43:44.623 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-01-23T08:43:44.623 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-01-23T08:43:44.624 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-01-23T08:43:44.624 INFO:teuthology.orchestra.run.smithi046.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-01-23T08:43:44.624 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-01-23T08:43:44.624 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-01-23T08:43:44.624 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-01-23T08:43:44.624 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-01-23T08:43:44.624 INFO:teuthology.orchestra.run.smithi046.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-01-23T08:43:44.624 INFO:teuthology.orchestra.run.smithi046.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-01-23T08:43:44.624 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-01-23T08:43:44.624 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-01-23T08:43:44.624 INFO:teuthology.orchestra.run.smithi046.stdout: qttranslations5-l10n rbd-mirror rbd-nbd socat unzip xmlstarlet zip 2024-01-23T08:43:44.625 INFO:teuthology.orchestra.run.smithi046.stdout:Suggested packages: 2024-01-23T08:43:44.625 INFO:teuthology.orchestra.run.smithi046.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-01-23T08:43:44.625 INFO:teuthology.orchestra.run.smithi046.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-01-23T08:43:44.625 INFO:teuthology.orchestra.run.smithi046.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-01-23T08:43:44.625 INFO:teuthology.orchestra.run.smithi046.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-01-23T08:43:44.625 INFO:teuthology.orchestra.run.smithi046.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-01-23T08:43:44.625 INFO:teuthology.orchestra.run.smithi046.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-01-23T08:43:44.625 INFO:teuthology.orchestra.run.smithi046.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-01-23T08:43:44.625 INFO:teuthology.orchestra.run.smithi046.stdout:Recommended packages: 2024-01-23T08:43:44.625 INFO:teuthology.orchestra.run.smithi046.stdout: btrfs-tools 2024-01-23T08:43:44.721 INFO:teuthology.orchestra.run.smithi175.stdout:The following NEW packages will be installed: 2024-01-23T08:43:44.722 INFO:teuthology.orchestra.run.smithi175.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2024-01-23T08:43:44.722 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2024-01-23T08:43:44.722 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2024-01-23T08:43:44.722 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2024-01-23T08:43:44.722 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume cephadm cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev 2024-01-23T08:43:44.722 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2 libcephfs2-dbg libdouble-conversion3 libjq1 liblttng-ust1 2024-01-23T08:43:44.722 INFO:teuthology.orchestra.run.smithi175.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-01-23T08:43:44.722 INFO:teuthology.orchestra.run.smithi175.stdout: libqt5network5 librados2 librados2-dbg libradosstriper1 libradosstriper1-dbg 2024-01-23T08:43:44.722 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1 librbd1-dbg librdkafka1 libreadline-dev librgw2 librgw2-dbg 2024-01-23T08:43:44.722 INFO:teuthology.orchestra.run.smithi175.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-01-23T08:43:44.723 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-01-23T08:43:44.723 INFO:teuthology.orchestra.run.smithi175.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-01-23T08:43:44.723 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-01-23T08:43:44.723 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-01-23T08:43:44.723 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-01-23T08:43:44.723 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-01-23T08:43:44.723 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-01-23T08:43:44.723 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-01-23T08:43:44.723 INFO:teuthology.orchestra.run.smithi175.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-01-23T08:43:44.723 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-01-23T08:43:44.723 INFO:teuthology.orchestra.run.smithi175.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-01-23T08:43:44.723 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-01-23T08:43:44.723 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-01-23T08:43:44.723 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-01-23T08:43:44.724 INFO:teuthology.orchestra.run.smithi175.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-01-23T08:43:44.724 INFO:teuthology.orchestra.run.smithi175.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-01-23T08:43:44.724 INFO:teuthology.orchestra.run.smithi175.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-01-23T08:43:44.724 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-01-23T08:43:44.724 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2024-01-23T08:43:44.724 INFO:teuthology.orchestra.run.smithi175.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2024-01-23T08:43:44.724 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd-dbg socat unzip xmlstarlet zip 2024-01-23T08:43:44.761 INFO:teuthology.orchestra.run.smithi046.stdout:The following NEW packages will be installed: 2024-01-23T08:43:44.761 INFO:teuthology.orchestra.run.smithi046.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2024-01-23T08:43:44.761 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2024-01-23T08:43:44.761 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2024-01-23T08:43:44.761 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2024-01-23T08:43:44.761 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume cephadm cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev 2024-01-23T08:43:44.761 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2 libcephfs2-dbg libdouble-conversion3 libjq1 liblttng-ust1 2024-01-23T08:43:44.761 INFO:teuthology.orchestra.run.smithi046.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-01-23T08:43:44.761 INFO:teuthology.orchestra.run.smithi046.stdout: libqt5network5 librados2 librados2-dbg libradosstriper1 libradosstriper1-dbg 2024-01-23T08:43:44.761 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1 librbd1-dbg librdkafka1 libreadline-dev librgw2 librgw2-dbg 2024-01-23T08:43:44.761 INFO:teuthology.orchestra.run.smithi046.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-01-23T08:43:44.762 INFO:teuthology.orchestra.run.smithi046.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-01-23T08:43:44.763 INFO:teuthology.orchestra.run.smithi046.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-01-23T08:43:44.763 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-01-23T08:43:44.763 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-01-23T08:43:44.763 INFO:teuthology.orchestra.run.smithi046.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-01-23T08:43:44.763 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-01-23T08:43:44.763 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-01-23T08:43:44.763 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-01-23T08:43:44.763 INFO:teuthology.orchestra.run.smithi046.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-01-23T08:43:44.763 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-01-23T08:43:44.763 INFO:teuthology.orchestra.run.smithi046.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-01-23T08:43:44.763 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-01-23T08:43:44.763 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-01-23T08:43:44.763 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-01-23T08:43:44.763 INFO:teuthology.orchestra.run.smithi046.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-01-23T08:43:44.764 INFO:teuthology.orchestra.run.smithi046.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-01-23T08:43:44.764 INFO:teuthology.orchestra.run.smithi046.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-01-23T08:43:44.764 INFO:teuthology.orchestra.run.smithi046.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-01-23T08:43:44.764 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2024-01-23T08:43:44.764 INFO:teuthology.orchestra.run.smithi046.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2024-01-23T08:43:44.764 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd-dbg socat unzip xmlstarlet zip 2024-01-23T08:43:44.898 INFO:teuthology.orchestra.run.smithi175.stdout:0 upgraded, 142 newly installed, 0 to remove and 266 not upgraded. 2024-01-23T08:43:44.898 INFO:teuthology.orchestra.run.smithi175.stdout:Need to get 3,660 MB of archives. 2024-01-23T08:43:44.898 INFO:teuthology.orchestra.run.smithi175.stdout:After this operation, 4,455 MB of additional disk space will be used. 2024-01-23T08:43:44.898 INFO:teuthology.orchestra.run.smithi175.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-01-23T08:43:44.900 INFO:teuthology.orchestra.run.smithi046.stdout:0 upgraded, 142 newly installed, 0 to remove and 266 not upgraded. 2024-01-23T08:43:44.900 INFO:teuthology.orchestra.run.smithi046.stdout:Need to get 3,660 MB of archives. 2024-01-23T08:43:44.900 INFO:teuthology.orchestra.run.smithi046.stdout:After this operation, 4,455 MB of additional disk space will be used. 2024-01-23T08:43:44.900 INFO:teuthology.orchestra.run.smithi046.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-01-23T08:43:44.947 INFO:teuthology.orchestra.run.smithi175.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-01-23T08:43:44.949 INFO:teuthology.orchestra.run.smithi046.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-01-23T08:43:44.974 INFO:teuthology.orchestra.run.smithi175.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-01-23T08:43:44.977 INFO:teuthology.orchestra.run.smithi046.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-01-23T08:43:45.075 INFO:teuthology.orchestra.run.smithi175.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-01-23T08:43:45.080 INFO:teuthology.orchestra.run.smithi046.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-01-23T08:43:45.094 INFO:teuthology.orchestra.run.smithi175.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-766-g0edf41a6-1jammy [3,516 kB] 2024-01-23T08:43:45.109 INFO:teuthology.orchestra.run.smithi046.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-766-g0edf41a6-1jammy [3,516 kB] 2024-01-23T08:43:45.144 INFO:teuthology.orchestra.run.smithi175.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-01-23T08:43:45.154 INFO:teuthology.orchestra.run.smithi046.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-01-23T08:43:45.160 INFO:teuthology.orchestra.run.smithi175.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-01-23T08:43:45.167 INFO:teuthology.orchestra.run.smithi046.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-01-23T08:43:45.198 INFO:teuthology.orchestra.run.smithi175.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-01-23T08:43:45.209 INFO:teuthology.orchestra.run.smithi046.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-01-23T08:43:45.384 INFO:teuthology.orchestra.run.smithi046.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-01-23T08:43:45.390 INFO:teuthology.orchestra.run.smithi046.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-01-23T08:43:45.404 INFO:teuthology.orchestra.run.smithi175.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-01-23T08:43:45.414 INFO:teuthology.orchestra.run.smithi175.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-01-23T08:43:45.420 INFO:teuthology.orchestra.run.smithi046.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-01-23T08:43:45.440 INFO:teuthology.orchestra.run.smithi046.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-01-23T08:43:45.442 INFO:teuthology.orchestra.run.smithi046.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-01-23T08:43:45.457 INFO:teuthology.orchestra.run.smithi046.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-01-23T08:43:45.517 INFO:teuthology.orchestra.run.smithi046.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-01-23T08:43:45.519 INFO:teuthology.orchestra.run.smithi175.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-01-23T08:43:45.525 INFO:teuthology.orchestra.run.smithi175.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-01-23T08:43:45.526 INFO:teuthology.orchestra.run.smithi175.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-01-23T08:43:45.544 INFO:teuthology.orchestra.run.smithi175.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-01-23T08:43:45.549 INFO:teuthology.orchestra.run.smithi175.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-01-23T08:43:45.551 INFO:teuthology.orchestra.run.smithi046.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-01-23T08:43:45.553 INFO:teuthology.orchestra.run.smithi175.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-01-23T08:43:45.554 INFO:teuthology.orchestra.run.smithi046.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-01-23T08:43:45.555 INFO:teuthology.orchestra.run.smithi046.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-01-23T08:43:45.555 INFO:teuthology.orchestra.run.smithi175.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-01-23T08:43:45.556 INFO:teuthology.orchestra.run.smithi175.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-01-23T08:43:45.559 INFO:teuthology.orchestra.run.smithi046.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2024-01-23T08:43:45.560 INFO:teuthology.orchestra.run.smithi175.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2024-01-23T08:43:45.564 INFO:teuthology.orchestra.run.smithi046.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-01-23T08:43:45.568 INFO:teuthology.orchestra.run.smithi046.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-01-23T08:43:45.569 INFO:teuthology.orchestra.run.smithi046.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-01-23T08:43:45.570 INFO:teuthology.orchestra.run.smithi046.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-01-23T08:43:45.578 INFO:teuthology.orchestra.run.smithi175.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-01-23T08:43:45.596 INFO:teuthology.orchestra.run.smithi046.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-01-23T08:43:45.602 INFO:teuthology.orchestra.run.smithi175.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-01-23T08:43:45.603 INFO:teuthology.orchestra.run.smithi175.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-01-23T08:43:45.604 INFO:teuthology.orchestra.run.smithi175.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-01-23T08:43:45.606 INFO:teuthology.orchestra.run.smithi175.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-01-23T08:43:45.606 INFO:teuthology.orchestra.run.smithi175.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-01-23T08:43:45.607 INFO:teuthology.orchestra.run.smithi175.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-01-23T08:43:45.607 INFO:teuthology.orchestra.run.smithi175.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-01-23T08:43:45.608 INFO:teuthology.orchestra.run.smithi046.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-01-23T08:43:45.609 INFO:teuthology.orchestra.run.smithi046.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-01-23T08:43:45.610 INFO:teuthology.orchestra.run.smithi046.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-01-23T08:43:45.612 INFO:teuthology.orchestra.run.smithi046.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-01-23T08:43:45.612 INFO:teuthology.orchestra.run.smithi046.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-01-23T08:43:45.614 INFO:teuthology.orchestra.run.smithi046.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-01-23T08:43:45.614 INFO:teuthology.orchestra.run.smithi175.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-01-23T08:43:45.615 INFO:teuthology.orchestra.run.smithi175.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-01-23T08:43:45.619 INFO:teuthology.orchestra.run.smithi046.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-01-23T08:43:45.620 INFO:teuthology.orchestra.run.smithi046.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-01-23T08:43:45.628 INFO:teuthology.orchestra.run.smithi046.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-01-23T08:43:45.645 INFO:teuthology.orchestra.run.smithi175.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-01-23T08:43:45.650 INFO:teuthology.orchestra.run.smithi175.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-01-23T08:43:45.651 INFO:teuthology.orchestra.run.smithi175.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-01-23T08:43:45.652 INFO:teuthology.orchestra.run.smithi175.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-01-23T08:43:45.652 INFO:teuthology.orchestra.run.smithi175.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-01-23T08:43:45.654 INFO:teuthology.orchestra.run.smithi175.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-01-23T08:43:45.655 INFO:teuthology.orchestra.run.smithi175.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-01-23T08:43:45.655 INFO:teuthology.orchestra.run.smithi175.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-01-23T08:43:45.659 INFO:teuthology.orchestra.run.smithi046.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-01-23T08:43:45.662 INFO:teuthology.orchestra.run.smithi046.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-01-23T08:43:45.663 INFO:teuthology.orchestra.run.smithi046.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-01-23T08:43:45.664 INFO:teuthology.orchestra.run.smithi046.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-01-23T08:43:45.667 INFO:teuthology.orchestra.run.smithi046.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-01-23T08:43:45.668 INFO:teuthology.orchestra.run.smithi046.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-01-23T08:43:45.670 INFO:teuthology.orchestra.run.smithi046.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-01-23T08:43:45.681 INFO:teuthology.orchestra.run.smithi046.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-01-23T08:43:45.682 INFO:teuthology.orchestra.run.smithi046.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-01-23T08:43:45.685 INFO:teuthology.orchestra.run.smithi175.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-01-23T08:43:45.687 INFO:teuthology.orchestra.run.smithi175.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-01-23T08:43:45.714 INFO:teuthology.orchestra.run.smithi046.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-01-23T08:43:45.715 INFO:teuthology.orchestra.run.smithi046.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-01-23T08:43:45.718 INFO:teuthology.orchestra.run.smithi046.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-01-23T08:43:45.722 INFO:teuthology.orchestra.run.smithi046.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-01-23T08:43:45.724 INFO:teuthology.orchestra.run.smithi046.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-01-23T08:43:45.724 INFO:teuthology.orchestra.run.smithi175.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-01-23T08:43:45.735 INFO:teuthology.orchestra.run.smithi175.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-01-23T08:43:45.735 INFO:teuthology.orchestra.run.smithi175.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-01-23T08:43:45.737 INFO:teuthology.orchestra.run.smithi175.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-01-23T08:43:45.737 INFO:teuthology.orchestra.run.smithi175.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-01-23T08:43:45.740 INFO:teuthology.orchestra.run.smithi175.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-01-23T08:43:45.744 INFO:teuthology.orchestra.run.smithi175.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-01-23T08:43:45.745 INFO:teuthology.orchestra.run.smithi175.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-01-23T08:43:45.753 INFO:teuthology.orchestra.run.smithi046.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-01-23T08:43:45.755 INFO:teuthology.orchestra.run.smithi046.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-01-23T08:43:45.760 INFO:teuthology.orchestra.run.smithi046.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-01-23T08:43:45.761 INFO:teuthology.orchestra.run.smithi046.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-01-23T08:43:45.763 INFO:teuthology.orchestra.run.smithi046.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-01-23T08:43:45.765 INFO:teuthology.orchestra.run.smithi175.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-01-23T08:43:45.766 INFO:teuthology.orchestra.run.smithi175.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-01-23T08:43:45.790 INFO:teuthology.orchestra.run.smithi046.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-01-23T08:43:45.805 INFO:teuthology.orchestra.run.smithi175.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-01-23T08:43:45.807 INFO:teuthology.orchestra.run.smithi175.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-01-23T08:43:45.809 INFO:teuthology.orchestra.run.smithi175.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-01-23T08:43:45.815 INFO:teuthology.orchestra.run.smithi175.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-01-23T08:43:45.977 INFO:teuthology.orchestra.run.smithi046.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-01-23T08:43:45.979 INFO:teuthology.orchestra.run.smithi046.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2024-01-23T08:43:45.981 INFO:teuthology.orchestra.run.smithi046.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-01-23T08:43:45.982 INFO:teuthology.orchestra.run.smithi046.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-01-23T08:43:45.984 INFO:teuthology.orchestra.run.smithi046.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-01-23T08:43:46.010 INFO:teuthology.orchestra.run.smithi175.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-01-23T08:43:46.011 INFO:teuthology.orchestra.run.smithi175.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2024-01-23T08:43:46.014 INFO:teuthology.orchestra.run.smithi175.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-01-23T08:43:46.014 INFO:teuthology.orchestra.run.smithi175.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-01-23T08:43:46.017 INFO:teuthology.orchestra.run.smithi175.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-01-23T08:43:46.021 INFO:teuthology.orchestra.run.smithi046.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-01-23T08:43:46.025 INFO:teuthology.orchestra.run.smithi046.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-01-23T08:43:46.026 INFO:teuthology.orchestra.run.smithi046.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-01-23T08:43:46.118 INFO:teuthology.orchestra.run.smithi046.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-01-23T08:43:46.119 INFO:teuthology.orchestra.run.smithi046.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-01-23T08:43:46.120 INFO:teuthology.orchestra.run.smithi046.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-01-23T08:43:46.122 INFO:teuthology.orchestra.run.smithi046.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-01-23T08:43:46.122 INFO:teuthology.orchestra.run.smithi175.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-01-23T08:43:46.123 INFO:teuthology.orchestra.run.smithi046.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-01-23T08:43:46.125 INFO:teuthology.orchestra.run.smithi046.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-01-23T08:43:46.126 INFO:teuthology.orchestra.run.smithi046.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-01-23T08:43:46.127 INFO:teuthology.orchestra.run.smithi046.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-01-23T08:43:46.127 INFO:teuthology.orchestra.run.smithi175.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-01-23T08:43:46.132 INFO:teuthology.orchestra.run.smithi175.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-01-23T08:43:46.134 INFO:teuthology.orchestra.run.smithi046.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-01-23T08:43:46.154 INFO:teuthology.orchestra.run.smithi046.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-01-23T08:43:46.160 INFO:teuthology.orchestra.run.smithi175.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-01-23T08:43:46.160 INFO:teuthology.orchestra.run.smithi175.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-01-23T08:43:46.161 INFO:teuthology.orchestra.run.smithi175.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-01-23T08:43:46.162 INFO:teuthology.orchestra.run.smithi175.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-01-23T08:43:46.163 INFO:teuthology.orchestra.run.smithi175.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-01-23T08:43:46.163 INFO:teuthology.orchestra.run.smithi175.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-01-23T08:43:46.164 INFO:teuthology.orchestra.run.smithi175.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-01-23T08:43:46.167 INFO:teuthology.orchestra.run.smithi046.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-01-23T08:43:46.168 INFO:teuthology.orchestra.run.smithi046.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-01-23T08:43:46.180 INFO:teuthology.orchestra.run.smithi046.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-01-23T08:43:46.187 INFO:teuthology.orchestra.run.smithi046.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-01-23T08:43:46.188 INFO:teuthology.orchestra.run.smithi046.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-01-23T08:43:46.189 INFO:teuthology.orchestra.run.smithi046.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-01-23T08:43:46.190 INFO:teuthology.orchestra.run.smithi175.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-01-23T08:43:46.191 INFO:teuthology.orchestra.run.smithi046.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-01-23T08:43:46.201 INFO:teuthology.orchestra.run.smithi175.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-01-23T08:43:46.205 INFO:teuthology.orchestra.run.smithi046.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-01-23T08:43:46.206 INFO:teuthology.orchestra.run.smithi046.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-01-23T08:43:46.224 INFO:teuthology.orchestra.run.smithi046.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-01-23T08:43:46.225 INFO:teuthology.orchestra.run.smithi175.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-01-23T08:43:46.225 INFO:teuthology.orchestra.run.smithi046.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-01-23T08:43:46.226 INFO:teuthology.orchestra.run.smithi046.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-01-23T08:43:46.227 INFO:teuthology.orchestra.run.smithi046.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-01-23T08:43:46.228 INFO:teuthology.orchestra.run.smithi175.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-01-23T08:43:46.229 INFO:teuthology.orchestra.run.smithi175.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-01-23T08:43:46.238 INFO:teuthology.orchestra.run.smithi175.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-01-23T08:43:46.246 INFO:teuthology.orchestra.run.smithi175.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-01-23T08:43:46.246 INFO:teuthology.orchestra.run.smithi175.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-01-23T08:43:46.249 INFO:teuthology.orchestra.run.smithi175.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-01-23T08:43:46.250 INFO:teuthology.orchestra.run.smithi175.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-01-23T08:43:46.262 INFO:teuthology.orchestra.run.smithi175.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-01-23T08:43:46.262 INFO:teuthology.orchestra.run.smithi046.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-01-23T08:43:46.263 INFO:teuthology.orchestra.run.smithi175.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-01-23T08:43:46.264 INFO:teuthology.orchestra.run.smithi046.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-01-23T08:43:46.284 INFO:teuthology.orchestra.run.smithi046.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-01-23T08:43:46.285 INFO:teuthology.orchestra.run.smithi046.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-01-23T08:43:46.286 INFO:teuthology.orchestra.run.smithi046.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-01-23T08:43:46.291 INFO:teuthology.orchestra.run.smithi046.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-01-23T08:43:46.298 INFO:teuthology.orchestra.run.smithi175.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-01-23T08:43:46.298 INFO:teuthology.orchestra.run.smithi175.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-01-23T08:43:46.300 INFO:teuthology.orchestra.run.smithi175.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-01-23T08:43:46.300 INFO:teuthology.orchestra.run.smithi046.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-01-23T08:43:46.301 INFO:teuthology.orchestra.run.smithi175.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-01-23T08:43:46.305 INFO:teuthology.orchestra.run.smithi175.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-01-23T08:43:46.308 INFO:teuthology.orchestra.run.smithi175.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-01-23T08:43:46.336 INFO:teuthology.orchestra.run.smithi175.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-01-23T08:43:46.348 INFO:teuthology.orchestra.run.smithi175.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-01-23T08:43:46.349 INFO:teuthology.orchestra.run.smithi175.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-01-23T08:43:46.355 INFO:teuthology.orchestra.run.smithi175.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-01-23T08:43:46.378 INFO:teuthology.orchestra.run.smithi175.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-01-23T08:43:46.803 INFO:teuthology.orchestra.run.smithi175.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-766-g0edf41a6-1jammy [3,206 kB] 2024-01-23T08:43:47.897 INFO:teuthology.orchestra.run.smithi175.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-766-g0edf41a6-1jammy [708 kB] 2024-01-23T08:43:48.066 INFO:teuthology.orchestra.run.smithi175.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-766-g0edf41a6-1jammy [356 kB] 2024-01-23T08:43:48.180 INFO:teuthology.orchestra.run.smithi175.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-766-g0edf41a6-1jammy [32.8 kB] 2024-01-23T08:43:48.211 INFO:teuthology.orchestra.run.smithi175.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-766-g0edf41a6-1jammy [180 kB] 2024-01-23T08:43:48.253 INFO:teuthology.orchestra.run.smithi175.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-766-g0edf41a6-1jammy [64.1 kB] 2024-01-23T08:43:48.278 INFO:teuthology.orchestra.run.smithi175.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-766-g0edf41a6-1jammy [330 kB] 2024-01-23T08:43:48.436 INFO:teuthology.orchestra.run.smithi175.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-766-g0edf41a6-1jammy [6,228 kB] 2024-01-23T08:43:48.464 INFO:teuthology.orchestra.run.smithi046.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-766-g0edf41a6-1jammy [3,206 kB] 2024-01-23T08:43:50.143 INFO:teuthology.orchestra.run.smithi175.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-766-g0edf41a6-1jammy [112 kB] 2024-01-23T08:43:50.163 INFO:teuthology.orchestra.run.smithi046.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-766-g0edf41a6-1jammy [708 kB] 2024-01-23T08:43:50.173 INFO:teuthology.orchestra.run.smithi175.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-766-g0edf41a6-1jammy [465 kB] 2024-01-23T08:43:50.264 INFO:teuthology.orchestra.run.smithi175.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-766-g0edf41a6-1jammy [23.0 MB] 2024-01-23T08:43:50.450 INFO:teuthology.orchestra.run.smithi046.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-766-g0edf41a6-1jammy [356 kB] 2024-01-23T08:43:50.572 INFO:teuthology.orchestra.run.smithi046.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-766-g0edf41a6-1jammy [32.8 kB] 2024-01-23T08:43:50.595 INFO:teuthology.orchestra.run.smithi046.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-766-g0edf41a6-1jammy [180 kB] 2024-01-23T08:43:50.644 INFO:teuthology.orchestra.run.smithi046.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-766-g0edf41a6-1jammy [64.1 kB] 2024-01-23T08:43:50.672 INFO:teuthology.orchestra.run.smithi046.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-766-g0edf41a6-1jammy [330 kB] 2024-01-23T08:43:50.782 INFO:teuthology.orchestra.run.smithi046.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-766-g0edf41a6-1jammy [6,228 kB] 2024-01-23T08:43:52.548 INFO:teuthology.orchestra.run.smithi046.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-766-g0edf41a6-1jammy [112 kB] 2024-01-23T08:43:52.563 INFO:teuthology.orchestra.run.smithi046.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-766-g0edf41a6-1jammy [465 kB] 2024-01-23T08:43:52.680 INFO:teuthology.orchestra.run.smithi046.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-766-g0edf41a6-1jammy [23.0 MB] 2024-01-23T08:43:54.853 INFO:teuthology.orchestra.run.smithi175.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-766-g0edf41a6-1jammy [5,056 kB] 2024-01-23T08:43:55.619 INFO:teuthology.orchestra.run.smithi175.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-766-g0edf41a6-1jammy [240 kB] 2024-01-23T08:43:55.651 INFO:teuthology.orchestra.run.smithi175.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-766-g0edf41a6-1jammy [124 kB] 2024-01-23T08:43:55.663 INFO:teuthology.orchestra.run.smithi175.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-766-g0edf41a6-1jammy [1,517 kB] 2024-01-23T08:43:55.952 INFO:teuthology.orchestra.run.smithi175.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-766-g0edf41a6-1jammy [6,238 kB] 2024-01-23T08:43:57.811 INFO:teuthology.orchestra.run.smithi175.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-766-g0edf41a6-1jammy [22.7 MB] 2024-01-23T08:43:58.736 INFO:teuthology.orchestra.run.smithi046.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-766-g0edf41a6-1jammy [5,056 kB] 2024-01-23T08:43:59.370 INFO:teuthology.orchestra.run.smithi046.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-766-g0edf41a6-1jammy [240 kB] 2024-01-23T08:43:59.378 INFO:teuthology.orchestra.run.smithi046.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-766-g0edf41a6-1jammy [124 kB] 2024-01-23T08:43:59.388 INFO:teuthology.orchestra.run.smithi046.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-766-g0edf41a6-1jammy [1,517 kB] 2024-01-23T08:43:59.550 INFO:teuthology.orchestra.run.smithi046.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-766-g0edf41a6-1jammy [6,238 kB] 2024-01-23T08:44:00.269 INFO:teuthology.orchestra.run.smithi046.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-766-g0edf41a6-1jammy [22.7 MB] 2024-01-23T08:44:01.824 INFO:teuthology.orchestra.run.smithi175.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-766-g0edf41a6-1jammy [14.0 kB] 2024-01-23T08:44:01.825 INFO:teuthology.orchestra.run.smithi175.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-766-g0edf41a6-1jammy [865 kB] 2024-01-23T08:44:01.916 INFO:teuthology.orchestra.run.smithi175.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-766-g0edf41a6-1jammy [2,183 kB] 2024-01-23T08:44:02.244 INFO:teuthology.orchestra.run.smithi046.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-766-g0edf41a6-1jammy [14.0 kB] 2024-01-23T08:44:02.245 INFO:teuthology.orchestra.run.smithi046.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-766-g0edf41a6-1jammy [865 kB] 2024-01-23T08:44:02.262 INFO:teuthology.orchestra.run.smithi046.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-766-g0edf41a6-1jammy [2,183 kB] 2024-01-23T08:44:02.308 INFO:teuthology.orchestra.run.smithi175.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-766-g0edf41a6-1jammy [770 kB] 2024-01-23T08:44:02.357 INFO:teuthology.orchestra.run.smithi046.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-766-g0edf41a6-1jammy [770 kB] 2024-01-23T08:44:02.393 INFO:teuthology.orchestra.run.smithi046.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-766-g0edf41a6-1jammy [139 kB] 2024-01-23T08:44:02.396 INFO:teuthology.orchestra.run.smithi046.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-766-g0edf41a6-1jammy [1,876 kB] 2024-01-23T08:44:02.450 INFO:teuthology.orchestra.run.smithi175.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-766-g0edf41a6-1jammy [139 kB] 2024-01-23T08:44:02.459 INFO:teuthology.orchestra.run.smithi175.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-766-g0edf41a6-1jammy [1,876 kB] 2024-01-23T08:44:02.482 INFO:teuthology.orchestra.run.smithi046.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-766-g0edf41a6-1jammy [8,625 kB] 2024-01-23T08:44:02.842 INFO:teuthology.orchestra.run.smithi046.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-766-g0edf41a6-1jammy [14.2 kB] 2024-01-23T08:44:02.842 INFO:teuthology.orchestra.run.smithi046.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-766-g0edf41a6-1jammy [48.8 MB] 2024-01-23T08:44:03.086 INFO:teuthology.orchestra.run.smithi175.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-766-g0edf41a6-1jammy [8,625 kB] 2024-01-23T08:44:04.997 INFO:teuthology.orchestra.run.smithi046.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-766-g0edf41a6-1jammy [121 kB] 2024-01-23T08:44:05.068 INFO:teuthology.orchestra.run.smithi046.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-766-g0edf41a6-1jammy [226 kB] 2024-01-23T08:44:05.073 INFO:teuthology.orchestra.run.smithi046.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-766-g0edf41a6-1jammy [34.0 kB] 2024-01-23T08:44:05.074 INFO:teuthology.orchestra.run.smithi046.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-766-g0edf41a6-1jammy [23.4 kB] 2024-01-23T08:44:05.075 INFO:teuthology.orchestra.run.smithi046.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-766-g0edf41a6-1jammy [38.4 kB] 2024-01-23T08:44:05.077 INFO:teuthology.orchestra.run.smithi046.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-766-g0edf41a6-1jammy [12.3 MB] 2024-01-23T08:44:05.151 INFO:teuthology.orchestra.run.smithi175.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-766-g0edf41a6-1jammy [14.2 kB] 2024-01-23T08:44:05.151 INFO:teuthology.orchestra.run.smithi175.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-766-g0edf41a6-1jammy [48.8 MB] 2024-01-23T08:44:05.441 INFO:teuthology.orchestra.run.smithi046.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-766-g0edf41a6-1jammy [91.4 kB] 2024-01-23T08:44:05.443 INFO:teuthology.orchestra.run.smithi046.stdout:Get:125 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 19.0.0-766-g0edf41a6-1jammy [3,119 kB] 2024-01-23T08:44:05.562 INFO:teuthology.orchestra.run.smithi046.stdout:Get:126 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 19.0.0-766-g0edf41a6-1jammy [178 kB] 2024-01-23T08:44:05.580 INFO:teuthology.orchestra.run.smithi046.stdout:Get:127 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 19.0.0-766-g0edf41a6-1jammy [702 MB] 2024-01-23T08:44:17.950 INFO:teuthology.orchestra.run.smithi175.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-766-g0edf41a6-1jammy [121 kB] 2024-01-23T08:44:17.953 INFO:teuthology.orchestra.run.smithi175.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-766-g0edf41a6-1jammy [226 kB] 2024-01-23T08:44:18.153 INFO:teuthology.orchestra.run.smithi175.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-766-g0edf41a6-1jammy [34.0 kB] 2024-01-23T08:44:18.185 INFO:teuthology.orchestra.run.smithi175.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-766-g0edf41a6-1jammy [23.4 kB] 2024-01-23T08:44:18.240 INFO:teuthology.orchestra.run.smithi175.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-766-g0edf41a6-1jammy [38.4 kB] 2024-01-23T08:44:18.248 INFO:teuthology.orchestra.run.smithi175.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-766-g0edf41a6-1jammy [12.3 MB] 2024-01-23T08:44:25.313 INFO:teuthology.orchestra.run.smithi175.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-766-g0edf41a6-1jammy [91.4 kB] 2024-01-23T08:44:25.339 INFO:teuthology.orchestra.run.smithi175.stdout:Get:125 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 19.0.0-766-g0edf41a6-1jammy [3,119 kB] 2024-01-23T08:44:26.236 INFO:teuthology.orchestra.run.smithi175.stdout:Get:126 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 19.0.0-766-g0edf41a6-1jammy [178 kB] 2024-01-23T08:44:26.274 INFO:teuthology.orchestra.run.smithi175.stdout:Get:127 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 19.0.0-766-g0edf41a6-1jammy [702 MB] 2024-01-23T08:45:27.379 INFO:teuthology.orchestra.run.smithi046.stdout:Get:128 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 19.0.0-766-g0edf41a6-1jammy [18.1 MB] 2024-01-23T08:45:28.419 INFO:teuthology.orchestra.run.smithi046.stdout:Get:129 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 19.0.0-766-g0edf41a6-1jammy [77.6 MB] 2024-01-23T08:45:34.283 INFO:teuthology.orchestra.run.smithi046.stdout:Get:130 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 19.0.0-766-g0edf41a6-1jammy [41.3 MB] 2024-01-23T08:45:36.958 INFO:teuthology.orchestra.run.smithi046.stdout:Get:131 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 19.0.0-766-g0edf41a6-1jammy [158 MB] 2024-01-23T08:45:47.619 INFO:teuthology.orchestra.run.smithi175.stdout:Get:128 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 19.0.0-766-g0edf41a6-1jammy [18.1 MB] 2024-01-23T08:45:48.336 INFO:teuthology.orchestra.run.smithi175.stdout:Get:129 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 19.0.0-766-g0edf41a6-1jammy [77.6 MB] 2024-01-23T08:45:52.269 INFO:teuthology.orchestra.run.smithi046.stdout:Get:132 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 19.0.0-766-g0edf41a6-1jammy [535 MB] 2024-01-23T08:45:52.696 INFO:teuthology.orchestra.run.smithi175.stdout:Get:130 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 19.0.0-766-g0edf41a6-1jammy [41.3 MB] 2024-01-23T08:45:54.600 INFO:teuthology.orchestra.run.smithi175.stdout:Get:131 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 19.0.0-766-g0edf41a6-1jammy [158 MB] 2024-01-23T08:46:02.131 INFO:teuthology.orchestra.run.smithi175.stdout:Get:132 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 19.0.0-766-g0edf41a6-1jammy [535 MB] 2024-01-23T08:46:30.069 INFO:teuthology.orchestra.run.smithi175.stdout:Get:133 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 19.0.0-766-g0edf41a6-1jammy [1,155 MB] 2024-01-23T08:46:59.170 INFO:teuthology.orchestra.run.smithi046.stdout:Get:133 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 19.0.0-766-g0edf41a6-1jammy [1,155 MB] 2024-01-23T08:48:36.940 INFO:teuthology.orchestra.run.smithi046.stdout:Get:134 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 19.0.0-766-g0edf41a6-1jammy [16.3 MB] 2024-01-23T08:48:38.083 INFO:teuthology.orchestra.run.smithi046.stdout:Get:135 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 19.0.0-766-g0edf41a6-1jammy [81.3 MB] 2024-01-23T08:48:46.696 INFO:teuthology.orchestra.run.smithi046.stdout:Get:136 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 19.0.0-766-g0edf41a6-1jammy [11.2 MB] 2024-01-23T08:48:48.268 INFO:teuthology.orchestra.run.smithi046.stdout:Get:137 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 19.0.0-766-g0edf41a6-1jammy [103 MB] 2024-01-23T08:48:49.621 INFO:teuthology.orchestra.run.smithi175.stdout:Get:134 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 19.0.0-766-g0edf41a6-1jammy [16.3 MB] 2024-01-23T08:48:50.686 INFO:teuthology.orchestra.run.smithi175.stdout:Get:135 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 19.0.0-766-g0edf41a6-1jammy [81.3 MB] 2024-01-23T08:48:58.857 INFO:teuthology.orchestra.run.smithi046.stdout:Get:138 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 19.0.0-766-g0edf41a6-1jammy [164 MB] 2024-01-23T08:48:59.164 INFO:teuthology.orchestra.run.smithi175.stdout:Get:136 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 19.0.0-766-g0edf41a6-1jammy [11.2 MB] 2024-01-23T08:49:00.243 INFO:teuthology.orchestra.run.smithi175.stdout:Get:137 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 19.0.0-766-g0edf41a6-1jammy [103 MB] 2024-01-23T08:49:12.511 INFO:teuthology.orchestra.run.smithi046.stdout:Get:139 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 19.0.0-766-g0edf41a6-1jammy [319 MB] 2024-01-23T08:49:13.201 INFO:teuthology.orchestra.run.smithi175.stdout:Get:138 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 19.0.0-766-g0edf41a6-1jammy [164 MB] 2024-01-23T08:49:27.289 INFO:teuthology.orchestra.run.smithi175.stdout:Get:139 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 19.0.0-766-g0edf41a6-1jammy [319 MB] 2024-01-23T08:49:31.972 INFO:teuthology.orchestra.run.smithi046.stdout:Get:140 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 19.0.0-766-g0edf41a6-1jammy [1,697 kB] 2024-01-23T08:49:32.004 INFO:teuthology.orchestra.run.smithi046.stdout:Get:141 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 19.0.0-766-g0edf41a6-1jammy [97.0 MB] 2024-01-23T08:49:37.761 INFO:teuthology.orchestra.run.smithi046.stdout:Get:142 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 19.0.0-766-g0edf41a6-1jammy [2,998 kB] 2024-01-23T08:49:38.442 INFO:teuthology.orchestra.run.smithi046.stdout:Fetched 3,660 MB in 5min 53s (10.4 MB/s) 2024-01-23T08:49:38.557 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-pyperclip. 2024-01-23T08:49:38.651 INFO:teuthology.orchestra.run.smithi046.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165989 files and directories currently installed.) 2024-01-23T08:49:38.657 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-01-23T08:49:38.697 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-01-23T08:49:38.967 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-wcwidth. 2024-01-23T08:49:38.993 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-01-23T08:49:39.033 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-23T08:49:39.353 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-cmd2. 2024-01-23T08:49:39.379 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-01-23T08:49:39.419 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-01-23T08:49:39.764 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-01-23T08:49:39.791 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-01-23T08:49:39.873 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-23T08:49:40.218 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-01-23T08:49:40.244 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-01-23T08:49:40.284 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-23T08:49:40.579 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-01-23T08:49:40.606 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-01-23T08:49:40.646 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-23T08:49:41.091 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-01-23T08:49:41.118 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-23T08:49:41.165 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-23T08:49:41.569 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-01-23T08:49:41.596 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-23T08:49:41.636 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-23T08:49:41.964 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-01-23T08:49:41.990 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-23T08:49:42.030 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-23T08:49:42.375 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-01-23T08:49:42.402 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-01-23T08:49:42.442 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-23T08:49:42.761 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package librados2. 2024-01-23T08:49:42.788 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../010-librados2_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:49:42.828 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking librados2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:49:43.223 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package librbd1. 2024-01-23T08:49:43.249 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../011-librbd1_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:49:43.289 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking librbd1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:49:43.834 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libcephfs2. 2024-01-23T08:49:43.860 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:49:43.900 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libcephfs2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:49:44.177 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-rados. 2024-01-23T08:49:44.193 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../013-python3-rados_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:49:44.236 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-rados (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:49:44.539 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-01-23T08:49:44.566 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-23T08:49:44.597 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-ceph-argparse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:49:44.675 INFO:teuthology.orchestra.run.smithi175.stdout:Get:140 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 19.0.0-766-g0edf41a6-1jammy [1,697 kB] 2024-01-23T08:49:44.706 INFO:teuthology.orchestra.run.smithi175.stdout:Get:141 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 19.0.0-766-g0edf41a6-1jammy [97.0 MB] 2024-01-23T08:49:44.824 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-cephfs. 2024-01-23T08:49:44.840 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:49:44.883 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-cephfs (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:49:45.203 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-ceph-common. 2024-01-23T08:49:45.229 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-23T08:49:45.269 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:49:45.597 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-prettytable. 2024-01-23T08:49:45.624 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-01-23T08:49:45.664 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-01-23T08:49:45.925 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-rbd. 2024-01-23T08:49:45.940 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:49:45.983 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-rbd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:49:46.328 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-01-23T08:49:46.354 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-01-23T08:49:46.394 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-23T08:49:46.664 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-01-23T08:49:46.680 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-01-23T08:49:46.713 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-01-23T08:49:46.983 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-01-23T08:49:46.999 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-01-23T08:49:47.041 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-23T08:49:47.370 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package lua5.1. 2024-01-23T08:49:47.396 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-01-23T08:49:47.436 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-01-23T08:49:47.731 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package lua-any. 2024-01-23T08:49:47.747 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-01-23T08:49:47.781 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking lua-any (27ubuntu1) ... 2024-01-23T08:49:48.000 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package zip. 2024-01-23T08:49:48.027 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-01-23T08:49:48.067 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking zip (3.0-12build2) ... 2024-01-23T08:49:48.362 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package unzip. 2024-01-23T08:49:48.378 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2024-01-23T08:49:48.420 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2024-01-23T08:49:48.759 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package luarocks. 2024-01-23T08:49:48.786 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-01-23T08:49:48.813 INFO:teuthology.orchestra.run.smithi175.stdout:Get:142 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2024-01-18-0823/0edf41a622739843d6b978b179ff3227b476dd9d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 19.0.0-766-g0edf41a6-1jammy [2,998 kB] 2024-01-23T08:49:48.817 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-01-23T08:49:49.192 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package librgw2. 2024-01-23T08:49:49.219 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../027-librgw2_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:49:49.258 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking librgw2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:49:49.481 INFO:teuthology.orchestra.run.smithi175.stdout:Fetched 3,660 MB in 6min 4s (10.1 MB/s) 2024-01-23T08:49:49.604 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pyperclip. 2024-01-23T08:49:49.691 INFO:teuthology.orchestra.run.smithi175.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165989 files and directories currently installed.) 2024-01-23T08:49:49.695 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-01-23T08:49:49.744 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-01-23T08:49:49.786 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-rgw. 2024-01-23T08:49:49.801 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:49:49.844 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-rgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:49:50.064 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-wcwidth. 2024-01-23T08:49:50.090 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-01-23T08:49:50.130 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-23T08:49:50.197 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package liboath0:amd64. 2024-01-23T08:49:50.224 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-01-23T08:49:50.263 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-01-23T08:49:50.408 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-cmd2. 2024-01-23T08:49:50.434 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-01-23T08:49:50.466 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-01-23T08:49:50.550 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libradosstriper1. 2024-01-23T08:49:50.577 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:49:50.616 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libradosstriper1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:49:50.769 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-01-23T08:49:50.795 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-01-23T08:49:50.878 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-23T08:49:51.036 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-common. 2024-01-23T08:49:51.064 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../031-ceph-common_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:49:51.102 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:49:51.214 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-01-23T08:49:51.240 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-01-23T08:49:51.281 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-23T08:49:51.609 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-01-23T08:49:51.635 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-01-23T08:49:51.684 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-23T08:49:52.104 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-01-23T08:49:52.130 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-23T08:49:52.171 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-23T08:49:52.408 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-base. 2024-01-23T08:49:52.435 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../032-ceph-base_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:49:52.484 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-base (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:49:52.565 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-01-23T08:49:52.591 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-23T08:49:52.632 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-23T08:49:52.968 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-01-23T08:49:52.994 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-23T08:49:53.034 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-23T08:49:53.037 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-01-23T08:49:53.065 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-01-23T08:49:53.104 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-01-23T08:49:53.407 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-cheroot. 2024-01-23T08:49:53.412 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-01-23T08:49:53.434 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-01-23T08:49:53.439 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-01-23T08:49:53.471 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-23T08:49:53.473 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-23T08:49:53.751 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-01-23T08:49:53.778 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-01-23T08:49:53.783 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package librados2. 2024-01-23T08:49:53.808 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../010-librados2_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:49:53.809 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-01-23T08:49:53.848 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking librados2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:49:54.096 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-jaraco.text. 2024-01-23T08:49:54.123 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-01-23T08:49:54.162 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-01-23T08:49:54.301 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package librbd1. 2024-01-23T08:49:54.327 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../011-librbd1_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:49:54.400 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking librbd1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:49:54.457 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-01-23T08:49:54.484 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-01-23T08:49:54.540 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-01-23T08:49:54.843 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-tempora. 2024-01-23T08:49:54.845 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libcephfs2. 2024-01-23T08:49:54.870 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-01-23T08:49:54.872 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:49:54.910 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-01-23T08:49:54.912 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libcephfs2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:49:55.165 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-rados. 2024-01-23T08:49:55.180 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../013-python3-rados_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:49:55.213 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-portend. 2024-01-23T08:49:55.214 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-rados (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:49:55.240 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-01-23T08:49:55.279 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-01-23T08:49:55.525 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-01-23T08:49:55.551 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-23T08:49:55.557 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-01-23T08:49:55.584 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-01-23T08:49:55.600 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-ceph-argparse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:49:55.624 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-01-23T08:49:55.853 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-cephfs. 2024-01-23T08:49:55.868 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:49:55.902 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-cherrypy3. 2024-01-23T08:49:55.911 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-cephfs (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:49:55.929 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-01-23T08:49:55.968 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-01-23T08:49:56.230 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-ceph-common. 2024-01-23T08:49:56.257 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-23T08:49:56.296 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-natsort. 2024-01-23T08:49:56.297 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:49:56.313 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-01-23T08:49:56.346 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-01-23T08:49:56.617 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-logutils. 2024-01-23T08:49:56.617 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-prettytable. 2024-01-23T08:49:56.643 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-01-23T08:49:56.644 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-01-23T08:49:56.683 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-01-23T08:49:56.708 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-01-23T08:49:56.961 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-rbd. 2024-01-23T08:49:56.969 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-markupsafe. 2024-01-23T08:49:56.976 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:49:56.996 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-01-23T08:49:57.010 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-rbd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:49:57.036 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-01-23T08:49:57.330 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-01-23T08:49:57.338 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-mako. 2024-01-23T08:49:57.356 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-01-23T08:49:57.366 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-01-23T08:49:57.396 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-23T08:49:57.405 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-23T08:49:57.665 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-01-23T08:49:57.681 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-01-23T08:49:57.724 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-01-23T08:49:57.784 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-simplegeneric. 2024-01-23T08:49:57.811 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-01-23T08:49:57.986 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-01-23T08:49:58.035 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-01-23T08:49:58.050 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-01-23T08:49:58.093 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-23T08:49:58.395 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-singledispatch. 2024-01-23T08:49:58.421 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-01-23T08:49:58.422 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package lua5.1. 2024-01-23T08:49:58.448 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-01-23T08:49:58.461 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-01-23T08:49:58.488 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-01-23T08:49:58.772 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-webob. 2024-01-23T08:49:58.800 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-01-23T08:49:58.816 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package lua-any. 2024-01-23T08:49:58.839 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-01-23T08:49:58.842 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-01-23T08:49:58.882 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking lua-any (27ubuntu1) ... 2024-01-23T08:49:59.127 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package zip. 2024-01-23T08:49:59.153 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-01-23T08:49:59.193 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking zip (3.0-12build2) ... 2024-01-23T08:49:59.200 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-waitress. 2024-01-23T08:49:59.228 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-01-23T08:49:59.270 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-23T08:49:59.521 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package unzip. 2024-01-23T08:49:59.536 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-tempita. 2024-01-23T08:49:59.548 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2024-01-23T08:49:59.553 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-01-23T08:49:59.586 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-01-23T08:49:59.588 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2024-01-23T08:49:59.856 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-paste. 2024-01-23T08:49:59.883 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-01-23T08:49:59.922 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-01-23T08:49:59.967 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package luarocks. 2024-01-23T08:49:59.993 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-01-23T08:50:00.058 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-01-23T08:50:00.260 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-01-23T08:50:00.286 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-01-23T08:50:00.326 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-01-23T08:50:00.416 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package librgw2. 2024-01-23T08:50:00.442 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../027-librgw2_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:00.482 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking librgw2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:00.612 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-pastedeploy. 2024-01-23T08:50:00.639 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-01-23T08:50:00.670 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-01-23T08:50:00.965 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-webtest. 2024-01-23T08:50:00.992 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-01-23T08:50:01.001 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-rgw. 2024-01-23T08:50:01.027 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:01.031 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-01-23T08:50:01.068 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-rgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:01.343 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-pecan. 2024-01-23T08:50:01.370 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-01-23T08:50:01.404 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package liboath0:amd64. 2024-01-23T08:50:01.409 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-01-23T08:50:01.430 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-01-23T08:50:01.471 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-01-23T08:50:01.740 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libradosstriper1. 2024-01-23T08:50:01.766 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:01.772 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-certifi. 2024-01-23T08:50:01.798 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libradosstriper1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:01.799 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-01-23T08:50:01.839 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-01-23T08:50:02.167 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-idna. 2024-01-23T08:50:02.194 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-01-23T08:50:02.218 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-common. 2024-01-23T08:50:02.225 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-idna (3.3-1) ... 2024-01-23T08:50:02.245 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../031-ceph-common_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:02.285 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:02.512 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-urllib3. 2024-01-23T08:50:02.539 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-01-23T08:50:02.578 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-23T08:50:02.881 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-requests. 2024-01-23T08:50:02.908 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-01-23T08:50:02.964 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-23T08:50:03.276 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-werkzeug. 2024-01-23T08:50:03.300 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-01-23T08:50:03.342 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-23T08:50:03.565 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-base. 2024-01-23T08:50:03.591 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../032-ceph-base_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:03.640 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-base (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:03.653 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-01-23T08:50:03.670 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-23T08:50:03.711 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-mgr-modules-core (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:04.108 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-01-23T08:50:04.135 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:04.183 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:04.210 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-01-23T08:50:04.237 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-01-23T08:50:04.277 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-01-23T08:50:04.436 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-bcrypt. 2024-01-23T08:50:04.452 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-01-23T08:50:04.486 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-01-23T08:50:04.530 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-cheroot. 2024-01-23T08:50:04.556 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-01-23T08:50:04.588 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-23T08:50:04.789 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-openssl. 2024-01-23T08:50:04.815 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-01-23T08:50:04.855 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-01-23T08:50:04.891 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-01-23T08:50:04.917 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-01-23T08:50:04.957 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-01-23T08:50:05.200 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-mgr. 2024-01-23T08:50:05.227 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:05.269 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-jaraco.text. 2024-01-23T08:50:05.275 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-mgr (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:05.295 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-01-23T08:50:05.335 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-01-23T08:50:05.628 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-mon. 2024-01-23T08:50:05.638 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-01-23T08:50:05.655 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:05.664 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-01-23T08:50:05.686 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-mon (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:05.704 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-01-23T08:50:05.965 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-tempora. 2024-01-23T08:50:05.992 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-01-23T08:50:06.023 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-01-23T08:50:06.310 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-portend. 2024-01-23T08:50:06.336 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-01-23T08:50:06.339 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-osd. 2024-01-23T08:50:06.367 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:06.376 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-01-23T08:50:06.406 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-osd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:06.704 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-01-23T08:50:06.730 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-01-23T08:50:06.771 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-01-23T08:50:07.073 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-cherrypy3. 2024-01-23T08:50:07.100 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-01-23T08:50:07.140 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-01-23T08:50:07.462 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-natsort. 2024-01-23T08:50:07.488 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-01-23T08:50:07.493 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph. 2024-01-23T08:50:07.509 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../068-ceph_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:07.528 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-01-23T08:50:07.551 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:07.837 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-fuse. 2024-01-23T08:50:07.840 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-logutils. 2024-01-23T08:50:07.864 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:07.866 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-01-23T08:50:07.895 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:07.907 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-01-23T08:50:08.184 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-markupsafe. 2024-01-23T08:50:08.211 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-01-23T08:50:08.223 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-mds. 2024-01-23T08:50:08.250 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-01-23T08:50:08.251 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:08.290 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-mds (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:08.520 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-mako. 2024-01-23T08:50:08.547 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-01-23T08:50:08.586 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-23T08:50:08.684 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package cephadm. 2024-01-23T08:50:08.712 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../071-cephadm_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:08.751 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:08.915 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-simplegeneric. 2024-01-23T08:50:08.943 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-01-23T08:50:08.981 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-01-23T08:50:09.096 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-asyncssh. 2024-01-23T08:50:09.123 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-01-23T08:50:09.162 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-01-23T08:50:09.292 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-singledispatch. 2024-01-23T08:50:09.318 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-01-23T08:50:09.359 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-01-23T08:50:09.482 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python-babel-localedata. 2024-01-23T08:50:09.509 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-01-23T08:50:09.548 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-23T08:50:09.645 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-webob. 2024-01-23T08:50:09.671 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-01-23T08:50:09.712 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-01-23T08:50:10.056 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-waitress. 2024-01-23T08:50:10.083 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-01-23T08:50:10.126 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-23T08:50:10.442 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-tempita. 2024-01-23T08:50:10.469 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-01-23T08:50:10.508 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-01-23T08:50:10.553 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-babel. 2024-01-23T08:50:10.581 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-01-23T08:50:10.619 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-01-23T08:50:10.780 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-paste. 2024-01-23T08:50:10.805 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-01-23T08:50:10.836 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-01-23T08:50:10.956 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-jinja2. 2024-01-23T08:50:10.984 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2024-01-23T08:50:11.022 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2024-01-23T08:50:11.173 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-01-23T08:50:11.199 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-01-23T08:50:11.239 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-01-23T08:50:11.359 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-01-23T08:50:11.386 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-23T08:50:11.425 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-mgr-cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:11.483 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pastedeploy. 2024-01-23T08:50:11.498 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-01-23T08:50:11.533 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-01-23T08:50:11.787 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-repoze.lru. 2024-01-23T08:50:11.811 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-webtest. 2024-01-23T08:50:11.815 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-01-23T08:50:11.837 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-01-23T08:50:11.853 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-01-23T08:50:11.886 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-01-23T08:50:12.114 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-routes. 2024-01-23T08:50:12.131 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-01-23T08:50:12.164 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-01-23T08:50:12.439 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pecan. 2024-01-23T08:50:12.466 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-01-23T08:50:12.476 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-01-23T08:50:12.492 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-23T08:50:12.505 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-01-23T08:50:12.526 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-mgr-dashboard (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:12.877 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-certifi. 2024-01-23T08:50:12.904 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-01-23T08:50:12.929 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-01-23T08:50:12.943 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-01-23T08:50:12.957 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-01-23T08:50:12.995 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-23T08:50:13.271 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-idna. 2024-01-23T08:50:13.298 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-01-23T08:50:13.354 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-idna (3.3-1) ... 2024-01-23T08:50:13.507 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-joblib. 2024-01-23T08:50:13.534 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-01-23T08:50:13.574 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-01-23T08:50:13.624 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-urllib3. 2024-01-23T08:50:13.651 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-01-23T08:50:13.682 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-23T08:50:13.952 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-requests. 2024-01-23T08:50:13.955 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-01-23T08:50:13.978 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-01-23T08:50:13.980 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-01-23T08:50:14.009 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-23T08:50:14.121 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-01-23T08:50:14.313 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-werkzeug. 2024-01-23T08:50:14.340 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-01-23T08:50:14.379 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-23T08:50:14.416 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-sklearn. 2024-01-23T08:50:14.443 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-01-23T08:50:14.482 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-23T08:50:14.649 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-01-23T08:50:14.664 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-23T08:50:14.698 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-modules-core (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:15.095 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-01-23T08:50:15.122 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:15.150 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-01-23T08:50:15.161 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:15.178 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-23T08:50:15.208 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:15.464 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-bcrypt. 2024-01-23T08:50:15.480 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-01-23T08:50:15.514 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-01-23T08:50:15.758 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-openssl. 2024-01-23T08:50:15.771 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-01-23T08:50:15.800 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-01-23T08:50:16.136 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr. 2024-01-23T08:50:16.163 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:16.170 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-cachetools. 2024-01-23T08:50:16.198 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-01-23T08:50:16.203 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:16.236 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-01-23T08:50:16.522 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-pyasn1. 2024-01-23T08:50:16.550 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-01-23T08:50:16.588 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-01-23T08:50:16.606 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mon. 2024-01-23T08:50:16.633 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:16.689 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mon (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:16.927 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-01-23T08:50:16.953 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-01-23T08:50:16.991 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-01-23T08:50:17.234 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-osd. 2024-01-23T08:50:17.261 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:17.292 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-osd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:17.320 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-rsa. 2024-01-23T08:50:17.348 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-01-23T08:50:17.386 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-rsa (4.8-1) ... 2024-01-23T08:50:17.707 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-google-auth. 2024-01-23T08:50:17.735 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-01-23T08:50:17.773 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-01-23T08:50:18.102 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-01-23T08:50:18.130 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-01-23T08:50:18.168 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-23T08:50:18.329 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph. 2024-01-23T08:50:18.344 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../068-ceph_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:18.378 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:18.480 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-websocket. 2024-01-23T08:50:18.507 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-01-23T08:50:18.546 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-01-23T08:50:18.631 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-fuse. 2024-01-23T08:50:18.657 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:18.689 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:18.858 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-kubernetes. 2024-01-23T08:50:18.886 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-01-23T08:50:18.924 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-23T08:50:19.059 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mds. 2024-01-23T08:50:19.085 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:19.125 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mds (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:19.528 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package cephadm. 2024-01-23T08:50:19.554 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../071-cephadm_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:19.588 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-01-23T08:50:19.603 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:19.605 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-23T08:50:19.646 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:19.889 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-asyncssh. 2024-01-23T08:50:19.904 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-01-23T08:50:19.938 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-01-23T08:50:19.974 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libonig5:amd64. 2024-01-23T08:50:20.003 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-01-23T08:50:20.040 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-23T08:50:20.275 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python-babel-localedata. 2024-01-23T08:50:20.290 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-01-23T08:50:20.333 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-23T08:50:20.344 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libjq1:amd64. 2024-01-23T08:50:20.372 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-01-23T08:50:20.410 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-23T08:50:20.663 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package jq. 2024-01-23T08:50:20.680 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-01-23T08:50:20.721 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-01-23T08:50:20.974 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package socat. 2024-01-23T08:50:21.002 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-01-23T08:50:21.040 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-01-23T08:50:21.360 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package xmlstarlet. 2024-01-23T08:50:21.371 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-babel. 2024-01-23T08:50:21.386 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-01-23T08:50:21.398 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-01-23T08:50:21.427 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-01-23T08:50:21.437 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-01-23T08:50:21.765 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-jinja2. 2024-01-23T08:50:21.790 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-test. 2024-01-23T08:50:21.792 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2024-01-23T08:50:21.818 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../099-ceph-test_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:21.832 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2024-01-23T08:50:21.856 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-test (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:22.176 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-01-23T08:50:22.203 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-23T08:50:22.243 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:22.588 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-repoze.lru. 2024-01-23T08:50:22.615 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-01-23T08:50:22.654 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-01-23T08:50:22.898 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-routes. 2024-01-23T08:50:22.914 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-01-23T08:50:22.948 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-01-23T08:50:23.243 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-01-23T08:50:23.259 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-23T08:50:23.293 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-dashboard (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:23.755 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-01-23T08:50:23.781 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-01-23T08:50:23.821 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-23T08:50:24.152 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-volume. 2024-01-23T08:50:24.169 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-23T08:50:24.202 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-volume (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:24.316 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-joblib. 2024-01-23T08:50:24.343 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-01-23T08:50:24.382 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-01-23T08:50:24.556 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package cephfs-mirror. 2024-01-23T08:50:24.584 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:24.614 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking cephfs-mirror (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:24.711 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-01-23T08:50:24.738 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-01-23T08:50:24.854 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-01-23T08:50:24.925 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-colorama. 2024-01-23T08:50:24.954 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-01-23T08:50:24.992 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-01-23T08:50:25.165 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-sklearn. 2024-01-23T08:50:25.192 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-01-23T08:50:25.232 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-23T08:50:25.261 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package cephfs-shell. 2024-01-23T08:50:25.278 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-23T08:50:25.319 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking cephfs-shell (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:25.589 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package cephfs-top. 2024-01-23T08:50:25.617 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-23T08:50:25.655 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking cephfs-top (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:25.899 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-01-23T08:50:25.899 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libcephfs-dev. 2024-01-23T08:50:25.916 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:25.926 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-23T08:50:25.957 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:25.957 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libcephfs-dev (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:26.237 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package lua-socket:amd64. 2024-01-23T08:50:26.266 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-01-23T08:50:26.304 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-23T08:50:26.641 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package lua-sec:amd64. 2024-01-23T08:50:26.670 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-01-23T08:50:26.708 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-01-23T08:50:26.901 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-cachetools. 2024-01-23T08:50:26.929 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-01-23T08:50:26.968 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-01-23T08:50:27.028 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package nvme-cli. 2024-01-23T08:50:27.056 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-01-23T08:50:27.086 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-01-23T08:50:27.271 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pyasn1. 2024-01-23T08:50:27.298 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-01-23T08:50:27.337 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-01-23T08:50:27.458 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package pkg-config. 2024-01-23T08:50:27.475 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-01-23T08:50:27.508 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-01-23T08:50:27.682 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-01-23T08:50:27.709 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-01-23T08:50:27.735 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-01-23T08:50:27.748 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-01-23T08:50:27.764 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-01-23T08:50:27.802 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-01-23T08:50:28.060 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-rsa. 2024-01-23T08:50:28.087 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-01-23T08:50:28.126 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-rsa (4.8-1) ... 2024-01-23T08:50:28.264 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-iniconfig. 2024-01-23T08:50:28.292 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-01-23T08:50:28.330 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-01-23T08:50:28.405 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-google-auth. 2024-01-23T08:50:28.420 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-01-23T08:50:28.455 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-01-23T08:50:28.574 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-pastescript. 2024-01-23T08:50:28.603 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-01-23T08:50:28.632 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-01-23T08:50:28.725 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-01-23T08:50:28.740 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-01-23T08:50:28.774 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-23T08:50:29.061 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-websocket. 2024-01-23T08:50:29.087 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-01-23T08:50:29.127 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-01-23T08:50:29.211 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-pluggy. 2024-01-23T08:50:29.239 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-01-23T08:50:29.277 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-01-23T08:50:29.447 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-kubernetes. 2024-01-23T08:50:29.474 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-01-23T08:50:29.513 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-23T08:50:29.588 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-psutil. 2024-01-23T08:50:29.617 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-01-23T08:50:29.655 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-01-23T08:50:29.983 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-py. 2024-01-23T08:50:30.014 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-01-23T08:50:30.057 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-py (1.10.0-1) ... 2024-01-23T08:50:30.185 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-01-23T08:50:30.201 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-23T08:50:30.243 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:30.377 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-pygments. 2024-01-23T08:50:30.394 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-01-23T08:50:30.435 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-01-23T08:50:30.571 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libonig5:amd64. 2024-01-23T08:50:30.599 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-01-23T08:50:30.638 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-23T08:50:30.898 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-pyinotify. 2024-01-23T08:50:30.926 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-01-23T08:50:30.964 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-01-23T08:50:30.982 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libjq1:amd64. 2024-01-23T08:50:31.010 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-01-23T08:50:31.049 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-23T08:50:31.250 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-toml. 2024-01-23T08:50:31.279 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-01-23T08:50:31.285 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package jq. 2024-01-23T08:50:31.301 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-01-23T08:50:31.316 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-01-23T08:50:31.334 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-01-23T08:50:31.544 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-pytest. 2024-01-23T08:50:31.573 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-01-23T08:50:31.587 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package socat. 2024-01-23T08:50:31.603 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-01-23T08:50:31.611 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-01-23T08:50:31.637 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-01-23T08:50:31.940 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package xmlstarlet. 2024-01-23T08:50:31.956 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-01-23T08:50:31.956 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package python3-simplejson. 2024-01-23T08:50:31.984 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-01-23T08:50:31.998 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-01-23T08:50:32.022 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-01-23T08:50:32.275 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-01-23T08:50:32.292 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-01-23T08:50:32.333 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-01-23T08:50:32.335 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-test. 2024-01-23T08:50:32.352 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../099-ceph-test_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:32.386 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-test (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:33.045 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package radosgw. 2024-01-23T08:50:33.074 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../122-radosgw_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:33.104 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking radosgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:33.982 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package rbd-fuse. 2024-01-23T08:50:34.010 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:34.048 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking rbd-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:34.393 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package rbd-mirror. 2024-01-23T08:50:34.421 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../124-rbd-mirror_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:34.448 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-volume. 2024-01-23T08:50:34.459 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking rbd-mirror (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:34.475 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-23T08:50:34.514 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-volume (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:34.877 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package cephfs-mirror. 2024-01-23T08:50:34.904 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:34.943 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking cephfs-mirror (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:35.012 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package rbd-nbd. 2024-01-23T08:50:35.040 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../125-rbd-nbd_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:35.078 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking rbd-nbd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:35.255 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-colorama. 2024-01-23T08:50:35.282 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-01-23T08:50:35.321 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-01-23T08:50:35.322 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-common-dbg. 2024-01-23T08:50:35.351 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../126-ceph-common-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:35.380 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-common-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:35.582 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package cephfs-shell. 2024-01-23T08:50:35.609 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-23T08:50:35.648 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking cephfs-shell (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:35.901 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package cephfs-top. 2024-01-23T08:50:35.928 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-766-g0edf41a6-1jammy_all.deb ... 2024-01-23T08:50:35.967 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking cephfs-top (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:36.203 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libcephfs-dev. 2024-01-23T08:50:36.219 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:36.261 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libcephfs-dev (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:36.589 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package lua-socket:amd64. 2024-01-23T08:50:36.616 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-01-23T08:50:36.664 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-23T08:50:36.993 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package lua-sec:amd64. 2024-01-23T08:50:37.021 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-01-23T08:50:37.059 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-01-23T08:50:37.397 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package nvme-cli. 2024-01-23T08:50:37.425 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-01-23T08:50:37.463 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-01-23T08:50:37.818 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package pkg-config. 2024-01-23T08:50:37.846 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-01-23T08:50:37.876 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-01-23T08:50:38.137 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-01-23T08:50:38.165 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-01-23T08:50:38.204 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-01-23T08:50:38.599 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-iniconfig. 2024-01-23T08:50:38.626 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-01-23T08:50:38.665 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-01-23T08:50:38.968 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pastescript. 2024-01-23T08:50:38.995 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-01-23T08:50:39.034 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-01-23T08:50:39.354 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pluggy. 2024-01-23T08:50:39.382 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-01-23T08:50:39.420 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-01-23T08:50:39.690 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-psutil. 2024-01-23T08:50:39.717 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-01-23T08:50:39.756 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-01-23T08:50:40.109 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-py. 2024-01-23T08:50:40.137 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-01-23T08:50:40.175 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-py (1.10.0-1) ... 2024-01-23T08:50:40.495 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pygments. 2024-01-23T08:50:40.511 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-01-23T08:50:40.553 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-01-23T08:50:40.999 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pyinotify. 2024-01-23T08:50:41.015 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-01-23T08:50:41.049 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-01-23T08:50:41.326 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-toml. 2024-01-23T08:50:41.354 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-01-23T08:50:41.393 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-01-23T08:50:41.688 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pytest. 2024-01-23T08:50:41.715 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-01-23T08:50:41.754 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-01-23T08:50:42.091 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-simplejson. 2024-01-23T08:50:42.118 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-01-23T08:50:42.157 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-01-23T08:50:42.426 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-fuse-dbg. 2024-01-23T08:50:42.426 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-01-23T08:50:42.442 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-01-23T08:50:42.454 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../127-ceph-fuse-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:42.484 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-01-23T08:50:42.492 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-fuse-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:43.061 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-mds-dbg. 2024-01-23T08:50:43.077 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../128-ceph-mds-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:43.111 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-mds-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:43.480 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package radosgw. 2024-01-23T08:50:43.508 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../122-radosgw_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:43.546 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking radosgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:44.063 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-mgr-dbg. 2024-01-23T08:50:44.080 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../129-ceph-mgr-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:44.121 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-mgr-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:44.282 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package rbd-fuse. 2024-01-23T08:50:44.298 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:44.332 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking rbd-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:44.610 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package rbd-mirror. 2024-01-23T08:50:44.638 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../124-rbd-mirror_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:44.676 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking rbd-mirror (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:44.790 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-mon-dbg. 2024-01-23T08:50:44.807 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../130-ceph-mon-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:44.849 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-mon-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:45.098 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package rbd-nbd. 2024-01-23T08:50:45.114 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../125-rbd-nbd_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:45.156 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking rbd-nbd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:45.400 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-common-dbg. 2024-01-23T08:50:45.416 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../126-ceph-common-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:45.450 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-common-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:46.642 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-osd-dbg. 2024-01-23T08:50:46.659 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../131-ceph-osd-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:46.701 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-osd-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:51.937 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ceph-test-dbg. 2024-01-23T08:50:51.954 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../132-ceph-test-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:51.995 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ceph-test-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:52.279 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-fuse-dbg. 2024-01-23T08:50:52.306 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../127-ceph-fuse-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:52.344 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-fuse-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:52.814 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mds-dbg. 2024-01-23T08:50:52.839 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../128-ceph-mds-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:52.880 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mds-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:53.866 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-dbg. 2024-01-23T08:50:53.882 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../129-ceph-mgr-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:53.916 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:54.543 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mon-dbg. 2024-01-23T08:50:54.559 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../130-ceph-mon-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:54.601 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mon-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:50:56.371 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-osd-dbg. 2024-01-23T08:50:56.386 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../131-ceph-osd-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:50:56.428 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-osd-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:01.531 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-test-dbg. 2024-01-23T08:51:01.559 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../132-ceph-test-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:51:01.597 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-test-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:02.770 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libcephfs2-dbg. 2024-01-23T08:51:02.787 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../133-libcephfs2-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:51:02.828 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libcephfs2-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:03.347 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package librados2-dbg. 2024-01-23T08:51:03.364 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../134-librados2-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:51:03.405 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking librados2-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:04.450 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libradosstriper1-dbg. 2024-01-23T08:51:04.478 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../135-libradosstriper1-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:51:04.516 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libradosstriper1-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:04.885 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package librbd1-dbg. 2024-01-23T08:51:04.901 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../136-librbd1-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:51:04.943 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking librbd1-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:06.187 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package librgw2-dbg. 2024-01-23T08:51:06.204 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../137-librgw2-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:51:06.237 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking librgw2-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:07.998 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package radosgw-dbg. 2024-01-23T08:51:08.014 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../138-radosgw-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:51:08.056 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking radosgw-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:11.317 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package rbd-fuse-dbg. 2024-01-23T08:51:11.345 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../139-rbd-fuse-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:51:11.383 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking rbd-fuse-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:11.661 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package rbd-mirror-dbg. 2024-01-23T08:51:11.689 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../140-rbd-mirror-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:51:11.727 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking rbd-mirror-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:12.297 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libcephfs2-dbg. 2024-01-23T08:51:12.313 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../133-libcephfs2-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:51:12.355 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libcephfs2-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:12.791 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package librados2-dbg. 2024-01-23T08:51:12.818 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../134-librados2-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:51:12.857 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking librados2-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:12.930 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package rbd-nbd-dbg. 2024-01-23T08:51:12.958 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../141-rbd-nbd-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:51:12.996 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking rbd-nbd-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:13.343 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-01-23T08:51:13.601 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-23T08:51:13.727 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-01-23T08:51:13.919 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libradosstriper1-dbg. 2024-01-23T08:51:13.935 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../135-libradosstriper1-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:51:13.969 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libradosstriper1-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:13.997 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-01-23T08:51:14.313 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package librbd1-dbg. 2024-01-23T08:51:14.329 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../136-librbd1-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:51:14.358 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-01-23T08:51:14.371 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking librbd1-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:14.744 INFO:teuthology.orchestra.run.smithi046.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-01-23T08:51:14.820 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:15.338 INFO:teuthology.orchestra.run.smithi046.stdout:Adding system user cephadm....done 2024-01-23T08:51:15.493 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-23T08:51:15.599 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package librgw2-dbg. 2024-01-23T08:51:15.615 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../137-librgw2-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:51:15.657 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking librgw2-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:15.769 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-01-23T08:51:16.029 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-01-23T08:51:16.155 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-01-23T08:51:16.423 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-01-23T08:51:16.690 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-01-23T08:51:16.791 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-py (1.10.0-1) ... 2024-01-23T08:51:17.085 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-01-23T08:51:17.462 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-01-23T08:51:17.560 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package radosgw-dbg. 2024-01-23T08:51:17.576 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../138-radosgw-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:51:17.618 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking radosgw-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:17.729 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-01-23T08:51:17.989 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-01-23T08:51:18.265 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2024-01-23T08:51:18.516 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-01-23T08:51:18.776 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-01-23T08:51:19.052 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-01-23T08:51:19.403 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-ceph-argparse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:19.679 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-23T08:51:19.805 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-23T08:51:19.931 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-01-23T08:51:20.191 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-01-23T08:51:20.316 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-01-23T08:51:20.567 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-01-23T08:51:20.754 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package rbd-fuse-dbg. 2024-01-23T08:51:20.770 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../139-rbd-fuse-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:51:20.803 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking rbd-fuse-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:20.968 INFO:teuthology.orchestra.run.smithi046.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-01-23T08:51:20.989 INFO:teuthology.orchestra.run.smithi046.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-01-23T08:51:21.054 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-23T08:51:21.064 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package rbd-mirror-dbg. 2024-01-23T08:51:21.080 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../140-rbd-mirror-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:51:21.122 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking rbd-mirror-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:21.180 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-01-23T08:51:21.548 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-23T08:51:21.665 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-01-23T08:51:21.925 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-01-23T08:51:22.176 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-01-23T08:51:22.317 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package rbd-nbd-dbg. 2024-01-23T08:51:22.344 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../141-rbd-nbd-dbg_19.0.0-766-g0edf41a6-1jammy_amd64.deb ... 2024-01-23T08:51:22.383 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking rbd-nbd-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:22.502 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up zip (3.0-12build2) ... 2024-01-23T08:51:22.628 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-01-23T08:51:22.738 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-01-23T08:51:22.997 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-23T08:51:23.123 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-01-23T08:51:23.322 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-01-23T08:51:23.380 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-01-23T08:51:23.614 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-01-23T08:51:23.714 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-01-23T08:51:23.732 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-01-23T08:51:23.833 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-23T08:51:24.117 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-01-23T08:51:24.156 INFO:teuthology.orchestra.run.smithi175.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-01-23T08:51:24.216 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:24.494 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-01-23T08:51:24.693 INFO:teuthology.orchestra.run.smithi175.stdout:Adding system user cephadm....done 2024-01-23T08:51:24.744 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-01-23T08:51:24.847 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-23T08:51:25.115 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-01-23T08:51:25.138 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-23T08:51:25.375 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-01-23T08:51:25.430 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-01-23T08:51:25.476 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-01-23T08:51:25.711 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-01-23T08:51:25.782 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-23T08:51:25.962 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-01-23T08:51:26.088 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-py (1.10.0-1) ... 2024-01-23T08:51:26.124 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-01-23T08:51:26.367 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-01-23T08:51:26.397 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-01-23T08:51:26.468 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:26.758 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-01-23T08:51:26.761 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-idna (3.3-1) ... 2024-01-23T08:51:27.009 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-01-23T08:51:27.087 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-23T08:51:27.244 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-01-23T08:51:27.537 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2024-01-23T08:51:27.830 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-01-23T08:51:28.089 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-01-23T08:51:28.285 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-01-23T08:51:28.374 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-01-23T08:51:28.545 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-23T08:51:28.679 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-toml (0.10.2-1) ... 2024-01-23T08:51:28.692 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-ceph-argparse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:28.935 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-23T08:51:28.955 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-23T08:51:29.061 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-23T08:51:29.081 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-01-23T08:51:29.187 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-01-23T08:51:29.207 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-23T08:51:29.446 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-01-23T08:51:29.508 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-01-23T08:51:29.573 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-01-23T08:51:29.743 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-01-23T08:51:29.840 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-01-23T08:51:29.977 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-23T08:51:30.128 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-01-23T08:51:30.311 INFO:teuthology.orchestra.run.smithi175.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-01-23T08:51:30.346 INFO:teuthology.orchestra.run.smithi175.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-01-23T08:51:30.393 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-23T08:51:30.437 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-01-23T08:51:30.519 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-01-23T08:51:30.697 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-01-23T08:51:30.879 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-23T08:51:30.956 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-01-23T08:51:31.005 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-01-23T08:51:31.216 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-01-23T08:51:31.273 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-01-23T08:51:31.475 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-01-23T08:51:31.540 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-01-23T08:51:31.726 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-23T08:51:31.850 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up zip (3.0-12build2) ... 2024-01-23T08:51:31.852 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-01-23T08:51:31.959 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-01-23T08:51:32.137 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-23T08:51:32.262 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-23T08:51:32.589 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-01-23T08:51:32.686 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-01-23T08:51:32.915 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-01-23T08:51:32.946 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-01-23T08:51:33.072 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-01-23T08:51:33.174 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-23T08:51:33.198 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-23T08:51:33.275 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-01-23T08:51:33.499 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-01-23T08:51:33.719 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-01-23T08:51:33.865 INFO:teuthology.orchestra.run.smithi046.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-01-23T08:51:33.892 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-01-23T08:51:34.111 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-23T08:51:34.142 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-01-23T08:51:34.237 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-01-23T08:51:34.528 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-23T08:51:34.655 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-01-23T08:51:34.846 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-01-23T08:51:34.914 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up lua-any (27ubuntu1) ... 2024-01-23T08:51:35.040 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-portend (3.0.0-1) ... 2024-01-23T08:51:35.172 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-23T08:51:35.308 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-23T08:51:35.409 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2024-01-23T08:51:35.531 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-01-23T08:51:35.735 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-01-23T08:51:35.791 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-01-23T08:51:35.900 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:36.028 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-23T08:51:36.185 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-idna (3.3-1) ... 2024-01-23T08:51:36.312 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-01-23T08:51:36.494 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-23T08:51:36.524 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-rsa (4.8-1) ... 2024-01-23T08:51:36.783 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-01-23T08:51:37.060 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-23T08:51:37.303 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-01-23T08:51:37.625 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-01-23T08:51:37.688 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-01-23T08:51:37.860 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-23T08:51:37.973 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-01-23T08:51:37.994 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-toml (0.10.2-1) ... 2024-01-23T08:51:38.254 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-23T08:51:38.308 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-23T08:51:38.380 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-01-23T08:51:38.434 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up librados2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:38.506 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-23T08:51:38.560 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libsqlite3-mod-ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:38.686 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-01-23T08:51:38.807 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-01-23T08:51:39.039 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libcephfs2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:39.042 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-01-23T08:51:39.165 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libradosstriper1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:39.266 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-01-23T08:51:39.276 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-23T08:51:39.394 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-01-23T08:51:39.526 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up librados2-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:39.635 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up librbd1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:39.703 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-01-23T08:51:39.761 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libcephfs2-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:39.888 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-mgr-modules-core (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:39.954 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-01-23T08:51:40.013 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:40.222 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-01-23T08:51:40.234 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-23T08:51:40.235 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-23T08:51:40.481 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-01-23T08:51:40.733 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-01-23T08:51:40.781 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libradosstriper1-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:40.932 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libcephfs-dev (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:40.984 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-23T08:51:41.058 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-fuse-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:41.110 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-01-23T08:51:41.176 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-rados (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:41.319 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up librgw2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:41.386 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-23T08:51:41.462 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up cephfs-top (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:41.512 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-23T08:51:41.596 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-23T08:51:41.813 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-01-23T08:51:42.123 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-01-23T08:51:42.382 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-23T08:51:42.491 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-01-23T08:51:42.609 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-01-23T08:51:42.706 INFO:teuthology.orchestra.run.smithi175.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-01-23T08:51:42.859 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up librbd1-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:42.944 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-23T08:51:42.968 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-rbd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:43.070 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-01-23T08:51:43.119 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up librgw2-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:43.245 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up rbd-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:43.371 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up rbd-nbd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:43.472 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-01-23T08:51:43.497 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-rgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:43.623 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up python3-cephfs (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:43.731 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up lua-any (27ubuntu1) ... 2024-01-23T08:51:43.748 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up rbd-nbd-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:43.857 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-portend (3.0.0-1) ... 2024-01-23T08:51:43.858 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up cephfs-shell (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:43.959 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up rbd-fuse-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:44.062 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:44.091 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-23T08:51:44.218 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2024-01-23T08:51:44.535 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-01-23T08:51:44.605 INFO:teuthology.orchestra.run.smithi046.stdout:Adding group ceph....done 2024-01-23T08:51:44.837 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-23T08:51:44.964 INFO:teuthology.orchestra.run.smithi046.stdout:Adding system user ceph....done 2024-01-23T08:51:45.099 INFO:teuthology.orchestra.run.smithi046.stdout:Setting system user ceph properties....done 2024-01-23T08:51:45.104 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-01-23T08:51:45.119 INFO:teuthology.orchestra.run.smithi046.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-01-23T08:51:45.258 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-01-23T08:51:45.307 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-rsa (4.8-1) ... 2024-01-23T08:51:45.559 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-01-23T08:51:45.582 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-01-23T08:51:45.827 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-23T08:51:46.054 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up cephfs-mirror (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:46.086 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-01-23T08:51:46.286 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-23T08:51:46.286 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-23T08:51:46.463 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-01-23T08:51:46.756 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-test (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:46.756 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-01-23T08:51:46.882 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up radosgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:47.092 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-23T08:51:47.218 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up librados2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:47.352 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-23T08:51:47.352 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-23T08:51:47.369 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libsqlite3-mod-ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:47.495 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-01-23T08:51:47.792 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-base (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:48.111 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libcephfs2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:48.133 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-01-23T08:51:48.299 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libradosstriper1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:48.409 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-01-23T08:51:48.619 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-mds (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:48.685 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up librados2-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:48.811 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up librbd1 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:48.849 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-23T08:51:48.849 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-23T08:51:48.937 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libcephfs2-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:49.063 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-modules-core (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:49.189 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:49.304 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-common-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:49.402 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-23T08:51:49.402 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-23T08:51:49.429 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up rbd-mirror (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:49.648 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-01-23T08:51:49.648 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-01-23T08:51:49.900 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libradosstriper1-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:50.000 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libcephfs-dev (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:50.126 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-fuse-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:50.139 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-mgr (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:50.253 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-rados (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:50.347 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-23T08:51:50.348 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-23T08:51:50.378 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up librgw2 (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:50.504 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up cephfs-top (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:50.655 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-23T08:51:50.885 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-mds-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:51.050 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up radosgw-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:51.151 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-test-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:51.277 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-osd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:51.575 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-23T08:51:51.576 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-23T08:51:51.884 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up librbd1-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:52.010 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-rbd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:52.062 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-mgr-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:52.136 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up librgw2-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:52.188 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-osd-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:52.262 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up rbd-fuse (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:52.388 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up rbd-nbd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:52.484 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up rbd-mirror-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:52.514 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-rgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:52.601 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-mgr-k8sevents (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:52.648 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-cephfs (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:52.727 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:52.749 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up rbd-nbd-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:52.867 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up cephfs-shell (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:52.878 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-mon (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:52.968 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up rbd-fuse-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:53.069 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-common (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:53.096 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-23T08:51:53.096 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-23T08:51:53.538 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-mgr-cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:53.596 INFO:teuthology.orchestra.run.smithi175.stdout:Adding group ceph....done 2024-01-23T08:51:53.689 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:53.815 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-mgr-dashboard (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:53.966 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-mon-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:54.005 INFO:teuthology.orchestra.run.smithi175.stdout:Adding system user ceph....done 2024-01-23T08:51:54.075 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ceph-volume (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:54.166 INFO:teuthology.orchestra.run.smithi175.stdout:Setting system user ceph properties....done 2024-01-23T08:51:54.181 INFO:teuthology.orchestra.run.smithi175.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-01-23T08:51:54.319 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-01-23T08:51:54.411 INFO:teuthology.orchestra.run.smithi046.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-01-23T08:51:54.520 INFO:teuthology.orchestra.run.smithi046.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-23T08:51:54.650 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-01-23T08:51:54.673 INFO:teuthology.orchestra.run.smithi046.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-23T08:51:55.323 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up cephfs-mirror (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:55.538 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-23T08:51:55.538 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-23T08:51:55.774 INFO:teuthology.orchestra.run.smithi046.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-23T08:51:56.073 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-test (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:56.183 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up radosgw (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:56.480 INFO:teuthology.orchestra.run.smithi046.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-23T08:51:56.483 DEBUG:teuthology.orchestra.run.smithi046:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-01-23T08:51:56.538 INFO:teuthology.orchestra.run.smithi046.stdout:Reading package lists... 2024-01-23T08:51:56.647 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-23T08:51:56.647 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-23T08:51:56.732 INFO:teuthology.orchestra.run.smithi046.stdout:Building dependency tree... 2024-01-23T08:51:56.733 INFO:teuthology.orchestra.run.smithi046.stdout:Reading state information... 2024-01-23T08:51:56.909 INFO:teuthology.orchestra.run.smithi046.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-01-23T08:51:56.909 INFO:teuthology.orchestra.run.smithi046.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-01-23T08:51:56.909 INFO:teuthology.orchestra.run.smithi046.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-01-23T08:51:56.909 INFO:teuthology.orchestra.run.smithi046.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-01-23T08:51:56.909 INFO:teuthology.orchestra.run.smithi046.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-01-23T08:51:56.909 INFO:teuthology.orchestra.run.smithi046.stdout:The following packages were automatically installed and are no longer required: 2024-01-23T08:51:56.909 INFO:teuthology.orchestra.run.smithi046.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-23T08:51:56.909 INFO:teuthology.orchestra.run.smithi046.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-23T08:51:56.909 INFO:teuthology.orchestra.run.smithi046.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-23T08:51:56.910 INFO:teuthology.orchestra.run.smithi046.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-23T08:51:56.910 INFO:teuthology.orchestra.run.smithi046.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-23T08:51:56.910 INFO:teuthology.orchestra.run.smithi046.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-23T08:51:56.910 INFO:teuthology.orchestra.run.smithi046.stdout:The following additional packages will be installed: 2024-01-23T08:51:56.910 INFO:teuthology.orchestra.run.smithi046.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-01-23T08:51:56.910 INFO:teuthology.orchestra.run.smithi046.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-01-23T08:51:56.911 INFO:teuthology.orchestra.run.smithi046.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-01-23T08:51:56.911 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-01-23T08:51:56.911 INFO:teuthology.orchestra.run.smithi046.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-23T08:51:56.912 INFO:teuthology.orchestra.run.smithi046.stdout:Suggested packages: 2024-01-23T08:51:56.912 INFO:teuthology.orchestra.run.smithi046.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-01-23T08:51:56.912 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-01-23T08:51:56.912 INFO:teuthology.orchestra.run.smithi046.stdout: libengine-pkcs11-openssl 2024-01-23T08:51:56.951 INFO:teuthology.orchestra.run.smithi046.stdout:The following NEW packages will be installed: 2024-01-23T08:51:56.951 INFO:teuthology.orchestra.run.smithi046.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-01-23T08:51:56.951 INFO:teuthology.orchestra.run.smithi046.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-01-23T08:51:56.952 INFO:teuthology.orchestra.run.smithi046.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-01-23T08:51:56.952 INFO:teuthology.orchestra.run.smithi046.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-01-23T08:51:56.952 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-01-23T08:51:56.952 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-01-23T08:51:56.952 INFO:teuthology.orchestra.run.smithi046.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-23T08:51:56.953 INFO:teuthology.orchestra.run.smithi046.stdout:The following packages will be upgraded: 2024-01-23T08:51:56.953 INFO:teuthology.orchestra.run.smithi046.stdout: libssl3 2024-01-23T08:51:57.134 INFO:teuthology.orchestra.run.smithi046.stdout:1 upgraded, 39 newly installed, 0 to remove and 265 not upgraded. 2024-01-23T08:51:57.134 INFO:teuthology.orchestra.run.smithi046.stdout:Need to get 54.6 MB of archives. 2024-01-23T08:51:57.134 INFO:teuthology.orchestra.run.smithi046.stdout:After this operation, 202 MB of additional disk space will be used. 2024-01-23T08:51:57.134 INFO:teuthology.orchestra.run.smithi046.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-01-23T08:51:57.135 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-base (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:57.611 INFO:teuthology.orchestra.run.smithi046.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2024-01-23T08:51:57.631 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-01-23T08:51:57.867 INFO:teuthology.orchestra.run.smithi046.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-01-23T08:51:57.902 INFO:teuthology.orchestra.run.smithi046.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-01-23T08:51:57.904 INFO:teuthology.orchestra.run.smithi046.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-01-23T08:51:57.909 INFO:teuthology.orchestra.run.smithi046.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-01-23T08:51:57.912 INFO:teuthology.orchestra.run.smithi046.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-01-23T08:51:57.913 INFO:teuthology.orchestra.run.smithi046.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-01-23T08:51:57.916 INFO:teuthology.orchestra.run.smithi046.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-01-23T08:51:57.919 INFO:teuthology.orchestra.run.smithi046.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-01-23T08:51:58.084 INFO:teuthology.orchestra.run.smithi046.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-01-23T08:51:58.084 INFO:teuthology.orchestra.run.smithi046.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-01-23T08:51:58.112 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mds (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:58.329 INFO:teuthology.orchestra.run.smithi046.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-01-23T08:51:58.335 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-23T08:51:58.335 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-23T08:51:58.840 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-common-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:58.949 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up rbd-mirror (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:59.157 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-01-23T08:51:59.157 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-01-23T08:51:59.510 INFO:teuthology.orchestra.run.smithi046.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-01-23T08:51:59.615 INFO:teuthology.orchestra.run.smithi046.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-01-23T08:51:59.637 INFO:teuthology.orchestra.run.smithi046.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-01-23T08:51:59.650 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:51:59.694 INFO:teuthology.orchestra.run.smithi046.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-01-23T08:51:59.731 INFO:teuthology.orchestra.run.smithi046.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-01-23T08:51:59.817 INFO:teuthology.orchestra.run.smithi046.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-01-23T08:51:59.852 INFO:teuthology.orchestra.run.smithi046.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-01-23T08:51:59.871 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-23T08:51:59.871 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-23T08:51:59.932 INFO:teuthology.orchestra.run.smithi046.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-01-23T08:51:59.998 INFO:teuthology.orchestra.run.smithi046.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2024-01-23T08:52:00.228 INFO:teuthology.orchestra.run.smithi046.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-01-23T08:52:00.283 INFO:teuthology.orchestra.run.smithi046.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-01-23T08:52:00.366 INFO:teuthology.orchestra.run.smithi046.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-01-23T08:52:00.385 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mds-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:52:00.511 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up radosgw-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:52:00.550 INFO:teuthology.orchestra.run.smithi046.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-01-23T08:52:00.609 INFO:teuthology.orchestra.run.smithi046.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-01-23T08:52:00.643 INFO:teuthology.orchestra.run.smithi046.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-01-23T08:52:00.662 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-test-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:52:00.665 INFO:teuthology.orchestra.run.smithi046.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-01-23T08:52:00.686 INFO:teuthology.orchestra.run.smithi046.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-01-23T08:52:00.755 INFO:teuthology.orchestra.run.smithi046.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-01-23T08:52:00.782 INFO:teuthology.orchestra.run.smithi046.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-01-23T08:52:00.788 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-osd (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:52:01.067 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-23T08:52:01.067 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-23T08:52:01.431 INFO:teuthology.orchestra.run.smithi046.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-01-23T08:52:01.451 INFO:teuthology.orchestra.run.smithi046.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-01-23T08:52:01.476 INFO:teuthology.orchestra.run.smithi046.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-01-23T08:52:01.515 INFO:teuthology.orchestra.run.smithi046.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-01-23T08:52:01.548 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:52:01.650 INFO:teuthology.orchestra.run.smithi046.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-01-23T08:52:01.674 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-osd-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:52:01.697 INFO:teuthology.orchestra.run.smithi046.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-01-23T08:52:01.792 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up rbd-mirror-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:52:01.808 INFO:teuthology.orchestra.run.smithi046.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-01-23T08:52:01.861 INFO:teuthology.orchestra.run.smithi046.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-01-23T08:52:01.901 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-k8sevents (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:52:02.002 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:52:02.145 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mon (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:52:02.288 INFO:teuthology.orchestra.run.smithi046.stdout:Preconfiguring packages ... 2024-01-23T08:52:02.354 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-23T08:52:02.354 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-23T08:52:02.455 INFO:teuthology.orchestra.run.smithi046.stdout:Fetched 54.6 MB in 5s (11.1 MB/s) 2024-01-23T08:52:02.592 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package flex. 2024-01-23T08:52:02.674 INFO:teuthology.orchestra.run.smithi046.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173925 files and directories currently installed.) 2024-01-23T08:52:02.679 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-01-23T08:52:02.715 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking flex (2.6.4-8build2) ... 2024-01-23T08:52:02.854 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-cephadm (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:52:03.005 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:52:03.132 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-dashboard (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:52:03.266 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mon-dbg (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:52:03.290 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-23T08:52:03.383 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-volume (19.0.0-766-g0edf41a6-1jammy) ... 2024-01-23T08:52:03.471 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2024-01-23T08:52:03.787 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-01-23T08:52:03.897 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-23T08:52:03.907 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-23T08:52:04.065 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-23T08:52:04.422 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package bison. 2024-01-23T08:52:04.526 INFO:teuthology.orchestra.run.smithi046.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173998 files and directories currently installed.) 2024-01-23T08:52:04.532 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-01-23T08:52:04.699 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-01-23T08:52:04.843 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-23T08:52:05.283 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-01-23T08:52:05.299 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-01-23T08:52:05.332 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-01-23T08:52:05.535 INFO:teuthology.orchestra.run.smithi175.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-23T08:52:05.538 DEBUG:teuthology.orchestra.run.smithi175:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-01-23T08:52:05.598 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-01-23T08:52:05.660 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package dump. 2024-01-23T08:52:05.689 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-01-23T08:52:05.727 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking dump (0.4b47-3) ... 2024-01-23T08:52:05.787 INFO:teuthology.orchestra.run.smithi175.stdout:Building dependency tree... 2024-01-23T08:52:05.788 INFO:teuthology.orchestra.run.smithi175.stdout:Reading state information... 2024-01-23T08:52:05.958 INFO:teuthology.orchestra.run.smithi175.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-01-23T08:52:05.958 INFO:teuthology.orchestra.run.smithi175.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-01-23T08:52:05.958 INFO:teuthology.orchestra.run.smithi175.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-01-23T08:52:05.958 INFO:teuthology.orchestra.run.smithi175.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-01-23T08:52:05.958 INFO:teuthology.orchestra.run.smithi175.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-01-23T08:52:05.958 INFO:teuthology.orchestra.run.smithi175.stdout:The following packages were automatically installed and are no longer required: 2024-01-23T08:52:05.958 INFO:teuthology.orchestra.run.smithi175.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-23T08:52:05.958 INFO:teuthology.orchestra.run.smithi175.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-23T08:52:05.958 INFO:teuthology.orchestra.run.smithi175.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-23T08:52:05.958 INFO:teuthology.orchestra.run.smithi175.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-23T08:52:05.959 INFO:teuthology.orchestra.run.smithi175.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-23T08:52:05.959 INFO:teuthology.orchestra.run.smithi175.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-23T08:52:05.959 INFO:teuthology.orchestra.run.smithi175.stdout:The following additional packages will be installed: 2024-01-23T08:52:05.959 INFO:teuthology.orchestra.run.smithi175.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-01-23T08:52:05.959 INFO:teuthology.orchestra.run.smithi175.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-01-23T08:52:05.960 INFO:teuthology.orchestra.run.smithi175.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-01-23T08:52:05.960 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-01-23T08:52:05.960 INFO:teuthology.orchestra.run.smithi175.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-23T08:52:05.961 INFO:teuthology.orchestra.run.smithi175.stdout:Suggested packages: 2024-01-23T08:52:05.961 INFO:teuthology.orchestra.run.smithi175.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-01-23T08:52:05.961 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-01-23T08:52:05.961 INFO:teuthology.orchestra.run.smithi175.stdout: libengine-pkcs11-openssl 2024-01-23T08:52:05.997 INFO:teuthology.orchestra.run.smithi175.stdout:The following NEW packages will be installed: 2024-01-23T08:52:05.997 INFO:teuthology.orchestra.run.smithi175.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-01-23T08:52:05.997 INFO:teuthology.orchestra.run.smithi175.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-01-23T08:52:05.998 INFO:teuthology.orchestra.run.smithi175.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-01-23T08:52:05.998 INFO:teuthology.orchestra.run.smithi175.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-01-23T08:52:05.998 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-01-23T08:52:05.998 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-01-23T08:52:05.998 INFO:teuthology.orchestra.run.smithi175.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-23T08:52:05.999 INFO:teuthology.orchestra.run.smithi175.stdout:The following packages will be upgraded: 2024-01-23T08:52:05.999 INFO:teuthology.orchestra.run.smithi175.stdout: libssl3 2024-01-23T08:52:06.005 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package indent. 2024-01-23T08:52:06.022 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-01-23T08:52:06.063 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-23T08:52:06.079 INFO:teuthology.orchestra.run.smithi175.stdout:1 upgraded, 39 newly installed, 0 to remove and 265 not upgraded. 2024-01-23T08:52:06.079 INFO:teuthology.orchestra.run.smithi175.stdout:Need to get 54.6 MB of archives. 2024-01-23T08:52:06.079 INFO:teuthology.orchestra.run.smithi175.stdout:After this operation, 202 MB of additional disk space will be used. 2024-01-23T08:52:06.080 INFO:teuthology.orchestra.run.smithi175.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-01-23T08:52:06.207 INFO:teuthology.orchestra.run.smithi175.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2024-01-23T08:52:06.275 INFO:teuthology.orchestra.run.smithi175.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-01-23T08:52:06.291 INFO:teuthology.orchestra.run.smithi175.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-01-23T08:52:06.292 INFO:teuthology.orchestra.run.smithi175.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-01-23T08:52:06.295 INFO:teuthology.orchestra.run.smithi175.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-01-23T08:52:06.297 INFO:teuthology.orchestra.run.smithi175.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-01-23T08:52:06.298 INFO:teuthology.orchestra.run.smithi175.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-01-23T08:52:06.299 INFO:teuthology.orchestra.run.smithi175.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-01-23T08:52:06.301 INFO:teuthology.orchestra.run.smithi175.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-01-23T08:52:06.301 INFO:teuthology.orchestra.run.smithi175.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-01-23T08:52:06.302 INFO:teuthology.orchestra.run.smithi175.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-01-23T08:52:06.320 INFO:teuthology.orchestra.run.smithi175.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-01-23T08:52:06.324 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-01-23T08:52:06.341 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-01-23T08:52:06.382 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-23T08:52:06.644 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-01-23T08:52:06.661 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-01-23T08:52:06.702 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-23T08:52:06.778 INFO:teuthology.orchestra.run.smithi175.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-01-23T08:52:06.781 INFO:teuthology.orchestra.run.smithi175.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-01-23T08:52:06.782 INFO:teuthology.orchestra.run.smithi175.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-01-23T08:52:06.786 INFO:teuthology.orchestra.run.smithi175.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-01-23T08:52:06.786 INFO:teuthology.orchestra.run.smithi175.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-01-23T08:52:06.793 INFO:teuthology.orchestra.run.smithi175.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-01-23T08:52:06.795 INFO:teuthology.orchestra.run.smithi175.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-01-23T08:52:06.807 INFO:teuthology.orchestra.run.smithi175.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-01-23T08:52:06.807 INFO:teuthology.orchestra.run.smithi175.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2024-01-23T08:52:06.838 INFO:teuthology.orchestra.run.smithi175.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-01-23T08:52:06.838 INFO:teuthology.orchestra.run.smithi175.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-01-23T08:52:06.850 INFO:teuthology.orchestra.run.smithi175.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-01-23T08:52:06.901 INFO:teuthology.orchestra.run.smithi175.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-01-23T08:52:06.901 INFO:teuthology.orchestra.run.smithi175.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-01-23T08:52:06.902 INFO:teuthology.orchestra.run.smithi175.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-01-23T08:52:06.902 INFO:teuthology.orchestra.run.smithi175.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-01-23T08:52:06.902 INFO:teuthology.orchestra.run.smithi175.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-01-23T08:52:06.920 INFO:teuthology.orchestra.run.smithi175.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-01-23T08:52:06.922 INFO:teuthology.orchestra.run.smithi175.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-01-23T08:52:06.971 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-01-23T08:52:06.989 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-01-23T08:52:07.030 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-01-23T08:52:07.349 INFO:teuthology.orchestra.run.smithi175.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-01-23T08:52:07.349 INFO:teuthology.orchestra.run.smithi175.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-01-23T08:52:07.349 INFO:teuthology.orchestra.run.smithi175.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-01-23T08:52:07.349 INFO:teuthology.orchestra.run.smithi175.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-01-23T08:52:07.350 INFO:teuthology.orchestra.run.smithi175.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-01-23T08:52:07.350 INFO:teuthology.orchestra.run.smithi175.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-01-23T08:52:07.366 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libfl2:amd64. 2024-01-23T08:52:07.372 INFO:teuthology.orchestra.run.smithi175.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-01-23T08:52:07.373 INFO:teuthology.orchestra.run.smithi175.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-01-23T08:52:07.395 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-01-23T08:52:07.433 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-01-23T08:52:07.694 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-01-23T08:52:07.722 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-01-23T08:52:07.760 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-23T08:52:07.780 INFO:teuthology.orchestra.run.smithi175.stdout:Preconfiguring packages ... 2024-01-23T08:52:07.928 INFO:teuthology.orchestra.run.smithi175.stdout:Fetched 54.6 MB in 1s (39.9 MB/s) 2024-01-23T08:52:07.954 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libjson-perl. 2024-01-23T08:52:07.972 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-01-23T08:52:08.013 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-01-23T08:52:08.039 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package flex. 2024-01-23T08:52:08.103 INFO:teuthology.orchestra.run.smithi175.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173925 files and directories currently installed.) 2024-01-23T08:52:08.108 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-01-23T08:52:08.147 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking flex (2.6.4-8build2) ... 2024-01-23T08:52:08.324 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libllvm14:amd64. 2024-01-23T08:52:08.352 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-01-23T08:52:08.390 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-23T08:52:08.824 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-23T08:52:08.996 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2024-01-23T08:52:09.415 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-23T08:52:09.923 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package bison. 2024-01-23T08:52:10.026 INFO:teuthology.orchestra.run.smithi175.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173998 files and directories currently installed.) 2024-01-23T08:52:10.032 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-01-23T08:52:10.068 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-01-23T08:52:10.082 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-01-23T08:52:10.097 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-23T08:52:10.134 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-23T08:52:10.379 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libmbim-proxy. 2024-01-23T08:52:10.396 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-23T08:52:10.437 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-23T08:52:10.475 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-01-23T08:52:10.503 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-01-23T08:52:10.550 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-01-23T08:52:10.715 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-01-23T08:52:10.743 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-23T08:52:10.781 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-23T08:52:10.845 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package dump. 2024-01-23T08:52:10.872 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-01-23T08:52:10.911 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking dump (0.4b47-3) ... 2024-01-23T08:52:11.125 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libndp0:amd64. 2024-01-23T08:52:11.154 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-01-23T08:52:11.192 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-23T08:52:11.206 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package indent. 2024-01-23T08:52:11.234 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-01-23T08:52:11.273 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-23T08:52:11.520 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libnm0:amd64. 2024-01-23T08:52:11.533 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-01-23T08:52:11.548 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-01-23T08:52:11.549 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-01-23T08:52:11.586 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-23T08:52:11.600 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-23T08:52:11.887 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-01-23T08:52:11.906 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libpq5:amd64. 2024-01-23T08:52:11.914 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-01-23T08:52:11.934 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-23T08:52:11.945 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-23T08:52:11.964 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-23T08:52:12.189 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-01-23T08:52:12.205 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-01-23T08:52:12.247 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-01-23T08:52:12.292 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-01-23T08:52:12.320 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-23T08:52:12.358 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-23T08:52:12.592 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libfl2:amd64. 2024-01-23T08:52:12.620 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-01-23T08:52:12.659 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-01-23T08:52:12.660 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libqmi-proxy. 2024-01-23T08:52:12.689 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-23T08:52:12.727 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-23T08:52:12.911 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-01-23T08:52:12.928 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-01-23T08:52:12.970 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-23T08:52:12.979 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-01-23T08:52:12.997 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-23T08:52:13.038 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-23T08:52:13.205 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libjson-perl. 2024-01-23T08:52:13.233 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-01-23T08:52:13.263 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-01-23T08:52:13.550 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libllvm14:amd64. 2024-01-23T08:52:13.558 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-01-23T08:52:13.577 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-01-23T08:52:13.586 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-01-23T08:52:13.616 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-23T08:52:13.624 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-01-23T08:52:13.977 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package modemmanager. 2024-01-23T08:52:14.005 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-23T08:52:14.060 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-23T08:52:14.624 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package network-manager. 2024-01-23T08:52:14.653 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-01-23T08:52:14.699 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-01-23T08:52:15.095 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-01-23T08:52:15.122 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-23T08:52:15.161 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-23T08:52:15.314 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package ppp. 2024-01-23T08:52:15.343 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-01-23T08:52:15.422 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libmbim-proxy. 2024-01-23T08:52:15.450 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-23T08:52:15.488 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-23T08:52:15.612 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-01-23T08:52:15.758 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-01-23T08:52:15.785 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-23T08:52:15.816 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-23T08:52:15.919 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package pptp-linux. 2024-01-23T08:52:15.947 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-01-23T08:52:15.985 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-01-23T08:52:16.127 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libndp0:amd64. 2024-01-23T08:52:16.154 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-01-23T08:52:16.193 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-23T08:52:16.246 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package network-manager-pptp. 2024-01-23T08:52:16.275 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-01-23T08:52:16.313 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-01-23T08:52:16.513 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libnm0:amd64. 2024-01-23T08:52:16.540 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-01-23T08:52:16.579 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-23T08:52:16.615 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package postgresql-client-common. 2024-01-23T08:52:16.644 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-01-23T08:52:16.682 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking postgresql-client-common (238) ... 2024-01-23T08:52:16.933 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libpq5:amd64. 2024-01-23T08:52:16.959 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-23T08:52:16.986 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package postgresql-client-14. 2024-01-23T08:52:16.998 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-23T08:52:17.014 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-23T08:52:17.052 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-23T08:52:17.326 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-01-23T08:52:17.354 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-23T08:52:17.384 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-23T08:52:17.641 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package postgresql-common. 2024-01-23T08:52:17.669 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-01-23T08:52:17.670 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libqmi-proxy. 2024-01-23T08:52:17.698 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-23T08:52:17.725 INFO:teuthology.orchestra.run.smithi046.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-01-23T08:52:17.736 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-23T08:52:17.755 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking postgresql-common (238) ... 2024-01-23T08:52:17.980 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-01-23T08:52:18.008 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-23T08:52:18.047 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-23T08:52:18.264 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package postgresql-14. 2024-01-23T08:52:18.293 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-23T08:52:18.334 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-23T08:52:18.526 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-01-23T08:52:18.553 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-01-23T08:52:18.584 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-01-23T08:52:19.371 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package modemmanager. 2024-01-23T08:52:19.399 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-01-23T08:52:19.437 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-23T08:52:19.725 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package postgresql. 2024-01-23T08:52:19.742 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-01-23T08:52:19.783 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking postgresql (14+238) ... 2024-01-23T08:52:20.010 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package postgresql-client. 2024-01-23T08:52:20.028 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-01-23T08:52:20.060 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking postgresql-client (14+238) ... 2024-01-23T08:52:20.068 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package network-manager. 2024-01-23T08:52:20.096 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-01-23T08:52:20.142 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-01-23T08:52:20.270 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package postgresql-contrib. 2024-01-23T08:52:20.287 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-01-23T08:52:20.328 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking postgresql-contrib (14+238) ... 2024-01-23T08:52:20.656 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package tcl8.6. 2024-01-23T08:52:20.685 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-01-23T08:52:20.723 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-23T08:52:20.766 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ppp. 2024-01-23T08:52:20.794 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-01-23T08:52:21.009 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package tcl. 2024-01-23T08:52:21.037 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-01-23T08:52:21.080 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-01-23T08:52:21.090 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-01-23T08:52:21.378 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package wpasupplicant. 2024-01-23T08:52:21.396 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package pptp-linux. 2024-01-23T08:52:21.407 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-01-23T08:52:21.424 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-01-23T08:52:21.436 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-23T08:52:21.462 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-01-23T08:52:21.723 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package network-manager-pptp. 2024-01-23T08:52:21.751 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-01-23T08:52:21.790 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-01-23T08:52:21.799 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-01-23T08:52:21.828 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-01-23T08:52:21.865 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-01-23T08:52:22.093 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package postgresql-client-common. 2024-01-23T08:52:22.121 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-01-23T08:52:22.159 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking postgresql-client-common (238) ... 2024-01-23T08:52:22.268 INFO:teuthology.orchestra.run.smithi046.stdout:Selecting previously unselected package usb-modeswitch. 2024-01-23T08:52:22.297 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-01-23T08:52:22.343 INFO:teuthology.orchestra.run.smithi046.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-23T08:52:22.480 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package postgresql-client-14. 2024-01-23T08:52:22.496 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-23T08:52:22.529 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-23T08:52:22.641 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up postgresql-client-common (238) ... 2024-01-23T08:52:22.858 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up flex (2.6.4-8build2) ... 2024-01-23T08:52:22.984 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-23T08:52:23.109 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-23T08:52:23.118 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package postgresql-common. 2024-01-23T08:52:23.146 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-01-23T08:52:23.202 INFO:teuthology.orchestra.run.smithi175.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-01-23T08:52:23.232 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking postgresql-common (238) ... 2024-01-23T08:52:23.235 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-01-23T08:52:23.361 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-23T08:52:23.470 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-23T08:52:23.641 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package postgresql-14. 2024-01-23T08:52:23.669 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-23T08:52:23.703 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-23T08:52:23.994 INFO:teuthology.orchestra.run.smithi046.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-01-23T08:52:24.076 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-23T08:52:24.490 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-23T08:52:24.490 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-23T08:52:24.962 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-01-23T08:52:25.053 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package postgresql. 2024-01-23T08:52:25.082 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-01-23T08:52:25.088 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-23T08:52:25.120 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking postgresql (14+238) ... 2024-01-23T08:52:25.214 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-01-23T08:52:25.340 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-01-23T08:52:25.388 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package postgresql-client. 2024-01-23T08:52:25.405 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-01-23T08:52:25.441 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-01-23T08:52:25.455 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking postgresql-client (14+238) ... 2024-01-23T08:52:25.550 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-23T08:52:25.677 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-01-23T08:52:25.682 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package postgresql-contrib. 2024-01-23T08:52:25.698 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-01-23T08:52:25.740 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking postgresql-contrib (14+238) ... 2024-01-23T08:52:26.026 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package tcl8.6. 2024-01-23T08:52:26.055 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-01-23T08:52:26.093 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-23T08:52:26.332 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-23T08:52:26.379 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package tcl. 2024-01-23T08:52:26.407 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-01-23T08:52:26.433 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up dump (0.4b47-3) ... 2024-01-23T08:52:26.450 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-01-23T08:52:26.509 INFO:teuthology.orchestra.run.smithi046.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-01-23T08:52:26.598 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-23T08:52:26.806 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package wpasupplicant. 2024-01-23T08:52:26.810 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-23T08:52:26.835 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-01-23T08:52:26.873 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-23T08:52:26.936 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up tcl (8.6.11+1build2) ... 2024-01-23T08:52:27.062 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libjson-perl (4.04000-1) ... 2024-01-23T08:52:27.213 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-01-23T08:52:27.244 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-01-23T08:52:27.272 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-01-23T08:52:27.303 INFO:teuthology.orchestra.run.smithi046.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-01-23T08:52:27.310 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-01-23T08:52:27.373 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-23T08:52:27.491 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-23T08:52:27.633 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-23T08:52:27.688 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package usb-modeswitch. 2024-01-23T08:52:27.716 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-01-23T08:52:27.734 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-23T08:52:27.763 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-23T08:52:27.860 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-01-23T08:52:28.028 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up postgresql-client (14+238) ... 2024-01-23T08:52:28.033 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up postgresql-client-common (238) ... 2024-01-23T08:52:28.154 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-01-23T08:52:28.244 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up flex (2.6.4-8build2) ... 2024-01-23T08:52:28.370 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-23T08:52:28.496 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-23T08:52:28.622 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-01-23T08:52:28.638 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:28.638 INFO:teuthology.orchestra.run.smithi046.stdout:The following network interfaces were found in /etc/network/interfaces 2024-01-23T08:52:28.639 INFO:teuthology.orchestra.run.smithi046.stdout:which means they are currently configured by ifupdown: 2024-01-23T08:52:28.639 INFO:teuthology.orchestra.run.smithi046.stdout:- ens1f0 2024-01-23T08:52:28.639 INFO:teuthology.orchestra.run.smithi046.stdout:If you want to manage those interfaces with NetworkManager instead 2024-01-23T08:52:28.639 INFO:teuthology.orchestra.run.smithi046.stdout:remove their configuration from /etc/network/interfaces. 2024-01-23T08:52:28.639 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:28.739 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-23T08:52:28.780 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-01-23T08:52:28.840 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-23T08:52:29.078 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-01-23T08:52:29.320 INFO:teuthology.orchestra.run.smithi175.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-01-23T08:52:29.390 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-01-23T08:52:29.412 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-23T08:52:29.781 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-23T08:52:29.781 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-23T08:52:29.867 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-23T08:52:30.010 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-23T08:52:30.128 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-01-23T08:52:30.229 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up postgresql-common (238) ... 2024-01-23T08:52:30.307 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-01-23T08:52:30.516 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-23T08:52:30.659 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-01-23T08:52:30.785 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-01-23T08:52:30.911 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-01-23T08:52:31.039 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-23T08:52:31.162 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-01-23T08:52:31.306 INFO:teuthology.orchestra.run.smithi046.stdout:Adding user postgres to group ssl-cert 2024-01-23T08:52:31.552 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:31.553 INFO:teuthology.orchestra.run.smithi046.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-01-23T08:52:31.758 INFO:teuthology.orchestra.run.smithi046.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-01-23T08:52:31.758 INFO:teuthology.orchestra.run.smithi046.stdout:Removing obsolete dictionary files: 2024-01-23T08:52:31.784 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-23T08:52:31.910 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up dump (0.4b47-3) ... 2024-01-23T08:52:32.004 INFO:teuthology.orchestra.run.smithi175.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-01-23T08:52:32.087 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-01-23T08:52:32.213 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-23T08:52:32.302 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-01-23T08:52:32.339 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up tcl (8.6.11+1build2) ... 2024-01-23T08:52:32.465 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libjson-perl (4.04000-1) ... 2024-01-23T08:52:32.574 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-01-23T08:52:32.647 INFO:teuthology.orchestra.run.smithi175.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-01-23T08:52:32.705 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-23T08:52:32.708 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-23T08:52:32.835 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-23T08:52:33.011 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-23T08:52:33.037 INFO:teuthology.orchestra.run.smithi046.stdout:Creating new PostgreSQL cluster 14/main ... 2024-01-23T08:52:33.056 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-01-23T08:52:33.105 INFO:teuthology.orchestra.run.smithi046.stdout:The files belonging to this database system will be owned by user "postgres". 2024-01-23T08:52:33.105 INFO:teuthology.orchestra.run.smithi046.stdout:This user must also own the server process. 2024-01-23T08:52:33.105 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:33.105 INFO:teuthology.orchestra.run.smithi046.stdout:The database cluster will be initialized with locale "en_US". 2024-01-23T08:52:33.105 INFO:teuthology.orchestra.run.smithi046.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-01-23T08:52:33.105 INFO:teuthology.orchestra.run.smithi046.stdout:The default text search configuration will be set to "english". 2024-01-23T08:52:33.105 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:33.105 INFO:teuthology.orchestra.run.smithi046.stdout:Data page checksums are disabled. 2024-01-23T08:52:33.105 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:33.105 INFO:teuthology.orchestra.run.smithi046.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-01-23T08:52:33.106 INFO:teuthology.orchestra.run.smithi046.stdout:creating subdirectories ... ok 2024-01-23T08:52:33.106 INFO:teuthology.orchestra.run.smithi046.stdout:selecting dynamic shared memory implementation ... posix 2024-01-23T08:52:33.120 INFO:teuthology.orchestra.run.smithi046.stdout:selecting default max_connections ... 100 2024-01-23T08:52:33.137 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-23T08:52:33.143 INFO:teuthology.orchestra.run.smithi046.stdout:selecting default shared_buffers ... 128MB 2024-01-23T08:52:33.153 INFO:teuthology.orchestra.run.smithi046.stdout:selecting default time zone ... Etc/UTC 2024-01-23T08:52:33.153 INFO:teuthology.orchestra.run.smithi046.stdout:creating configuration files ... ok 2024-01-23T08:52:33.263 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-01-23T08:52:33.271 INFO:teuthology.orchestra.run.smithi046.stdout:running bootstrap script ... ok 2024-01-23T08:52:33.431 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up postgresql-client (14+238) ... 2024-01-23T08:52:33.557 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-01-23T08:52:33.950 INFO:teuthology.orchestra.run.smithi046.stdout:performing post-bootstrap initialization ... ok 2024-01-23T08:52:34.007 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:34.007 INFO:teuthology.orchestra.run.smithi175.stdout:The following network interfaces were found in /etc/network/interfaces 2024-01-23T08:52:34.007 INFO:teuthology.orchestra.run.smithi175.stdout:which means they are currently configured by ifupdown: 2024-01-23T08:52:34.007 INFO:teuthology.orchestra.run.smithi175.stdout:- enp3s0f1 2024-01-23T08:52:34.007 INFO:teuthology.orchestra.run.smithi175.stdout:If you want to manage those interfaces with NetworkManager instead 2024-01-23T08:52:34.007 INFO:teuthology.orchestra.run.smithi175.stdout:remove their configuration from /etc/network/interfaces. 2024-01-23T08:52:34.007 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:34.120 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-01-23T08:52:34.459 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-01-23T08:52:34.590 INFO:teuthology.orchestra.run.smithi046.stdout:syncing data to disk ... ok 2024-01-23T08:52:34.811 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-01-23T08:52:34.979 INFO:teuthology.orchestra.run.smithi046.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-01-23T08:52:35.318 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-23T08:52:35.469 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-23T08:52:35.595 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-01-23T08:52:35.771 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up postgresql-common (238) ... 2024-01-23T08:52:36.672 INFO:teuthology.orchestra.run.smithi175.stdout:Adding user postgres to group ssl-cert 2024-01-23T08:52:36.905 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:36.905 INFO:teuthology.orchestra.run.smithi175.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-01-23T08:52:37.109 INFO:teuthology.orchestra.run.smithi175.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-01-23T08:52:37.110 INFO:teuthology.orchestra.run.smithi175.stdout:Removing obsolete dictionary files: 2024-01-23T08:52:37.710 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-01-23T08:52:37.728 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-23T08:52:37.828 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up postgresql-contrib (14+238) ... 2024-01-23T08:52:37.929 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up postgresql (14+238) ... 2024-01-23T08:52:38.055 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-23T08:52:38.080 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-23T08:52:38.190 INFO:teuthology.orchestra.run.smithi046.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-23T08:52:38.388 INFO:teuthology.orchestra.run.smithi175.stdout:Creating new PostgreSQL cluster 14/main ... 2024-01-23T08:52:38.402 INFO:teuthology.orchestra.run.smithi175.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-01-23T08:52:38.443 INFO:teuthology.orchestra.run.smithi175.stdout:The files belonging to this database system will be owned by user "postgres". 2024-01-23T08:52:38.443 INFO:teuthology.orchestra.run.smithi175.stdout:This user must also own the server process. 2024-01-23T08:52:38.443 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:38.443 INFO:teuthology.orchestra.run.smithi175.stdout:The database cluster will be initialized with locale "en_US". 2024-01-23T08:52:38.443 INFO:teuthology.orchestra.run.smithi175.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-01-23T08:52:38.443 INFO:teuthology.orchestra.run.smithi175.stdout:The default text search configuration will be set to "english". 2024-01-23T08:52:38.443 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:38.443 INFO:teuthology.orchestra.run.smithi175.stdout:Data page checksums are disabled. 2024-01-23T08:52:38.443 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:38.443 INFO:teuthology.orchestra.run.smithi175.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-01-23T08:52:38.444 INFO:teuthology.orchestra.run.smithi175.stdout:creating subdirectories ... ok 2024-01-23T08:52:38.444 INFO:teuthology.orchestra.run.smithi175.stdout:selecting dynamic shared memory implementation ... posix 2024-01-23T08:52:38.448 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-01-23T08:52:38.448 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-01-23T08:52:38.456 INFO:teuthology.orchestra.run.smithi175.stdout:selecting default max_connections ... 100 2024-01-23T08:52:38.472 INFO:teuthology.orchestra.run.smithi175.stdout:selecting default shared_buffers ... 128MB 2024-01-23T08:52:38.481 INFO:teuthology.orchestra.run.smithi175.stdout:selecting default time zone ... Etc/UTC 2024-01-23T08:52:38.482 INFO:teuthology.orchestra.run.smithi175.stdout:creating configuration files ... ok 2024-01-23T08:52:38.596 INFO:teuthology.orchestra.run.smithi175.stdout:running bootstrap script ... ok 2024-01-23T08:52:38.967 INFO:teuthology.orchestra.run.smithi046.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-01-23T08:52:39.241 INFO:teuthology.orchestra.run.smithi175.stdout:performing post-bootstrap initialization ... ok 2024-01-23T08:52:39.261 INFO:teuthology.orchestra.run.smithi046.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-23T08:52:39.421 INFO:teuthology.orchestra.run.smithi046.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-23T08:52:39.809 INFO:teuthology.orchestra.run.smithi175.stdout:syncing data to disk ... ok 2024-01-23T08:52:40.217 INFO:teuthology.orchestra.run.smithi175.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-01-23T08:52:40.765 INFO:teuthology.orchestra.run.smithi046.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-01-23T08:52:40.865 INFO:teuthology.orchestra.run.smithi046.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-23T08:52:41.325 INFO:teuthology.orchestra.run.smithi046.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-23T08:52:41.331 DEBUG:teuthology.parallel:result is None 2024-01-23T08:52:42.995 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-23T08:52:43.121 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up postgresql-contrib (14+238) ... 2024-01-23T08:52:43.246 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up postgresql (14+238) ... 2024-01-23T08:52:43.372 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-23T08:52:43.498 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-01-23T08:52:43.734 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-01-23T08:52:43.734 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-01-23T08:52:44.301 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-01-23T08:52:44.603 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-23T08:52:44.754 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-23T08:52:46.099 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-01-23T08:52:46.198 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-23T08:52:46.690 INFO:teuthology.orchestra.run.smithi175.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-23T08:52:46.694 DEBUG:teuthology.parallel:result is None 2024-01-23T08:52:46.695 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0edf41a622739843d6b978b179ff3227b476dd9d 2024-01-23T08:52:46.936 DEBUG:teuthology.orchestra.run.smithi046:> dpkg-query -W -f '${Version}' ceph 2024-01-23T08:52:46.957 INFO:teuthology.orchestra.run.smithi046.stdout:19.0.0-766-g0edf41a6-1jammy 2024-01-23T08:52:46.958 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-766-g0edf41a6-1jammy 2024-01-23T08:52:46.958 INFO:teuthology.task.install:The correct ceph version 19.0.0-766-g0edf41a6-1jammy is installed. 2024-01-23T08:52:46.960 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0edf41a622739843d6b978b179ff3227b476dd9d 2024-01-23T08:52:47.108 DEBUG:teuthology.orchestra.run.smithi175:> dpkg-query -W -f '${Version}' ceph 2024-01-23T08:52:47.128 INFO:teuthology.orchestra.run.smithi175.stdout:19.0.0-766-g0edf41a6-1jammy 2024-01-23T08:52:47.128 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-766-g0edf41a6-1jammy 2024-01-23T08:52:47.128 INFO:teuthology.task.install:The correct ceph version 19.0.0-766-g0edf41a6-1jammy is installed. 2024-01-23T08:52:47.130 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-01-23T08:52:47.130 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:52:47.130 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-23T08:52:47.144 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-01-23T08:52:47.145 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-23T08:52:47.184 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-01-23T08:52:47.185 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:52:47.185 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/daemon-helper 2024-01-23T08:52:47.200 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-23T08:52:47.259 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-01-23T08:52:47.259 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/daemon-helper 2024-01-23T08:52:47.272 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-23T08:52:47.327 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-01-23T08:52:47.328 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:52:47.328 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-23T08:52:47.340 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-23T08:52:47.395 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-01-23T08:52:47.395 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-23T08:52:47.408 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-23T08:52:47.462 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-01-23T08:52:47.462 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:52:47.462 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/stdin-killer 2024-01-23T08:52:47.475 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-23T08:52:47.531 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-01-23T08:52:47.531 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/stdin-killer 2024-01-23T08:52:47.545 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-23T08:52:47.599 INFO:teuthology.run_tasks:Running task ceph... 2024-01-23T08:52:47.682 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-01-23T08:52:47.683 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 777 /var/log/ceph 2024-01-23T08:52:47.685 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 777 /var/log/ceph 2024-01-23T08:52:47.697 INFO:tasks.ceph:Disabling ceph logrotate... 2024-01-23T08:52:47.697 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-23T08:52:47.741 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-23T08:52:47.753 INFO:tasks.ceph:Creating extra log directories... 2024-01-23T08:52:47.753 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-23T08:52:47.796 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-23T08:52:47.815 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-01-23T08:52:47.815 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-01-23T08:52:47.815 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-01-23T08:52:47.816 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:52:47.816 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-23T08:52:47.856 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-23T08:52:47.931 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-01-23T08:52:47.932 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-23T08:52:47.938 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-23T08:52:48.017 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-01-23T08:52:48.017 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-01-23T08:52:48.017 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-01-22_19:46:51-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7527402', 'branch': 'wip-yuri8-testing-2024-01-18-0823', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7527402', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'cbodley-2024-01-22_19:46:51-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri8-testing-2024-01-18-0823'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d', 'valgrind': {'exit_on_first_error': False, 'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri8-testing-2024-01-18-0823-plus-55233', 'sha1': '9db6bac5568c8be6cfd98da20bd2b62582f0776f'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 6631, 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri8-testing-2024-01-18-0823-plus-55233', 'suite_path': '/home/teuthworker/src/github.com_cbodley_ceph_9db6bac5568c8be6cfd98da20bd2b62582f0776f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/cbodley/ceph.git', 'suite_sha1': '9db6bac5568c8be6cfd98da20bd2b62582f0776f', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi046.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOBg1hcnBuGx7jM7i325dTMohQb3/NxqEgH4TkiCDEurU1rMgwiIew0H5aqftIlUd8slseNALE2EVbg4l2VAyuw=', 'smithi175.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMs8YH4mKA99SvOyE1azd3KjV93HQxKIp4TgOO8kSIy+8wn9J4vdlCcOL9MZ5gC7XzKUJI7bOrtMI6hyrXJj/3c='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '0edf41a622739843d6b978b179ff3227b476dd9d', 'valgrind': {'exit_on_first_error': False, 'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'cd45576300487d997e5a85abed65500b9f5d143b', 'timestamp': '2024-01-22_19:46:51', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-01-23T08:52:48.017 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-23T08:52:48.020 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-23T08:52:48.060 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/run/ceph 2024-01-23T08:52:48.068 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/run/ceph 2024-01-23T08:52:48.117 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:52:48.117 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/scratch_devs of=/dev/stdout 2024-01-23T08:52:48.128 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-23T08:52:48.128 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_1 2024-01-23T08:52:48.175 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-23T08:52:48.176 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-23T08:52:48.176 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 884 Links: 1 2024-01-23T08:52:48.176 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-23T08:52:48.176 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-01-23 08:40:17.595283814 +0000 2024-01-23T08:52:48.176 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-01-23 08:40:17.355285958 +0000 2024-01-23T08:52:48.176 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-01-23 08:40:17.355285958 +0000 2024-01-23T08:52:48.176 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: - 2024-01-23T08:52:48.176 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-23T08:52:48.230 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-01-23T08:52:48.231 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-01-23T08:52:48.231 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000241843 s, 2.1 MB/s 2024-01-23T08:52:48.232 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-23T08:52:48.281 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_2 2024-01-23T08:52:48.327 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-23T08:52:48.327 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-23T08:52:48.328 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 901 Links: 1 2024-01-23T08:52:48.328 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-23T08:52:48.328 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-01-23 08:40:18.071279563 +0000 2024-01-23T08:52:48.328 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-01-23 08:40:17.827281741 +0000 2024-01-23T08:52:48.328 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-01-23 08:40:17.827281741 +0000 2024-01-23T08:52:48.328 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: - 2024-01-23T08:52:48.328 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-23T08:52:48.382 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-01-23T08:52:48.382 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-01-23T08:52:48.382 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000298675 s, 1.7 MB/s 2024-01-23T08:52:48.384 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-23T08:52:48.433 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_3 2024-01-23T08:52:48.479 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-23T08:52:48.480 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-23T08:52:48.480 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 921 Links: 1 2024-01-23T08:52:48.480 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-23T08:52:48.480 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-01-23 08:40:18.551275275 +0000 2024-01-23T08:52:48.480 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-01-23 08:40:18.291277598 +0000 2024-01-23T08:52:48.480 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-01-23 08:40:18.291277598 +0000 2024-01-23T08:52:48.480 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: - 2024-01-23T08:52:48.480 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-23T08:52:48.534 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-01-23T08:52:48.534 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-01-23T08:52:48.534 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000293118 s, 1.7 MB/s 2024-01-23T08:52:48.536 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-23T08:52:48.585 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_4 2024-01-23T08:52:48.631 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-23T08:52:48.632 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-23T08:52:48.632 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 931 Links: 1 2024-01-23T08:52:48.632 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-23T08:52:48.632 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-01-23 08:40:19.035270952 +0000 2024-01-23T08:52:48.632 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-01-23 08:40:18.767273345 +0000 2024-01-23T08:52:48.632 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-01-23 08:40:18.767273345 +0000 2024-01-23T08:52:48.632 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: - 2024-01-23T08:52:48.632 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-23T08:52:48.686 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-01-23T08:52:48.686 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-01-23T08:52:48.687 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000298411 s, 1.7 MB/s 2024-01-23T08:52:48.688 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-23T08:52:48.737 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-23T08:52:48.737 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-01-23T08:52:48.737 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/scratch_devs of=/dev/stdout 2024-01-23T08:52:48.743 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-23T08:52:48.743 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_1 2024-01-23T08:52:48.792 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-23T08:52:48.793 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-23T08:52:48.793 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-01-23T08:52:48.793 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-23T08:52:48.793 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-01-23 08:40:15.067412026 +0000 2024-01-23T08:52:48.793 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-01-23 08:40:14.787414526 +0000 2024-01-23T08:52:48.793 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-01-23 08:40:14.787414526 +0000 2024-01-23T08:52:48.793 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2024-01-23T08:52:48.793 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-23T08:52:48.846 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-01-23T08:52:48.846 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-01-23T08:52:48.847 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000461727 s, 1.1 MB/s 2024-01-23T08:52:48.848 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-23T08:52:48.897 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_2 2024-01-23T08:52:48.948 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-23T08:52:48.948 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-23T08:52:48.948 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 906 Links: 1 2024-01-23T08:52:48.948 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-23T08:52:48.948 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-01-23 08:40:15.547407737 +0000 2024-01-23T08:52:48.948 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-01-23 08:40:15.307409882 +0000 2024-01-23T08:52:48.948 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-01-23 08:40:15.307409882 +0000 2024-01-23T08:52:48.948 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2024-01-23T08:52:48.949 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-23T08:52:49.002 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-01-23T08:52:49.002 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-01-23T08:52:49.002 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.00041454 s, 1.2 MB/s 2024-01-23T08:52:49.003 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-23T08:52:49.057 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_3 2024-01-23T08:52:49.104 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-23T08:52:49.104 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-23T08:52:49.104 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 916 Links: 1 2024-01-23T08:52:49.104 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-23T08:52:49.104 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-01-23 08:40:15.791405559 +0000 2024-01-23T08:52:49.104 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-01-23 08:40:15.787405595 +0000 2024-01-23T08:52:49.104 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-01-23 08:40:15.787405595 +0000 2024-01-23T08:52:49.105 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2024-01-23T08:52:49.105 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-23T08:52:49.158 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-01-23T08:52:49.158 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-01-23T08:52:49.158 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.00041535 s, 1.2 MB/s 2024-01-23T08:52:49.159 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-23T08:52:49.209 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_4 2024-01-23T08:52:49.256 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-23T08:52:49.256 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-23T08:52:49.256 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 940 Links: 1 2024-01-23T08:52:49.256 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-23T08:52:49.256 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-01-23 08:40:16.579398520 +0000 2024-01-23T08:52:49.257 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-01-23 08:40:16.307400950 +0000 2024-01-23T08:52:49.257 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-01-23 08:40:16.307400950 +0000 2024-01-23T08:52:49.257 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2024-01-23T08:52:49.257 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-23T08:52:49.309 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-01-23T08:52:49.309 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-01-23T08:52:49.310 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000381804 s, 1.3 MB/s 2024-01-23T08:52:49.311 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-23T08:52:49.362 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-23T08:52:49.362 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi046.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-23T08:52:49.362 INFO:tasks.ceph:Generating config... 2024-01-23T08:52:49.363 INFO:tasks.ceph:[client] client mount timeout = 600 2024-01-23T08:52:49.363 INFO:tasks.ceph:[client] debug client = 20 2024-01-23T08:52:49.363 INFO:tasks.ceph:[client] debug ms = 1 2024-01-23T08:52:49.363 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-01-23T08:52:49.363 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-01-23T08:52:49.363 INFO:tasks.ceph:[global] mds beacon grace = 60 2024-01-23T08:52:49.363 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2024-01-23T08:52:49.363 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2024-01-23T08:52:49.364 INFO:tasks.ceph:[mds] debug mds = 20 2024-01-23T08:52:49.364 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-01-23T08:52:49.364 INFO:tasks.ceph:[mds] debug ms = 1 2024-01-23T08:52:49.364 INFO:tasks.ceph:[mds] mds debug frag = True 2024-01-23T08:52:49.364 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-01-23T08:52:49.364 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-01-23T08:52:49.364 INFO:tasks.ceph:[mds] mds valgrind exit = True 2024-01-23T08:52:49.364 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-01-23T08:52:49.364 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-01-23T08:52:49.364 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-01-23T08:52:49.364 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-01-23T08:52:49.364 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-01-23T08:52:49.365 INFO:tasks.ceph:[mgr] debug ms = 1 2024-01-23T08:52:49.365 INFO:tasks.ceph:[mon] debug mon = 20 2024-01-23T08:52:49.365 INFO:tasks.ceph:[mon] debug ms = 1 2024-01-23T08:52:49.365 INFO:tasks.ceph:[mon] debug paxos = 20 2024-01-23T08:52:49.365 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-01-23T08:52:49.365 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-01-23T08:52:49.365 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-01-23T08:52:49.365 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-01-23T08:52:49.365 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-01-23T08:52:49.365 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-01-23T08:52:49.365 INFO:tasks.ceph:[osd] debug ms = 1 2024-01-23T08:52:49.365 INFO:tasks.ceph:[osd] debug osd = 20 2024-01-23T08:52:49.365 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-01-23T08:52:49.365 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-01-23T08:52:49.365 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-01-23T08:52:49.366 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-01-23T08:52:49.366 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-01-23T08:52:49.366 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-01-23T08:52:49.366 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-01-23T08:52:49.366 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-01-23T08:52:49.366 INFO:tasks.ceph:Setting up mon.a... 2024-01-23T08:52:49.366 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-01-23T08:52:49.400 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.keyring 2024-01-23T08:52:49.412 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-01-23T08:52:49.488 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-23T08:52:49.548 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.46'), ('mon.b', '172.21.15.175'), ('mon.c', '[v2:172.21.15.175:3301,v1:172.21.15.175:6790]')] 2024-01-23T08:52:49.549 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.46,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-01-23T08:52:49.550 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:52:49.550 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-01-23T08:52:49.596 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.46 --add b 172.21.15.175 --addv c '[v2:172.21.15.175:3301,v1:172.21.15.175:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-01-23T08:52:49.682 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-01-23T08:52:49.682 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: generated fsid fdbdd393-f422-45ae-a488-2bbb0163e580 2024-01-23T08:52:49.682 INFO:teuthology.orchestra.run.smithi046.stdout:setting min_mon_release = quincy 2024-01-23T08:52:49.682 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 0 2024-01-23T08:52:49.682 INFO:teuthology.orchestra.run.smithi046.stdout:fsid fdbdd393-f422-45ae-a488-2bbb0163e580 2024-01-23T08:52:49.682 INFO:teuthology.orchestra.run.smithi046.stdout:last_changed 2024-01-23T08:52:49.687631+0000 2024-01-23T08:52:49.682 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-01-23T08:52:49.687631+0000 2024-01-23T08:52:49.682 INFO:teuthology.orchestra.run.smithi046.stdout:min_mon_release 17 (quincy) 2024-01-23T08:52:49.682 INFO:teuthology.orchestra.run.smithi046.stdout:election_strategy: 1 2024-01-23T08:52:49.682 INFO:teuthology.orchestra.run.smithi046.stdout:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-01-23T08:52:49.682 INFO:teuthology.orchestra.run.smithi046.stdout:1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.b 2024-01-23T08:52:49.683 INFO:teuthology.orchestra.run.smithi046.stdout:2: [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] mon.c 2024-01-23T08:52:49.683 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-01-23T08:52:49.684 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-01-23T08:52:49.732 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID fdbdd393-f422-45ae-a488-2bbb0163e580... 2024-01-23T08:52:49.732 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-23T08:52:49.776 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-23T08:52:49.808 INFO:teuthology.orchestra.run.smithi046.stdout:[global] 2024-01-23T08:52:49.808 INFO:teuthology.orchestra.run.smithi046.stdout: chdir = "" 2024-01-23T08:52:49.808 INFO:teuthology.orchestra.run.smithi046.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-23T08:52:49.808 INFO:teuthology.orchestra.run.smithi046.stdout: auth supported = cephx 2024-01-23T08:52:49.808 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:49.808 INFO:teuthology.orchestra.run.smithi046.stdout: filestore xattr use omap = true 2024-01-23T08:52:49.808 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:49.808 INFO:teuthology.orchestra.run.smithi046.stdout: mon clock drift allowed = 1.000 2024-01-23T08:52:49.808 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:49.808 INFO:teuthology.orchestra.run.smithi046.stdout: osd crush chooseleaf type = 0 2024-01-23T08:52:49.808 INFO:teuthology.orchestra.run.smithi046.stdout: auth debug = true 2024-01-23T08:52:49.809 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:49.809 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on old message = true 2024-01-23T08:52:49.809 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on bug = true 2024-01-23T08:52:49.809 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:49.809 INFO:teuthology.orchestra.run.smithi046.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-23T08:52:49.809 INFO:teuthology.orchestra.run.smithi046.stdout: mon pg warn max object skew = 0 2024-01-23T08:52:49.809 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:49.809 INFO:teuthology.orchestra.run.smithi046.stdout: # disable pg_autoscaler by default for new pools 2024-01-23T08:52:49.809 INFO:teuthology.orchestra.run.smithi046.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-23T08:52:49.810 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:49.810 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default size = 2 2024-01-23T08:52:49.810 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:49.810 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow primary affinity = true 2024-01-23T08:52:49.810 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow pg remap = true 2024-01-23T08:52:49.810 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on legacy crush tunables = false 2024-01-23T08:52:49.810 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on crush straw calc version zero = false 2024-01-23T08:52:49.811 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on no sortbitwise = false 2024-01-23T08:52:49.811 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on osd down out interval zero = false 2024-01-23T08:52:49.811 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on too few osds = false 2024-01-23T08:52:49.811 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-23T08:52:49.811 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-23T08:52:49.811 INFO:teuthology.orchestra.run.smithi046.stdout: mon_allow_pool_size_one = true 2024-01-23T08:52:49.811 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:49.811 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-23T08:52:49.811 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:49.811 INFO:teuthology.orchestra.run.smithi046.stdout: osd default data pool replay window = 5 2024-01-23T08:52:49.812 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:49.812 INFO:teuthology.orchestra.run.smithi046.stdout: mon allow pool delete = true 2024-01-23T08:52:49.812 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:49.812 INFO:teuthology.orchestra.run.smithi046.stdout: mon cluster log file level = debug 2024-01-23T08:52:49.812 INFO:teuthology.orchestra.run.smithi046.stdout: debug asserts on shutdown = true 2024-01-23T08:52:49.812 INFO:teuthology.orchestra.run.smithi046.stdout: mon health detail to clog = false 2024-01-23T08:52:49.812 INFO:teuthology.orchestra.run.smithi046.stdout: mon host = "172.21.15.46,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]" 2024-01-23T08:52:49.812 INFO:teuthology.orchestra.run.smithi046.stdout: mds beacon grace = 60 2024-01-23T08:52:49.812 INFO:teuthology.orchestra.run.smithi046.stdout: mds heartbeat grace = 60 2024-01-23T08:52:49.813 INFO:teuthology.orchestra.run.smithi046.stdout: osd heartbeat grace = 60 2024-01-23T08:52:49.813 INFO:teuthology.orchestra.run.smithi046.stdout: fsid = fdbdd393-f422-45ae-a488-2bbb0163e580 2024-01-23T08:52:49.813 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:49.813 INFO:teuthology.orchestra.run.smithi046.stdout:[osd] 2024-01-23T08:52:49.813 INFO:teuthology.orchestra.run.smithi046.stdout: osd journal size = 100 2024-01-23T08:52:49.813 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:49.814 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub load threshold = 5.0 2024-01-23T08:52:49.814 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub max interval = 600 2024-01-23T08:52:49.814 INFO:teuthology.orchestra.run.smithi046.stdout: osd mclock profile = high_recovery_ops 2024-01-23T08:52:49.814 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:49.814 INFO:teuthology.orchestra.run.smithi046.stdout: osd recover clone overlap = true 2024-01-23T08:52:49.814 INFO:teuthology.orchestra.run.smithi046.stdout: osd recovery max chunk = 1048576 2024-01-23T08:52:49.814 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:49.815 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug shutdown = true 2024-01-23T08:52:49.815 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug op order = true 2024-01-23T08:52:49.815 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug verify stray on activate = true 2024-01-23T08:52:49.815 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug trim objects = true 2024-01-23T08:52:49.815 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:49.815 INFO:teuthology.orchestra.run.smithi046.stdout: osd open classes on start = true 2024-01-23T08:52:49.816 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug pg log writeout = true 2024-01-23T08:52:49.816 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:49.816 INFO:teuthology.orchestra.run.smithi046.stdout: osd deep scrub update digest min age = 30 2024-01-23T08:52:49.816 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:49.816 INFO:teuthology.orchestra.run.smithi046.stdout: osd map max advance = 10 2024-01-23T08:52:49.816 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:49.817 INFO:teuthology.orchestra.run.smithi046.stdout: journal zero on create = true 2024-01-23T08:52:49.817 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:49.817 INFO:teuthology.orchestra.run.smithi046.stdout: filestore ondisk finisher threads = 3 2024-01-23T08:52:49.817 INFO:teuthology.orchestra.run.smithi046.stdout: filestore apply finisher threads = 3 2024-01-23T08:52:49.817 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:49.818 INFO:teuthology.orchestra.run.smithi046.stdout: bdev debug aio = true 2024-01-23T08:52:49.818 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug misdirected ops = true 2024-01-23T08:52:49.818 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore block size = 96636764160 2024-01-23T08:52:49.818 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore fsck on mount = True 2024-01-23T08:52:49.818 INFO:teuthology.orchestra.run.smithi046.stdout: debug bluefs = 20 2024-01-23T08:52:49.818 INFO:teuthology.orchestra.run.smithi046.stdout: debug bluestore = 20 2024-01-23T08:52:49.818 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-01-23T08:52:49.818 INFO:teuthology.orchestra.run.smithi046.stdout: debug osd = 20 2024-01-23T08:52:49.818 INFO:teuthology.orchestra.run.smithi046.stdout: debug rocksdb = 10 2024-01-23T08:52:49.818 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd backfillfull_ratio = 0.85 2024-01-23T08:52:49.818 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd full ratio = 0.9 2024-01-23T08:52:49.818 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd nearfull ratio = 0.8 2024-01-23T08:52:49.818 INFO:teuthology.orchestra.run.smithi046.stdout: osd failsafe full ratio = 0.95 2024-01-23T08:52:49.818 INFO:teuthology.orchestra.run.smithi046.stdout: osd fast shutdown = False 2024-01-23T08:52:49.819 INFO:teuthology.orchestra.run.smithi046.stdout: osd objectstore = bluestore 2024-01-23T08:52:49.819 INFO:teuthology.orchestra.run.smithi046.stdout: osd op complaint time = 180 2024-01-23T08:52:49.819 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:49.819 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr] 2024-01-23T08:52:49.819 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-01-23T08:52:49.819 INFO:teuthology.orchestra.run.smithi046.stdout: debug mgr = 20 2024-01-23T08:52:49.819 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2024-01-23T08:52:49.819 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2024-01-23T08:52:49.819 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2024-01-23T08:52:49.819 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2024-01-23T08:52:49.819 INFO:teuthology.orchestra.run.smithi046.stdout: mgr/telemetry/nag = false 2024-01-23T08:52:49.819 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:49.819 INFO:teuthology.orchestra.run.smithi046.stdout:[mon] 2024-01-23T08:52:49.819 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-01-23T08:52:49.819 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2024-01-23T08:52:49.820 INFO:teuthology.orchestra.run.smithi046.stdout: debug paxos = 20 2024-01-23T08:52:49.820 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2024-01-23T08:52:49.820 INFO:teuthology.orchestra.run.smithi046.stdout: mon data avail warn = 5 2024-01-23T08:52:49.820 INFO:teuthology.orchestra.run.smithi046.stdout: mon mgr mkfs grace = 240 2024-01-23T08:52:49.820 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2024-01-23T08:52:49.820 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd reporter subtree level = osd 2024-01-23T08:52:49.820 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd prime pg temp = true 2024-01-23T08:52:49.820 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2024-01-23T08:52:49.820 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:49.820 INFO:teuthology.orchestra.run.smithi046.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-23T08:52:49.820 INFO:teuthology.orchestra.run.smithi046.stdout: auth mon ticket ttl = 660 # 11m 2024-01-23T08:52:49.820 INFO:teuthology.orchestra.run.smithi046.stdout: auth service ticket ttl = 240 # 4m 2024-01-23T08:52:49.820 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:49.820 INFO:teuthology.orchestra.run.smithi046.stdout: # don't complain about insecure global_id in the test suite 2024-01-23T08:52:49.821 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-23T08:52:49.821 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-23T08:52:49.821 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:49.821 INFO:teuthology.orchestra.run.smithi046.stdout: # 1m isn't quite enough 2024-01-23T08:52:49.821 INFO:teuthology.orchestra.run.smithi046.stdout: mon_down_mkfs_grace = 2m 2024-01-23T08:52:49.821 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:49.821 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_filestore_osds = false 2024-01-23T08:52:49.821 INFO:teuthology.orchestra.run.smithi046.stdout: mon op complaint time = 120 2024-01-23T08:52:49.821 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd crush smoke test = False 2024-01-23T08:52:49.821 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:52:49.821 INFO:teuthology.orchestra.run.smithi046.stdout:[client] 2024-01-23T08:52:49.821 INFO:teuthology.orchestra.run.smithi046.stdout: rgw cache enabled = true 2024-01-23T08:52:49.821 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable ops log = true 2024-01-23T08:52:49.821 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable usage log = true 2024-01-23T08:52:49.821 INFO:teuthology.orchestra.run.smithi046.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-23T08:52:49.822 INFO:teuthology.orchestra.run.smithi046.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-23T08:52:49.822 INFO:teuthology.orchestra.run.smithi046.stdout: client mount timeout = 600 2024-01-23T08:52:49.822 INFO:teuthology.orchestra.run.smithi046.stdout: debug client = 20 2024-01-23T08:52:49.822 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-01-23T08:52:49.822 INFO:teuthology.orchestra.run.smithi046.stdout: rados mon op timeout = 900 2024-01-23T08:52:49.822 INFO:teuthology.orchestra.run.smithi046.stdout: rados osd op timeout = 900 2024-01-23T08:52:49.822 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.a] 2024-01-23T08:52:49.822 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.b] 2024-01-23T08:52:49.822 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.c] 2024-01-23T08:52:49.822 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.a] 2024-01-23T08:52:49.822 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.c] 2024-01-23T08:52:49.822 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.e] 2024-01-23T08:52:49.822 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.b] 2024-01-23T08:52:49.822 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.d] 2024-01-23T08:52:49.823 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.f] 2024-01-23T08:52:49.823 INFO:teuthology.orchestra.run.smithi046.stdout:[mds] 2024-01-23T08:52:49.823 INFO:teuthology.orchestra.run.smithi046.stdout: debug mds = 20 2024-01-23T08:52:49.823 INFO:teuthology.orchestra.run.smithi046.stdout: debug mds balancer = 20 2024-01-23T08:52:49.823 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-01-23T08:52:49.823 INFO:teuthology.orchestra.run.smithi046.stdout: mds debug frag = True 2024-01-23T08:52:49.823 INFO:teuthology.orchestra.run.smithi046.stdout: mds debug scatterstat = True 2024-01-23T08:52:49.823 INFO:teuthology.orchestra.run.smithi046.stdout: mds op complaint time = 180 2024-01-23T08:52:49.823 INFO:teuthology.orchestra.run.smithi046.stdout: mds valgrind exit = True 2024-01-23T08:52:49.823 INFO:teuthology.orchestra.run.smithi046.stdout: mds verify scatter = True 2024-01-23T08:52:49.823 INFO:teuthology.orchestra.run.smithi046.stdout: osd op complaint time = 180 2024-01-23T08:52:49.823 INFO:teuthology.orchestra.run.smithi046.stdout: rados mon op timeout = 900 2024-01-23T08:52:49.823 INFO:teuthology.orchestra.run.smithi046.stdout: rados osd op timeout = 900 2024-01-23T08:52:49.825 INFO:teuthology.orchestra.run.smithi175.stdout:[global] 2024-01-23T08:52:49.825 INFO:teuthology.orchestra.run.smithi175.stdout: chdir = "" 2024-01-23T08:52:49.825 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-23T08:52:49.825 INFO:teuthology.orchestra.run.smithi175.stdout: auth supported = cephx 2024-01-23T08:52:49.825 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:49.825 INFO:teuthology.orchestra.run.smithi175.stdout: filestore xattr use omap = true 2024-01-23T08:52:49.825 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:49.825 INFO:teuthology.orchestra.run.smithi175.stdout: mon clock drift allowed = 1.000 2024-01-23T08:52:49.826 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:49.826 INFO:teuthology.orchestra.run.smithi175.stdout: osd crush chooseleaf type = 0 2024-01-23T08:52:49.826 INFO:teuthology.orchestra.run.smithi175.stdout: auth debug = true 2024-01-23T08:52:49.826 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:49.826 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on old message = true 2024-01-23T08:52:49.826 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on bug = true 2024-01-23T08:52:49.826 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:49.826 INFO:teuthology.orchestra.run.smithi175.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-23T08:52:49.826 INFO:teuthology.orchestra.run.smithi175.stdout: mon pg warn max object skew = 0 2024-01-23T08:52:49.826 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:49.826 INFO:teuthology.orchestra.run.smithi175.stdout: # disable pg_autoscaler by default for new pools 2024-01-23T08:52:49.826 INFO:teuthology.orchestra.run.smithi175.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-23T08:52:49.826 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:49.826 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default size = 2 2024-01-23T08:52:49.827 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:49.827 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow primary affinity = true 2024-01-23T08:52:49.827 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow pg remap = true 2024-01-23T08:52:49.827 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on legacy crush tunables = false 2024-01-23T08:52:49.827 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on crush straw calc version zero = false 2024-01-23T08:52:49.827 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on no sortbitwise = false 2024-01-23T08:52:49.827 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on osd down out interval zero = false 2024-01-23T08:52:49.827 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on too few osds = false 2024-01-23T08:52:49.827 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-23T08:52:49.827 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-23T08:52:49.827 INFO:teuthology.orchestra.run.smithi175.stdout: mon_allow_pool_size_one = true 2024-01-23T08:52:49.827 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:49.827 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-23T08:52:49.827 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:49.827 INFO:teuthology.orchestra.run.smithi175.stdout: osd default data pool replay window = 5 2024-01-23T08:52:49.828 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:49.828 INFO:teuthology.orchestra.run.smithi175.stdout: mon allow pool delete = true 2024-01-23T08:52:49.828 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:49.828 INFO:teuthology.orchestra.run.smithi175.stdout: mon cluster log file level = debug 2024-01-23T08:52:49.828 INFO:teuthology.orchestra.run.smithi175.stdout: debug asserts on shutdown = true 2024-01-23T08:52:49.828 INFO:teuthology.orchestra.run.smithi175.stdout: mon health detail to clog = false 2024-01-23T08:52:49.828 INFO:teuthology.orchestra.run.smithi175.stdout: mon host = "172.21.15.46,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]" 2024-01-23T08:52:49.828 INFO:teuthology.orchestra.run.smithi175.stdout: mds beacon grace = 60 2024-01-23T08:52:49.828 INFO:teuthology.orchestra.run.smithi175.stdout: mds heartbeat grace = 60 2024-01-23T08:52:49.828 INFO:teuthology.orchestra.run.smithi175.stdout: osd heartbeat grace = 60 2024-01-23T08:52:49.828 INFO:teuthology.orchestra.run.smithi175.stdout: fsid = fdbdd393-f422-45ae-a488-2bbb0163e580 2024-01-23T08:52:49.828 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:49.828 INFO:teuthology.orchestra.run.smithi175.stdout:[osd] 2024-01-23T08:52:49.828 INFO:teuthology.orchestra.run.smithi175.stdout: osd journal size = 100 2024-01-23T08:52:49.829 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:49.829 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub load threshold = 5.0 2024-01-23T08:52:49.829 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub max interval = 600 2024-01-23T08:52:49.829 INFO:teuthology.orchestra.run.smithi175.stdout: osd mclock profile = high_recovery_ops 2024-01-23T08:52:49.829 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:49.829 INFO:teuthology.orchestra.run.smithi175.stdout: osd recover clone overlap = true 2024-01-23T08:52:49.829 INFO:teuthology.orchestra.run.smithi175.stdout: osd recovery max chunk = 1048576 2024-01-23T08:52:49.829 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:49.829 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug shutdown = true 2024-01-23T08:52:49.829 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug op order = true 2024-01-23T08:52:49.829 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug verify stray on activate = true 2024-01-23T08:52:49.829 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug trim objects = true 2024-01-23T08:52:49.829 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:49.829 INFO:teuthology.orchestra.run.smithi175.stdout: osd open classes on start = true 2024-01-23T08:52:49.829 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug pg log writeout = true 2024-01-23T08:52:49.830 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:49.830 INFO:teuthology.orchestra.run.smithi175.stdout: osd deep scrub update digest min age = 30 2024-01-23T08:52:49.830 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:49.830 INFO:teuthology.orchestra.run.smithi175.stdout: osd map max advance = 10 2024-01-23T08:52:49.830 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:49.830 INFO:teuthology.orchestra.run.smithi175.stdout: journal zero on create = true 2024-01-23T08:52:49.830 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:49.830 INFO:teuthology.orchestra.run.smithi175.stdout: filestore ondisk finisher threads = 3 2024-01-23T08:52:49.830 INFO:teuthology.orchestra.run.smithi175.stdout: filestore apply finisher threads = 3 2024-01-23T08:52:49.830 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:49.830 INFO:teuthology.orchestra.run.smithi175.stdout: bdev debug aio = true 2024-01-23T08:52:49.830 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug misdirected ops = true 2024-01-23T08:52:49.830 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore block size = 96636764160 2024-01-23T08:52:49.830 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore fsck on mount = True 2024-01-23T08:52:49.831 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluefs = 20 2024-01-23T08:52:49.831 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluestore = 20 2024-01-23T08:52:49.831 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-01-23T08:52:49.831 INFO:teuthology.orchestra.run.smithi175.stdout: debug osd = 20 2024-01-23T08:52:49.831 INFO:teuthology.orchestra.run.smithi175.stdout: debug rocksdb = 10 2024-01-23T08:52:49.831 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd backfillfull_ratio = 0.85 2024-01-23T08:52:49.831 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd full ratio = 0.9 2024-01-23T08:52:49.831 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd nearfull ratio = 0.8 2024-01-23T08:52:49.831 INFO:teuthology.orchestra.run.smithi175.stdout: osd failsafe full ratio = 0.95 2024-01-23T08:52:49.831 INFO:teuthology.orchestra.run.smithi175.stdout: osd fast shutdown = False 2024-01-23T08:52:49.831 INFO:teuthology.orchestra.run.smithi175.stdout: osd objectstore = bluestore 2024-01-23T08:52:49.831 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2024-01-23T08:52:49.831 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:49.831 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr] 2024-01-23T08:52:49.831 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-01-23T08:52:49.831 INFO:teuthology.orchestra.run.smithi175.stdout: debug mgr = 20 2024-01-23T08:52:49.832 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-01-23T08:52:49.832 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-01-23T08:52:49.832 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-01-23T08:52:49.832 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-01-23T08:52:49.832 INFO:teuthology.orchestra.run.smithi175.stdout: mgr/telemetry/nag = false 2024-01-23T08:52:49.832 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:49.832 INFO:teuthology.orchestra.run.smithi175.stdout:[mon] 2024-01-23T08:52:49.832 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-01-23T08:52:49.832 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-01-23T08:52:49.832 INFO:teuthology.orchestra.run.smithi175.stdout: debug paxos = 20 2024-01-23T08:52:49.832 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-01-23T08:52:49.832 INFO:teuthology.orchestra.run.smithi175.stdout: mon data avail warn = 5 2024-01-23T08:52:49.832 INFO:teuthology.orchestra.run.smithi175.stdout: mon mgr mkfs grace = 240 2024-01-23T08:52:49.832 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-01-23T08:52:49.833 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd reporter subtree level = osd 2024-01-23T08:52:49.833 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd prime pg temp = true 2024-01-23T08:52:49.833 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-01-23T08:52:49.833 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:49.833 INFO:teuthology.orchestra.run.smithi175.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-23T08:52:49.833 INFO:teuthology.orchestra.run.smithi175.stdout: auth mon ticket ttl = 660 # 11m 2024-01-23T08:52:49.833 INFO:teuthology.orchestra.run.smithi175.stdout: auth service ticket ttl = 240 # 4m 2024-01-23T08:52:49.833 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:49.833 INFO:teuthology.orchestra.run.smithi175.stdout: # don't complain about insecure global_id in the test suite 2024-01-23T08:52:49.833 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-23T08:52:49.833 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-23T08:52:49.833 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:49.833 INFO:teuthology.orchestra.run.smithi175.stdout: # 1m isn't quite enough 2024-01-23T08:52:49.833 INFO:teuthology.orchestra.run.smithi175.stdout: mon_down_mkfs_grace = 2m 2024-01-23T08:52:49.834 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:49.834 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_filestore_osds = false 2024-01-23T08:52:49.834 INFO:teuthology.orchestra.run.smithi175.stdout: mon op complaint time = 120 2024-01-23T08:52:49.834 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd crush smoke test = False 2024-01-23T08:52:49.834 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-23T08:52:49.834 INFO:teuthology.orchestra.run.smithi175.stdout:[client] 2024-01-23T08:52:49.834 INFO:teuthology.orchestra.run.smithi175.stdout: rgw cache enabled = true 2024-01-23T08:52:49.834 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable ops log = true 2024-01-23T08:52:49.834 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable usage log = true 2024-01-23T08:52:49.834 INFO:teuthology.orchestra.run.smithi175.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-23T08:52:49.834 INFO:teuthology.orchestra.run.smithi175.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-23T08:52:49.835 INFO:teuthology.orchestra.run.smithi175.stdout: client mount timeout = 600 2024-01-23T08:52:49.835 INFO:teuthology.orchestra.run.smithi175.stdout: debug client = 20 2024-01-23T08:52:49.835 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-01-23T08:52:49.835 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2024-01-23T08:52:49.835 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2024-01-23T08:52:49.835 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.a] 2024-01-23T08:52:49.835 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.b] 2024-01-23T08:52:49.835 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.c] 2024-01-23T08:52:49.835 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2024-01-23T08:52:49.835 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.c] 2024-01-23T08:52:49.835 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.e] 2024-01-23T08:52:49.835 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2024-01-23T08:52:49.835 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.d] 2024-01-23T08:52:49.835 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.f] 2024-01-23T08:52:49.836 INFO:teuthology.orchestra.run.smithi175.stdout:[mds] 2024-01-23T08:52:49.836 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds = 20 2024-01-23T08:52:49.836 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds balancer = 20 2024-01-23T08:52:49.836 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-01-23T08:52:49.836 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug frag = True 2024-01-23T08:52:49.836 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug scatterstat = True 2024-01-23T08:52:49.836 INFO:teuthology.orchestra.run.smithi175.stdout: mds op complaint time = 180 2024-01-23T08:52:49.836 INFO:teuthology.orchestra.run.smithi175.stdout: mds valgrind exit = True 2024-01-23T08:52:49.836 INFO:teuthology.orchestra.run.smithi175.stdout: mds verify scatter = True 2024-01-23T08:52:49.836 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2024-01-23T08:52:49.836 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2024-01-23T08:52:49.836 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2024-01-23T08:52:49.836 INFO:tasks.ceph:Creating admin key on mon.a... 2024-01-23T08:52:49.837 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-01-23T08:52:49.916 INFO:tasks.ceph:Copying monmap to all nodes... 2024-01-23T08:52:49.916 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:52:49.916 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-01-23T08:52:49.921 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:52:49.922 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-01-23T08:52:49.968 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi046.front.sepia.ceph.com 2024-01-23T08:52:49.969 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:52:49.969 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-23T08:52:49.969 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-23T08:52:50.034 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:52:50.034 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-23T08:52:50.080 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi175.front.sepia.ceph.com 2024-01-23T08:52:50.080 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-01-23T08:52:50.080 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-23T08:52:50.080 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-23T08:52:50.100 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-01-23T08:52:50.100 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-23T08:52:50.148 INFO:tasks.ceph:Setting up mon nodes... 2024-01-23T08:52:50.148 INFO:tasks.ceph:Setting up mgr nodes... 2024-01-23T08:52:50.148 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-01-23T08:52:50.193 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-01-23T08:52:50.196 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-01-23T08:52:50.238 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-01-23T08:52:50.249 INFO:tasks.ceph:Setting up mds nodes... 2024-01-23T08:52:50.249 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-01-23T08:52:50.290 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-01-23T08:52:50.292 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-01-23T08:52:50.351 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-01-23T08:52:50.438 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-01-23T08:52:50.441 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-01-23T08:52:50.494 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-01-23T08:52:50.581 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-01-23T08:52:50.584 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-01-23T08:52:50.640 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-01-23T08:52:50.684 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-01-23T08:52:50.687 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-01-23T08:52:50.743 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-01-23T08:52:50.826 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-01-23T08:52:50.828 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-01-23T08:52:50.884 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-01-23T08:52:50.968 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-01-23T08:52:50.971 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-01-23T08:52:51.027 INFO:tasks.ceph_client:Setting up client nodes... 2024-01-23T08:52:51.027 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-01-23T08:52:51.066 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-01-23T08:52:51.078 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-01-23T08:52:51.078 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi046.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-23T08:52:51.078 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-01-23T08:52:51.131 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-23T08:52:51.131 INFO:tasks.ceph:role: osd.0 2024-01-23T08:52:51.132 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi046.front.sepia.ceph.com 2024-01-23T08:52:51.132 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-23T08:52:51.186 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-23T08:52:51.186 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-23T08:52:51.186 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-23T08:52:51.186 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-23T08:52:51.186 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-23T08:52:51.186 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-01-23T08:52:51.186 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-23T08:52:51.186 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-23T08:52:51.186 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-23T08:52:51.186 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-23T08:52:51.210 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-01-23T08:52:51.211 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-01-23T08:52:51.211 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-01-23T08:52:51.275 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-01-23T08:52:51.332 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-23T08:52:51.333 INFO:teuthology.orchestra.run.smithi046.stderr:sudo: /sbin/restorecon: command not found 2024-01-23T08:52:51.333 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-01-23T08:52:51.387 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-23T08:52:51.388 INFO:tasks.ceph:role: osd.1 2024-01-23T08:52:51.388 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi046.front.sepia.ceph.com 2024-01-23T08:52:51.388 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-23T08:52:51.443 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-23T08:52:51.444 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-23T08:52:51.444 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-23T08:52:51.444 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-23T08:52:51.444 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-23T08:52:51.444 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-01-23T08:52:51.444 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-23T08:52:51.444 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-23T08:52:51.444 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-23T08:52:51.444 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-23T08:52:51.467 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-01-23T08:52:51.469 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-01-23T08:52:51.469 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-01-23T08:52:51.525 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-01-23T08:52:51.580 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-23T08:52:51.580 INFO:teuthology.orchestra.run.smithi046.stderr:sudo: /sbin/restorecon: command not found 2024-01-23T08:52:51.581 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-01-23T08:52:51.634 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-23T08:52:51.634 INFO:tasks.ceph:role: osd.2 2024-01-23T08:52:51.634 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi046.front.sepia.ceph.com 2024-01-23T08:52:51.634 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-23T08:52:51.687 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-23T08:52:51.687 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-23T08:52:51.687 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-23T08:52:51.687 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-23T08:52:51.687 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-23T08:52:51.687 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-01-23T08:52:51.687 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-23T08:52:51.687 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-23T08:52:51.687 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-23T08:52:51.687 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-23T08:52:51.712 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-01-23T08:52:51.714 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-01-23T08:52:51.714 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-01-23T08:52:51.772 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-01-23T08:52:51.824 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-23T08:52:51.824 INFO:teuthology.orchestra.run.smithi046.stderr:sudo: /sbin/restorecon: command not found 2024-01-23T08:52:51.824 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-01-23T08:52:51.878 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-23T08:52:51.878 INFO:tasks.ceph:role: osd.3 2024-01-23T08:52:51.878 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi046.front.sepia.ceph.com 2024-01-23T08:52:51.878 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-23T08:52:51.931 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-23T08:52:51.931 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-23T08:52:51.932 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-23T08:52:51.932 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-23T08:52:51.932 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-23T08:52:51.932 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-01-23T08:52:51.932 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-23T08:52:51.932 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-23T08:52:51.932 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-23T08:52:51.932 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-23T08:52:51.955 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-01-23T08:52:51.957 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-01-23T08:52:51.957 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-01-23T08:52:52.014 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-01-23T08:52:52.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-23T08:52:52.068 INFO:teuthology.orchestra.run.smithi046.stderr:sudo: /sbin/restorecon: command not found 2024-01-23T08:52:52.069 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-23T08:52:52.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:52:52.217+0000 7fbd5897a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-01-23T08:52:52.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:52:52.217+0000 7fbd5897a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-01-23T08:52:52.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:52:52.217+0000 7fbd5897a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-23T08:52:52.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:52:52.217+0000 7fbd5897a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-23T08:52:52.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:52:52.217+0000 7fbd5897a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-23T08:52:52.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:52:52.221+0000 7fbd5897a640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-01-23T08:52:55.202 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-01-23T08:52:55.216 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-23T08:52:55.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:52:55.297+0000 7f0444885640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-01-23T08:52:55.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:52:55.297+0000 7f0444885640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-01-23T08:52:55.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:52:55.297+0000 7f0444885640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-23T08:52:55.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:52:55.297+0000 7f0444885640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-23T08:52:55.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:52:55.297+0000 7f0444885640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-23T08:52:55.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:52:55.301+0000 7f0444885640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-01-23T08:52:58.268 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-01-23T08:52:58.325 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-23T08:52:58.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:52:58.405+0000 7f89029aa640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-01-23T08:52:58.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:52:58.405+0000 7f89029aa640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-01-23T08:52:58.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:52:58.405+0000 7f89029aa640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-23T08:52:58.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:52:58.405+0000 7f89029aa640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-23T08:52:58.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:52:58.405+0000 7f89029aa640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-23T08:52:58.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:52:58.409+0000 7f89029aa640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-01-23T08:53:01.371 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-01-23T08:53:01.428 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-23T08:53:01.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:01.513+0000 7f35c4270640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-01-23T08:53:01.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:01.513+0000 7f35c4270640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-01-23T08:53:01.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:01.513+0000 7f35c4270640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-23T08:53:01.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:01.513+0000 7f35c4270640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-23T08:53:01.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:01.513+0000 7f35c4270640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-23T08:53:01.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:01.513+0000 7f35c4270640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-01-23T08:53:04.494 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-01-23T08:53:04.548 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-01-23T08:53:04.562 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-23T08:53:04.562 INFO:tasks.ceph:role: osd.4 2024-01-23T08:53:04.563 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com 2024-01-23T08:53:04.563 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-23T08:53:04.624 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-23T08:53:04.624 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-23T08:53:04.624 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-23T08:53:04.624 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-23T08:53:04.624 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-23T08:53:04.624 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-01-23T08:53:04.624 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-23T08:53:04.624 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-23T08:53:04.624 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-23T08:53:04.624 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-23T08:53:05.074 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-01-23T08:53:05.076 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-01-23T08:53:05.077 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-01-23T08:53:05.182 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-01-23T08:53:05.194 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-23T08:53:05.194 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: /sbin/restorecon: command not found 2024-01-23T08:53:05.195 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-01-23T08:53:05.247 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-23T08:53:05.247 INFO:tasks.ceph:role: osd.5 2024-01-23T08:53:05.247 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi175.front.sepia.ceph.com 2024-01-23T08:53:05.247 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-23T08:53:05.311 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-23T08:53:05.311 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-23T08:53:05.311 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-23T08:53:05.311 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-23T08:53:05.311 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-23T08:53:05.312 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-01-23T08:53:05.312 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-23T08:53:05.312 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-23T08:53:05.312 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-23T08:53:05.312 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-23T08:53:05.777 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-01-23T08:53:05.779 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-01-23T08:53:05.780 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-01-23T08:53:05.932 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-01-23T08:53:05.943 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-23T08:53:05.943 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: /sbin/restorecon: command not found 2024-01-23T08:53:05.944 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-01-23T08:53:06.000 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-23T08:53:06.000 INFO:tasks.ceph:role: osd.6 2024-01-23T08:53:06.000 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi175.front.sepia.ceph.com 2024-01-23T08:53:06.000 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-23T08:53:06.063 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-23T08:53:06.063 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-23T08:53:06.063 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-23T08:53:06.063 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-23T08:53:06.063 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-23T08:53:06.063 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-01-23T08:53:06.063 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-23T08:53:06.063 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-23T08:53:06.064 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-23T08:53:06.064 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-23T08:53:06.549 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-01-23T08:53:06.551 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-01-23T08:53:06.551 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-01-23T08:53:06.710 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-01-23T08:53:06.721 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-23T08:53:06.721 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: /sbin/restorecon: command not found 2024-01-23T08:53:06.722 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-01-23T08:53:06.775 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-23T08:53:06.775 INFO:tasks.ceph:role: osd.7 2024-01-23T08:53:06.775 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi175.front.sepia.ceph.com 2024-01-23T08:53:06.775 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-23T08:53:06.839 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-23T08:53:06.839 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-23T08:53:06.840 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-23T08:53:06.840 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-23T08:53:06.840 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-23T08:53:06.840 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-01-23T08:53:06.840 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-23T08:53:06.840 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-23T08:53:06.840 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-23T08:53:06.840 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-23T08:53:07.278 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-01-23T08:53:07.280 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-01-23T08:53:07.280 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-01-23T08:53:07.383 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-01-23T08:53:07.393 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-23T08:53:07.393 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: /sbin/restorecon: command not found 2024-01-23T08:53:07.393 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-23T08:53:07.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:07.510+0000 7f6d7bdda640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-01-23T08:53:07.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:07.510+0000 7f6d7bdda640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-01-23T08:53:07.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:07.510+0000 7f6d7bdda640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-23T08:53:07.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:07.510+0000 7f6d7bdda640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-23T08:53:07.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:07.510+0000 7f6d7bdda640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-23T08:53:07.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:07.514+0000 7f6d7bdda640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-01-23T08:53:10.472 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-01-23T08:53:10.486 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-23T08:53:10.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:10.570+0000 7fda60bc7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-01-23T08:53:10.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:10.570+0000 7fda60bc7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-01-23T08:53:10.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:10.570+0000 7fda60bc7640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-23T08:53:10.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:10.570+0000 7fda60bc7640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-23T08:53:10.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:10.570+0000 7fda60bc7640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-23T08:53:10.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:10.570+0000 7fda60bc7640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-01-23T08:53:13.531 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-01-23T08:53:13.588 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-23T08:53:13.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:13.674+0000 7fab1ed35640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-01-23T08:53:13.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:13.674+0000 7fab1ed35640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-01-23T08:53:13.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:13.674+0000 7fab1ed35640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-23T08:53:13.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:13.674+0000 7fab1ed35640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-23T08:53:13.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:13.674+0000 7fab1ed35640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-23T08:53:13.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:13.674+0000 7fab1ed35640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-01-23T08:53:16.647 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-01-23T08:53:16.704 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-23T08:53:16.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:16.794+0000 7fefa864d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-01-23T08:53:16.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:16.798+0000 7fefa864d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-01-23T08:53:16.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:16.798+0000 7fefa864d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-23T08:53:16.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:16.798+0000 7fefa864d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-23T08:53:16.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:16.798+0000 7fefa864d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-23T08:53:16.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:16.798+0000 7fefa864d640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-01-23T08:53:18.019 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T08:53:18.022 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T08:53:19.786 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-01-23T08:53:19.799 INFO:tasks.ceph:Reading keys from all nodes... 2024-01-23T08:53:19.799 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:53:19.800 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-01-23T08:53:19.813 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:53:19.813 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-01-23T08:53:19.867 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:53:19.867 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-01-23T08:53:19.924 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:53:19.924 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-01-23T08:53:19.983 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:53:19.983 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-01-23T08:53:20.039 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:53:20.040 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-01-23T08:53:20.095 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:53:20.095 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-01-23T08:53:20.155 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:53:20.155 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-01-23T08:53:20.215 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-01-23T08:53:20.215 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-01-23T08:53:20.229 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-01-23T08:53:20.229 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-01-23T08:53:20.284 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-01-23T08:53:20.284 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-01-23T08:53:20.339 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-01-23T08:53:20.339 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-01-23T08:53:20.394 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-01-23T08:53:20.395 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-01-23T08:53:20.448 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-01-23T08:53:20.449 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-01-23T08:53:20.502 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-01-23T08:53:20.502 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-01-23T08:53:20.554 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-01-23T08:53:20.554 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-01-23T08:53:20.606 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:53:20.606 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-01-23T08:53:20.612 INFO:tasks.ceph:Adding keys to all mons... 2024-01-23T08:53:20.612 DEBUG:teuthology.orchestra.run.smithi046:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-23T08:53:20.656 DEBUG:teuthology.orchestra.run.smithi175:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-23T08:53:20.666 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr.y] 2024-01-23T08:53:20.666 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBifq9lYbPhCxAAuMu60lmUBEpu3t0xgfYETg== 2024-01-23T08:53:20.666 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.a] 2024-01-23T08:53:20.666 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBifq9lmD2iERAAqbT4Y0X6v6K5v5NI9+OprA== 2024-01-23T08:53:20.666 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.c] 2024-01-23T08:53:20.666 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBifq9ltY2BGhAAvVIUlxAhEd7OmR7rVXsy5g== 2024-01-23T08:53:20.666 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.e] 2024-01-23T08:53:20.666 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBifq9l5RX/IhAAWx9k2rZwzS3wC+wIiNtmGg== 2024-01-23T08:53:20.667 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.0] 2024-01-23T08:53:20.667 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBkfq9laxdeDRAAqiR1YDHKW1YH4QTsxE8qhw== 2024-01-23T08:53:20.667 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.1] 2024-01-23T08:53:20.667 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBnfq9lTF8lEhAAktXl7Yd/XgEKGWxhYyUOYA== 2024-01-23T08:53:20.667 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.2] 2024-01-23T08:53:20.667 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBqfq9lAPyWGBAASkHBRoNS/d9Crg+JKpsqKg== 2024-01-23T08:53:20.667 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.3] 2024-01-23T08:53:20.667 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBtfq9lH53jHhAAXgHumxTKftkThep6x0Iwqw== 2024-01-23T08:53:20.667 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr.x] 2024-01-23T08:53:20.667 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBifq9lUWWnDhAA1sapgX8bF9Uzd7K8iHkFRg== 2024-01-23T08:53:20.667 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.b] 2024-01-23T08:53:20.667 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBifq9lI51BKRAAq4jD7msWaktKrwzN5IQobw== 2024-01-23T08:53:20.667 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.d] 2024-01-23T08:53:20.668 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBifq9lDFarMRAAMZ8oh/DW8L/jQs269XTg6g== 2024-01-23T08:53:20.668 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.f] 2024-01-23T08:53:20.668 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBifq9lBtMrOhAApBpJXkeNmsUVwuyTJa6+5Q== 2024-01-23T08:53:20.668 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.4] 2024-01-23T08:53:20.668 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBzfq9lpRl3HhAABfDNAeZAxRd5CBBvjjLmnw== 2024-01-23T08:53:20.668 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.5] 2024-01-23T08:53:20.668 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQB2fq9l+CkiIhAA0BceUyVuWZWNn4priOhgBg== 2024-01-23T08:53:20.668 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.6] 2024-01-23T08:53:20.668 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQB5fq9lUU9VKBAAmknqKbR0TEv2cFwMLY66/w== 2024-01-23T08:53:20.668 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.7] 2024-01-23T08:53:20.668 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQB8fq9lbjmWLxAA/f3dR3inUKYurnpORSlefQ== 2024-01-23T08:53:20.668 INFO:teuthology.orchestra.run.smithi046.stdout:[client.0] 2024-01-23T08:53:20.668 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBjfq9lme5OBBAAJlt6BzE8Gh9druM2CIeAbQ== 2024-01-23T08:53:20.670 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr.y] 2024-01-23T08:53:20.670 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBifq9lYbPhCxAAuMu60lmUBEpu3t0xgfYETg== 2024-01-23T08:53:20.670 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2024-01-23T08:53:20.670 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBifq9lmD2iERAAqbT4Y0X6v6K5v5NI9+OprA== 2024-01-23T08:53:20.670 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.c] 2024-01-23T08:53:20.670 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBifq9ltY2BGhAAvVIUlxAhEd7OmR7rVXsy5g== 2024-01-23T08:53:20.670 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.e] 2024-01-23T08:53:20.670 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBifq9l5RX/IhAAWx9k2rZwzS3wC+wIiNtmGg== 2024-01-23T08:53:20.670 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.0] 2024-01-23T08:53:20.671 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBkfq9laxdeDRAAqiR1YDHKW1YH4QTsxE8qhw== 2024-01-23T08:53:20.671 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.1] 2024-01-23T08:53:20.671 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBnfq9lTF8lEhAAktXl7Yd/XgEKGWxhYyUOYA== 2024-01-23T08:53:20.671 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.2] 2024-01-23T08:53:20.671 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBqfq9lAPyWGBAASkHBRoNS/d9Crg+JKpsqKg== 2024-01-23T08:53:20.671 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.3] 2024-01-23T08:53:20.671 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBtfq9lH53jHhAAXgHumxTKftkThep6x0Iwqw== 2024-01-23T08:53:20.671 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr.x] 2024-01-23T08:53:20.671 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBifq9lUWWnDhAA1sapgX8bF9Uzd7K8iHkFRg== 2024-01-23T08:53:20.671 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2024-01-23T08:53:20.671 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBifq9lI51BKRAAq4jD7msWaktKrwzN5IQobw== 2024-01-23T08:53:20.671 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.d] 2024-01-23T08:53:20.671 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBifq9lDFarMRAAMZ8oh/DW8L/jQs269XTg6g== 2024-01-23T08:53:20.671 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.f] 2024-01-23T08:53:20.671 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBifq9lBtMrOhAApBpJXkeNmsUVwuyTJa6+5Q== 2024-01-23T08:53:20.672 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.4] 2024-01-23T08:53:20.672 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBzfq9lpRl3HhAABfDNAeZAxRd5CBBvjjLmnw== 2024-01-23T08:53:20.672 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.5] 2024-01-23T08:53:20.672 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQB2fq9l+CkiIhAA0BceUyVuWZWNn4priOhgBg== 2024-01-23T08:53:20.672 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.6] 2024-01-23T08:53:20.672 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQB5fq9lUU9VKBAAmknqKbR0TEv2cFwMLY66/w== 2024-01-23T08:53:20.672 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.7] 2024-01-23T08:53:20.672 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQB8fq9lbjmWLxAA/f3dR3inUKYurnpORSlefQ== 2024-01-23T08:53:20.672 INFO:teuthology.orchestra.run.smithi175.stdout:[client.0] 2024-01-23T08:53:20.672 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBjfq9lme5OBBAAJlt6BzE8Gh9druM2CIeAbQ== 2024-01-23T08:53:20.672 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-23T08:53:20.712 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-23T08:53:20.758 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-23T08:53:20.800 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-23T08:53:20.850 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-23T08:53:20.852 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-23T08:53:20.930 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-23T08:53:20.940 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-23T08:53:21.018 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T08:53:21.028 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T08:53:21.101 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T08:53:21.104 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T08:53:21.188 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T08:53:21.192 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T08:53:21.235 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T08:53:21.238 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T08:53:21.314 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-23T08:53:21.324 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-23T08:53:21.394 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-23T08:53:21.412 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-23T08:53:21.477 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-23T08:53:21.479 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-23T08:53:21.560 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-23T08:53:21.564 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-23T08:53:21.647 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T08:53:21.649 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T08:53:21.732 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T08:53:21.735 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T08:53:21.818 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T08:53:21.820 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T08:53:21.900 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T08:53:21.904 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T08:53:21.982 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-23T08:53:21.988 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-23T08:53:22.069 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-01-23T08:53:22.070 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-01-23T08:53:22.086 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-23T08:53:22.176 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-01-23T08:53:22.187 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-01-23T08:53:22.201 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-23T08:53:22.295 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-01-23T08:53:22.306 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-01-23T08:53:22.357 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-23T08:53:22.449 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-01-23T08:53:22.459 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-23T08:53:22.461 DEBUG:teuthology.orchestra.run.smithi175:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-23T08:53:22.507 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-01-23T08:53:22.507 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-01-23T08:53:22.507 INFO:tasks.ceph.mon.a:Restarting daemon 2024-01-23T08:53:22.508 DEBUG:teuthology.orchestra.run.smithi046:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2024-01-23T08:53:22.510 INFO:tasks.ceph.mon.a:Started 2024-01-23T08:53:22.510 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-01-23T08:53:22.510 INFO:tasks.ceph.mon.b:Restarting daemon 2024-01-23T08:53:22.510 DEBUG:teuthology.orchestra.run.smithi175:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2024-01-23T08:53:22.553 INFO:tasks.ceph.mon.b:Started 2024-01-23T08:53:22.553 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-01-23T08:53:22.553 INFO:tasks.ceph.mon.c:Restarting daemon 2024-01-23T08:53:22.553 DEBUG:teuthology.orchestra.run.smithi175:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2024-01-23T08:53:22.555 INFO:tasks.ceph.mon.c:Started 2024-01-23T08:53:22.555 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-01-23T08:53:22.556 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-01-23T08:53:22.556 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2024-01-23T08:53:22.558 INFO:tasks.ceph.mgr.y:Started 2024-01-23T08:53:22.558 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-01-23T08:53:22.559 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2024-01-23T08:53:22.561 INFO:tasks.ceph.mgr.x:Started 2024-01-23T08:53:22.561 INFO:tasks.ceph:Setting crush tunables to default 2024-01-23T08:53:22.561 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd crush tunables default 2024-01-23T08:53:22.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:22.685+0000 7f25505bd640 1 Processor -- start 2024-01-23T08:53:22.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:22.685+0000 7f25505bd640 1 -- start start 2024-01-23T08:53:22.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:22.685+0000 7f25505bd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f254806feb0 0x7f2548159a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:22.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:22.685+0000 7f25505bd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f25480c65a0 0x7f25480c18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:22.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:22.685+0000 7f25505bd640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25480c0e90 con 0x7f2548070290 2024-01-23T08:53:22.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:22.685+0000 7f25505bd640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2548156d20 con 0x7f25480c65a0 2024-01-23T08:53:22.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:22.685+0000 7f25505bd640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2548156fc0 con 0x7f254806feb0 2024-01-23T08:53:22.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:22.685+0000 7f254db58640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7f2548070290 legacy=0x7f2548156490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-01-23T08:53:22.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:22.685+0000 7f254eb5a640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7f25480c65a0 msgr2=0x7f25480c18e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.46:3300/0 2024-01-23T08:53:22.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:22.685+0000 7f254eb5a640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f25480c65a0 0x7f25480c18e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-23T08:53:22.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:22.685+0000 7f254e359640 1 -- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f254806feb0 msgr2=0x7f2548159a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3301/0 2024-01-23T08:53:22.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:22.685+0000 7f254e359640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f254806feb0 0x7f2548159a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-23T08:53:22.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:22.889+0000 7f254eb5a640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7f25480c65a0 msgr2=0x7f25480c18e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.46:3300/0 2024-01-23T08:53:22.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:22.889+0000 7f254db58640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7f2548070290 legacy=0x7f2548156490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-01-23T08:53:22.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:22.889+0000 7f254eb5a640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f25480c65a0 0x7f25480c18e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-23T08:53:22.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:22.889+0000 7f254e359640 1 -- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f254806feb0 msgr2=0x7f2548159a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3301/0 2024-01-23T08:53:22.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:22.889+0000 7f254e359640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f254806feb0 0x7f2548159a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-23T08:53:23.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:23.293+0000 7f254eb5a640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7f25480c65a0 msgr2=0x7f25480c18e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.46:3300/0 2024-01-23T08:53:23.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:23.293+0000 7f254eb5a640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f25480c65a0 0x7f25480c18e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-23T08:53:23.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:23.293+0000 7f254db58640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7f2548070290 legacy=0x7f2548156490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-01-23T08:53:23.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:23.293+0000 7f254e359640 1 -- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f254806feb0 msgr2=0x7f2548159a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3301/0 2024-01-23T08:53:23.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:23.293+0000 7f254e359640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f254806feb0 0x7f2548159a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-23T08:53:24.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:24.097+0000 7f254eb5a640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7f25480c65a0 msgr2=0x7f25480c18e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.46:3300/0 2024-01-23T08:53:24.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:24.097+0000 7f254eb5a640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f25480c65a0 0x7f25480c18e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-23T08:53:24.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:24.097+0000 7f254db58640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7f2548070290 legacy=0x7f2548156490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-01-23T08:53:24.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:24.097+0000 7f254e359640 1 -- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f254806feb0 msgr2=0x7f2548159a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3301/0 2024-01-23T08:53:24.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:24.097+0000 7f254e359640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f254806feb0 0x7f2548159a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-23T08:53:25.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:25.685+0000 7f253ffff640 1 -- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f254806feb0 msgr2=0x7f2548159a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-23T08:53:25.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:25.685+0000 7f253ffff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f254806feb0 0x7f2548159a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:25.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:25.685+0000 7f253ffff640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7f25480c65a0 msgr2=0x7f25480c18e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-23T08:53:25.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:25.685+0000 7f253ffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f25480c65a0 0x7f25480c18e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:25.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:25.685+0000 7f253ffff640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7f2548070290 legacy=0x7f2548156490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-23T08:53:25.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:25.685+0000 7f253ffff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f252c0058e0 0x7f252c007d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:25.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:25.685+0000 7f253ffff640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2548157280 con 0x7f252c0083b0 2024-01-23T08:53:25.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:25.689+0000 7f253ffff640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2548156d20 con 0x7f252c0058e0 2024-01-23T08:53:25.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:25.689+0000 7f254e359640 1 -- >> v2:172.21.15.175:3300/0 conn(0x7f252c0058e0 msgr2=0x7f252c007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3300/0 2024-01-23T08:53:25.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:25.689+0000 7f254db58640 1 -- >> v1:172.21.15.175:6789/0 conn(0x7f252c0083b0 legacy=0x7f252c00a870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.175:6789/0 2024-01-23T08:53:25.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:25.689+0000 7f254e359640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f252c0058e0 0x7f252c007d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-23T08:53:25.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:25.893+0000 7f254e359640 1 -- >> v2:172.21.15.175:3300/0 conn(0x7f252c0058e0 msgr2=0x7f252c007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3300/0 2024-01-23T08:53:25.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:25.893+0000 7f254db58640 1 -- >> v1:172.21.15.175:6789/0 conn(0x7f252c0083b0 legacy=0x7f252c00a870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.175:6789/0 2024-01-23T08:53:25.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:25.893+0000 7f254e359640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f252c0058e0 0x7f252c007d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-23T08:53:26.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:26.297+0000 7f254e359640 1 -- >> v2:172.21.15.175:3300/0 conn(0x7f252c0058e0 msgr2=0x7f252c007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3300/0 2024-01-23T08:53:26.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:26.297+0000 7f254db58640 1 -- >> v1:172.21.15.175:6789/0 conn(0x7f252c0083b0 legacy=0x7f252c00a870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.175:6789/0 2024-01-23T08:53:26.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:26.297+0000 7f254e359640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f252c0058e0 0x7f252c007d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-23T08:53:27.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:27.101+0000 7f254db58640 1 -- >> v1:172.21.15.175:6789/0 conn(0x7f252c0083b0 legacy=0x7f252c00a870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.175:6789/0 2024-01-23T08:53:27.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:27.101+0000 7f254e359640 1 -- >> v2:172.21.15.175:3300/0 conn(0x7f252c0058e0 msgr2=0x7f252c007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3300/0 2024-01-23T08:53:27.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:27.101+0000 7f254e359640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f252c0058e0 0x7f252c007d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-23T08:53:28.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:28.689+0000 7f253ffff640 1 -- >> v2:172.21.15.175:3300/0 conn(0x7f252c0058e0 msgr2=0x7f252c007d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-23T08:53:28.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:28.689+0000 7f253ffff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f252c0058e0 0x7f252c007d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:28.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:28.689+0000 7f253ffff640 1 -- >> v1:172.21.15.175:6789/0 conn(0x7f252c0083b0 legacy=0x7f252c00a870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-23T08:53:28.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:28.689+0000 7f254eb5a640 1 -- reap_dead start 2024-01-23T08:53:28.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:28.689+0000 7f253ffff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f252c00c100 0x7f252c007d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:28.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:28.689+0000 7f253ffff640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25480c0e90 con 0x7f252c00a8e0 2024-01-23T08:53:28.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:28.689+0000 7f253ffff640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2548157280 con 0x7f252c00c580 2024-01-23T08:53:28.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:28.689+0000 7f253ffff640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2548156d20 con 0x7f252c00c100 2024-01-23T08:53:28.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:28.689+0000 7f254eb5a640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7f252c00a8e0 legacy=0x7f252c00f290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-01-23T08:53:28.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:28.689+0000 7f254e359640 1 -- >> v2:172.21.15.175:3300/0 conn(0x7f252c00c100 msgr2=0x7f252c007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3300/0 2024-01-23T08:53:28.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:28.689+0000 7f254e359640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f252c00c100 0x7f252c007d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-23T08:53:28.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:28.689+0000 7f254db58640 1 -- >> v1:172.21.15.175:6789/0 conn(0x7f252c00c580 legacy=0x7f252c00ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.175:6789/0 2024-01-23T08:53:28.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:28.893+0000 7f254eb5a640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7f252c00a8e0 legacy=0x7f252c00f290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-01-23T08:53:28.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:28.893+0000 7f254e359640 1 -- >> v2:172.21.15.175:3300/0 conn(0x7f252c00c100 msgr2=0x7f252c007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3300/0 2024-01-23T08:53:28.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:28.893+0000 7f254db58640 1 -- >> v1:172.21.15.175:6789/0 conn(0x7f252c00c580 legacy=0x7f252c00ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.175:6789/0 2024-01-23T08:53:28.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:28.893+0000 7f254e359640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f252c00c100 0x7f252c007d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-23T08:53:29.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:29.297+0000 7f254eb5a640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7f252c00a8e0 legacy=0x7f252c00f290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-01-23T08:53:29.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:29.297+0000 7f254e359640 1 -- >> v2:172.21.15.175:3300/0 conn(0x7f252c00c100 msgr2=0x7f252c007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3300/0 2024-01-23T08:53:29.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:29.297+0000 7f254db58640 1 -- >> v1:172.21.15.175:6789/0 conn(0x7f252c00c580 legacy=0x7f252c00ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.175:6789/0 2024-01-23T08:53:29.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:29.297+0000 7f254e359640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f252c00c100 0x7f252c007d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-23T08:53:30.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:30.101+0000 7f254eb5a640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7f252c00a8e0 legacy=0x7f252c00f290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-01-23T08:53:30.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:30.101+0000 7f254db58640 1 -- >> v1:172.21.15.175:6789/0 conn(0x7f252c00c580 legacy=0x7f252c00ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.175:6789/0 2024-01-23T08:53:30.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:30.101+0000 7f254e359640 1 -- >> v2:172.21.15.175:3300/0 conn(0x7f252c00c100 msgr2=0x7f252c007d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3300/0 2024-01-23T08:53:30.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:30.101+0000 7f254e359640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f252c00c100 0x7f252c007d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-23T08:53:30.826 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:00:08.115 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T08:53:30.835 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:00:08.124 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T08:53:31.153 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:00:08.442 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T08:53:31.162 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:00:08.451 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T08:53:31.181 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:00:08.532 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T08:53:31.525 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:00:08.876 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T08:53:31.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:31.689+0000 7f253ffff640 1 -- >> v2:172.21.15.175:3300/0 conn(0x7f252c00c100 msgr2=0x7f252c007d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-23T08:53:31.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:31.689+0000 7f253ffff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f252c00c100 0x7f252c007d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:31.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:31.689+0000 7f253ffff640 1 -- >> v1:172.21.15.175:6789/0 conn(0x7f252c00c580 legacy=0x7f252c00ca10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-23T08:53:31.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:31.689+0000 7f253ffff640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7f252c00a8e0 legacy=0x7f252c00f290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-23T08:53:31.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:31.689+0000 7f253ffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 0x7f252c010e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:31.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:31.689+0000 7f253ffff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c011370 0x7f252c011a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:31.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:31.689+0000 7f253ffff640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2548156d20 con 0x7f252c010a20 2024-01-23T08:53:31.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:31.689+0000 7f253ffff640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2548156fc0 con 0x7f252c011370 2024-01-23T08:53:31.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:31.689+0000 7f254e359640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 msgr2=0x7f252c010e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.46:3300/0 2024-01-23T08:53:31.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:31.689+0000 7f254e359640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 0x7f252c010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-23T08:53:31.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:31.689+0000 7f254db58640 1 -- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c011370 msgr2=0x7f252c011a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3301/0 2024-01-23T08:53:31.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:31.689+0000 7f254db58640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c011370 0x7f252c011a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-23T08:53:31.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:31.893+0000 7f254e359640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 msgr2=0x7f252c010e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.46:3300/0 2024-01-23T08:53:31.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:31.893+0000 7f254e359640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 0x7f252c010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-23T08:53:31.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:31.893+0000 7f254db58640 1 -- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c011370 msgr2=0x7f252c011a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3301/0 2024-01-23T08:53:31.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:31.893+0000 7f254db58640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c011370 0x7f252c011a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-23T08:53:32.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:32.296+0000 7f254e359640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 msgr2=0x7f252c010e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.46:3300/0 2024-01-23T08:53:32.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:32.296+0000 7f254e359640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 0x7f252c010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-23T08:53:32.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:32.296+0000 7f254db58640 1 -- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c011370 msgr2=0x7f252c011a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3301/0 2024-01-23T08:53:32.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:32.296+0000 7f254db58640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c011370 0x7f252c011a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-23T08:53:33.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:33.132+0000 7f254db58640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c011370 0x7f252c011a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:33.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:33.152+0000 7f254e359640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 0x7f252c010e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:33.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:33.152+0000 7f254e359640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 0x7f252c010e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58486/0 (socket says 172.21.15.46:58486) 2024-01-23T08:53:33.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:33.152+0000 7f254e359640 1 -- 172.21.15.46:0/3127091442 learned_addr learned my addr 172.21.15.46:0/3127091442 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:53:33.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:33.176+0000 7f254e359640 1 -- 172.21.15.46:0/3127091442 >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 msgr2=0x7f252c010e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-23T08:53:33.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:33.176+0000 7f254e359640 1 -- 172.21.15.46:0/3127091442 >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 msgr2=0x7f252c010e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T08:53:33.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:33.176+0000 7f254e359640 1 --2- 172.21.15.46:0/3127091442 >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 0x7f252c010e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T08:53:33.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:33.176+0000 7f254e359640 1 --2- 172.21.15.46:0/3127091442 >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 0x7f252c010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-23T08:53:33.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:33.228+0000 7f254db58640 1 -- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c011370 msgr2=0x7f252c011a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-23T08:53:33.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:33.228+0000 7f254db58640 1 -- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c011370 msgr2=0x7f252c011a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T08:53:33.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:33.228+0000 7f254db58640 1 --2- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c011370 0x7f252c011a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T08:53:33.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:33.228+0000 7f254db58640 1 --2- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c011370 0x7f252c011a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-23T08:53:34.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:34.688+0000 7f253ffff640 1 -- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c011370 msgr2=0x7f252c011a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-23T08:53:34.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:34.688+0000 7f253ffff640 1 --2- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c011370 0x7f252c011a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:34.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:34.688+0000 7f253ffff640 1 -- 172.21.15.46:0/3127091442 >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 msgr2=0x7f252c010e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-23T08:53:34.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:34.688+0000 7f253ffff640 1 --2- 172.21.15.46:0/3127091442 >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 0x7f252c010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:34.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:34.688+0000 7f253ffff640 1 --2- 172.21.15.46:0/3127091442 >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 0x7f252c010e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:34.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:34.688+0000 7f254eb5a640 1 -- 172.21.15.46:0/3127091442 reap_dead start 2024-01-23T08:53:34.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:34.688+0000 7f253ffff640 1 --2- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c00c0e0 0x7f252c007d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:34.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:34.688+0000 7f253ffff640 1 -- 172.21.15.46:0/3127091442 --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f252c003480 con 0x7f252c00a8e0 2024-01-23T08:53:34.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:34.688+0000 7f253ffff640 1 -- 172.21.15.46:0/3127091442 --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2548156d20 con 0x7f252c010a20 2024-01-23T08:53:34.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:34.688+0000 7f253ffff640 1 -- 172.21.15.46:0/3127091442 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2548156fc0 con 0x7f252c00c0e0 2024-01-23T08:53:34.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:34.688+0000 7f254eb5a640 1 --2- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c00c0e0 0x7f252c007d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:34.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:34.692+0000 7f254eb5a640 1 -- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c00c0e0 msgr2=0x7f252c007d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-01-23T08:53:34.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:34.692+0000 7f254eb5a640 1 -- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c00c0e0 msgr2=0x7f252c007d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T08:53:34.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:34.692+0000 7f254eb5a640 1 --2- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c00c0e0 0x7f252c007d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T08:53:34.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:34.692+0000 7f254eb5a640 1 --2- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c00c0e0 0x7f252c007d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-23T08:53:34.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:34.896+0000 7f254eb5a640 1 --2- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c00c0e0 0x7f252c007d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:34.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:34.900+0000 7f254eb5a640 1 -- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c00c0e0 msgr2=0x7f252c007d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-01-23T08:53:34.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:34.900+0000 7f254eb5a640 1 -- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c00c0e0 msgr2=0x7f252c007d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T08:53:34.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:34.900+0000 7f254eb5a640 1 --2- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c00c0e0 0x7f252c007d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T08:53:34.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:34.900+0000 7f254eb5a640 1 --2- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c00c0e0 0x7f252c007d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-23T08:53:34.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:34.916+0000 7f254e359640 1 --2- 172.21.15.46:0/3127091442 >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 0x7f252c010e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:34.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:34.928+0000 7f254e359640 1 -- 172.21.15.46:0/3127091442 >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 msgr2=0x7f252c010e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-23T08:53:34.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:34.928+0000 7f254e359640 1 -- 172.21.15.46:0/3127091442 >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 msgr2=0x7f252c010e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T08:53:34.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:34.928+0000 7f254e359640 1 --2- 172.21.15.46:0/3127091442 >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 0x7f252c010e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T08:53:34.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:34.928+0000 7f254e359640 1 --2- 172.21.15.46:0/3127091442 >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 0x7f252c010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-23T08:53:35.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:35.304+0000 7f254eb5a640 1 --2- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c00c0e0 0x7f252c007d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:35.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:35.308+0000 7f254eb5a640 1 -- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c00c0e0 msgr2=0x7f252c007d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-01-23T08:53:35.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:35.308+0000 7f254eb5a640 1 -- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c00c0e0 msgr2=0x7f252c007d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T08:53:35.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:35.308+0000 7f254eb5a640 1 --2- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c00c0e0 0x7f252c007d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T08:53:35.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:35.308+0000 7f254eb5a640 1 --2- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c00c0e0 0x7f252c007d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-23T08:53:36.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:36.012+0000 7f254e359640 1 --2- 172.21.15.46:0/3127091442 >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 0x7f252c010e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:36.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:36.016+0000 7f254e359640 1 -- 172.21.15.46:0/3127091442 >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 msgr2=0x7f252c010e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-23T08:53:36.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:36.016+0000 7f254e359640 1 -- 172.21.15.46:0/3127091442 >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 msgr2=0x7f252c010e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T08:53:36.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:36.016+0000 7f254e359640 1 --2- 172.21.15.46:0/3127091442 >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 0x7f252c010e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T08:53:36.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:36.016+0000 7f254e359640 1 --2- 172.21.15.46:0/3127091442 >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 0x7f252c010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-23T08:53:36.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:36.144+0000 7f254eb5a640 1 --2- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c00c0e0 0x7f252c007d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:36.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:36.152+0000 7f254eb5a640 1 -- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c00c0e0 msgr2=0x7f252c007d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-23T08:53:36.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:36.152+0000 7f254eb5a640 1 -- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c00c0e0 msgr2=0x7f252c007d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T08:53:36.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:36.152+0000 7f254eb5a640 1 --2- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c00c0e0 0x7f252c007d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T08:53:36.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:36.152+0000 7f254eb5a640 1 --2- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c00c0e0 0x7f252c007d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-23T08:53:36.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:36.488+0000 7f254e359640 1 --2- 172.21.15.46:0/3127091442 >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 0x7f252c010e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:36.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:36.524+0000 7f254e359640 1 -- 172.21.15.46:0/3127091442 >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 msgr2=0x7f252c010e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-23T08:53:36.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:36.524+0000 7f254e359640 1 -- 172.21.15.46:0/3127091442 >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 msgr2=0x7f252c010e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T08:53:36.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:36.524+0000 7f254e359640 1 --2- 172.21.15.46:0/3127091442 >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 0x7f252c010e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T08:53:36.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:36.524+0000 7f254e359640 1 --2- 172.21.15.46:0/3127091442 >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 0x7f252c010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-23T08:53:37.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:37.492+0000 7f254e359640 1 --2- 172.21.15.46:0/3127091442 >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 0x7f252c010e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:37.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:37.620+0000 7f254e359640 1 -- 172.21.15.46:0/3127091442 >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 msgr2=0x7f252c010e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-23T08:53:37.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:37.620+0000 7f254e359640 1 -- 172.21.15.46:0/3127091442 >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 msgr2=0x7f252c010e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T08:53:37.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:37.620+0000 7f254e359640 1 --2- 172.21.15.46:0/3127091442 >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 0x7f252c010e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T08:53:37.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:37.620+0000 7f254e359640 1 --2- 172.21.15.46:0/3127091442 >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 0x7f252c010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-23T08:53:37.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:37.692+0000 7f253ffff640 1 -- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c00c0e0 msgr2=0x7f252c007d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-23T08:53:37.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:37.692+0000 7f253ffff640 1 --2- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f252c00c0e0 0x7f252c007d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:37.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:37.692+0000 7f253ffff640 1 -- 172.21.15.46:0/3127091442 >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 msgr2=0x7f252c010e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-23T08:53:37.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:37.692+0000 7f253ffff640 1 --2- 172.21.15.46:0/3127091442 >> v2:172.21.15.46:3300/0 conn(0x7f252c010a20 0x7f252c010e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:37.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:37.692+0000 7f253ffff640 1 -- 172.21.15.46:0/3127091442 >> v1:172.21.15.175:6789/0 conn(0x7f252c00a8e0 legacy=0x7f252c00ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:37.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:37.692+0000 7f253ffff640 1 --2- 172.21.15.46:0/3127091442 >> v2:172.21.15.175:3300/0 conn(0x7f252c0102a0 0x7f252c0037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:37.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:37.692+0000 7f253ffff640 1 -- 172.21.15.46:0/3127091442 --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25480c0e90 con 0x7f252c00b0c0 2024-01-23T08:53:37.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:37.692+0000 7f253ffff640 1 -- 172.21.15.46:0/3127091442 --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2548156d20 con 0x7f252c0102a0 2024-01-23T08:53:37.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.000+0000 7f254db58640 1 --2- 172.21.15.46:0/3127091442 >> v2:172.21.15.175:3300/0 conn(0x7f252c0102a0 0x7f252c0037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:38.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.016+0000 7f254db58640 1 -- 172.21.15.46:0/3127091442 >> v2:172.21.15.175:3300/0 conn(0x7f252c0102a0 msgr2=0x7f252c0037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-23T08:53:38.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.016+0000 7f254db58640 1 -- 172.21.15.46:0/3127091442 >> v2:172.21.15.175:3300/0 conn(0x7f252c0102a0 msgr2=0x7f252c0037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T08:53:38.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.016+0000 7f254db58640 1 --2- 172.21.15.46:0/3127091442 >> v2:172.21.15.175:3300/0 conn(0x7f252c0102a0 0x7f252c0037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T08:53:38.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.016+0000 7f254db58640 1 --2- 172.21.15.46:0/3127091442 >> v2:172.21.15.175:3300/0 conn(0x7f252c0102a0 0x7f252c0037a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-23T08:53:38.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.220+0000 7f254db58640 1 --2- 172.21.15.46:0/3127091442 >> v2:172.21.15.175:3300/0 conn(0x7f252c0102a0 0x7f252c0037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:38.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.224+0000 7f254db58640 1 -- 172.21.15.46:0/3127091442 >> v2:172.21.15.175:3300/0 conn(0x7f252c0102a0 msgr2=0x7f252c0037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-23T08:53:38.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.224+0000 7f254db58640 1 -- 172.21.15.46:0/3127091442 >> v2:172.21.15.175:3300/0 conn(0x7f252c0102a0 msgr2=0x7f252c0037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T08:53:38.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.224+0000 7f254db58640 1 --2- 172.21.15.46:0/3127091442 >> v2:172.21.15.175:3300/0 conn(0x7f252c0102a0 0x7f252c0037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T08:53:38.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.224+0000 7f254db58640 1 --2- 172.21.15.46:0/3127091442 >> v2:172.21.15.175:3300/0 conn(0x7f252c0102a0 0x7f252c0037a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-23T08:53:38.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.508+0000 7f254d357640 1 -- 172.21.15.46:0/3127091442 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895739352 0 0) 0x7f25480c0e90 con 0x7f252c00b0c0 2024-01-23T08:53:38.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.512+0000 7f254d357640 1 -- 172.21.15.46:0/3127091442 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2534003530 con 0x7f252c00b0c0 2024-01-23T08:53:38.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.648+0000 7f254db58640 1 --2- 172.21.15.46:0/3127091442 >> v2:172.21.15.175:3300/0 conn(0x7f252c0102a0 0x7f252c0037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:38.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.700+0000 7f254d357640 1 -- 172.21.15.46:0/3127091442 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2425876255 0 0) 0x7f2534003530 con 0x7f252c00b0c0 2024-01-23T08:53:38.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.700+0000 7f254d357640 1 -- 172.21.15.46:0/3127091442 >> v2:172.21.15.175:3300/0 conn(0x7f252c0102a0 msgr2=0x7f252c0037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:53:38.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.700+0000 7f254d357640 1 --2- 172.21.15.46:0/3127091442 >> v2:172.21.15.175:3300/0 conn(0x7f252c0102a0 0x7f252c0037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:38.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.700+0000 7f254d357640 1 -- 172.21.15.46:0/3127091442 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2548157280 con 0x7f252c00b0c0 2024-01-23T08:53:38.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.700+0000 7f254d357640 1 -- 172.21.15.46:0/3127091442 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466917103 0 0) 0x7f2538003ea0 con 0x7f252c00b0c0 2024-01-23T08:53:38.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.700+0000 7f254d357640 1 -- 172.21.15.46:0/3127091442 >> v1:172.21.15.46:6789/0 conn(0x7f252c00b0c0 legacy=0x7f252c00b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:38.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.700+0000 7f254eb5a640 1 -- 172.21.15.46:0/3127091442 reap_dead start 2024-01-23T08:53:38.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.700+0000 7f254d357640 1 --2- 172.21.15.46:0/3127091442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25340039f0 0x7f2534003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:38.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.700+0000 7f254d357640 1 --2- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25340047d0 0x7f2534004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:38.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.700+0000 7f254d357640 1 --2- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2534005190 0x7f253400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:38.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.700+0000 7f254d357640 1 -- 172.21.15.46:0/3127091442 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2548156d20 con 0x7f25340039f0 2024-01-23T08:53:38.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.700+0000 7f254d357640 1 -- 172.21.15.46:0/3127091442 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253400c130 con 0x7f2534005190 2024-01-23T08:53:38.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.700+0000 7f254d357640 1 -- 172.21.15.46:0/3127091442 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253400c2f0 con 0x7f25340047d0 2024-01-23T08:53:38.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.776+0000 7f254db58640 1 --2- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25340047d0 0x7f2534004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:38.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.784+0000 7f254db58640 1 -- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2534005190 msgr2=0x7f253400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:53:38.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.784+0000 7f254db58640 1 --2- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2534005190 0x7f253400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:38.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.784+0000 7f254db58640 1 -- 172.21.15.46:0/3127091442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25340039f0 msgr2=0x7f2534003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:53:38.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.784+0000 7f254db58640 1 --2- 172.21.15.46:0/3127091442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25340039f0 0x7f2534003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:38.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.784+0000 7f254db58640 1 -- 172.21.15.46:0/3127091442 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2534003530 con 0x7f25340047d0 2024-01-23T08:53:38.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.936+0000 7f254db58640 1 --2- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25340047d0 0x7f2534004c50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2544009460 tx=0x7f254401d730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5fb3bfe4a55acfd server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:38.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.972+0000 7f254d357640 1 -- 172.21.15.46:0/3127091442 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25440ae640 con 0x7f25340047d0 2024-01-23T08:53:38.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.972+0000 7f254d357640 1 -- 172.21.15.46:0/3127091442 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25440ae7a0 con 0x7f25340047d0 2024-01-23T08:53:38.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.972+0000 7f254d357640 1 -- 172.21.15.46:0/3127091442 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25440aebb0 con 0x7f25340047d0 2024-01-23T08:53:38.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.972+0000 7f25505bd640 1 -- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25340047d0 msgr2=0x7f2534004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:38.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.972+0000 7f25505bd640 1 --2- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25340047d0 0x7f2534004c50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2544009460 tx=0x7f254401d730 comp rx=0 tx=0).stop 2024-01-23T08:53:38.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.972+0000 7f25505bd640 1 -- 172.21.15.46:0/3127091442 shutdown_connections 2024-01-23T08:53:38.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.972+0000 7f25505bd640 1 --2- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2534005190 0x7f253400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:38.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.972+0000 7f25505bd640 1 --2- 172.21.15.46:0/3127091442 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25340047d0 0x7f2534004c50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:38.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.972+0000 7f25505bd640 1 --2- 172.21.15.46:0/3127091442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25340039f0 0x7f2534003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:38.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.972+0000 7f25505bd640 1 -- 172.21.15.46:0/3127091442 >> 172.21.15.46:0/3127091442 conn(0x7f2548072890 msgr2=0x7f254806e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:53:38.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.972+0000 7f25505bd640 1 -- 172.21.15.46:0/3127091442 shutdown_connections 2024-01-23T08:53:38.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.972+0000 7f25505bd640 1 -- 172.21.15.46:0/3127091442 wait complete. 2024-01-23T08:53:38.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.976+0000 7f25505bd640 1 Processor -- start 2024-01-23T08:53:38.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.976+0000 7f25505bd640 1 -- start start 2024-01-23T08:53:38.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.976+0000 7f25505bd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25340039f0 0x7f25480cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:38.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.976+0000 7f25505bd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25340047d0 0x7f25480c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:38.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.976+0000 7f25505bd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2534005190 0x7f25481f15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:38.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.976+0000 7f25505bd640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25480ca3c0 con 0x7f25340047d0 2024-01-23T08:53:38.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.976+0000 7f25505bd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254814aed0 con 0x7f25340039f0 2024-01-23T08:53:38.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.976+0000 7f25505bd640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2548157770 con 0x7f2534005190 2024-01-23T08:53:38.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.980+0000 7f254eb5a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2534005190 0x7f25481f15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:38.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.984+0000 7f254e359640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25340039f0 0x7f25480cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:38.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.984+0000 7f254eb5a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2534005190 0x7f25481f15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:50482/0 (socket says 172.21.15.46:50482) 2024-01-23T08:53:38.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:38.984+0000 7f254eb5a640 1 -- 172.21.15.46:0/1499089703 learned_addr learned my addr 172.21.15.46:0/1499089703 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:53:38.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:39.000+0000 7f254eb5a640 1 -- 172.21.15.46:0/1499089703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25340039f0 msgr2=0x7f25480cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:38.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:39.000+0000 7f254eb5a640 1 --2- 172.21.15.46:0/1499089703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25340039f0 0x7f25480cb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:38.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:39.000+0000 7f254eb5a640 1 -- 172.21.15.46:0/1499089703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25340047d0 msgr2=0x7f25480c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:38.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:39.000+0000 7f254eb5a640 1 --2- 172.21.15.46:0/1499089703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25340047d0 0x7f25480c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:38.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:39.000+0000 7f254eb5a640 1 -- 172.21.15.46:0/1499089703 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2548157a50 con 0x7f2534005190 2024-01-23T08:53:39.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:39.004+0000 7f254eb5a640 1 --2- 172.21.15.46:0/1499089703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2534005190 0x7f25481f15f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2540003c20 tx=0x7f25400125f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:39.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:39.020+0000 7f253effd640 1 -- 172.21.15.46:0/1499089703 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2540012e50 con 0x7f2534005190 2024-01-23T08:53:39.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:39.020+0000 7f253effd640 1 -- 172.21.15.46:0/1499089703 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2540011040 con 0x7f2534005190 2024-01-23T08:53:39.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:39.020+0000 7f253effd640 1 -- 172.21.15.46:0/1499089703 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2540017660 con 0x7f2534005190 2024-01-23T08:53:39.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:39.020+0000 7f25505bd640 1 -- 172.21.15.46:0/1499089703 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25480c9a20 con 0x7f2534005190 2024-01-23T08:53:39.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:39.020+0000 7f25505bd640 1 -- 172.21.15.46:0/1499089703 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25480c9fe0 con 0x7f2534005190 2024-01-23T08:53:39.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:39.020+0000 7f25505bd640 1 -- 172.21.15.46:0/1499089703 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25480ca500 con 0x7f2534005190 2024-01-23T08:53:39.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:39.284+0000 7f253effd640 1 -- 172.21.15.46:0/1499089703 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f2540017b40 con 0x7f2534005190 2024-01-23T08:53:39.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:39.300+0000 7f253effd640 1 -- 172.21.15.46:0/1499089703 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f254002d430 con 0x7f2534005190 2024-01-23T08:53:39.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:39.300+0000 7f253effd640 1 -- 172.21.15.46:0/1499089703 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f25480ca500 con 0x7f2534005190 2024-01-23T08:53:39.326 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-23T08:53:39.328+0000 7f7390b6c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-23T08:53:39.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:39.384+0000 7f25505bd640 1 -- 172.21.15.46:0/1499089703 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f25480ca6c0 con 0x7f2534005190 2024-01-23T08:53:39.384 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-01-23T08:53:39.390+0000 7f70293b0180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-23T08:53:39.837 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-23T08:53:39.840+0000 7f7390b6c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-23T08:53:39.872 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-01-23T08:53:39.878+0000 7f70293b0180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-23T08:53:40.057 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-23T08:53:40.060+0000 7f7390b6c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-23T08:53:40.072 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-01-23T08:53:40.078+0000 7f70293b0180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-23T08:53:40.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:40.116+0000 7f253effd640 1 -- 172.21.15.46:0/1499089703 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2540014e80 con 0x7f2534005190 2024-01-23T08:53:40.114 INFO:teuthology.orchestra.run.smithi046.stderr:adjusted tunables profile to default 2024-01-23T08:53:40.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:40.120+0000 7f25505bd640 1 -- 172.21.15.46:0/1499089703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2534005190 msgr2=0x7f25481f15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:40.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:40.120+0000 7f25505bd640 1 --2- 172.21.15.46:0/1499089703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2534005190 0x7f25481f15f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2540003c20 tx=0x7f25400125f0 comp rx=0 tx=0).stop 2024-01-23T08:53:40.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:40.120+0000 7f25505bd640 1 -- 172.21.15.46:0/1499089703 shutdown_connections 2024-01-23T08:53:40.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:40.120+0000 7f25505bd640 1 --2- 172.21.15.46:0/1499089703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2534005190 0x7f25481f15f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:40.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:40.120+0000 7f25505bd640 1 --2- 172.21.15.46:0/1499089703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25340047d0 0x7f25480c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:40.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:40.120+0000 7f25505bd640 1 --2- 172.21.15.46:0/1499089703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25340039f0 0x7f25480cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:40.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:40.120+0000 7f25505bd640 1 -- 172.21.15.46:0/1499089703 >> 172.21.15.46:0/1499089703 conn(0x7f2548072890 msgr2=0x7f254806a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:53:40.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:40.120+0000 7f25505bd640 1 -- 172.21.15.46:0/1499089703 shutdown_connections 2024-01-23T08:53:40.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:40.120+0000 7f25505bd640 1 -- 172.21.15.46:0/1499089703 wait complete. 2024-01-23T08:53:40.135 INFO:tasks.ceph:check_enable_crimson: False 2024-01-23T08:53:40.135 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-01-23T08:53:40.136 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:53:40.136 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-01-23T08:53:40.147 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:53:40.147 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-01-23T08:53:40.202 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:53:40.203 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-01-23T08:53:40.259 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:53:40.259 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-01-23T08:53:40.314 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-01-23T08:53:40.314 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-01-23T08:53:40.327 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-01-23T08:53:40.327 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-01-23T08:53:40.382 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-01-23T08:53:40.382 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-01-23T08:53:40.434 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-01-23T08:53:40.434 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-01-23T08:53:40.486 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new f32c3d7d-e32a-42d8-b55f-db874d915a12 0 2024-01-23T08:53:40.632 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-01-23T08:53:40.638+0000 7f70293b0180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-23T08:53:40.638 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-23T08:53:40.640+0000 7f7390b6c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-23T08:53:40.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.650+0000 7f52502ba640 1 Processor -- start 2024-01-23T08:53:40.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.650+0000 7f52502ba640 1 -- start start 2024-01-23T08:53:40.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.650+0000 7f52502ba640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5248151640 0x7f52480c8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:40.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.650+0000 7f52502ba640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f52480c8dc0 0x7f524815a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:40.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.650+0000 7f52502ba640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52480c3ac0 con 0x7f52480c3690 2024-01-23T08:53:40.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.650+0000 7f52502ba640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52480b0530 con 0x7f5248151640 2024-01-23T08:53:40.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.650+0000 7f52502ba640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52480c3200 con 0x7f52480c8dc0 2024-01-23T08:53:40.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.654+0000 7f524e857640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f52480c8dc0 0x7f524815a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:40.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.654+0000 7f524d855640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f52480c3690 0x7f52480ccd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:59118/0 (socket says 172.21.15.175:59118) 2024-01-23T08:53:40.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.654+0000 7f524d855640 1 -- 172.21.15.175:0/2560206874 learned_addr learned my addr 172.21.15.175:0/2560206874 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-01-23T08:53:40.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.654+0000 7f524e056640 1 --2- 172.21.15.175:0/2560206874 >> v2:172.21.15.46:3300/0 conn(0x7f5248151640 0x7f52480c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:40.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.658+0000 7f524d054640 1 -- 172.21.15.175:0/2560206874 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2335853633 0 0) 0x7f52480c3ac0 con 0x7f52480c3690 2024-01-23T08:53:40.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.658+0000 7f524d054640 1 -- 172.21.15.175:0/2560206874 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5234003530 con 0x7f52480c3690 2024-01-23T08:53:40.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.658+0000 7f524e857640 1 -- 172.21.15.175:0/2560206874 >> v2:172.21.15.46:3300/0 conn(0x7f5248151640 msgr2=0x7f52480c8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:53:40.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.658+0000 7f524e857640 1 --2- 172.21.15.175:0/2560206874 >> v2:172.21.15.46:3300/0 conn(0x7f5248151640 0x7f52480c8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:40.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.658+0000 7f524e857640 1 -- 172.21.15.175:0/2560206874 >> v1:172.21.15.175:6789/0 conn(0x7f52480c3690 legacy=0x7f52480ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:40.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.658+0000 7f524e857640 1 -- 172.21.15.175:0/2560206874 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52480c9230 con 0x7f52480c8dc0 2024-01-23T08:53:40.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.666+0000 7f524e857640 1 --2- 172.21.15.175:0/2560206874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52480c8dc0 0x7f524815a960 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f52480b0d00 tx=0x7f524001f0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcaf8f6ee12ae40 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:40.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.674+0000 7f524d054640 1 -- 172.21.15.175:0/2560206874 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52400b0440 con 0x7f52480c8dc0 2024-01-23T08:53:40.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.674+0000 7f524d054640 1 -- 172.21.15.175:0/2560206874 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52400b05a0 con 0x7f52480c8dc0 2024-01-23T08:53:40.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.674+0000 7f524d054640 1 -- 172.21.15.175:0/2560206874 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52400b0930 con 0x7f52480c8dc0 2024-01-23T08:53:40.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.678+0000 7f52502ba640 1 -- 172.21.15.175:0/2560206874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52480c8dc0 msgr2=0x7f524815a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:40.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.678+0000 7f52502ba640 1 --2- 172.21.15.175:0/2560206874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52480c8dc0 0x7f524815a960 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f52480b0d00 tx=0x7f524001f0f0 comp rx=0 tx=0).stop 2024-01-23T08:53:40.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.678+0000 7f52502ba640 1 -- 172.21.15.175:0/2560206874 shutdown_connections 2024-01-23T08:53:40.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.678+0000 7f52502ba640 1 --2- 172.21.15.175:0/2560206874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52480c8dc0 0x7f524815a960 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:40.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.678+0000 7f52502ba640 1 --2- 172.21.15.175:0/2560206874 >> v2:172.21.15.46:3300/0 conn(0x7f5248151640 0x7f52480c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:40.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.678+0000 7f52502ba640 1 -- 172.21.15.175:0/2560206874 >> 172.21.15.175:0/2560206874 conn(0x7f524806a660 msgr2=0x7f524806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:53:40.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.678+0000 7f52502ba640 1 -- 172.21.15.175:0/2560206874 shutdown_connections 2024-01-23T08:53:40.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.678+0000 7f52502ba640 1 -- 172.21.15.175:0/2560206874 wait complete. 2024-01-23T08:53:40.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.678+0000 7f52502ba640 1 Processor -- start 2024-01-23T08:53:40.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.678+0000 7f52502ba640 1 -- start start 2024-01-23T08:53:40.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.678+0000 7f52502ba640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52480c3690 0x7f52481ed700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:40.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.678+0000 7f52502ba640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52480c8dc0 0x7f5248070d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:40.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.678+0000 7f52502ba640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5248151640 0x7f524814bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:40.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.678+0000 7f52502ba640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5248153190 con 0x7f5248151640 2024-01-23T08:53:40.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.678+0000 7f52502ba640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52480cab80 con 0x7f52480c3690 2024-01-23T08:53:40.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.678+0000 7f52502ba640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52480cb370 con 0x7f52480c8dc0 2024-01-23T08:53:40.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.678+0000 7f524d855640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52480c8dc0 0x7f5248070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:40.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.678+0000 7f524e056640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52480c3690 0x7f52481ed700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:40.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.678+0000 7f524d855640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52480c8dc0 0x7f5248070d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:41052/0 (socket says 172.21.15.175:41052) 2024-01-23T08:53:40.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.678+0000 7f524d855640 1 -- 172.21.15.175:0/1295040643 learned_addr learned my addr 172.21.15.175:0/1295040643 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-01-23T08:53:40.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.682+0000 7f524e857640 1 --2- 172.21.15.175:0/1295040643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5248151640 0x7f524814bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:40.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.682+0000 7f524d855640 1 -- 172.21.15.175:0/1295040643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52480c3690 msgr2=0x7f52481ed700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:40.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.682+0000 7f524d855640 1 --2- 172.21.15.175:0/1295040643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52480c3690 0x7f52481ed700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:40.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.682+0000 7f524d855640 1 -- 172.21.15.175:0/1295040643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5248151640 msgr2=0x7f524814bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:40.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.682+0000 7f524d855640 1 --2- 172.21.15.175:0/1295040643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5248151640 0x7f524814bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:40.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.682+0000 7f524d855640 1 -- 172.21.15.175:0/1295040643 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5240009a70 con 0x7f52480c8dc0 2024-01-23T08:53:40.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.686+0000 7f524d855640 1 --2- 172.21.15.175:0/1295040643 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52480c8dc0 0x7f5248070d20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f523800c450 tx=0x7f523800c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:40.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.690+0000 7f523effd640 1 -- 172.21.15.175:0/1295040643 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5238005cf0 con 0x7f52480c8dc0 2024-01-23T08:53:40.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.690+0000 7f523effd640 1 -- 172.21.15.175:0/1295040643 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5238005e50 con 0x7f52480c8dc0 2024-01-23T08:53:40.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.690+0000 7f523effd640 1 -- 172.21.15.175:0/1295040643 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5238007290 con 0x7f52480c8dc0 2024-01-23T08:53:40.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.690+0000 7f52502ba640 1 -- 172.21.15.175:0/1295040643 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52481edc40 con 0x7f52480c8dc0 2024-01-23T08:53:40.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.690+0000 7f52502ba640 1 -- 172.21.15.175:0/1295040643 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52480cb090 con 0x7f52480c8dc0 2024-01-23T08:53:40.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.690+0000 7f52502ba640 1 -- 172.21.15.175:0/1295040643 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52480ca730 con 0x7f52480c8dc0 2024-01-23T08:53:40.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.690+0000 7f523effd640 1 -- 172.21.15.175:0/1295040643 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f523801c440 con 0x7f52480c8dc0 2024-01-23T08:53:40.693 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-01-23T08:53:40.698+0000 7f70293b0180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-23T08:53:40.694 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-23T08:53:40.696+0000 7f7390b6c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-23T08:53:40.745 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-01-23T08:53:40.750+0000 7f70293b0180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-23T08:53:40.749 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-23T08:53:40.752+0000 7f7390b6c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-23T08:53:40.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.794+0000 7f523effd640 1 -- 172.21.15.175:0/1295040643 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5238012ad0 con 0x7f52480c8dc0 2024-01-23T08:53:40.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.794+0000 7f523effd640 1 -- 172.21.15.175:0/1295040643 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f52481edc40 con 0x7f52480c8dc0 2024-01-23T08:53:40.824 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-01-23T08:53:40.830+0000 7f70293b0180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-23T08:53:40.830 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-23T08:53:40.832+0000 7f7390b6c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-23T08:53:40.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:40.878+0000 7f52502ba640 1 -- 172.21.15.175:0/1295040643 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f32c3d7d-e32a-42d8-b55f-db874d915a12", "id": 0} v 0) v1 -- 0x7f524814d6c0 con 0x7f52480c8dc0 2024-01-23T08:53:40.880 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-01-23T08:53:40.886+0000 7f70293b0180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-23T08:53:40.885 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-23T08:53:40.888+0000 7f7390b6c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-23T08:53:40.962 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-01-23T08:53:40.966+0000 7f70293b0180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-23T08:53:40.966 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-23T08:53:40.968+0000 7f7390b6c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-23T08:53:41.013 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-01-23T08:53:41.018+0000 7f70293b0180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-23T08:53:41.020 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-23T08:53:41.024+0000 7f7390b6c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-23T08:53:41.155 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-01-23T08:53:41.158+0000 7f70293b0180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-23T08:53:41.168 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-23T08:53:41.172+0000 7f7390b6c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-23T08:53:41.217 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-01-23T08:53:41.222+0000 7f70293b0180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-23T08:53:41.231 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-23T08:53:41.236+0000 7f7390b6c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-23T08:53:41.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.282+0000 7f523effd640 1 -- 172.21.15.175:0/1295040643 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f32c3d7d-e32a-42d8-b55f-db874d915a12", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f524814d6c0 con 0x7f52480c8dc0 2024-01-23T08:53:41.275 INFO:teuthology.orchestra.run.smithi175.stdout:0 2024-01-23T08:53:41.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.282+0000 7f52502ba640 1 -- 172.21.15.175:0/1295040643 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52480c8dc0 msgr2=0x7f5248070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:41.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.282+0000 7f52502ba640 1 --2- 172.21.15.175:0/1295040643 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52480c8dc0 0x7f5248070d20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f523800c450 tx=0x7f523800c910 comp rx=0 tx=0).stop 2024-01-23T08:53:41.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.282+0000 7f52502ba640 1 -- 172.21.15.175:0/1295040643 shutdown_connections 2024-01-23T08:53:41.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.282+0000 7f52502ba640 1 --2- 172.21.15.175:0/1295040643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5248151640 0x7f524814bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:41.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.282+0000 7f52502ba640 1 --2- 172.21.15.175:0/1295040643 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52480c8dc0 0x7f5248070d20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:41.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.282+0000 7f52502ba640 1 --2- 172.21.15.175:0/1295040643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52480c3690 0x7f52481ed700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:41.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.282+0000 7f52502ba640 1 -- 172.21.15.175:0/1295040643 >> 172.21.15.175:0/1295040643 conn(0x7f524806a660 msgr2=0x7f52480b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:53:41.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.282+0000 7f52502ba640 1 -- 172.21.15.175:0/1295040643 shutdown_connections 2024-01-23T08:53:41.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.282+0000 7f52502ba640 1 -- 172.21.15.175:0/1295040643 wait complete. 2024-01-23T08:53:41.296 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 6f3b6bd2-bbea-4d08-84d5-4407363b5eb2 1 2024-01-23T08:53:41.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.418+0000 7f91ed55a640 1 Processor -- start 2024-01-23T08:53:41.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.418+0000 7f91ed55a640 1 -- start start 2024-01-23T08:53:41.415 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.418+0000 7f91ed55a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f91e8151640 0x7f91e80c8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:41.415 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.418+0000 7f91ed55a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91e80c3690 0x7f91e80c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:41.415 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.418+0000 7f91ed55a640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f91e80ccd10 0x7f91e80cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:41.415 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.418+0000 7f91ed55a640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e80b0530 con 0x7f91e80ccd10 2024-01-23T08:53:41.415 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.418+0000 7f91ed55a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e80c3200 con 0x7f91e8151640 2024-01-23T08:53:41.415 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.418+0000 7f91ed55a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e80c3a90 con 0x7f91e80c3690 2024-01-23T08:53:41.415 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.418+0000 7f91e67fc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91e80c3690 0x7f91e80c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:41.415 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.418+0000 7f91e6ffd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f91e8151640 0x7f91e80c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:41.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.422+0000 7f91e67fc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91e80c3690 0x7f91e80c8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:41064/0 (socket says 172.21.15.175:41064) 2024-01-23T08:53:41.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.422+0000 7f91e67fc640 1 -- 172.21.15.175:0/2146221998 learned_addr learned my addr 172.21.15.175:0/2146221998 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-01-23T08:53:41.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.422+0000 7f91e77fe640 1 --2- 172.21.15.175:0/2146221998 >> v2:172.21.15.46:3300/0 conn(0x7f91e80ccd10 0x7f91e80cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:41.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.422+0000 7f91e67fc640 1 -- 172.21.15.175:0/2146221998 >> v2:172.21.15.175:3300/0 conn(0x7f91e8151640 msgr2=0x7f91e80c8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:53:41.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.422+0000 7f91e67fc640 1 --2- 172.21.15.175:0/2146221998 >> v2:172.21.15.175:3300/0 conn(0x7f91e8151640 0x7f91e80c8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:41.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.422+0000 7f91e67fc640 1 -- 172.21.15.175:0/2146221998 >> v2:172.21.15.46:3300/0 conn(0x7f91e80ccd10 msgr2=0x7f91e80cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:53:41.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.422+0000 7f91e67fc640 1 --2- 172.21.15.175:0/2146221998 >> v2:172.21.15.46:3300/0 conn(0x7f91e80ccd10 0x7f91e80cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:41.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.422+0000 7f91e67fc640 1 -- 172.21.15.175:0/2146221998 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e815b4f0 con 0x7f91e80c3690 2024-01-23T08:53:41.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.426+0000 7f91e67fc640 1 --2- 172.21.15.175:0/2146221998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91e80c3690 0x7f91e80c8dc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f91e80c7b10 tx=0x7f91dc01ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c956b4fb91d6149 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:41.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.430+0000 7f91e5ffb640 1 -- 172.21.15.175:0/2146221998 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc0a89b0 con 0x7f91e80c3690 2024-01-23T08:53:41.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.430+0000 7f91e5ffb640 1 -- 172.21.15.175:0/2146221998 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91dc0a8b10 con 0x7f91e80c3690 2024-01-23T08:53:41.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.430+0000 7f91e5ffb640 1 -- 172.21.15.175:0/2146221998 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc0a8ea0 con 0x7f91e80c3690 2024-01-23T08:53:41.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.430+0000 7f91ed55a640 1 -- 172.21.15.175:0/2146221998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91e80c3690 msgr2=0x7f91e80c8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:41.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.430+0000 7f91ed55a640 1 --2- 172.21.15.175:0/2146221998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91e80c3690 0x7f91e80c8dc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f91e80c7b10 tx=0x7f91dc01ecf0 comp rx=0 tx=0).stop 2024-01-23T08:53:41.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.430+0000 7f91ed55a640 1 -- 172.21.15.175:0/2146221998 shutdown_connections 2024-01-23T08:53:41.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.430+0000 7f91ed55a640 1 --2- 172.21.15.175:0/2146221998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91e80c3690 0x7f91e80c8dc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:41.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.430+0000 7f91ed55a640 1 --2- 172.21.15.175:0/2146221998 >> v2:172.21.15.46:3300/0 conn(0x7f91e80ccd10 0x7f91e80cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:41.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.430+0000 7f91ed55a640 1 --2- 172.21.15.175:0/2146221998 >> v2:172.21.15.175:3300/0 conn(0x7f91e8151640 0x7f91e80c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:41.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.430+0000 7f91ed55a640 1 -- 172.21.15.175:0/2146221998 >> 172.21.15.175:0/2146221998 conn(0x7f91e806a660 msgr2=0x7f91e806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:53:41.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.430+0000 7f91ed55a640 1 -- 172.21.15.175:0/2146221998 shutdown_connections 2024-01-23T08:53:41.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.430+0000 7f91ed55a640 1 -- 172.21.15.175:0/2146221998 wait complete. 2024-01-23T08:53:41.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.434+0000 7f91ed55a640 1 Processor -- start 2024-01-23T08:53:41.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.434+0000 7f91ed55a640 1 -- start start 2024-01-23T08:53:41.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.434+0000 7f91ed55a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91e80c3690 0x7f91e8157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:41.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.434+0000 7f91ed55a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91e80ccd10 0x7f91e8145ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:41.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.434+0000 7f91ed55a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91e8151640 0x7f91e80c1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:41.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.434+0000 7f91ed55a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e8151d60 con 0x7f91e80ccd10 2024-01-23T08:53:41.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.434+0000 7f91ed55a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e8149d00 con 0x7f91e8151640 2024-01-23T08:53:41.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.434+0000 7f91ed55a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e8146010 con 0x7f91e80c3690 2024-01-23T08:53:41.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.434+0000 7f91e6ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91e80c3690 0x7f91e8157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:41.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.434+0000 7f91e77fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91e8151640 0x7f91e80c1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:41.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.434+0000 7f91e6ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91e80c3690 0x7f91e8157ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:41074/0 (socket says 172.21.15.175:41074) 2024-01-23T08:53:41.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.434+0000 7f91e6ffd640 1 -- 172.21.15.175:0/4223623877 learned_addr learned my addr 172.21.15.175:0/4223623877 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-01-23T08:53:41.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.434+0000 7f91e67fc640 1 --2- 172.21.15.175:0/4223623877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91e80ccd10 0x7f91e8145ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:41.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.438+0000 7f91e6ffd640 1 -- 172.21.15.175:0/4223623877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91e8151640 msgr2=0x7f91e80c1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:41.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.438+0000 7f91e6ffd640 1 --2- 172.21.15.175:0/4223623877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91e8151640 0x7f91e80c1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:41.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.438+0000 7f91e6ffd640 1 -- 172.21.15.175:0/4223623877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91e80ccd10 msgr2=0x7f91e8145ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:41.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.438+0000 7f91e6ffd640 1 --2- 172.21.15.175:0/4223623877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91e80ccd10 0x7f91e8145ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:41.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.438+0000 7f91e6ffd640 1 -- 172.21.15.175:0/4223623877 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc0094d0 con 0x7f91e80c3690 2024-01-23T08:53:41.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.442+0000 7f91e6ffd640 1 --2- 172.21.15.175:0/4223623877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91e80c3690 0x7f91e8157ea0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f91d800e8a0 tx=0x7f91d800eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:41.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.446+0000 7f91cf7fe640 1 -- 172.21.15.175:0/4223623877 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d8009510 con 0x7f91e80c3690 2024-01-23T08:53:41.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.446+0000 7f91cf7fe640 1 -- 172.21.15.175:0/4223623877 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d800c940 con 0x7f91e80c3690 2024-01-23T08:53:41.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.446+0000 7f91cf7fe640 1 -- 172.21.15.175:0/4223623877 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d800ccb0 con 0x7f91e80c3690 2024-01-23T08:53:41.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.446+0000 7f91ed55a640 1 -- 172.21.15.175:0/4223623877 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e8156630 con 0x7f91e80c3690 2024-01-23T08:53:41.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.446+0000 7f91ed55a640 1 -- 172.21.15.175:0/4223623877 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e8151f70 con 0x7f91e80c3690 2024-01-23T08:53:41.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.446+0000 7f91ed55a640 1 -- 172.21.15.175:0/4223623877 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e8074340 con 0x7f91e80c3690 2024-01-23T08:53:41.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.450+0000 7f91cf7fe640 1 -- 172.21.15.175:0/4223623877 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f91d80059a0 con 0x7f91e80c3690 2024-01-23T08:53:41.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.534+0000 7f91cf7fe640 1 -- 172.21.15.175:0/4223623877 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f91d8006740 con 0x7f91e80c3690 2024-01-23T08:53:41.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.598+0000 7f91cf7fe640 1 -- 172.21.15.175:0/4223623877 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f91d8021060 con 0x7f91e80c3690 2024-01-23T08:53:41.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.686+0000 7f91ed55a640 1 -- 172.21.15.175:0/4223623877 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6f3b6bd2-bbea-4d08-84d5-4407363b5eb2", "id": 1} v 0) v1 -- 0x7f91e81ed180 con 0x7f91e80c3690 2024-01-23T08:53:41.842 INFO:tasks.ceph.mgr.y.smithi046.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-01-23T08:53:41.842 INFO:tasks.ceph.mgr.y.smithi046.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-01-23T08:53:41.843 INFO:tasks.ceph.mgr.y.smithi046.stderr: from numpy import show_config as show_numpy_config 2024-01-23T08:53:41.865 INFO:tasks.ceph.mgr.x.smithi175.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-01-23T08:53:41.865 INFO:tasks.ceph.mgr.x.smithi175.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-01-23T08:53:41.866 INFO:tasks.ceph.mgr.x.smithi175.stderr: from numpy import show_config as show_numpy_config 2024-01-23T08:53:41.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.890+0000 7f91cf7fe640 1 -- 172.21.15.175:0/4223623877 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6f3b6bd2-bbea-4d08-84d5-4407363b5eb2", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f91d8017070 con 0x7f91e80c3690 2024-01-23T08:53:41.886 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-01-23T08:53:41.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.894+0000 7f91ed55a640 1 -- 172.21.15.175:0/4223623877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91e80c3690 msgr2=0x7f91e8157ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:41.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.894+0000 7f91ed55a640 1 --2- 172.21.15.175:0/4223623877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91e80c3690 0x7f91e8157ea0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f91d800e8a0 tx=0x7f91d800eca0 comp rx=0 tx=0).stop 2024-01-23T08:53:41.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.894+0000 7f91ed55a640 1 -- 172.21.15.175:0/4223623877 shutdown_connections 2024-01-23T08:53:41.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.894+0000 7f91ed55a640 1 --2- 172.21.15.175:0/4223623877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91e8151640 0x7f91e80c1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:41.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.894+0000 7f91ed55a640 1 --2- 172.21.15.175:0/4223623877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91e80ccd10 0x7f91e8145ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:41.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.894+0000 7f91ed55a640 1 --2- 172.21.15.175:0/4223623877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91e80c3690 0x7f91e8157ea0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:41.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.894+0000 7f91ed55a640 1 -- 172.21.15.175:0/4223623877 >> 172.21.15.175:0/4223623877 conn(0x7f91e806a660 msgr2=0x7f91e8150230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:53:41.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.894+0000 7f91ed55a640 1 -- 172.21.15.175:0/4223623877 shutdown_connections 2024-01-23T08:53:41.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:41.894+0000 7f91ed55a640 1 -- 172.21.15.175:0/4223623877 wait complete. 2024-01-23T08:53:41.916 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 8f110727-31e7-4f69-926b-c87481d4d28d 2 2024-01-23T08:53:41.921 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-23T08:53:41.924+0000 7f7390b6c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-23T08:53:41.942 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-01-23T08:53:41.946+0000 7f70293b0180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-23T08:53:42.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.046+0000 7fad70c1c640 1 Processor -- start 2024-01-23T08:53:42.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.046+0000 7fad70c1c640 1 -- start start 2024-01-23T08:53:42.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.046+0000 7fad70c1c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fad6c151640 0x7fad6c0c8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:42.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.046+0000 7fad70c1c640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad6c0c3ac0 con 0x7fad6c0c3690 2024-01-23T08:53:42.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.046+0000 7fad70c1c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad6c0c3200 con 0x7fad6c0c8dc0 2024-01-23T08:53:42.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.046+0000 7fad70c1c640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad6c0b0530 con 0x7fad6c151640 2024-01-23T08:53:42.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.074+0000 7fad6ad9d640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fad6c0c8dc0 0x7fad6c15a960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:59120/0 (socket says 172.21.15.175:59120) 2024-01-23T08:53:42.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.074+0000 7fad6ad9d640 1 -- 172.21.15.175:0/1366941664 learned_addr learned my addr 172.21.15.175:0/1366941664 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-01-23T08:53:42.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.082+0000 7fad6a59c640 1 --2- 172.21.15.175:0/1366941664 >> v2:172.21.15.46:3300/0 conn(0x7fad6c151640 0x7fad6c0c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:42.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.082+0000 7fad6959a640 1 -- 172.21.15.175:0/1366941664 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4285969540 0 0) 0x7fad6c0c3200 con 0x7fad6c0c8dc0 2024-01-23T08:53:42.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.082+0000 7fad6959a640 1 -- 172.21.15.175:0/1366941664 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad54003530 con 0x7fad6c0c8dc0 2024-01-23T08:53:42.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.094+0000 7fad6959a640 1 -- 172.21.15.175:0/1366941664 <== mon.1 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1954937890 0 0) 0x7fad54003530 con 0x7fad6c0c8dc0 2024-01-23T08:53:42.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.094+0000 7fad6959a640 1 -- 172.21.15.175:0/1366941664 >> v2:172.21.15.46:3300/0 conn(0x7fad6c151640 msgr2=0x7fad6c0c8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:53:42.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.094+0000 7fad6959a640 1 --2- 172.21.15.175:0/1366941664 >> v2:172.21.15.46:3300/0 conn(0x7fad6c151640 0x7fad6c0c8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:42.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.094+0000 7fad6959a640 1 -- 172.21.15.175:0/1366941664 >> v1:172.21.15.46:6789/0 conn(0x7fad6c0c3690 legacy=0x7fad6c0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:42.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.094+0000 7fad6959a640 1 -- 172.21.15.175:0/1366941664 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6c0c9230 con 0x7fad6c0c8dc0 2024-01-23T08:53:42.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.094+0000 7fad6959a640 1 -- 172.21.15.175:0/1366941664 <== mon.1 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466917103 0 0) 0x7fad64001a00 con 0x7fad6c0c8dc0 2024-01-23T08:53:42.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.094+0000 7fad6959a640 1 -- 172.21.15.175:0/1366941664 >> v1:172.21.15.175:6789/0 conn(0x7fad6c0c8dc0 legacy=0x7fad6c15a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:42.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.094+0000 7fad6959a640 1 --2- 172.21.15.175:0/1366941664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad54003a40 0x7fad54003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:42.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.094+0000 7fad6959a640 1 --2- 172.21.15.175:0/1366941664 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad540047d0 0x7fad54004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:42.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.094+0000 7fad6959a640 1 --2- 172.21.15.175:0/1366941664 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad540051e0 0x7fad5400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:42.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.094+0000 7fad6959a640 1 -- 172.21.15.175:0/1366941664 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c0b0530 con 0x7fad540047d0 2024-01-23T08:53:42.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.094+0000 7fad6959a640 1 -- 172.21.15.175:0/1366941664 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5400c0f0 con 0x7fad54003a40 2024-01-23T08:53:42.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.094+0000 7fad6959a640 1 -- 172.21.15.175:0/1366941664 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5400c2b0 con 0x7fad540051e0 2024-01-23T08:53:42.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.094+0000 7fad6ad9d640 1 --2- 172.21.15.175:0/1366941664 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad540051e0 0x7fad5400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:42.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.098+0000 7fad6a59c640 1 --2- 172.21.15.175:0/1366941664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad54003a40 0x7fad54003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:42.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.098+0000 7fad6a59c640 1 -- 172.21.15.175:0/1366941664 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad540051e0 msgr2=0x7fad5400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:53:42.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.098+0000 7fad6a59c640 1 --2- 172.21.15.175:0/1366941664 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad540051e0 0x7fad5400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:42.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.098+0000 7fad6a59c640 1 -- 172.21.15.175:0/1366941664 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad540047d0 msgr2=0x7fad54004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:53:42.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.098+0000 7fad6a59c640 1 --2- 172.21.15.175:0/1366941664 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad540047d0 0x7fad54004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:42.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.098+0000 7fad6a59c640 1 -- 172.21.15.175:0/1366941664 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad54003530 con 0x7fad54003a40 2024-01-23T08:53:42.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.098+0000 7fad6ad9d640 1 -- 172.21.15.175:0/1366941664 reap_dead start 2024-01-23T08:53:42.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.106+0000 7fad6a59c640 1 --2- 172.21.15.175:0/1366941664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad54003a40 0x7fad54003e60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fad5c009ae0 tx=0x7fad5c01ca70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=778da0f78850f0eb server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:42.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.110+0000 7fad6959a640 1 -- 172.21.15.175:0/1366941664 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c0a5660 con 0x7fad54003a40 2024-01-23T08:53:42.104 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-23T08:53:42.108+0000 7f7390b6c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-23T08:53:42.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.110+0000 7fad6959a640 1 -- 172.21.15.175:0/1366941664 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5c0a57c0 con 0x7fad54003a40 2024-01-23T08:53:42.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.114+0000 7fad70c1c640 1 -- 172.21.15.175:0/1366941664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad54003a40 msgr2=0x7fad54003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:42.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.114+0000 7fad70c1c640 1 --2- 172.21.15.175:0/1366941664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad54003a40 0x7fad54003e60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fad5c009ae0 tx=0x7fad5c01ca70 comp rx=0 tx=0).stop 2024-01-23T08:53:42.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.114+0000 7fad70c1c640 1 -- 172.21.15.175:0/1366941664 shutdown_connections 2024-01-23T08:53:42.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.114+0000 7fad70c1c640 1 --2- 172.21.15.175:0/1366941664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad54003a40 0x7fad54003e60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:42.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.114+0000 7fad70c1c640 1 -- 172.21.15.175:0/1366941664 >> 172.21.15.175:0/1366941664 conn(0x7fad6c06a660 msgr2=0x7fad6c06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:53:42.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.114+0000 7fad70c1c640 1 -- 172.21.15.175:0/1366941664 shutdown_connections 2024-01-23T08:53:42.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.114+0000 7fad70c1c640 1 -- 172.21.15.175:0/1366941664 wait complete. 2024-01-23T08:53:42.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.114+0000 7fad70c1c640 1 Processor -- start 2024-01-23T08:53:42.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.114+0000 7fad70c1c640 1 -- start start 2024-01-23T08:53:42.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.118+0000 7fad70c1c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad54003a40 0x7fad6c14b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:42.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.118+0000 7fad70c1c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad6c1e2ed0 0x7fad6c1e0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:42.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.118+0000 7fad70c1c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad6c14ce80 0x7fad6c1f09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:42.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.118+0000 7fad70c1c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c14f890 con 0x7fad6c14ce80 2024-01-23T08:53:42.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.118+0000 7fad70c1c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c1e2d00 con 0x7fad54003a40 2024-01-23T08:53:42.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.118+0000 7fad70c1c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c1e1450 con 0x7fad6c1e2ed0 2024-01-23T08:53:42.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.118+0000 7fad69d9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad6c1e2ed0 0x7fad6c1e0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:42.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.118+0000 7fad69d9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad6c1e2ed0 0x7fad6c1e0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:41100/0 (socket says 172.21.15.175:41100) 2024-01-23T08:53:42.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.118+0000 7fad69d9b640 1 -- 172.21.15.175:0/1477905444 learned_addr learned my addr 172.21.15.175:0/1477905444 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-01-23T08:53:42.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.118+0000 7fad6ad9d640 1 --2- 172.21.15.175:0/1477905444 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad6c14ce80 0x7fad6c1f09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:42.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.118+0000 7fad6a59c640 1 --2- 172.21.15.175:0/1477905444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad54003a40 0x7fad6c14b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:42.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.122+0000 7fad69d9b640 1 -- 172.21.15.175:0/1477905444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad54003a40 msgr2=0x7fad6c14b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:42.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.122+0000 7fad69d9b640 1 --2- 172.21.15.175:0/1477905444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad54003a40 0x7fad6c14b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:42.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.122+0000 7fad69d9b640 1 -- 172.21.15.175:0/1477905444 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad6c14ce80 msgr2=0x7fad6c1f09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:42.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.122+0000 7fad69d9b640 1 --2- 172.21.15.175:0/1477905444 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad6c14ce80 0x7fad6c1f09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:42.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.122+0000 7fad69d9b640 1 -- 172.21.15.175:0/1477905444 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6c1edfc0 con 0x7fad6c1e2ed0 2024-01-23T08:53:42.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.126+0000 7fad69d9b640 1 --2- 172.21.15.175:0/1477905444 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad6c1e2ed0 0x7fad6c1e0f10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fad6000c530 tx=0x7fad6000c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:42.125 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-01-23T08:53:42.130+0000 7f70293b0180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-23T08:53:42.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.130+0000 7fad5affd640 1 -- 172.21.15.175:0/1477905444 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad600052d0 con 0x7fad6c1e2ed0 2024-01-23T08:53:42.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.130+0000 7fad5affd640 1 -- 172.21.15.175:0/1477905444 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad60005450 con 0x7fad6c1e2ed0 2024-01-23T08:53:42.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.130+0000 7fad5affd640 1 -- 172.21.15.175:0/1477905444 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad60012870 con 0x7fad6c1e2ed0 2024-01-23T08:53:42.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.130+0000 7fad70c1c640 1 -- 172.21.15.175:0/1477905444 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad6c1ee2a0 con 0x7fad6c1e2ed0 2024-01-23T08:53:42.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.130+0000 7fad70c1c640 1 -- 172.21.15.175:0/1477905444 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad6c14a870 con 0x7fad6c1e2ed0 2024-01-23T08:53:42.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.134+0000 7fad70c1c640 1 -- 172.21.15.175:0/1477905444 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad6c14a360 con 0x7fad6c1e2ed0 2024-01-23T08:53:42.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.134+0000 7fad5affd640 1 -- 172.21.15.175:0/1477905444 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fad60012d50 con 0x7fad6c1e2ed0 2024-01-23T08:53:42.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.262+0000 7fad5affd640 1 -- 172.21.15.175:0/1477905444 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fad6001baa0 con 0x7fad6c1e2ed0 2024-01-23T08:53:42.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.262+0000 7fad5affd640 1 -- 172.21.15.175:0/1477905444 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7fad6001bcf0 con 0x7fad6c1e2ed0 2024-01-23T08:53:42.279 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-23T08:53:42.284+0000 7f7390b6c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-23T08:53:42.305 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-01-23T08:53:42.310+0000 7f70293b0180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-23T08:53:42.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.342+0000 7fad70c1c640 1 -- 172.21.15.175:0/1477905444 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8f110727-31e7-4f69-926b-c87481d4d28d", "id": 2} v 0) v1 -- 0x7fad6c074340 con 0x7fad6c1e2ed0 2024-01-23T08:53:42.351 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-23T08:53:42.352+0000 7f7390b6c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-23T08:53:42.374 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-01-23T08:53:42.378+0000 7f70293b0180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-23T08:53:42.494 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-23T08:53:42.496+0000 7f7390b6c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-23T08:53:42.511 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-01-23T08:53:42.518+0000 7f70293b0180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-23T08:53:42.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.542+0000 7fad5affd640 1 -- 172.21.15.175:0/1477905444 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8f110727-31e7-4f69-926b-c87481d4d28d", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fad6002a0b0 con 0x7fad6c1e2ed0 2024-01-23T08:53:42.537 INFO:teuthology.orchestra.run.smithi175.stdout:2 2024-01-23T08:53:42.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.542+0000 7fad70c1c640 1 -- 172.21.15.175:0/1477905444 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad6c1e2ed0 msgr2=0x7fad6c1e0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:42.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.542+0000 7fad70c1c640 1 --2- 172.21.15.175:0/1477905444 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad6c1e2ed0 0x7fad6c1e0f10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fad6000c530 tx=0x7fad6000c9f0 comp rx=0 tx=0).stop 2024-01-23T08:53:42.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.542+0000 7fad70c1c640 1 -- 172.21.15.175:0/1477905444 shutdown_connections 2024-01-23T08:53:42.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.542+0000 7fad70c1c640 1 --2- 172.21.15.175:0/1477905444 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad6c14ce80 0x7fad6c1f09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:42.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.542+0000 7fad70c1c640 1 --2- 172.21.15.175:0/1477905444 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad6c1e2ed0 0x7fad6c1e0f10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:42.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.542+0000 7fad70c1c640 1 --2- 172.21.15.175:0/1477905444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad54003a40 0x7fad6c14b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:42.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.542+0000 7fad70c1c640 1 -- 172.21.15.175:0/1477905444 >> 172.21.15.175:0/1477905444 conn(0x7fad6c06a660 msgr2=0x7fad6c070ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:53:42.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.542+0000 7fad70c1c640 1 -- 172.21.15.175:0/1477905444 shutdown_connections 2024-01-23T08:53:42.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.542+0000 7fad70c1c640 1 -- 172.21.15.175:0/1477905444 wait complete. 2024-01-23T08:53:42.561 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 3aa7527d-0463-4373-b9c7-e6b507a7987f 3 2024-01-23T08:53:42.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.726+0000 7f4a5d06a640 1 Processor -- start 2024-01-23T08:53:42.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.730+0000 7f4a5d06a640 1 -- start start 2024-01-23T08:53:42.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.730+0000 7f4a5d06a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4a5806e460 0x7f4a580c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:42.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.730+0000 7f4a5d06a640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a58156a20 con 0x7f4a58150500 2024-01-23T08:53:42.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.730+0000 7f4a5d06a640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a58156d00 con 0x7f4a580c2e00 2024-01-23T08:53:42.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.730+0000 7f4a5d06a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a58156fe0 con 0x7f4a5806e460 2024-01-23T08:53:42.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.730+0000 7f4a5759e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4a5806e460 0x7f4a580c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:42.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.730+0000 7f4a5759e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4a5806e460 0x7f4a580c5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:38794/0 (socket says 172.21.15.175:38794) 2024-01-23T08:53:42.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.730+0000 7f4a5759e640 1 -- 172.21.15.175:0/16374784 learned_addr learned my addr 172.21.15.175:0/16374784 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-01-23T08:53:42.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.734+0000 7f4a5759e640 1 -- 172.21.15.175:0/16374784 >> v1:172.21.15.175:6789/0 conn(0x7f4a580c2e00 legacy=0x7f4a5815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:42.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.734+0000 7f4a5759e640 1 -- 172.21.15.175:0/16374784 >> v1:172.21.15.46:6789/0 conn(0x7f4a58150500 legacy=0x7f4a58156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:42.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.734+0000 7f4a5759e640 1 -- 172.21.15.175:0/16374784 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a581599e0 con 0x7f4a5806e460 2024-01-23T08:53:42.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.738+0000 7f4a5759e640 1 --2- 172.21.15.175:0/16374784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a5806e460 0x7f4a580c5f20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4a50009e50 tx=0x7f4a5001f1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c3874ebec28eb98 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:42.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.742+0000 7f4a5659c640 1 -- 172.21.15.175:0/16374784 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500af400 con 0x7f4a5806e460 2024-01-23T08:53:42.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.742+0000 7f4a5659c640 1 -- 172.21.15.175:0/16374784 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a500ab050 con 0x7f4a5806e460 2024-01-23T08:53:42.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.742+0000 7f4a5659c640 1 -- 172.21.15.175:0/16374784 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500af780 con 0x7f4a5806e460 2024-01-23T08:53:42.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.742+0000 7f4a5d06a640 1 -- 172.21.15.175:0/16374784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a5806e460 msgr2=0x7f4a580c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:42.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.742+0000 7f4a5d06a640 1 --2- 172.21.15.175:0/16374784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a5806e460 0x7f4a580c5f20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4a50009e50 tx=0x7f4a5001f1f0 comp rx=0 tx=0).stop 2024-01-23T08:53:42.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.742+0000 7f4a5d06a640 1 -- 172.21.15.175:0/16374784 shutdown_connections 2024-01-23T08:53:42.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.742+0000 7f4a5d06a640 1 --2- 172.21.15.175:0/16374784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a5806e460 0x7f4a580c5f20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:42.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.742+0000 7f4a5d06a640 1 -- 172.21.15.175:0/16374784 >> 172.21.15.175:0/16374784 conn(0x7f4a5806b770 msgr2=0x7f4a5806bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:53:42.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.742+0000 7f4a5d06a640 1 -- 172.21.15.175:0/16374784 shutdown_connections 2024-01-23T08:53:42.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.742+0000 7f4a5d06a640 1 -- 172.21.15.175:0/16374784 wait complete. 2024-01-23T08:53:42.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.746+0000 7f4a5d06a640 1 Processor -- start 2024-01-23T08:53:42.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.746+0000 7f4a5d06a640 1 -- start start 2024-01-23T08:53:42.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.746+0000 7f4a5d06a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a5806e460 0x7f4a580c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:42.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.746+0000 7f4a5d06a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a580c2e00 0x7f4a581ed150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:42.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.746+0000 7f4a5d06a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a58150500 0x7f4a581ed690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:42.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.746+0000 7f4a5d06a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5814efe0 con 0x7f4a5806e460 2024-01-23T08:53:42.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.746+0000 7f4a5d06a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5814edb0 con 0x7f4a58150500 2024-01-23T08:53:42.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.746+0000 7f4a5d06a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5814e400 con 0x7f4a580c2e00 2024-01-23T08:53:42.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.746+0000 7f4a4ffff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a580c2e00 0x7f4a581ed150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:42.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.746+0000 7f4a5759e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a58150500 0x7f4a581ed690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:42.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.746+0000 7f4a4ffff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a580c2e00 0x7f4a581ed150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:41108/0 (socket says 172.21.15.175:41108) 2024-01-23T08:53:42.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.746+0000 7f4a4ffff640 1 -- 172.21.15.175:0/230271708 learned_addr learned my addr 172.21.15.175:0/230271708 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-01-23T08:53:42.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.746+0000 7f4a56d9d640 1 --2- 172.21.15.175:0/230271708 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a5806e460 0x7f4a580c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:42.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.750+0000 7f4a5759e640 1 -- 172.21.15.175:0/230271708 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a580c2e00 msgr2=0x7f4a581ed150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:42.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.750+0000 7f4a5759e640 1 --2- 172.21.15.175:0/230271708 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a580c2e00 0x7f4a581ed150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:42.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.750+0000 7f4a5759e640 1 -- 172.21.15.175:0/230271708 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a5806e460 msgr2=0x7f4a580c4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:42.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.750+0000 7f4a5759e640 1 --2- 172.21.15.175:0/230271708 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a5806e460 0x7f4a580c4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:42.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.750+0000 7f4a5759e640 1 -- 172.21.15.175:0/230271708 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a50009b30 con 0x7f4a58150500 2024-01-23T08:53:42.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.750+0000 7f4a4ffff640 1 --2- 172.21.15.175:0/230271708 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a580c2e00 0x7f4a581ed150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-23T08:53:42.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.754+0000 7f4a5759e640 1 --2- 172.21.15.175:0/230271708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a58150500 0x7f4a581ed690 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4a580c6d90 tx=0x7f4a5001bf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:42.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.758+0000 7f4a4f7fe640 1 -- 172.21.15.175:0/230271708 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500bf070 con 0x7f4a58150500 2024-01-23T08:53:42.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.758+0000 7f4a4f7fe640 1 -- 172.21.15.175:0/230271708 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a500afbc0 con 0x7f4a58150500 2024-01-23T08:53:42.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.758+0000 7f4a4f7fe640 1 -- 172.21.15.175:0/230271708 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500b9410 con 0x7f4a58150500 2024-01-23T08:53:42.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.758+0000 7f4a5d06a640 1 -- 172.21.15.175:0/230271708 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a581539c0 con 0x7f4a58150500 2024-01-23T08:53:42.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.758+0000 7f4a5d06a640 1 -- 172.21.15.175:0/230271708 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5814e650 con 0x7f4a58150500 2024-01-23T08:53:42.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.758+0000 7f4a5d06a640 1 -- 172.21.15.175:0/230271708 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a58074340 con 0x7f4a58150500 2024-01-23T08:53:42.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.762+0000 7f4a4f7fe640 1 -- 172.21.15.175:0/230271708 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f4a500b6070 con 0x7f4a58150500 2024-01-23T08:53:42.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.958+0000 7f4a4f7fe640 1 -- 172.21.15.175:0/230271708 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f4a500b9d80 con 0x7f4a58150500 2024-01-23T08:53:42.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:42.958+0000 7f4a4f7fe640 1 -- 172.21.15.175:0/230271708 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f4a500b4070 con 0x7f4a58150500 2024-01-23T08:53:43.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.034+0000 7f4a5d06a640 1 -- 172.21.15.175:0/230271708 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3aa7527d-0463-4373-b9c7-e6b507a7987f", "id": 3} v 0) v1 -- 0x7f4a580cb9f0 con 0x7f4a58150500 2024-01-23T08:53:43.137 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-23T08:53:43.140+0000 7f7390b6c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-23T08:53:43.195 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-01-23T08:53:43.202+0000 7f70293b0180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-23T08:53:43.217 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-23T08:53:43.220+0000 7f7390b6c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-23T08:53:43.269 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-01-23T08:53:43.274+0000 7f70293b0180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-23T08:53:43.399 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-23T08:53:43.404+0000 7f7390b6c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-23T08:53:43.446 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-01-23T08:53:43.450+0000 7f70293b0180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-23T08:53:43.478 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-23T08:53:43.480+0000 7f7390b6c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-23T08:53:43.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.494+0000 7f4a4f7fe640 1 -- 172.21.15.175:0/230271708 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3aa7527d-0463-4373-b9c7-e6b507a7987f", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4a500b98f0 con 0x7f4a58150500 2024-01-23T08:53:43.487 INFO:teuthology.orchestra.run.smithi175.stdout:3 2024-01-23T08:53:43.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.494+0000 7f4a5d06a640 1 -- 172.21.15.175:0/230271708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a58150500 msgr2=0x7f4a581ed690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:43.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.494+0000 7f4a5d06a640 1 --2- 172.21.15.175:0/230271708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a58150500 0x7f4a581ed690 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4a580c6d90 tx=0x7f4a5001bf90 comp rx=0 tx=0).stop 2024-01-23T08:53:43.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.494+0000 7f4a5d06a640 1 -- 172.21.15.175:0/230271708 shutdown_connections 2024-01-23T08:53:43.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.494+0000 7f4a5d06a640 1 --2- 172.21.15.175:0/230271708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a58150500 0x7f4a581ed690 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:43.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.494+0000 7f4a5d06a640 1 --2- 172.21.15.175:0/230271708 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a580c2e00 0x7f4a581ed150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:43.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.494+0000 7f4a5d06a640 1 --2- 172.21.15.175:0/230271708 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a5806e460 0x7f4a580c4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:43.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.494+0000 7f4a5d06a640 1 -- 172.21.15.175:0/230271708 >> 172.21.15.175:0/230271708 conn(0x7f4a5806b770 msgr2=0x7f4a580c90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:53:43.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.494+0000 7f4a5d06a640 1 -- 172.21.15.175:0/230271708 shutdown_connections 2024-01-23T08:53:43.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.494+0000 7f4a5d06a640 1 -- 172.21.15.175:0/230271708 wait complete. 2024-01-23T08:53:43.507 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new eb47a1e5-9f26-465f-b188-87c6eed63c2e 4 2024-01-23T08:53:43.523 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-01-23T08:53:43.530+0000 7f70293b0180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-23T08:53:43.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.626+0000 7f37f862c640 1 Processor -- start 2024-01-23T08:53:43.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.626+0000 7f37f862c640 1 -- start start 2024-01-23T08:53:43.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.630+0000 7f37f862c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37f0151740 0x7f37f0157380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:43.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.630+0000 7f37f862c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f37f00c7990 0x7f37f006feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:43.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.630+0000 7f37f862c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37f00c7500 con 0x7f37f00c5db0 2024-01-23T08:53:43.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.630+0000 7f37f862c640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37f006f190 con 0x7f37f00c7990 2024-01-23T08:53:43.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.630+0000 7f37f862c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f0151b20 con 0x7f37f0151740 2024-01-23T08:53:43.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.630+0000 7f37f63c8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37f0151740 0x7f37f0157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:43.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.630+0000 7f37f5bc7640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f37f00c5db0 0x7f37f006ea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:59130/0 (socket says 172.21.15.175:59130) 2024-01-23T08:53:43.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.630+0000 7f37f5bc7640 1 -- 172.21.15.175:0/2505299429 learned_addr learned my addr 172.21.15.175:0/2505299429 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-01-23T08:53:43.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.630+0000 7f37f6bc9640 1 --2- 172.21.15.175:0/2505299429 >> v2:172.21.15.46:3300/0 conn(0x7f37f00c7990 0x7f37f006feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:43.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.630+0000 7f37f63c8640 1 -- 172.21.15.175:0/2505299429 >> v2:172.21.15.46:3300/0 conn(0x7f37f00c7990 msgr2=0x7f37f006feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:53:43.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.630+0000 7f37f63c8640 1 --2- 172.21.15.175:0/2505299429 >> v2:172.21.15.46:3300/0 conn(0x7f37f00c7990 0x7f37f006feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:43.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.630+0000 7f37f63c8640 1 -- 172.21.15.175:0/2505299429 >> v1:172.21.15.175:6789/0 conn(0x7f37f00c5db0 legacy=0x7f37f006ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:43.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.630+0000 7f37f63c8640 1 -- 172.21.15.175:0/2505299429 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f00c7e40 con 0x7f37f0151740 2024-01-23T08:53:43.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.634+0000 7f37f63c8640 1 --2- 172.21.15.175:0/2505299429 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37f0151740 0x7f37f0157380 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f37e40097c0 tx=0x7f37e401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71fce9f95ed80bca server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:43.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.638+0000 7f37f53c6640 1 -- 172.21.15.175:0/2505299429 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e40a8970 con 0x7f37f0151740 2024-01-23T08:53:43.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.638+0000 7f37f53c6640 1 -- 172.21.15.175:0/2505299429 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e40a8ad0 con 0x7f37f0151740 2024-01-23T08:53:43.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.638+0000 7f37f53c6640 1 -- 172.21.15.175:0/2505299429 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e40a8e60 con 0x7f37f0151740 2024-01-23T08:53:43.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.638+0000 7f37f862c640 1 -- 172.21.15.175:0/2505299429 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37f0151740 msgr2=0x7f37f0157380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:43.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.638+0000 7f37f862c640 1 --2- 172.21.15.175:0/2505299429 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37f0151740 0x7f37f0157380 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f37e40097c0 tx=0x7f37e401ec70 comp rx=0 tx=0).stop 2024-01-23T08:53:43.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.638+0000 7f37f862c640 1 -- 172.21.15.175:0/2505299429 shutdown_connections 2024-01-23T08:53:43.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.638+0000 7f37f862c640 1 --2- 172.21.15.175:0/2505299429 >> v2:172.21.15.46:3300/0 conn(0x7f37f00c7990 0x7f37f006feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:43.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.638+0000 7f37f862c640 1 --2- 172.21.15.175:0/2505299429 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37f0151740 0x7f37f0157380 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:43.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.638+0000 7f37f862c640 1 -- 172.21.15.175:0/2505299429 >> 172.21.15.175:0/2505299429 conn(0x7f37f006b770 msgr2=0x7f37f006bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:53:43.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.638+0000 7f37f862c640 1 -- 172.21.15.175:0/2505299429 shutdown_connections 2024-01-23T08:53:43.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.638+0000 7f37f862c640 1 -- 172.21.15.175:0/2505299429 wait complete. 2024-01-23T08:53:43.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.642+0000 7f37f862c640 1 Processor -- start 2024-01-23T08:53:43.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.642+0000 7f37f862c640 1 -- start start 2024-01-23T08:53:43.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.642+0000 7f37f862c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37f00c5db0 0x7f37f00c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:43.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.642+0000 7f37f862c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37f00c7990 0x7f37f01f3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:43.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.642+0000 7f37f862c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37f0151740 0x7f37f0149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:43.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.642+0000 7f37f862c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f014ced0 con 0x7f37f00c7990 2024-01-23T08:53:43.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.642+0000 7f37f862c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f01f2bc0 con 0x7f37f00c5db0 2024-01-23T08:53:43.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.642+0000 7f37f862c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f01f2890 con 0x7f37f0151740 2024-01-23T08:53:43.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.642+0000 7f37f6bc9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37f0151740 0x7f37f0149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:43.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.642+0000 7f37f63c8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37f00c5db0 0x7f37f00c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:43.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.642+0000 7f37f6bc9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37f0151740 0x7f37f0149780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:41118/0 (socket says 172.21.15.175:41118) 2024-01-23T08:53:43.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.642+0000 7f37f6bc9640 1 -- 172.21.15.175:0/2478340158 learned_addr learned my addr 172.21.15.175:0/2478340158 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-01-23T08:53:43.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.642+0000 7f37f5bc7640 1 --2- 172.21.15.175:0/2478340158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37f00c7990 0x7f37f01f3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:43.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.646+0000 7f37f63c8640 1 -- 172.21.15.175:0/2478340158 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37f0151740 msgr2=0x7f37f0149780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:43.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.646+0000 7f37f63c8640 1 --2- 172.21.15.175:0/2478340158 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37f0151740 0x7f37f0149780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:43.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.646+0000 7f37f63c8640 1 -- 172.21.15.175:0/2478340158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37f00c7990 msgr2=0x7f37f01f3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:43.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.646+0000 7f37f63c8640 1 --2- 172.21.15.175:0/2478340158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37f00c7990 0x7f37f01f3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:43.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.646+0000 7f37f63c8640 1 -- 172.21.15.175:0/2478340158 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e4009420 con 0x7f37f00c5db0 2024-01-23T08:53:43.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.650+0000 7f37f63c8640 1 --2- 172.21.15.175:0/2478340158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37f00c5db0 0x7f37f00c46c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f37e40af000 tx=0x7f37e401ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:43.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.654+0000 7f37e2ffd640 1 -- 172.21.15.175:0/2478340158 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e40b9630 con 0x7f37f00c5db0 2024-01-23T08:53:43.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.654+0000 7f37e2ffd640 1 -- 172.21.15.175:0/2478340158 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e40b97d0 con 0x7f37f00c5db0 2024-01-23T08:53:43.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.654+0000 7f37f862c640 1 -- 172.21.15.175:0/2478340158 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f014cc10 con 0x7f37f00c5db0 2024-01-23T08:53:43.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.654+0000 7f37e2ffd640 1 -- 172.21.15.175:0/2478340158 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e40b9b80 con 0x7f37f00c5db0 2024-01-23T08:53:43.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.654+0000 7f37f862c640 1 -- 172.21.15.175:0/2478340158 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f00c2d80 con 0x7f37f00c5db0 2024-01-23T08:53:43.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.654+0000 7f37f862c640 1 -- 172.21.15.175:0/2478340158 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f00709f0 con 0x7f37f00c5db0 2024-01-23T08:53:43.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.774+0000 7f37e2ffd640 1 -- 172.21.15.175:0/2478340158 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f37e40b7040 con 0x7f37f00c5db0 2024-01-23T08:53:43.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.774+0000 7f37e2ffd640 1 -- 172.21.15.175:0/2478340158 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f37e40ce940 con 0x7f37f00c5db0 2024-01-23T08:53:43.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.774+0000 7f37e2ffd640 1 -- 172.21.15.175:0/2478340158 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f37e40b5070 con 0x7f37f00c5db0 2024-01-23T08:53:43.783 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-23T08:53:43.784+0000 7f7390b6c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-23T08:53:43.821 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-01-23T08:53:43.826+0000 7f70293b0180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-23T08:53:43.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:43.850+0000 7f37f862c640 1 -- 172.21.15.175:0/2478340158 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "eb47a1e5-9f26-465f-b188-87c6eed63c2e", "id": 4} v 0) v1 -- 0x7f37f01f29d0 con 0x7f37f00c5db0 2024-01-23T08:53:43.847 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-23T08:53:43.848+0000 7f7390b6c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-23T08:53:43.883 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-01-23T08:53:43.890+0000 7f70293b0180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-23T08:53:44.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.238+0000 7f37e2ffd640 1 -- 172.21.15.175:0/2478340158 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "eb47a1e5-9f26-465f-b188-87c6eed63c2e", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f37e40d20b0 con 0x7f37f00c5db0 2024-01-23T08:53:44.236 INFO:teuthology.orchestra.run.smithi175.stdout:4 2024-01-23T08:53:44.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.242+0000 7f37f862c640 1 -- 172.21.15.175:0/2478340158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37f00c5db0 msgr2=0x7f37f00c46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:44.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.242+0000 7f37f862c640 1 --2- 172.21.15.175:0/2478340158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37f00c5db0 0x7f37f00c46c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f37e40af000 tx=0x7f37e401ba10 comp rx=0 tx=0).stop 2024-01-23T08:53:44.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.242+0000 7f37f862c640 1 -- 172.21.15.175:0/2478340158 shutdown_connections 2024-01-23T08:53:44.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.242+0000 7f37f862c640 1 --2- 172.21.15.175:0/2478340158 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37f0151740 0x7f37f0149780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:44.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.242+0000 7f37f862c640 1 --2- 172.21.15.175:0/2478340158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37f00c7990 0x7f37f01f3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:44.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.242+0000 7f37f862c640 1 --2- 172.21.15.175:0/2478340158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37f00c5db0 0x7f37f00c46c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:44.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.242+0000 7f37f862c640 1 -- 172.21.15.175:0/2478340158 >> 172.21.15.175:0/2478340158 conn(0x7f37f006b770 msgr2=0x7f37f00c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:53:44.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.242+0000 7f37f862c640 1 -- 172.21.15.175:0/2478340158 shutdown_connections 2024-01-23T08:53:44.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.242+0000 7f37f862c640 1 -- 172.21.15.175:0/2478340158 wait complete. 2024-01-23T08:53:44.267 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 34048409-998c-44f3-a29d-dcad7a6c917b 5 2024-01-23T08:53:44.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.438+0000 7f622cf05640 1 Processor -- start 2024-01-23T08:53:44.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.438+0000 7f622cf05640 1 -- start start 2024-01-23T08:53:44.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.438+0000 7f622cf05640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62281536b0 0x7f62280c7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:44.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.438+0000 7f622cf05640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6228153a90 0x7f622806ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:44.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.438+0000 7f622cf05640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f62280c2bc0 0x7f62280c8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:44.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.438+0000 7f622cf05640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62280c1330 con 0x7f62280c2bc0 2024-01-23T08:53:44.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.438+0000 7f622cf05640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62280c6a90 con 0x7f6228153a90 2024-01-23T08:53:44.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.438+0000 7f622cf05640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622806e000 con 0x7f62281536b0 2024-01-23T08:53:44.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.518+0000 7f622659c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62281536b0 0x7f62280c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:44.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.522+0000 7f622659c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62281536b0 0x7f62280c7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:41134/0 (socket says 172.21.15.175:41134) 2024-01-23T08:53:44.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.522+0000 7f622659c640 1 -- 172.21.15.175:0/228436061 learned_addr learned my addr 172.21.15.175:0/228436061 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-01-23T08:53:44.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.526+0000 7f622659c640 1 -- 172.21.15.175:0/228436061 >> v2:172.21.15.175:3300/0 conn(0x7f6228153a90 msgr2=0x7f622806ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:53:44.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.526+0000 7f622659c640 1 --2- 172.21.15.175:0/228436061 >> v2:172.21.15.175:3300/0 conn(0x7f6228153a90 0x7f622806ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:44.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.526+0000 7f622659c640 1 -- 172.21.15.175:0/228436061 >> v2:172.21.15.46:3300/0 conn(0x7f62280c2bc0 msgr2=0x7f62280c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:53:44.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.526+0000 7f622659c640 1 --2- 172.21.15.175:0/228436061 >> v2:172.21.15.46:3300/0 conn(0x7f62280c2bc0 0x7f62280c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:44.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.526+0000 7f622659c640 1 -- 172.21.15.175:0/228436061 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622806e2e0 con 0x7f62281536b0 2024-01-23T08:53:44.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.534+0000 7f622659c640 1 --2- 172.21.15.175:0/228436061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62281536b0 0x7f62280c7280 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f622806b6d0 tx=0x7f621801ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4da528f275b343d7 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:44.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.538+0000 7f622559a640 1 -- 172.21.15.175:0/228436061 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62180a89b0 con 0x7f62281536b0 2024-01-23T08:53:44.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.538+0000 7f622559a640 1 -- 172.21.15.175:0/228436061 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62180a8b10 con 0x7f62281536b0 2024-01-23T08:53:44.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.538+0000 7f622559a640 1 -- 172.21.15.175:0/228436061 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62180a8ea0 con 0x7f62281536b0 2024-01-23T08:53:44.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.538+0000 7f622cf05640 1 -- 172.21.15.175:0/228436061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62281536b0 msgr2=0x7f62280c7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:44.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.538+0000 7f622cf05640 1 --2- 172.21.15.175:0/228436061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62281536b0 0x7f62280c7280 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f622806b6d0 tx=0x7f621801ecf0 comp rx=0 tx=0).stop 2024-01-23T08:53:44.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.538+0000 7f622cf05640 1 -- 172.21.15.175:0/228436061 shutdown_connections 2024-01-23T08:53:44.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.538+0000 7f622cf05640 1 --2- 172.21.15.175:0/228436061 >> v2:172.21.15.46:3300/0 conn(0x7f62280c2bc0 0x7f62280c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:44.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.538+0000 7f622cf05640 1 --2- 172.21.15.175:0/228436061 >> v2:172.21.15.175:3300/0 conn(0x7f6228153a90 0x7f622806ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:44.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.538+0000 7f622cf05640 1 --2- 172.21.15.175:0/228436061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62281536b0 0x7f62280c7280 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:44.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.538+0000 7f622cf05640 1 -- 172.21.15.175:0/228436061 >> 172.21.15.175:0/228436061 conn(0x7f622806b770 msgr2=0x7f622806bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:53:44.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.538+0000 7f622cf05640 1 -- 172.21.15.175:0/228436061 shutdown_connections 2024-01-23T08:53:44.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.538+0000 7f622cf05640 1 -- 172.21.15.175:0/228436061 wait complete. 2024-01-23T08:53:44.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.542+0000 7f622cf05640 1 Processor -- start 2024-01-23T08:53:44.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.542+0000 7f622cf05640 1 -- start start 2024-01-23T08:53:44.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.542+0000 7f622cf05640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62280c2bc0 0x7f62280ca680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:44.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.542+0000 7f622cf05640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62281536b0 0x7f62280cb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:44.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.542+0000 7f622cf05640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6228148190 0x7f62280c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:44.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.542+0000 7f622cf05640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6228147500 con 0x7f62281536b0 2024-01-23T08:53:44.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.542+0000 7f622cf05640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62281486f0 con 0x7f6228148190 2024-01-23T08:53:44.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.542+0000 7f622cf05640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62280cb940 con 0x7f62280c2bc0 2024-01-23T08:53:44.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.546+0000 7f622659c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62280c2bc0 0x7f62280ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:44.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.546+0000 7f622659c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62280c2bc0 0x7f62280ca680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:41138/0 (socket says 172.21.15.175:41138) 2024-01-23T08:53:44.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.546+0000 7f622659c640 1 -- 172.21.15.175:0/4116331120 learned_addr learned my addr 172.21.15.175:0/4116331120 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-01-23T08:53:44.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.550+0000 7f622659c640 1 -- 172.21.15.175:0/4116331120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6228148190 msgr2=0x7f62280c6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:44.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.550+0000 7f622659c640 1 --2- 172.21.15.175:0/4116331120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6228148190 0x7f62280c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:44.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.550+0000 7f622659c640 1 -- 172.21.15.175:0/4116331120 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62281536b0 msgr2=0x7f62280cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:44.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.550+0000 7f622659c640 1 --2- 172.21.15.175:0/4116331120 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62281536b0 0x7f62280cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:44.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.550+0000 7f622659c640 1 -- 172.21.15.175:0/4116331120 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62180094d0 con 0x7f62280c2bc0 2024-01-23T08:53:44.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.554+0000 7f622659c640 1 --2- 172.21.15.175:0/4116331120 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62280c2bc0 0x7f62280ca680 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f621801c920 tx=0x7f621801ba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:44.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.562+0000 7f621effd640 1 -- 172.21.15.175:0/4116331120 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62180b0e20 con 0x7f62280c2bc0 2024-01-23T08:53:44.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.562+0000 7f621effd640 1 -- 172.21.15.175:0/4116331120 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62180ba440 con 0x7f62280c2bc0 2024-01-23T08:53:44.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.562+0000 7f621effd640 1 -- 172.21.15.175:0/4116331120 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62180ba7f0 con 0x7f62280c2bc0 2024-01-23T08:53:44.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.562+0000 7f622cf05640 1 -- 172.21.15.175:0/4116331120 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6228146880 con 0x7f62280c2bc0 2024-01-23T08:53:44.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.562+0000 7f622cf05640 1 -- 172.21.15.175:0/4116331120 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6228146e40 con 0x7f62280c2bc0 2024-01-23T08:53:44.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.566+0000 7f622cf05640 1 -- 172.21.15.175:0/4116331120 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6228074340 con 0x7f62280c2bc0 2024-01-23T08:53:44.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.594+0000 7f621effd640 1 -- 172.21.15.175:0/4116331120 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 2) v1 ==== 42947+0+0 (secure 0 0 0) 0x7f62180ba950 con 0x7f62280c2bc0 2024-01-23T08:53:44.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.718+0000 7f621effd640 1 -- 172.21.15.175:0/4116331120 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f62180c3d40 con 0x7f62280c2bc0 2024-01-23T08:53:44.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.718+0000 7f621effd640 1 -- 172.21.15.175:0/4116331120 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f62180ce430 con 0x7f62280c2bc0 2024-01-23T08:53:44.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:44.798+0000 7f622cf05640 1 -- 172.21.15.175:0/4116331120 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "34048409-998c-44f3-a29d-dcad7a6c917b", "id": 5} v 0) v1 -- 0x7f6228140ef0 con 0x7f62280c2bc0 2024-01-23T08:53:45.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.210+0000 7f621effd640 1 -- 172.21.15.175:0/4116331120 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "34048409-998c-44f3-a29d-dcad7a6c917b", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f62180b5020 con 0x7f62280c2bc0 2024-01-23T08:53:45.203 INFO:teuthology.orchestra.run.smithi175.stdout:5 2024-01-23T08:53:45.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.210+0000 7f622cf05640 1 -- 172.21.15.175:0/4116331120 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62280c2bc0 msgr2=0x7f62280ca680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:45.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.210+0000 7f622cf05640 1 --2- 172.21.15.175:0/4116331120 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62280c2bc0 0x7f62280ca680 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f621801c920 tx=0x7f621801ba90 comp rx=0 tx=0).stop 2024-01-23T08:53:45.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.210+0000 7f622cf05640 1 -- 172.21.15.175:0/4116331120 shutdown_connections 2024-01-23T08:53:45.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.210+0000 7f622cf05640 1 --2- 172.21.15.175:0/4116331120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6228148190 0x7f62280c6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:45.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.210+0000 7f622cf05640 1 --2- 172.21.15.175:0/4116331120 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62281536b0 0x7f62280cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:45.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.210+0000 7f622cf05640 1 --2- 172.21.15.175:0/4116331120 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62280c2bc0 0x7f62280ca680 secure :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f621801c920 tx=0x7f621801ba90 comp rx=0 tx=0).stop 2024-01-23T08:53:45.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.210+0000 7f622cf05640 1 -- 172.21.15.175:0/4116331120 >> 172.21.15.175:0/4116331120 conn(0x7f622806b770 msgr2=0x7f622814fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:53:45.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.210+0000 7f622cf05640 1 -- 172.21.15.175:0/4116331120 shutdown_connections 2024-01-23T08:53:45.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.210+0000 7f622cf05640 1 -- 172.21.15.175:0/4116331120 wait complete. 2024-01-23T08:53:45.225 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new f5d45d3f-9af3-44a1-a730-c260ed1654b9 6 2024-01-23T08:53:45.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.350+0000 7f7279419640 1 Processor -- start 2024-01-23T08:53:45.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.350+0000 7f7279419640 1 -- start start 2024-01-23T08:53:45.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.350+0000 7f7279419640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72740c5580 0x7f72740c7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:45.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.350+0000 7f7279419640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72740c7c10 con 0x7f72741507a0 2024-01-23T08:53:45.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.350+0000 7f7279419640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7274159850 con 0x7f72740c51a0 2024-01-23T08:53:45.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.350+0000 7f7279419640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7274159b30 con 0x7f72740c5580 2024-01-23T08:53:45.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.354+0000 7f72737fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72740c5580 0x7f72740c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:45.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.354+0000 7f72737fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72740c5580 0x7f72740c7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:41154/0 (socket says 172.21.15.175:41154) 2024-01-23T08:53:45.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.354+0000 7f72737fe640 1 -- 172.21.15.175:0/3204032750 learned_addr learned my addr 172.21.15.175:0/3204032750 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-01-23T08:53:45.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.354+0000 7f72737fe640 1 -- 172.21.15.175:0/3204032750 >> v1:172.21.15.175:6789/0 conn(0x7f72740c51a0 legacy=0x7f7274150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:53:45.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.354+0000 7f72737fe640 1 -- 172.21.15.175:0/3204032750 >> v1:172.21.15.46:6789/0 conn(0x7f72741507a0 legacy=0x7f72740c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:53:45.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.354+0000 7f72737fe640 1 -- 172.21.15.175:0/3204032750 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7274159e10 con 0x7f72740c5580 2024-01-23T08:53:45.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.358+0000 7f72737fe640 1 --2- 172.21.15.175:0/3204032750 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72740c5580 0x7f72740c7620 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f726c009e80 tx=0x7f726c01f1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=646509c939385e53 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:45.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.362+0000 7f7271ffb640 1 -- 172.21.15.175:0/3204032750 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c0af400 con 0x7f72740c5580 2024-01-23T08:53:45.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.362+0000 7f7271ffb640 1 -- 172.21.15.175:0/3204032750 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726c0ab050 con 0x7f72740c5580 2024-01-23T08:53:45.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.362+0000 7f7271ffb640 1 -- 172.21.15.175:0/3204032750 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c0af780 con 0x7f72740c5580 2024-01-23T08:53:45.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.362+0000 7f7279419640 1 -- 172.21.15.175:0/3204032750 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72740c5580 msgr2=0x7f72740c7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:45.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.362+0000 7f7279419640 1 --2- 172.21.15.175:0/3204032750 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72740c5580 0x7f72740c7620 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f726c009e80 tx=0x7f726c01f1a0 comp rx=0 tx=0).stop 2024-01-23T08:53:45.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.362+0000 7f7279419640 1 -- 172.21.15.175:0/3204032750 shutdown_connections 2024-01-23T08:53:45.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.362+0000 7f7279419640 1 --2- 172.21.15.175:0/3204032750 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72740c5580 0x7f72740c7620 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:45.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.362+0000 7f7279419640 1 -- 172.21.15.175:0/3204032750 >> 172.21.15.175:0/3204032750 conn(0x7f72740cb3e0 msgr2=0x7f72740cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:53:45.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.362+0000 7f7279419640 1 -- 172.21.15.175:0/3204032750 shutdown_connections 2024-01-23T08:53:45.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.362+0000 7f7279419640 1 -- 172.21.15.175:0/3204032750 wait complete. 2024-01-23T08:53:45.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.366+0000 7f7279419640 1 Processor -- start 2024-01-23T08:53:45.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.366+0000 7f7279419640 1 -- start start 2024-01-23T08:53:45.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.366+0000 7f7279419640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72740c51a0 0x7f72741540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:45.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.366+0000 7f7279419640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72740c5580 0x7f72741edf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:45.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.366+0000 7f7279419640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72741507a0 0x7f727414db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:45.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.366+0000 7f7279419640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7274151800 con 0x7f72740c5580 2024-01-23T08:53:45.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.366+0000 7f7279419640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72741ee4b0 con 0x7f72741507a0 2024-01-23T08:53:45.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.366+0000 7f7279419640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7274154730 con 0x7f72740c51a0 2024-01-23T08:53:45.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.366+0000 7f7272ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72740c51a0 0x7f72741540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:45.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.366+0000 7f7272ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72740c51a0 0x7f72741540f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:41158/0 (socket says 172.21.15.175:41158) 2024-01-23T08:53:45.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.366+0000 7f7272ffd640 1 -- 172.21.15.175:0/162199022 learned_addr learned my addr 172.21.15.175:0/162199022 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-01-23T08:53:45.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.370+0000 7f7272ffd640 1 -- 172.21.15.175:0/162199022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72741507a0 msgr2=0x7f727414db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:45.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.370+0000 7f7272ffd640 1 --2- 172.21.15.175:0/162199022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72741507a0 0x7f727414db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:45.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.370+0000 7f7272ffd640 1 -- 172.21.15.175:0/162199022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72740c5580 msgr2=0x7f72741edf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:45.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.370+0000 7f7272ffd640 1 --2- 172.21.15.175:0/162199022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72740c5580 0x7f72741edf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:45.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.370+0000 7f7272ffd640 1 -- 172.21.15.175:0/162199022 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726c009b30 con 0x7f72740c51a0 2024-01-23T08:53:45.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.370+0000 7f7272ffd640 1 --2- 172.21.15.175:0/162199022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72740c51a0 0x7f72741540f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f725c00c490 tx=0x7f725c001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:45.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.378+0000 7f726b7fe640 1 -- 172.21.15.175:0/162199022 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c003600 con 0x7f72740c51a0 2024-01-23T08:53:45.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.378+0000 7f726b7fe640 1 -- 172.21.15.175:0/162199022 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725c003780 con 0x7f72740c51a0 2024-01-23T08:53:45.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.378+0000 7f7279419640 1 -- 172.21.15.175:0/162199022 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7274150bf0 con 0x7f72740c51a0 2024-01-23T08:53:45.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.378+0000 7f726b7fe640 1 -- 172.21.15.175:0/162199022 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c003b70 con 0x7f72740c51a0 2024-01-23T08:53:45.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.378+0000 7f7279419640 1 -- 172.21.15.175:0/162199022 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72741511b0 con 0x7f72740c51a0 2024-01-23T08:53:45.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.378+0000 7f7279419640 1 -- 172.21.15.175:0/162199022 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7274074340 con 0x7f72740c51a0 2024-01-23T08:53:45.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.506+0000 7f726b7fe640 1 -- 172.21.15.175:0/162199022 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 2) v1 ==== 42947+0+0 (secure 0 0 0) 0x7f725c003cd0 con 0x7f72740c51a0 2024-01-23T08:53:45.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.510+0000 7f726b7fe640 1 -- 172.21.15.175:0/162199022 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f725c01b3b0 con 0x7f72740c51a0 2024-01-23T08:53:45.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.510+0000 7f726b7fe640 1 -- 172.21.15.175:0/162199022 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f725c01bb10 con 0x7f72740c51a0 2024-01-23T08:53:45.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:45.578+0000 7f7279419640 1 -- 172.21.15.175:0/162199022 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f5d45d3f-9af3-44a1-a730-c260ed1654b9", "id": 6} v 0) v1 -- 0x7f72740cbc60 con 0x7f72740c51a0 2024-01-23T08:53:46.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:46.414+0000 7f726b7fe640 1 -- 172.21.15.175:0/162199022 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mgrmap(e 3) v1 ==== 85657+0+0 (secure 0 0 0) 0x7f725c01ad20 con 0x7f72740c51a0 2024-01-23T08:53:46.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:46.414+0000 7f726b7fe640 1 --2- 172.21.15.175:0/162199022 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7254066790 0x7f7254068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:46.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:46.414+0000 7f72727fc640 1 --2- 172.21.15.175:0/162199022 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7254066790 0x7f7254068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:46.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:46.414+0000 7f72727fc640 1 --2- 172.21.15.175:0/162199022 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7254066790 0x7f7254068b80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7274150bc0 tx=0x7f7264006bb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:46.595 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-23T08:53:46.600+0000 7f73383b9640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-01-23T08:53:46.674 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-23T08:53:46.676+0000 7f73383b9640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-01-23T08:53:46.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:46.874+0000 7f726b7fe640 1 -- 172.21.15.175:0/162199022 <== mon.2 v2:172.21.15.175:3301/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f5d45d3f-9af3-44a1-a730-c260ed1654b9", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f725c0534c0 con 0x7f72740c51a0 2024-01-23T08:53:46.870 INFO:teuthology.orchestra.run.smithi175.stdout:6 2024-01-23T08:53:46.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:46.878+0000 7f7279419640 1 -- 172.21.15.175:0/162199022 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7254066790 msgr2=0x7f7254068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:46.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:46.878+0000 7f7279419640 1 --2- 172.21.15.175:0/162199022 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7254066790 0x7f7254068b80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7274150bc0 tx=0x7f7264006bb0 comp rx=0 tx=0).stop 2024-01-23T08:53:46.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:46.878+0000 7f7279419640 1 -- 172.21.15.175:0/162199022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72740c51a0 msgr2=0x7f72741540f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:46.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:46.878+0000 7f7279419640 1 --2- 172.21.15.175:0/162199022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72740c51a0 0x7f72741540f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f725c00c490 tx=0x7f725c001e80 comp rx=0 tx=0).stop 2024-01-23T08:53:46.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:46.878+0000 7f7279419640 1 -- 172.21.15.175:0/162199022 shutdown_connections 2024-01-23T08:53:46.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:46.878+0000 7f7279419640 1 --2- 172.21.15.175:0/162199022 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7254066790 0x7f7254068b80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:46.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:46.878+0000 7f7279419640 1 --2- 172.21.15.175:0/162199022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72741507a0 0x7f727414db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:46.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:46.878+0000 7f7279419640 1 --2- 172.21.15.175:0/162199022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72740c5580 0x7f72741edf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:46.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:46.878+0000 7f7279419640 1 --2- 172.21.15.175:0/162199022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72740c51a0 0x7f72741540f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:46.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:46.878+0000 7f7279419640 1 -- 172.21.15.175:0/162199022 >> 172.21.15.175:0/162199022 conn(0x7f72740cb3e0 msgr2=0x7f727414ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:53:46.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:46.878+0000 7f7279419640 1 -- 172.21.15.175:0/162199022 shutdown_connections 2024-01-23T08:53:46.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:46.878+0000 7f7279419640 1 -- 172.21.15.175:0/162199022 wait complete. 2024-01-23T08:53:46.892 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 16d12e53-2ad3-4b5c-a789-22b45056fd9d 7 2024-01-23T08:53:47.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.022+0000 7f68a937d640 1 Processor -- start 2024-01-23T08:53:47.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.022+0000 7f68a937d640 1 -- start start 2024-01-23T08:53:47.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.022+0000 7f68a937d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68a41518a0 0x7f68a415ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:47.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.022+0000 7f68a937d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a415a9d0 con 0x7f68a40c7f30 2024-01-23T08:53:47.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.022+0000 7f68a937d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a41573e0 con 0x7f68a40c8310 2024-01-23T08:53:47.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.022+0000 7f68a937d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a406e1a0 con 0x7f68a41518a0 2024-01-23T08:53:47.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.022+0000 7f68a37fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68a41518a0 0x7f68a415ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:47.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.022+0000 7f68a27fc640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f68a40c8310 0x7f68a4151190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:59154/0 (socket says 172.21.15.175:59154) 2024-01-23T08:53:47.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.022+0000 7f68a27fc640 1 -- 172.21.15.175:0/762051174 learned_addr learned my addr 172.21.15.175:0/762051174 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-01-23T08:53:47.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.026+0000 7f68a37fe640 1 -- 172.21.15.175:0/762051174 >> v1:172.21.15.175:6789/0 conn(0x7f68a40c8310 legacy=0x7f68a4151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:47.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.026+0000 7f68a37fe640 1 -- 172.21.15.175:0/762051174 >> v1:172.21.15.46:6789/0 conn(0x7f68a40c7f30 legacy=0x7f68a406da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:53:47.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.026+0000 7f68a37fe640 1 -- 172.21.15.175:0/762051174 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a41576a0 con 0x7f68a41518a0 2024-01-23T08:53:47.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.030+0000 7f68a37fe640 1 --2- 172.21.15.175:0/762051174 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68a41518a0 0x7f68a415ae60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f689c009dc0 tx=0x7f689c01f120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=914d3bbc05e6d8ee server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:47.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.034+0000 7f68a1ffb640 1 -- 172.21.15.175:0/762051174 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c0af600 con 0x7f68a41518a0 2024-01-23T08:53:47.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.034+0000 7f68a1ffb640 1 -- 172.21.15.175:0/762051174 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689c0ab050 con 0x7f68a41518a0 2024-01-23T08:53:47.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.034+0000 7f68a1ffb640 1 -- 172.21.15.175:0/762051174 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c0af980 con 0x7f68a41518a0 2024-01-23T08:53:47.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.034+0000 7f68a937d640 1 -- 172.21.15.175:0/762051174 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68a41518a0 msgr2=0x7f68a415ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:47.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.034+0000 7f68a937d640 1 --2- 172.21.15.175:0/762051174 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68a41518a0 0x7f68a415ae60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f689c009dc0 tx=0x7f689c01f120 comp rx=0 tx=0).stop 2024-01-23T08:53:47.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.034+0000 7f68a937d640 1 -- 172.21.15.175:0/762051174 shutdown_connections 2024-01-23T08:53:47.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.034+0000 7f68a937d640 1 --2- 172.21.15.175:0/762051174 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68a41518a0 0x7f68a415ae60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:47.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.034+0000 7f68a937d640 1 -- 172.21.15.175:0/762051174 >> 172.21.15.175:0/762051174 conn(0x7f68a406aa60 msgr2=0x7f68a406ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:53:47.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.034+0000 7f68a937d640 1 -- 172.21.15.175:0/762051174 shutdown_connections 2024-01-23T08:53:47.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.034+0000 7f68a937d640 1 -- 172.21.15.175:0/762051174 wait complete. 2024-01-23T08:53:47.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.038+0000 7f68a937d640 1 Processor -- start 2024-01-23T08:53:47.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.038+0000 7f68a937d640 1 -- start start 2024-01-23T08:53:47.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.038+0000 7f68a937d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68a40c7f30 0x7f68a4142ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:47.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.038+0000 7f68a937d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68a40c8310 0x7f68a41503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:47.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.038+0000 7f68a937d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68a41518a0 0x7f68a40c1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:47.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.038+0000 7f68a937d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a414ebd0 con 0x7f68a40c8310 2024-01-23T08:53:47.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.038+0000 7f68a937d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a40c2c30 con 0x7f68a41518a0 2024-01-23T08:53:47.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.038+0000 7f68a937d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a41430e0 con 0x7f68a40c7f30 2024-01-23T08:53:47.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.038+0000 7f68a2ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68a40c7f30 0x7f68a4142ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:47.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.038+0000 7f68a37fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68a41518a0 0x7f68a40c1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:47.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.038+0000 7f68a2ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68a40c7f30 0x7f68a4142ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:41188/0 (socket says 172.21.15.175:41188) 2024-01-23T08:53:47.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.038+0000 7f68a2ffd640 1 -- 172.21.15.175:0/1224357901 learned_addr learned my addr 172.21.15.175:0/1224357901 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-01-23T08:53:47.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.042+0000 7f68a2ffd640 1 -- 172.21.15.175:0/1224357901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68a41518a0 msgr2=0x7f68a40c1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:47.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.042+0000 7f68a2ffd640 1 --2- 172.21.15.175:0/1224357901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68a41518a0 0x7f68a40c1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:47.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.042+0000 7f68a2ffd640 1 -- 172.21.15.175:0/1224357901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68a40c8310 msgr2=0x7f68a41503e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:47.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.042+0000 7f68a2ffd640 1 --2- 172.21.15.175:0/1224357901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68a40c8310 0x7f68a41503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:47.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.042+0000 7f68a2ffd640 1 -- 172.21.15.175:0/1224357901 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689c009a70 con 0x7f68a40c7f30 2024-01-23T08:53:47.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.046+0000 7f68a2ffd640 1 --2- 172.21.15.175:0/1224357901 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68a40c7f30 0x7f68a4142ba0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f689400c490 tx=0x7f6894001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:47.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.046+0000 7f688b7fe640 1 -- 172.21.15.175:0/1224357901 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6894003600 con 0x7f68a40c7f30 2024-01-23T08:53:47.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.046+0000 7f688b7fe640 1 -- 172.21.15.175:0/1224357901 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6894003780 con 0x7f68a40c7f30 2024-01-23T08:53:47.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.046+0000 7f68a937d640 1 -- 172.21.15.175:0/1224357901 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a40c02a0 con 0x7f68a40c7f30 2024-01-23T08:53:47.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.046+0000 7f688b7fe640 1 -- 172.21.15.175:0/1224357901 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6894003b70 con 0x7f68a40c7f30 2024-01-23T08:53:47.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.046+0000 7f68a937d640 1 -- 172.21.15.175:0/1224357901 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a41f2fd0 con 0x7f68a40c7f30 2024-01-23T08:53:47.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.050+0000 7f68a937d640 1 -- 172.21.15.175:0/1224357901 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a4074340 con 0x7f68a40c7f30 2024-01-23T08:53:47.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.070+0000 7f688b7fe640 1 -- 172.21.15.175:0/1224357901 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 3) v1 ==== 85657+0+0 (secure 0 0 0) 0x7f6894003cd0 con 0x7f68a40c7f30 2024-01-23T08:53:47.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.070+0000 7f688b7fe640 1 --2- 172.21.15.175:0/1224357901 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6890066350 0x7f6890068810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:47.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.070+0000 7f68a27fc640 1 --2- 172.21.15.175:0/1224357901 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6890066350 0x7f6890068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:47.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.070+0000 7f68a27fc640 1 --2- 172.21.15.175:0/1224357901 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6890066350 0x7f6890068810 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6898000f70 tx=0x7f6898007a90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:47.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.350+0000 7f688b7fe640 1 -- 172.21.15.175:0/1224357901 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f6894054860 con 0x7f68a40c7f30 2024-01-23T08:53:47.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.350+0000 7f688b7fe640 1 -- 172.21.15.175:0/1224357901 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6894050ba0 con 0x7f68a40c7f30 2024-01-23T08:53:47.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.526+0000 7f68a937d640 1 -- 172.21.15.175:0/1224357901 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "16d12e53-2ad3-4b5c-a789-22b45056fd9d", "id": 7} v 0) v1 -- 0x7f68a406d090 con 0x7f68a40c7f30 2024-01-23T08:53:47.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:47.810+0000 7f688b7fe640 1 -- 172.21.15.175:0/1224357901 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mgrmap(e 4) v1 ==== 85763+0+0 (secure 0 0 0) 0x7f6894050f70 con 0x7f68a40c7f30 2024-01-23T08:53:48.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:48.170+0000 7f688b7fe640 1 -- 172.21.15.175:0/1224357901 <== mon.2 v2:172.21.15.175:3301/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "16d12e53-2ad3-4b5c-a789-22b45056fd9d", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6894075790 con 0x7f68a40c7f30 2024-01-23T08:53:48.167 INFO:teuthology.orchestra.run.smithi175.stdout:7 2024-01-23T08:53:48.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:48.178+0000 7f68a937d640 1 -- 172.21.15.175:0/1224357901 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6890066350 msgr2=0x7f6890068810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:48.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:48.178+0000 7f68a937d640 1 --2- 172.21.15.175:0/1224357901 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6890066350 0x7f6890068810 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6898000f70 tx=0x7f6898007a90 comp rx=0 tx=0).stop 2024-01-23T08:53:48.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:48.178+0000 7f68a937d640 1 -- 172.21.15.175:0/1224357901 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68a40c7f30 msgr2=0x7f68a4142ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:48.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:48.178+0000 7f68a937d640 1 --2- 172.21.15.175:0/1224357901 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68a40c7f30 0x7f68a4142ba0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f689400c490 tx=0x7f6894001e80 comp rx=0 tx=0).stop 2024-01-23T08:53:48.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:48.178+0000 7f68a937d640 1 -- 172.21.15.175:0/1224357901 shutdown_connections 2024-01-23T08:53:48.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:48.178+0000 7f68a937d640 1 --2- 172.21.15.175:0/1224357901 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6890066350 0x7f6890068810 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:48.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:48.178+0000 7f68a937d640 1 --2- 172.21.15.175:0/1224357901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68a41518a0 0x7f68a40c1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:48.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:48.178+0000 7f68a937d640 1 --2- 172.21.15.175:0/1224357901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68a40c8310 0x7f68a41503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:48.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:48.178+0000 7f68a937d640 1 --2- 172.21.15.175:0/1224357901 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68a40c7f30 0x7f68a4142ba0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:48.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:48.178+0000 7f68a937d640 1 -- 172.21.15.175:0/1224357901 >> 172.21.15.175:0/1224357901 conn(0x7f68a406aa60 msgr2=0x7f68a40c54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:53:48.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:48.178+0000 7f68a937d640 1 -- 172.21.15.175:0/1224357901 shutdown_connections 2024-01-23T08:53:48.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-01-23T08:53:48.178+0000 7f68a937d640 1 -- 172.21.15.175:0/1224357901 wait complete. 2024-01-23T08:53:48.185 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T08:53:48.190 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T08:53:48.194 INFO:tasks.ceph.osd.0:Restarting daemon 2024-01-23T08:53:48.194 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2024-01-23T08:53:48.276 INFO:tasks.ceph.osd.0:Started 2024-01-23T08:53:48.276 INFO:tasks.ceph.osd.1:Restarting daemon 2024-01-23T08:53:48.276 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2024-01-23T08:53:48.278 INFO:tasks.ceph.osd.1:Started 2024-01-23T08:53:48.278 INFO:tasks.ceph.osd.2:Restarting daemon 2024-01-23T08:53:48.279 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2024-01-23T08:53:48.281 INFO:tasks.ceph.osd.2:Started 2024-01-23T08:53:48.281 INFO:tasks.ceph.osd.3:Restarting daemon 2024-01-23T08:53:48.281 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2024-01-23T08:53:48.283 INFO:tasks.ceph.osd.3:Started 2024-01-23T08:53:48.283 INFO:tasks.ceph.osd.4:Restarting daemon 2024-01-23T08:53:48.283 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2024-01-23T08:53:48.285 INFO:tasks.ceph.osd.4:Started 2024-01-23T08:53:48.286 INFO:tasks.ceph.osd.5:Restarting daemon 2024-01-23T08:53:48.286 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2024-01-23T08:53:48.288 INFO:tasks.ceph.osd.5:Started 2024-01-23T08:53:48.288 INFO:tasks.ceph.osd.6:Restarting daemon 2024-01-23T08:53:48.288 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2024-01-23T08:53:48.290 INFO:tasks.ceph.osd.6:Started 2024-01-23T08:53:48.290 INFO:tasks.ceph.osd.7:Restarting daemon 2024-01-23T08:53:48.291 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2024-01-23T08:53:48.293 INFO:tasks.ceph.osd.7:Started 2024-01-23T08:53:48.294 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-23T08:53:48.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.436+0000 7fcfef477640 1 Processor -- start 2024-01-23T08:53:48.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.436+0000 7fcfef477640 1 -- start start 2024-01-23T08:53:48.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.436+0000 7fcfef477640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcfe80c8ea0 0x7fcfe80ca200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:48.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.436+0000 7fcfef477640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe80c7620 con 0x7fcfe8153900 2024-01-23T08:53:48.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.436+0000 7fcfef477640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe80c7b50 con 0x7fcfe80c93f0 2024-01-23T08:53:48.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.436+0000 7fcfef477640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe80c8b20 con 0x7fcfe80c8ea0 2024-01-23T08:53:48.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.448+0000 7fcfeca12640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fcfe80c93f0 0x7fcfe815d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.46:48744/0 (socket says 172.21.15.46:48744) 2024-01-23T08:53:48.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.448+0000 7fcfeca12640 1 -- 172.21.15.46:0/3393937229 learned_addr learned my addr 172.21.15.46:0/3393937229 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:53:48.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.452+0000 7fcfeda14640 1 --2- 172.21.15.46:0/3393937229 >> v2:172.21.15.46:3300/0 conn(0x7fcfe80c8ea0 0x7fcfe80ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:48.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.460+0000 7fcfdffff640 1 -- 172.21.15.46:0/3393937229 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1073204240 0 0) 0x7fcfe80c7620 con 0x7fcfe8153900 2024-01-23T08:53:48.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.460+0000 7fcfdffff640 1 -- 172.21.15.46:0/3393937229 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfd4003530 con 0x7fcfe8153900 2024-01-23T08:53:48.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.464+0000 7fcfdffff640 1 -- 172.21.15.46:0/3393937229 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3203419856 0 0) 0x7fcfd4003530 con 0x7fcfe8153900 2024-01-23T08:53:48.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.464+0000 7fcfdffff640 1 -- 172.21.15.46:0/3393937229 >> v2:172.21.15.46:3300/0 conn(0x7fcfe80c8ea0 msgr2=0x7fcfe80ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:53:48.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.464+0000 7fcfdffff640 1 --2- 172.21.15.46:0/3393937229 >> v2:172.21.15.46:3300/0 conn(0x7fcfe80c8ea0 0x7fcfe80ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:48.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.464+0000 7fcfdffff640 1 -- 172.21.15.46:0/3393937229 >> v1:172.21.15.175:6789/0 conn(0x7fcfe80c93f0 legacy=0x7fcfe815d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:53:48.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.464+0000 7fcfdffff640 1 -- 172.21.15.46:0/3393937229 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe815cd30 con 0x7fcfe8153900 2024-01-23T08:53:48.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.464+0000 7fcfdffff640 1 -- 172.21.15.46:0/3393937229 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466917103 0 0) 0x7fcfe4001680 con 0x7fcfe8153900 2024-01-23T08:53:48.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.464+0000 7fcfdffff640 1 -- 172.21.15.46:0/3393937229 >> v1:172.21.15.46:6789/0 conn(0x7fcfe8153900 legacy=0x7fcfe8070b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:48.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.464+0000 7fcfdffff640 1 --2- 172.21.15.46:0/3393937229 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfd40039d0 0x7fcfd4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:48.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.464+0000 7fcfdffff640 1 --2- 172.21.15.46:0/3393937229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfd40047d0 0x7fcfd4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:48.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.464+0000 7fcfdffff640 1 --2- 172.21.15.46:0/3393937229 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcfd4005190 0x7fcfd400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:48.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.464+0000 7fcfdffff640 1 -- 172.21.15.46:0/3393937229 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe80c8b20 con 0x7fcfd40039d0 2024-01-23T08:53:48.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.464+0000 7fcfdffff640 1 -- 172.21.15.46:0/3393937229 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd400c060 con 0x7fcfd40047d0 2024-01-23T08:53:48.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.464+0000 7fcfdffff640 1 -- 172.21.15.46:0/3393937229 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd400c220 con 0x7fcfd4005190 2024-01-23T08:53:48.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.464+0000 7fcfeda14640 1 --2- 172.21.15.46:0/3393937229 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcfd4005190 0x7fcfd400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:48.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.468+0000 7fcfeda14640 1 -- 172.21.15.46:0/3393937229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfd40047d0 msgr2=0x7fcfd4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:53:48.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.468+0000 7fcfeda14640 1 --2- 172.21.15.46:0/3393937229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfd40047d0 0x7fcfd4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:48.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.468+0000 7fcfeda14640 1 -- 172.21.15.46:0/3393937229 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfd40039d0 msgr2=0x7fcfd4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:53:48.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.468+0000 7fcfeda14640 1 --2- 172.21.15.46:0/3393937229 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfd40039d0 0x7fcfd4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:48.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.468+0000 7fcfeda14640 1 -- 172.21.15.46:0/3393937229 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd4003530 con 0x7fcfd4005190 2024-01-23T08:53:48.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.468+0000 7fcfeda14640 1 -- 172.21.15.46:0/3393937229 reap_dead start 2024-01-23T08:53:48.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.472+0000 7fcfeda14640 1 --2- 172.21.15.46:0/3393937229 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcfd4005190 0x7fcfd400b990 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009fc0 tx=0x7fcfe001cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=547ded3e5cceecd5 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.476+0000 7fcfdffff640 1 -- 172.21.15.46:0/3393937229 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe00a5c60 con 0x7fcfd4005190 2024-01-23T08:53:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.476+0000 7fcfdffff640 1 -- 172.21.15.46:0/3393937229 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe000f040 con 0x7fcfd4005190 2024-01-23T08:53:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.476+0000 7fcfdffff640 1 -- 172.21.15.46:0/3393937229 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe00039a0 con 0x7fcfd4005190 2024-01-23T08:53:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.476+0000 7fcfef477640 1 -- 172.21.15.46:0/3393937229 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcfd4005190 msgr2=0x7fcfd400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.476+0000 7fcfef477640 1 --2- 172.21.15.46:0/3393937229 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcfd4005190 0x7fcfd400b990 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009fc0 tx=0x7fcfe001cc70 comp rx=0 tx=0).stop 2024-01-23T08:53:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.476+0000 7fcfef477640 1 -- 172.21.15.46:0/3393937229 shutdown_connections 2024-01-23T08:53:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.476+0000 7fcfef477640 1 --2- 172.21.15.46:0/3393937229 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcfd4005190 0x7fcfd400b990 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:48.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.476+0000 7fcfef477640 1 -- 172.21.15.46:0/3393937229 >> 172.21.15.46:0/3393937229 conn(0x7fcfe8066b40 msgr2=0x7fcfe806eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:53:48.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.476+0000 7fcfef477640 1 -- 172.21.15.46:0/3393937229 shutdown_connections 2024-01-23T08:53:48.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.476+0000 7fcfef477640 1 -- 172.21.15.46:0/3393937229 wait complete. 2024-01-23T08:53:48.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.476+0000 7fcfef477640 1 Processor -- start 2024-01-23T08:53:48.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.476+0000 7fcfef477640 1 -- start start 2024-01-23T08:53:48.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.476+0000 7fcfef477640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfd4005190 0x7fcfe81f1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:48.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.476+0000 7fcfef477640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcfe80cb7a0 0x7fcfe81f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:48.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.476+0000 7fcfef477640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfe80c3c00 0x7fcfe814a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:48.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.476+0000 7fcfef477640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe8150f60 con 0x7fcfe80c3c00 2024-01-23T08:53:48.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.476+0000 7fcfef477640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe8151520 con 0x7fcfd4005190 2024-01-23T08:53:48.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.476+0000 7fcfef477640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe80cd540 con 0x7fcfe80cb7a0 2024-01-23T08:53:48.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.480+0000 7fcfeda14640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfe80c3c00 0x7fcfe814a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:48.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.480+0000 7fcfeca12640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcfe80cb7a0 0x7fcfe81f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:48.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.480+0000 7fcfeca12640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcfe80cb7a0 0x7fcfe81f20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:45258/0 (socket says 172.21.15.46:45258) 2024-01-23T08:53:48.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.480+0000 7fcfeca12640 1 -- 172.21.15.46:0/2397890397 learned_addr learned my addr 172.21.15.46:0/2397890397 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:53:48.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.484+0000 7fcfeca12640 1 -- 172.21.15.46:0/2397890397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfd4005190 msgr2=0x7fcfe81f1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:48.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.484+0000 7fcfeca12640 1 --2- 172.21.15.46:0/2397890397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfd4005190 0x7fcfe81f1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:48.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.484+0000 7fcfeca12640 1 -- 172.21.15.46:0/2397890397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfe80c3c00 msgr2=0x7fcfe814a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:48.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.484+0000 7fcfeca12640 1 --2- 172.21.15.46:0/2397890397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfe80c3c00 0x7fcfe814a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:48.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.484+0000 7fcfeca12640 1 -- 172.21.15.46:0/2397890397 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe81f5830 con 0x7fcfe80cb7a0 2024-01-23T08:53:48.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.484+0000 7fcfeda14640 1 --2- 172.21.15.46:0/2397890397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfe80c3c00 0x7fcfe814a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-23T08:53:48.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.484+0000 7fcfeca12640 1 --2- 172.21.15.46:0/2397890397 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcfe80cb7a0 0x7fcfe81f20a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcfd800c3c0 tx=0x7fcfd800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:48.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.488+0000 7fcfddffb640 1 -- 172.21.15.46:0/2397890397 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8005cf0 con 0x7fcfe80cb7a0 2024-01-23T08:53:48.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.488+0000 7fcfddffb640 1 -- 172.21.15.46:0/2397890397 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd8005e50 con 0x7fcfe80cb7a0 2024-01-23T08:53:48.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.488+0000 7fcfddffb640 1 -- 172.21.15.46:0/2397890397 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd80072f0 con 0x7fcfe80cb7a0 2024-01-23T08:53:48.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.488+0000 7fcfef477640 1 -- 172.21.15.46:0/2397890397 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe81f5b10 con 0x7fcfe80cb7a0 2024-01-23T08:53:48.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.488+0000 7fcfef477640 1 -- 172.21.15.46:0/2397890397 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe80cd200 con 0x7fcfe80cb7a0 2024-01-23T08:53:48.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.492+0000 7fcfef477640 1 -- 172.21.15.46:0/2397890397 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe81f5cd0 con 0x7fcfe80cb7a0 2024-01-23T08:53:48.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.512+0000 7fcfddffb640 1 -- 172.21.15.46:0/2397890397 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 4) v1 ==== 85763+0+0 (secure 0 0 0) 0x7fcfd8007450 con 0x7fcfe80cb7a0 2024-01-23T08:53:48.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.512+0000 7fcfddffb640 1 --2- 172.21.15.46:0/2397890397 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fcfcc0664c0 0x7fcfcc068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:48.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.512+0000 7fcfed213640 1 --2- 172.21.15.46:0/2397890397 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fcfcc0664c0 0x7fcfcc068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:48.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.512+0000 7fcfed213640 1 --2- 172.21.15.46:0/2397890397 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fcfcc0664c0 0x7fcfcc068980 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4007950 tx=0x7fcfe4001630 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:48.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.512+0000 7fcfddffb640 1 -- 172.21.15.46:0/2397890397 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fcfd8054750 con 0x7fcfe80cb7a0 2024-01-23T08:53:48.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:48.824+0000 7fcfddffb640 1 -- 172.21.15.46:0/2397890397 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fcfd8050a90 con 0x7fcfe80cb7a0 2024-01-23T08:53:48.977 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-01-23T08:53:48.980+0000 7f5c2bd7f640 -1 Falling back to public interface 2024-01-23T08:53:48.984 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-01-23T08:53:48.990+0000 7fedfae0b640 -1 Falling back to public interface 2024-01-23T08:53:48.984 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-01-23T08:53:48.990+0000 7f746bc8a640 -1 Falling back to public interface 2024-01-23T08:53:48.991 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-01-23T08:53:48.996+0000 7f071706e640 -1 Falling back to public interface 2024-01-23T08:53:48.992 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-01-23T08:53:48.998+0000 7ffaab199640 -1 Falling back to public interface 2024-01-23T08:53:48.992 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-01-23T08:53:48.998+0000 7ff7a40e6640 -1 Falling back to public interface 2024-01-23T08:53:48.993 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-01-23T08:53:48.996+0000 7fc1962ff640 -1 Falling back to public interface 2024-01-23T08:53:48.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:49.000+0000 7fcfef477640 1 -- 172.21.15.46:0/2397890397 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfe81f5ca0 con 0x7fcfe80cb7a0 2024-01-23T08:53:49.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:49.052+0000 7fcfddffb640 1 -- 172.21.15.46:0/2397890397 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fcfd8017020 con 0x7fcfe80cb7a0 2024-01-23T08:53:49.048 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:53:49.048 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":10,"fsid":"fdbdd393-f422-45ae-a488-2bbb0163e580","created":"2024-01-23T08:53:36.942515+0000","modified":"2024-01-23T08:53:47.852614+0000","last_up_change":"0.000000","last_in_change":"2024-01-23T08:53:47.852614+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f32c3d7d-e32a-42d8-b55f-db874d915a12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6f3b6bd2-bbea-4d08-84d5-4407363b5eb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8f110727-31e7-4f69-926b-c87481d4d28d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3aa7527d-0463-4373-b9c7-e6b507a7987f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"eb47a1e5-9f26-465f-b188-87c6eed63c2e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"34048409-998c-44f3-a29d-dcad7a6c917b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f5d45d3f-9af3-44a1-a730-c260ed1654b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"16d12e53-2ad3-4b5c-a789-22b45056fd9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T08:53:49.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:49.052+0000 7fcfef477640 1 -- 172.21.15.46:0/2397890397 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fcfcc0664c0 msgr2=0x7fcfcc068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:49.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:49.052+0000 7fcfef477640 1 --2- 172.21.15.46:0/2397890397 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fcfcc0664c0 0x7fcfcc068980 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4007950 tx=0x7fcfe4001630 comp rx=0 tx=0).stop 2024-01-23T08:53:49.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:49.052+0000 7fcfef477640 1 -- 172.21.15.46:0/2397890397 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcfe80cb7a0 msgr2=0x7fcfe81f20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:49.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:49.052+0000 7fcfef477640 1 --2- 172.21.15.46:0/2397890397 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcfe80cb7a0 0x7fcfe81f20a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcfd800c3c0 tx=0x7fcfd800c880 comp rx=0 tx=0).stop 2024-01-23T08:53:49.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:49.052+0000 7fcfef477640 1 -- 172.21.15.46:0/2397890397 shutdown_connections 2024-01-23T08:53:49.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:49.052+0000 7fcfef477640 1 --2- 172.21.15.46:0/2397890397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcfe80c3c00 0x7fcfe814a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:49.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:49.052+0000 7fcfef477640 1 --2- 172.21.15.46:0/2397890397 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcfe80cb7a0 0x7fcfe81f20a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:49.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:49.052+0000 7fcfef477640 1 --2- 172.21.15.46:0/2397890397 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fcfcc0664c0 0x7fcfcc068980 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:49.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:49.052+0000 7fcfef477640 1 --2- 172.21.15.46:0/2397890397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfd4005190 0x7fcfe81f1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:49.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:49.052+0000 7fcfef477640 1 -- 172.21.15.46:0/2397890397 >> 172.21.15.46:0/2397890397 conn(0x7fcfe8066b40 msgr2=0x7fcfe8073c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:53:49.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:49.052+0000 7fcfef477640 1 -- 172.21.15.46:0/2397890397 shutdown_connections 2024-01-23T08:53:49.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:49.056+0000 7fcfef477640 1 -- 172.21.15.46:0/2397890397 wait complete. 2024-01-23T08:53:49.064 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-01-23T08:53:49.068+0000 7f1369cfe640 -1 Falling back to public interface 2024-01-23T08:53:49.071 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-01-23T08:53:49.071 INFO:tasks.ceph:Waiting for OSDs to come up 2024-01-23T08:53:49.878 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-23T08:53:49.998 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.000+0000 7eff77f95640 1 Processor -- start 2024-01-23T08:53:49.998 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.000+0000 7eff77f95640 1 -- start start 2024-01-23T08:53:49.999 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.004+0000 7eff77f95640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7eff70153870 0x7eff7006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:49.999 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.004+0000 7eff77f95640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7006a640 0x7eff7015cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:49.999 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.004+0000 7eff77f95640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff700c72d0 con 0x7eff70153490 2024-01-23T08:53:49.999 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.004+0000 7eff77f95640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff7006fdc0 con 0x7eff70153870 2024-01-23T08:53:49.999 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.004+0000 7eff77f95640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff7006fb20 con 0x7eff7006a640 2024-01-23T08:53:50.000 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.004+0000 7eff75530640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7eff70153870 0x7eff7006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:50.000 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.004+0000 7eff75530640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7eff70153870 0x7eff7006f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56726/0 (socket says 172.21.15.46:56726) 2024-01-23T08:53:50.000 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.004+0000 7eff75530640 1 -- 172.21.15.46:0/2313957029 learned_addr learned my addr 172.21.15.46:0/2313957029 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:53:50.002 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.004+0000 7eff75530640 1 -- 172.21.15.46:0/2313957029 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7006a640 msgr2=0x7eff7015cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:53:50.003 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.004+0000 7eff75530640 1 --2- 172.21.15.46:0/2313957029 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7006a640 0x7eff7015cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:50.003 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.004+0000 7eff75530640 1 -- 172.21.15.46:0/2313957029 >> v1:172.21.15.175:6789/0 conn(0x7eff70153490 legacy=0x7eff700c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:53:50.003 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.004+0000 7eff75530640 1 -- 172.21.15.46:0/2313957029 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff700c66c0 con 0x7eff70153870 2024-01-23T08:53:50.006 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.008+0000 7eff75530640 1 --2- 172.21.15.46:0/2313957029 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff70153870 0x7eff7006f5e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7eff60009870 tx=0x7eff6001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b521da7bae9962d5 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:50.010 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.012+0000 7eff74d2f640 1 -- 172.21.15.46:0/2313957029 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff600a89b0 con 0x7eff70153870 2024-01-23T08:53:50.010 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.012+0000 7eff74d2f640 1 -- 172.21.15.46:0/2313957029 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff600a8b10 con 0x7eff70153870 2024-01-23T08:53:50.010 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.012+0000 7eff74d2f640 1 -- 172.21.15.46:0/2313957029 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff600a8ea0 con 0x7eff70153870 2024-01-23T08:53:50.011 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.016+0000 7eff77f95640 1 -- 172.21.15.46:0/2313957029 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff70153870 msgr2=0x7eff7006f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:50.011 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.016+0000 7eff77f95640 1 --2- 172.21.15.46:0/2313957029 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff70153870 0x7eff7006f5e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7eff60009870 tx=0x7eff6001ecf0 comp rx=0 tx=0).stop 2024-01-23T08:53:50.011 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.016+0000 7eff77f95640 1 -- 172.21.15.46:0/2313957029 shutdown_connections 2024-01-23T08:53:50.011 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.016+0000 7eff77f95640 1 --2- 172.21.15.46:0/2313957029 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7006a640 0x7eff7015cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:50.011 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.016+0000 7eff77f95640 1 --2- 172.21.15.46:0/2313957029 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff70153870 0x7eff7006f5e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:50.011 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.016+0000 7eff77f95640 1 -- 172.21.15.46:0/2313957029 >> 172.21.15.46:0/2313957029 conn(0x7eff700c7f30 msgr2=0x7eff700c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:53:50.011 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.016+0000 7eff77f95640 1 -- 172.21.15.46:0/2313957029 shutdown_connections 2024-01-23T08:53:50.012 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.016+0000 7eff77f95640 1 -- 172.21.15.46:0/2313957029 wait complete. 2024-01-23T08:53:50.012 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.016+0000 7eff77f95640 1 Processor -- start 2024-01-23T08:53:50.012 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.016+0000 7eff77f95640 1 -- start start 2024-01-23T08:53:50.013 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.016+0000 7eff77f95640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7006a640 0x7eff70158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:50.013 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.016+0000 7eff77f95640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff70153490 0x7eff70159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:50.013 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.016+0000 7eff77f95640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff7015a540 0x7eff70155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:50.013 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.016+0000 7eff77f95640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff701596a0 con 0x7eff70153490 2024-01-23T08:53:50.014 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.016+0000 7eff77f95640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff701efc00 con 0x7eff7015a540 2024-01-23T08:53:50.014 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.016+0000 7eff77f95640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff70158790 con 0x7eff7006a640 2024-01-23T08:53:50.014 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.016+0000 7eff75530640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff70153490 0x7eff70159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:50.014 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.016+0000 7eff75530640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff70153490 0x7eff70159160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56734/0 (socket says 172.21.15.46:56734) 2024-01-23T08:53:50.014 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.016+0000 7eff75530640 1 -- 172.21.15.46:0/1080459943 learned_addr learned my addr 172.21.15.46:0/1080459943 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:53:50.017 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.020+0000 7eff75530640 1 -- 172.21.15.46:0/1080459943 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7006a640 msgr2=0x7eff70158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:50.017 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.020+0000 7eff75530640 1 --2- 172.21.15.46:0/1080459943 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7006a640 0x7eff70158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:50.017 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.020+0000 7eff75530640 1 -- 172.21.15.46:0/1080459943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff7015a540 msgr2=0x7eff70155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:50.017 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.020+0000 7eff75530640 1 --2- 172.21.15.46:0/1080459943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff7015a540 0x7eff70155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:50.018 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.020+0000 7eff75530640 1 -- 172.21.15.46:0/1080459943 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff600094d0 con 0x7eff70153490 2024-01-23T08:53:50.021 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.024+0000 7eff75530640 1 --2- 172.21.15.46:0/1080459943 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff70153490 0x7eff70159160 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7eff6001c920 tx=0x7eff6001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:50.025 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.028+0000 7eff667fc640 1 -- 172.21.15.46:0/1080459943 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff600b0e60 con 0x7eff70153490 2024-01-23T08:53:50.025 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.028+0000 7eff667fc640 1 -- 172.21.15.46:0/1080459943 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff600ba440 con 0x7eff70153490 2024-01-23T08:53:50.026 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.028+0000 7eff667fc640 1 -- 172.21.15.46:0/1080459943 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff600ba7f0 con 0x7eff70153490 2024-01-23T08:53:50.026 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.028+0000 7eff77f95640 1 -- 172.21.15.46:0/1080459943 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff701f0130 con 0x7eff70153490 2024-01-23T08:53:50.026 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.028+0000 7eff77f95640 1 -- 172.21.15.46:0/1080459943 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff701efe50 con 0x7eff70153490 2024-01-23T08:53:50.027 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.032+0000 7eff77f95640 1 -- 172.21.15.46:0/1080459943 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff70074c00 con 0x7eff70153490 2024-01-23T08:53:50.051 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.056+0000 7eff667fc640 1 -- 172.21.15.46:0/1080459943 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) v1 ==== 85763+0+0 (secure 0 0 0) 0x7eff600ba950 con 0x7eff70153490 2024-01-23T08:53:50.051 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.056+0000 7eff667fc640 1 --2- 172.21.15.46:0/1080459943 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7eff540664c0 0x7eff54068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:50.052 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.056+0000 7eff75d31640 1 --2- 172.21.15.46:0/1080459943 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7eff540664c0 0x7eff54068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:50.052 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.056+0000 7eff75d31640 1 --2- 172.21.15.46:0/1080459943 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7eff540664c0 0x7eff54068980 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7eff6c007fd0 tx=0x7eff6c0079a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:50.354 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.356+0000 7eff667fc640 1 -- 172.21.15.46:0/1080459943 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7eff600aee20 con 0x7eff70153490 2024-01-23T08:53:50.354 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.356+0000 7eff667fc640 1 -- 172.21.15.46:0/1080459943 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7eff600efab0 con 0x7eff70153490 2024-01-23T08:53:50.525 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.528+0000 7eff77f95640 1 -- 172.21.15.46:0/1080459943 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff70074c00 con 0x7eff70153490 2024-01-23T08:53:50.588 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.592+0000 7eff667fc640 1 -- 172.21.15.46:0/1080459943 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7eff600b5070 con 0x7eff70153490 2024-01-23T08:53:50.588 INFO:teuthology.misc.health.smithi046.stdout: 2024-01-23T08:53:50.588 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":10,"fsid":"fdbdd393-f422-45ae-a488-2bbb0163e580","created":"2024-01-23T08:53:36.942515+0000","modified":"2024-01-23T08:53:47.852614+0000","last_up_change":"0.000000","last_in_change":"2024-01-23T08:53:47.852614+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f32c3d7d-e32a-42d8-b55f-db874d915a12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6f3b6bd2-bbea-4d08-84d5-4407363b5eb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8f110727-31e7-4f69-926b-c87481d4d28d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3aa7527d-0463-4373-b9c7-e6b507a7987f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"eb47a1e5-9f26-465f-b188-87c6eed63c2e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"34048409-998c-44f3-a29d-dcad7a6c917b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f5d45d3f-9af3-44a1-a730-c260ed1654b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"16d12e53-2ad3-4b5c-a789-22b45056fd9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T08:53:50.590 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.592+0000 7eff77f95640 1 -- 172.21.15.46:0/1080459943 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7eff540664c0 msgr2=0x7eff54068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:50.590 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.592+0000 7eff77f95640 1 --2- 172.21.15.46:0/1080459943 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7eff540664c0 0x7eff54068980 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7eff6c007fd0 tx=0x7eff6c0079a0 comp rx=0 tx=0).stop 2024-01-23T08:53:50.590 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.592+0000 7eff77f95640 1 -- 172.21.15.46:0/1080459943 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff70153490 msgr2=0x7eff70159160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:50.590 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.592+0000 7eff77f95640 1 --2- 172.21.15.46:0/1080459943 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff70153490 0x7eff70159160 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7eff6001c920 tx=0x7eff6001ba90 comp rx=0 tx=0).stop 2024-01-23T08:53:50.590 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.592+0000 7eff77f95640 1 -- 172.21.15.46:0/1080459943 shutdown_connections 2024-01-23T08:53:50.591 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.592+0000 7eff77f95640 1 --2- 172.21.15.46:0/1080459943 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7eff540664c0 0x7eff54068980 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:50.591 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.592+0000 7eff77f95640 1 --2- 172.21.15.46:0/1080459943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff7015a540 0x7eff70155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:50.591 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.592+0000 7eff77f95640 1 --2- 172.21.15.46:0/1080459943 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff70153490 0x7eff70159160 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:50.591 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.592+0000 7eff77f95640 1 --2- 172.21.15.46:0/1080459943 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7006a640 0x7eff70158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:50.591 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.592+0000 7eff77f95640 1 -- 172.21.15.46:0/1080459943 >> 172.21.15.46:0/1080459943 conn(0x7eff700c7f30 msgr2=0x7eff700c8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:53:50.591 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.592+0000 7eff77f95640 1 -- 172.21.15.46:0/1080459943 shutdown_connections 2024-01-23T08:53:50.591 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:50.592+0000 7eff77f95640 1 -- 172.21.15.46:0/1080459943 wait complete. 2024-01-23T08:53:50.609 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-23T08:53:51.326 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-01-23T08:53:51.330+0000 7fedfae0b640 -1 osd.6 0 log_to_monitors true 2024-01-23T08:53:51.878 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-01-23T08:53:51.882+0000 7ff7a40e6640 -1 osd.5 0 log_to_monitors true 2024-01-23T08:53:52.689 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-01-23T08:53:52.692+0000 7f071706e640 -1 osd.2 0 log_to_monitors true 2024-01-23T08:53:52.766 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-01-23T08:53:52.770+0000 7f746bc8a640 -1 osd.4 0 log_to_monitors true 2024-01-23T08:53:52.791 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-01-23T08:53:52.796+0000 7f5c2bd7f640 -1 osd.1 0 log_to_monitors true 2024-01-23T08:53:52.861 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-01-23T08:53:52.864+0000 7fc1962ff640 -1 osd.0 0 log_to_monitors true 2024-01-23T08:53:52.890 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-01-23T08:53:52.894+0000 7ffaab199640 -1 osd.7 0 log_to_monitors true 2024-01-23T08:53:52.904 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-01-23T08:53:52.908+0000 7f1369cfe640 -1 osd.3 0 log_to_monitors true 2024-01-23T08:53:54.442 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-01-23T08:53:54.446+0000 7fedf75c6640 -1 osd.6 0 waiting for initial osdmap 2024-01-23T08:53:54.480 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-01-23T08:53:54.486+0000 7fedeebef640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-23T08:53:56.011 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-01-23T08:53:56.016+0000 7f0713017640 -1 osd.2 0 waiting for initial osdmap 2024-01-23T08:53:56.137 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-01-23T08:53:56.140+0000 7f1365ca7640 -1 osd.3 0 waiting for initial osdmap 2024-01-23T08:53:56.147 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-01-23T08:53:56.152+0000 7fc192aba640 -1 osd.0 0 waiting for initial osdmap 2024-01-23T08:53:56.192 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-01-23T08:53:56.196+0000 7f5c2853a640 -1 osd.1 0 waiting for initial osdmap 2024-01-23T08:53:56.216 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-01-23T08:53:56.220+0000 7fc18a0e3640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-23T08:53:56.216 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-01-23T08:53:56.220+0000 7f135dae2640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-23T08:53:56.223 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-01-23T08:53:56.228+0000 7f070ae52640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-23T08:53:56.231 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-01-23T08:53:56.236+0000 7f5c1fb63640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-23T08:53:56.367 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-01-23T08:53:56.374+0000 7f7467c33640 -1 osd.4 0 waiting for initial osdmap 2024-01-23T08:53:56.423 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-01-23T08:53:56.426+0000 7ff7a008f640 -1 osd.5 0 waiting for initial osdmap 2024-01-23T08:53:56.463 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-01-23T08:53:56.470+0000 7ffaa7142640 -1 osd.7 0 waiting for initial osdmap 2024-01-23T08:53:56.488 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-01-23T08:53:56.494+0000 7f745fa6e640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-23T08:53:56.504 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-01-23T08:53:56.510+0000 7ff797eca640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-23T08:53:56.512 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-01-23T08:53:56.518+0000 7ffa9ef7d640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-23T08:53:57.416 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-23T08:53:57.543 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.548+0000 7f4e7077b640 1 Processor -- start 2024-01-23T08:53:57.543 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.548+0000 7f4e7077b640 1 -- start start 2024-01-23T08:53:57.544 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.548+0000 7f4e7077b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4e68151510 0x7f4e68157310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:57.544 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.548+0000 7f4e7077b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e68070bd0 0x7f4e68071040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:57.544 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.548+0000 7f4e7077b640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e680c3900 con 0x7f4e680c7d60 2024-01-23T08:53:57.545 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.548+0000 7f4e7077b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e68157c80 con 0x7f4e68151510 2024-01-23T08:53:57.545 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.548+0000 7f4e7077b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e68157f20 con 0x7f4e68070bd0 2024-01-23T08:53:57.545 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.548+0000 7f4e6dd16640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4e680c7d60 0x7f4e680c31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53054/0 (socket says 172.21.15.46:53054) 2024-01-23T08:53:57.545 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.548+0000 7f4e6dd16640 1 -- 172.21.15.46:0/1530864800 learned_addr learned my addr 172.21.15.46:0/1530864800 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:53:57.549 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.552+0000 7f4e6d515640 1 -- 172.21.15.46:0/1530864800 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3363618555 0 0) 0x7f4e680c3900 con 0x7f4e680c7d60 2024-01-23T08:53:57.549 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.552+0000 7f4e6d515640 1 -- 172.21.15.46:0/1530864800 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e54003530 con 0x7f4e680c7d60 2024-01-23T08:53:57.553 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.556+0000 7f4e6d515640 1 -- 172.21.15.46:0/1530864800 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3974400206 0 0) 0x7f4e54003530 con 0x7f4e680c7d60 2024-01-23T08:53:57.554 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.556+0000 7f4e6d515640 1 -- 172.21.15.46:0/1530864800 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e68070bd0 msgr2=0x7f4e68071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:53:57.554 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.556+0000 7f4e6d515640 1 --2- 172.21.15.46:0/1530864800 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e68070bd0 0x7f4e68071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:57.554 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.556+0000 7f4e6d515640 1 -- 172.21.15.46:0/1530864800 >> v2:172.21.15.175:3300/0 conn(0x7f4e68151510 msgr2=0x7f4e68157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:53:57.554 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.556+0000 7f4e6d515640 1 --2- 172.21.15.46:0/1530864800 >> v2:172.21.15.175:3300/0 conn(0x7f4e68151510 0x7f4e68157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:57.554 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.556+0000 7f4e6d515640 1 -- 172.21.15.46:0/1530864800 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e681581c0 con 0x7f4e680c7d60 2024-01-23T08:53:57.554 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.556+0000 7f4e6d515640 1 -- 172.21.15.46:0/1530864800 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466917103 0 0) 0x7f4e58001680 con 0x7f4e680c7d60 2024-01-23T08:53:57.554 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.556+0000 7f4e6d515640 1 -- 172.21.15.46:0/1530864800 >> v1:172.21.15.46:6789/0 conn(0x7f4e680c7d60 legacy=0x7f4e680c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:57.554 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.556+0000 7f4e6d515640 1 --2- 172.21.15.46:0/1530864800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e54003980 0x7f4e54003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:57.554 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.556+0000 7f4e6d515640 1 --2- 172.21.15.46:0/1530864800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e540047d0 0x7f4e54004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:57.554 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.556+0000 7f4e6d515640 1 --2- 172.21.15.46:0/1530864800 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e68070bd0 0x7f4e5400fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:57.554 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.556+0000 7f4e6d515640 1 -- 172.21.15.46:0/1530864800 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e68157c80 con 0x7f4e540047d0 2024-01-23T08:53:57.554 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.556+0000 7f4e6d515640 1 -- 172.21.15.46:0/1530864800 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e68157f20 con 0x7f4e54003980 2024-01-23T08:53:57.554 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.556+0000 7f4e6d515640 1 -- 172.21.15.46:0/1530864800 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e540055e0 con 0x7f4e68070bd0 2024-01-23T08:53:57.555 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.560+0000 7f4e6dd16640 1 --2- 172.21.15.46:0/1530864800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e540047d0 0x7f4e54004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:57.566 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.568+0000 7f4e6dd16640 1 -- 172.21.15.46:0/1530864800 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e68070bd0 msgr2=0x7f4e5400fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:53:57.566 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.568+0000 7f4e6dd16640 1 --2- 172.21.15.46:0/1530864800 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e68070bd0 0x7f4e5400fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:57.566 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.568+0000 7f4e6dd16640 1 -- 172.21.15.46:0/1530864800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e54003980 msgr2=0x7f4e54003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:53:57.566 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.568+0000 7f4e6dd16640 1 --2- 172.21.15.46:0/1530864800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e54003980 0x7f4e54003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:57.566 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.568+0000 7f4e6dd16640 1 -- 172.21.15.46:0/1530864800 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e54003530 con 0x7f4e540047d0 2024-01-23T08:53:57.569 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.572+0000 7f4e6dd16640 1 --2- 172.21.15.46:0/1530864800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e540047d0 0x7f4e54004c50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800c110 tx=0x7f4e5801cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1074b77e7f7735 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:57.574 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.576+0000 7f4e6d515640 1 -- 172.21.15.46:0/1530864800 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e580058e0 con 0x7f4e540047d0 2024-01-23T08:53:57.574 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.576+0000 7f4e6d515640 1 -- 172.21.15.46:0/1530864800 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e58005a60 con 0x7f4e540047d0 2024-01-23T08:53:57.574 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.576+0000 7f4e6d515640 1 -- 172.21.15.46:0/1530864800 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e58005e10 con 0x7f4e540047d0 2024-01-23T08:53:57.575 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.576+0000 7f4e7077b640 1 -- 172.21.15.46:0/1530864800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e540047d0 msgr2=0x7f4e54004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:57.575 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.580+0000 7f4e7077b640 1 --2- 172.21.15.46:0/1530864800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e540047d0 0x7f4e54004c50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800c110 tx=0x7f4e5801cba0 comp rx=0 tx=0).stop 2024-01-23T08:53:57.575 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.580+0000 7f4e6ed18640 1 -- 172.21.15.46:0/1530864800 reap_dead start 2024-01-23T08:53:57.575 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.580+0000 7f4e7077b640 1 -- 172.21.15.46:0/1530864800 shutdown_connections 2024-01-23T08:53:57.575 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.580+0000 7f4e7077b640 1 -- 172.21.15.46:0/1530864800 >> 172.21.15.46:0/1530864800 conn(0x7f4e6806a640 msgr2=0x7f4e6806aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:53:57.575 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.580+0000 7f4e7077b640 1 -- 172.21.15.46:0/1530864800 shutdown_connections 2024-01-23T08:53:57.575 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.580+0000 7f4e7077b640 1 -- 172.21.15.46:0/1530864800 wait complete. 2024-01-23T08:53:57.576 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.580+0000 7f4e7077b640 1 Processor -- start 2024-01-23T08:53:57.576 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.580+0000 7f4e7077b640 1 -- start start 2024-01-23T08:53:57.577 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.580+0000 7f4e7077b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e540047d0 0x7f4e680b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:57.577 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.580+0000 7f4e7077b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e68155180 0x7f4e680b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:57.578 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.580+0000 7f4e7077b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e68155a90 0x7f4e68155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:57.578 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.580+0000 7f4e7077b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e681ebef0 con 0x7f4e68155180 2024-01-23T08:53:57.578 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.580+0000 7f4e7077b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e68156450 con 0x7f4e540047d0 2024-01-23T08:53:57.578 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.580+0000 7f4e7077b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e681eb040 con 0x7f4e68155a90 2024-01-23T08:53:57.578 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.580+0000 7f4e6dd16640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e68155180 0x7f4e680b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:57.578 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.580+0000 7f4e6dd16640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e68155180 0x7f4e680b11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47064/0 (socket says 172.21.15.46:47064) 2024-01-23T08:53:57.578 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.580+0000 7f4e6dd16640 1 -- 172.21.15.46:0/3571283555 learned_addr learned my addr 172.21.15.46:0/3571283555 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:53:57.583 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.588+0000 7f4e6dd16640 1 -- 172.21.15.46:0/3571283555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e68155a90 msgr2=0x7f4e68155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:57.583 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.588+0000 7f4e6dd16640 1 --2- 172.21.15.46:0/3571283555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e68155a90 0x7f4e68155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:57.583 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.588+0000 7f4e6dd16640 1 -- 172.21.15.46:0/3571283555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e540047d0 msgr2=0x7f4e680b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:57.583 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.588+0000 7f4e6dd16640 1 --2- 172.21.15.46:0/3571283555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e540047d0 0x7f4e680b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:57.583 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.588+0000 7f4e6dd16640 1 -- 172.21.15.46:0/3571283555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e680b29c0 con 0x7f4e68155180 2024-01-23T08:53:57.587 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.592+0000 7f4e6dd16640 1 --2- 172.21.15.46:0/3571283555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e68155180 0x7f4e680b11d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4e58007040 tx=0x7f4e54005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:57.591 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.596+0000 7f4e5effd640 1 -- 172.21.15.46:0/3571283555 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e580a6c00 con 0x7f4e68155180 2024-01-23T08:53:57.592 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.596+0000 7f4e5effd640 1 -- 172.21.15.46:0/3571283555 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e580a6d60 con 0x7f4e68155180 2024-01-23T08:53:57.592 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.596+0000 7f4e5effd640 1 -- 172.21.15.46:0/3571283555 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e58004a10 con 0x7f4e68155180 2024-01-23T08:53:57.592 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.596+0000 7f4e7077b640 1 -- 172.21.15.46:0/3571283555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e681eb2e0 con 0x7f4e68155180 2024-01-23T08:53:57.592 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.596+0000 7f4e7077b640 1 -- 172.21.15.46:0/3571283555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e681eb8a0 con 0x7f4e68155180 2024-01-23T08:53:57.592 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.596+0000 7f4e7077b640 1 -- 172.21.15.46:0/3571283555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e680741c0 con 0x7f4e68155180 2024-01-23T08:53:57.879 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.884+0000 7f4e5effd640 1 -- 172.21.15.46:0/3571283555 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) v1 ==== 85763+0+0 (secure 0 0 0) 0x7f4e58004b70 con 0x7f4e68155180 2024-01-23T08:53:57.880 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.884+0000 7f4e5effd640 1 --2- 172.21.15.46:0/3571283555 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4e4c0664c0 0x7f4e4c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:57.880 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.884+0000 7f4e6e517640 1 --2- 172.21.15.46:0/3571283555 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4e4c0664c0 0x7f4e4c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:57.880 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.884+0000 7f4e6e517640 1 --2- 172.21.15.46:0/3571283555 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4e4c0664c0 0x7f4e4c068980 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4e64006fd0 tx=0x7f4e64006d80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:57.911 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.912+0000 7f4e5effd640 1 -- 172.21.15.46:0/3571283555 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2511+0+0 (secure 0 0 0) 0x7f4e58004e20 con 0x7f4e68155180 2024-01-23T08:53:57.911 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:57.916+0000 7f4e5effd640 1 -- 172.21.15.46:0/3571283555 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f4e580eb080 con 0x7f4e68155180 2024-01-23T08:53:58.098 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:58.100+0000 7f4e7077b640 1 -- 172.21.15.46:0/3571283555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e6814f870 con 0x7f4e68155180 2024-01-23T08:53:58.337 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:58.340+0000 7f4e5effd640 1 -- 172.21.15.46:0/3571283555 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+10944 (secure 0 0 0) 0x7f4e580bc090 con 0x7f4e68155180 2024-01-23T08:53:58.337 INFO:teuthology.misc.health.smithi046.stdout: 2024-01-23T08:53:58.337 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":15,"fsid":"fdbdd393-f422-45ae-a488-2bbb0163e580","created":"2024-01-23T08:53:36.942515+0000","modified":"2024-01-23T08:53:57.198113+0000","last_up_change":"2024-01-23T08:53:57.198113+0000","last_in_change":"2024-01-23T08:53:47.852614+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f32c3d7d-e32a-42d8-b55f-db874d915a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6818","nonce":2681790976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6821","nonce":2681790976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6825","nonce":2681790976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6823","nonce":2681790976}]},"public_addr":"172.21.15.46:6818/2681790976","cluster_addr":"172.21.15.46:6821/2681790976","heartbeat_back_addr":"172.21.15.46:6825/2681790976","heartbeat_front_addr":"172.21.15.46:6823/2681790976","state":["exists","up"]},{"osd":1,"uuid":"6f3b6bd2-bbea-4d08-84d5-4407363b5eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6803","nonce":3679152623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6805","nonce":3679152623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6809","nonce":3679152623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6807","nonce":3679152623}]},"public_addr":"172.21.15.46:6803/3679152623","cluster_addr":"172.21.15.46:6805/3679152623","heartbeat_back_addr":"172.21.15.46:6809/3679152623","heartbeat_front_addr":"172.21.15.46:6807/3679152623","state":["exists","up"]},{"osd":2,"uuid":"8f110727-31e7-4f69-926b-c87481d4d28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6811","nonce":3869652274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6813","nonce":3869652274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6820","nonce":3869652274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6815","nonce":3869652274}]},"public_addr":"172.21.15.46:6811/3869652274","cluster_addr":"172.21.15.46:6813/3869652274","heartbeat_back_addr":"172.21.15.46:6820/3869652274","heartbeat_front_addr":"172.21.15.46:6815/3869652274","state":["exists","up"]},{"osd":3,"uuid":"3aa7527d-0463-4373-b9c7-e6b507a7987f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6827","nonce":4168860822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6829","nonce":4168860822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6833","nonce":4168860822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6831","nonce":4168860822}]},"public_addr":"172.21.15.46:6827/4168860822","cluster_addr":"172.21.15.46:6829/4168860822","heartbeat_back_addr":"172.21.15.46:6833/4168860822","heartbeat_front_addr":"172.21.15.46:6831/4168860822","state":["exists","up"]},{"osd":4,"uuid":"eb47a1e5-9f26-465f-b188-87c6eed63c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6805","nonce":3115257412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6808","nonce":3115257412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6815","nonce":3115257412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6812","nonce":3115257412}]},"public_addr":"172.21.15.175:6805/3115257412","cluster_addr":"172.21.15.175:6808/3115257412","heartbeat_back_addr":"172.21.15.175:6815/3115257412","heartbeat_front_addr":"172.21.15.175:6812/3115257412","state":["exists","up"]},{"osd":5,"uuid":"34048409-998c-44f3-a29d-dcad7a6c917b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6818","nonce":3146473948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6822","nonce":3146473948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6831","nonce":3146473948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6826","nonce":3146473948}]},"public_addr":"172.21.15.175:6818/3146473948","cluster_addr":"172.21.15.175:6822/3146473948","heartbeat_back_addr":"172.21.15.175:6831/3146473948","heartbeat_front_addr":"172.21.15.175:6826/3146473948","state":["exists","up"]},{"osd":6,"uuid":"f5d45d3f-9af3-44a1-a730-c260ed1654b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6801","nonce":4161180058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6804","nonce":4161180058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6814","nonce":4161180058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6809","nonce":4161180058}]},"public_addr":"172.21.15.175:6801/4161180058","cluster_addr":"172.21.15.175:6804/4161180058","heartbeat_back_addr":"172.21.15.175:6814/4161180058","heartbeat_front_addr":"172.21.15.175:6809/4161180058","state":["exists","up"]},{"osd":7,"uuid":"16d12e53-2ad3-4b5c-a789-22b45056fd9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6819","nonce":2670236415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6823","nonce":2670236415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6830","nonce":2670236415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6827","nonce":2670236415}]},"public_addr":"172.21.15.175:6819/2670236415","cluster_addr":"172.21.15.175:6823/2670236415","heartbeat_back_addr":"172.21.15.175:6830/2670236415","heartbeat_front_addr":"172.21.15.175:6827/2670236415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.285635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T08:53:58.341 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:58.344+0000 7f4e7077b640 1 -- 172.21.15.46:0/3571283555 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4e4c0664c0 msgr2=0x7f4e4c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:58.341 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:58.344+0000 7f4e7077b640 1 --2- 172.21.15.46:0/3571283555 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4e4c0664c0 0x7f4e4c068980 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4e64006fd0 tx=0x7f4e64006d80 comp rx=0 tx=0).stop 2024-01-23T08:53:58.341 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:58.344+0000 7f4e7077b640 1 -- 172.21.15.46:0/3571283555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e68155180 msgr2=0x7f4e680b11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:58.341 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:58.344+0000 7f4e7077b640 1 --2- 172.21.15.46:0/3571283555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e68155180 0x7f4e680b11d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4e58007040 tx=0x7f4e54005800 comp rx=0 tx=0).stop 2024-01-23T08:53:58.341 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:58.344+0000 7f4e7077b640 1 -- 172.21.15.46:0/3571283555 shutdown_connections 2024-01-23T08:53:58.341 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:58.344+0000 7f4e7077b640 1 --2- 172.21.15.46:0/3571283555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e68155a90 0x7f4e68155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:58.342 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:58.344+0000 7f4e7077b640 1 --2- 172.21.15.46:0/3571283555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e68155180 0x7f4e680b11d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:58.342 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:58.344+0000 7f4e7077b640 1 --2- 172.21.15.46:0/3571283555 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4e4c0664c0 0x7f4e4c068980 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:58.342 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:58.344+0000 7f4e7077b640 1 --2- 172.21.15.46:0/3571283555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e540047d0 0x7f4e680b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:58.342 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:58.344+0000 7f4e7077b640 1 -- 172.21.15.46:0/3571283555 >> 172.21.15.46:0/3571283555 conn(0x7f4e6806a640 msgr2=0x7f4e6814fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:53:58.342 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:58.344+0000 7f4e7077b640 1 -- 172.21.15.46:0/3571283555 shutdown_connections 2024-01-23T08:53:58.342 INFO:teuthology.misc.health.smithi046.stderr:2024-01-23T08:53:58.344+0000 7f4e7077b640 1 -- 172.21.15.46:0/3571283555 wait complete. 2024-01-23T08:53:58.368 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-01-23T08:53:58.369 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-01-23T08:53:58.369 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-01-23T08:53:58.369 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-23T08:53:58.369 DEBUG:teuthology.orchestra.run.smithi046:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i a 2024-01-23T08:53:58.372 INFO:tasks.ceph.mds.a:Started 2024-01-23T08:53:58.372 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-01-23T08:53:58.372 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-23T08:53:58.372 DEBUG:teuthology.orchestra.run.smithi046:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i c 2024-01-23T08:53:58.374 INFO:tasks.ceph.mds.c:Started 2024-01-23T08:53:58.374 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-01-23T08:53:58.374 INFO:tasks.ceph.mds.e:Restarting daemon 2024-01-23T08:53:58.375 DEBUG:teuthology.orchestra.run.smithi046:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i e 2024-01-23T08:53:58.377 INFO:tasks.ceph.mds.e:Started 2024-01-23T08:53:58.377 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-01-23T08:53:58.378 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-23T08:53:58.378 DEBUG:teuthology.orchestra.run.smithi175:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i b 2024-01-23T08:53:58.381 INFO:tasks.ceph.mds.b:Started 2024-01-23T08:53:58.381 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-01-23T08:53:58.381 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-23T08:53:58.381 DEBUG:teuthology.orchestra.run.smithi175:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i d 2024-01-23T08:53:58.384 INFO:tasks.ceph.mds.d:Started 2024-01-23T08:53:58.384 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-01-23T08:53:58.384 INFO:tasks.ceph.mds.f:Restarting daemon 2024-01-23T08:53:58.385 DEBUG:teuthology.orchestra.run.smithi175:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i f 2024-01-23T08:53:58.387 INFO:tasks.ceph.mds.f:Started 2024-01-23T08:53:58.388 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-01-23T08:53:58.388 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-23T08:53:58.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.532+0000 7f93fd47f640 1 Processor -- start 2024-01-23T08:53:58.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.532+0000 7f93fd47f640 1 -- start start 2024-01-23T08:53:58.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.532+0000 7f93fd47f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f93f8151620 0x7f93f80c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:58.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.532+0000 7f93fd47f640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f80c94b0 con 0x7f93f80b1fb0 2024-01-23T08:53:58.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.532+0000 7f93fd47f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f8157c60 con 0x7f93f81580f0 2024-01-23T08:53:58.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.532+0000 7f93fd47f640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f80c7200 con 0x7f93f8151620 2024-01-23T08:53:58.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.536+0000 7f93f6ffd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f93f8151620 0x7f93f80c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:58.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.536+0000 7f93f6ffd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f93f8151620 0x7f93f80c88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:51894/0 (socket says 172.21.15.46:51894) 2024-01-23T08:53:58.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.536+0000 7f93f6ffd640 1 -- 172.21.15.46:0/2958742827 learned_addr learned my addr 172.21.15.46:0/2958742827 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:53:58.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.540+0000 7f93f6ffd640 1 -- 172.21.15.46:0/2958742827 >> v1:172.21.15.175:6789/0 conn(0x7f93f81580f0 legacy=0x7f93f80c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:53:58.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.540+0000 7f93f6ffd640 1 -- 172.21.15.46:0/2958742827 >> v1:172.21.15.46:6789/0 conn(0x7f93f80b1fb0 legacy=0x7f93f806e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:53:58.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.540+0000 7f93f6ffd640 1 -- 172.21.15.46:0/2958742827 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f80c85d0 con 0x7f93f8151620 2024-01-23T08:53:58.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.548+0000 7f93f6ffd640 1 --2- 172.21.15.46:0/2958742827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93f8151620 0x7f93f80c88d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f93e8009870 tx=0x7f93e801ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3f31cbfcbff0337 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:58.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.556+0000 7f93f5ffb640 1 -- 172.21.15.46:0/2958742827 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e80a89b0 con 0x7f93f8151620 2024-01-23T08:53:58.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.556+0000 7f93f5ffb640 1 -- 172.21.15.46:0/2958742827 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e80a8b10 con 0x7f93f8151620 2024-01-23T08:53:58.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.556+0000 7f93f5ffb640 1 -- 172.21.15.46:0/2958742827 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e80a8ea0 con 0x7f93f8151620 2024-01-23T08:53:58.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.556+0000 7f93fd47f640 1 -- 172.21.15.46:0/2958742827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93f8151620 msgr2=0x7f93f80c88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:58.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.556+0000 7f93fd47f640 1 --2- 172.21.15.46:0/2958742827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93f8151620 0x7f93f80c88d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f93e8009870 tx=0x7f93e801ecb0 comp rx=0 tx=0).stop 2024-01-23T08:53:58.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.556+0000 7f93fd47f640 1 -- 172.21.15.46:0/2958742827 shutdown_connections 2024-01-23T08:53:58.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.556+0000 7f93fd47f640 1 --2- 172.21.15.46:0/2958742827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93f8151620 0x7f93f80c88d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:58.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.556+0000 7f93fd47f640 1 -- 172.21.15.46:0/2958742827 >> 172.21.15.46:0/2958742827 conn(0x7f93f806a660 msgr2=0x7f93f806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:53:58.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.556+0000 7f93fd47f640 1 -- 172.21.15.46:0/2958742827 shutdown_connections 2024-01-23T08:53:58.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.556+0000 7f93fd47f640 1 -- 172.21.15.46:0/2958742827 wait complete. 2024-01-23T08:53:58.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.560+0000 7f93fd47f640 1 Processor -- start 2024-01-23T08:53:58.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.560+0000 7f93fd47f640 1 -- start start 2024-01-23T08:53:58.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.560+0000 7f93fd47f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93f80b1fb0 0x7f93f81500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:58.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.560+0000 7f93fd47f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93f8151620 0x7f93f8153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:58.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.560+0000 7f93fd47f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93f81580f0 0x7f93f8156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:58.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.560+0000 7f93fd47f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f8152480 con 0x7f93f80b1fb0 2024-01-23T08:53:58.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.560+0000 7f93fd47f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f8152870 con 0x7f93f8151620 2024-01-23T08:53:58.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.560+0000 7f93fd47f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f814d580 con 0x7f93f81580f0 2024-01-23T08:53:58.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.564+0000 7f93f67fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93f8151620 0x7f93f8153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:58.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.564+0000 7f93f77fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93f81580f0 0x7f93f8156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:58.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.564+0000 7f93f67fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93f8151620 0x7f93f8153430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:51908/0 (socket says 172.21.15.46:51908) 2024-01-23T08:53:58.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.564+0000 7f93f67fc640 1 -- 172.21.15.46:0/1666275325 learned_addr learned my addr 172.21.15.46:0/1666275325 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:53:58.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.568+0000 7f93f67fc640 1 -- 172.21.15.46:0/1666275325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93f81580f0 msgr2=0x7f93f8156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:58.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.568+0000 7f93f67fc640 1 --2- 172.21.15.46:0/1666275325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93f81580f0 0x7f93f8156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:58.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.568+0000 7f93f67fc640 1 -- 172.21.15.46:0/1666275325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93f80b1fb0 msgr2=0x7f93f81500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:58.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.568+0000 7f93f67fc640 1 --2- 172.21.15.46:0/1666275325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93f80b1fb0 0x7f93f81500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:58.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.568+0000 7f93f67fc640 1 -- 172.21.15.46:0/1666275325 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e80094d0 con 0x7f93f8151620 2024-01-23T08:53:58.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.576+0000 7f93f67fc640 1 --2- 172.21.15.46:0/1666275325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93f8151620 0x7f93f8153430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f93ec00c4c0 tx=0x7f93ec001e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:58.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.584+0000 7f93df7fe640 1 -- 172.21.15.46:0/1666275325 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ec005480 con 0x7f93f8151620 2024-01-23T08:53:58.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.584+0000 7f93df7fe640 1 -- 172.21.15.46:0/1666275325 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93ec003600 con 0x7f93f8151620 2024-01-23T08:53:58.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.584+0000 7f93df7fe640 1 -- 172.21.15.46:0/1666275325 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ec003990 con 0x7f93f8151620 2024-01-23T08:53:58.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.584+0000 7f93fd47f640 1 -- 172.21.15.46:0/1666275325 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f81505e0 con 0x7f93f8151620 2024-01-23T08:53:58.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.584+0000 7f93fd47f640 1 -- 172.21.15.46:0/1666275325 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f8151e00 con 0x7f93f8151620 2024-01-23T08:53:58.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.588+0000 7f93fd47f640 1 -- 172.21.15.46:0/1666275325 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f8074340 con 0x7f93f8151620 2024-01-23T08:53:58.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.972+0000 7f93df7fe640 1 -- 172.21.15.46:0/1666275325 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 4) v1 ==== 85763+0+0 (secure 0 0 0) 0x7f93ec01b3b0 con 0x7f93f8151620 2024-01-23T08:53:58.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.972+0000 7f93df7fe640 1 --2- 172.21.15.46:0/1666275325 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f93e40664f0 0x7f93e40689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:58.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.976+0000 7f93f6ffd640 1 --2- 172.21.15.46:0/1666275325 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f93e40664f0 0x7f93e40689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:58.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.976+0000 7f93f6ffd640 1 --2- 172.21.15.46:0/1666275325 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f93e40664f0 0x7f93e40689b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f93e80b2000 tx=0x7f93e8004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:58.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.976+0000 7f93df7fe640 1 -- 172.21.15.46:0/1666275325 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f93ec054640 con 0x7f93f8151620 2024-01-23T08:53:58.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:58.996+0000 7f93df7fe640 1 -- 172.21.15.46:0/1666275325 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f93ec050980 con 0x7f93f8151620 2024-01-23T08:53:59.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.168+0000 7f93fd47f640 1 -- 172.21.15.46:0/1666275325 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93f815b900 con 0x7f93f8151620 2024-01-23T08:53:59.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.572+0000 7f93df7fe640 1 -- 172.21.15.46:0/1666275325 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+10944 (secure 0 0 0) 0x7f93ec017090 con 0x7f93f8151620 2024-01-23T08:53:59.569 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:53:59.570 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":15,"fsid":"fdbdd393-f422-45ae-a488-2bbb0163e580","created":"2024-01-23T08:53:36.942515+0000","modified":"2024-01-23T08:53:57.198113+0000","last_up_change":"2024-01-23T08:53:57.198113+0000","last_in_change":"2024-01-23T08:53:47.852614+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f32c3d7d-e32a-42d8-b55f-db874d915a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6818","nonce":2681790976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6821","nonce":2681790976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6825","nonce":2681790976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6823","nonce":2681790976}]},"public_addr":"172.21.15.46:6818/2681790976","cluster_addr":"172.21.15.46:6821/2681790976","heartbeat_back_addr":"172.21.15.46:6825/2681790976","heartbeat_front_addr":"172.21.15.46:6823/2681790976","state":["exists","up"]},{"osd":1,"uuid":"6f3b6bd2-bbea-4d08-84d5-4407363b5eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6803","nonce":3679152623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6805","nonce":3679152623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6809","nonce":3679152623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6807","nonce":3679152623}]},"public_addr":"172.21.15.46:6803/3679152623","cluster_addr":"172.21.15.46:6805/3679152623","heartbeat_back_addr":"172.21.15.46:6809/3679152623","heartbeat_front_addr":"172.21.15.46:6807/3679152623","state":["exists","up"]},{"osd":2,"uuid":"8f110727-31e7-4f69-926b-c87481d4d28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6811","nonce":3869652274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6813","nonce":3869652274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6820","nonce":3869652274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6815","nonce":3869652274}]},"public_addr":"172.21.15.46:6811/3869652274","cluster_addr":"172.21.15.46:6813/3869652274","heartbeat_back_addr":"172.21.15.46:6820/3869652274","heartbeat_front_addr":"172.21.15.46:6815/3869652274","state":["exists","up"]},{"osd":3,"uuid":"3aa7527d-0463-4373-b9c7-e6b507a7987f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6827","nonce":4168860822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6829","nonce":4168860822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6833","nonce":4168860822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6831","nonce":4168860822}]},"public_addr":"172.21.15.46:6827/4168860822","cluster_addr":"172.21.15.46:6829/4168860822","heartbeat_back_addr":"172.21.15.46:6833/4168860822","heartbeat_front_addr":"172.21.15.46:6831/4168860822","state":["exists","up"]},{"osd":4,"uuid":"eb47a1e5-9f26-465f-b188-87c6eed63c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6805","nonce":3115257412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6808","nonce":3115257412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6815","nonce":3115257412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6812","nonce":3115257412}]},"public_addr":"172.21.15.175:6805/3115257412","cluster_addr":"172.21.15.175:6808/3115257412","heartbeat_back_addr":"172.21.15.175:6815/3115257412","heartbeat_front_addr":"172.21.15.175:6812/3115257412","state":["exists","up"]},{"osd":5,"uuid":"34048409-998c-44f3-a29d-dcad7a6c917b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6818","nonce":3146473948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6822","nonce":3146473948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6831","nonce":3146473948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6826","nonce":3146473948}]},"public_addr":"172.21.15.175:6818/3146473948","cluster_addr":"172.21.15.175:6822/3146473948","heartbeat_back_addr":"172.21.15.175:6831/3146473948","heartbeat_front_addr":"172.21.15.175:6826/3146473948","state":["exists","up"]},{"osd":6,"uuid":"f5d45d3f-9af3-44a1-a730-c260ed1654b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6801","nonce":4161180058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6804","nonce":4161180058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6814","nonce":4161180058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6809","nonce":4161180058}]},"public_addr":"172.21.15.175:6801/4161180058","cluster_addr":"172.21.15.175:6804/4161180058","heartbeat_back_addr":"172.21.15.175:6814/4161180058","heartbeat_front_addr":"172.21.15.175:6809/4161180058","state":["exists","up"]},{"osd":7,"uuid":"16d12e53-2ad3-4b5c-a789-22b45056fd9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6819","nonce":2670236415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6823","nonce":2670236415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6830","nonce":2670236415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6827","nonce":2670236415}]},"public_addr":"172.21.15.175:6819/2670236415","cluster_addr":"172.21.15.175:6823/2670236415","heartbeat_back_addr":"172.21.15.175:6830/2670236415","heartbeat_front_addr":"172.21.15.175:6827/2670236415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.285635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T08:53:59.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.576+0000 7f93fd47f640 1 -- 172.21.15.46:0/1666275325 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f93e40664f0 msgr2=0x7f93e40689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:59.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.576+0000 7f93fd47f640 1 --2- 172.21.15.46:0/1666275325 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f93e40664f0 0x7f93e40689b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f93e80b2000 tx=0x7f93e8004740 comp rx=0 tx=0).stop 2024-01-23T08:53:59.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.576+0000 7f93fd47f640 1 -- 172.21.15.46:0/1666275325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93f8151620 msgr2=0x7f93f8153430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:59.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.576+0000 7f93fd47f640 1 --2- 172.21.15.46:0/1666275325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93f8151620 0x7f93f8153430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f93ec00c4c0 tx=0x7f93ec001e80 comp rx=0 tx=0).stop 2024-01-23T08:53:59.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.576+0000 7f93fd47f640 1 -- 172.21.15.46:0/1666275325 shutdown_connections 2024-01-23T08:53:59.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.576+0000 7f93fd47f640 1 --2- 172.21.15.46:0/1666275325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93f81580f0 0x7f93f8156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:59.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.576+0000 7f93fd47f640 1 --2- 172.21.15.46:0/1666275325 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f93e40664f0 0x7f93e40689b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:59.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.576+0000 7f93fd47f640 1 --2- 172.21.15.46:0/1666275325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93f8151620 0x7f93f8153430 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:59.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.576+0000 7f93fd47f640 1 --2- 172.21.15.46:0/1666275325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93f80b1fb0 0x7f93f81500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:59.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.576+0000 7f93fd47f640 1 -- 172.21.15.46:0/1666275325 >> 172.21.15.46:0/1666275325 conn(0x7f93f806a660 msgr2=0x7f93f80c1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:53:59.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.576+0000 7f93fd47f640 1 -- 172.21.15.46:0/1666275325 shutdown_connections 2024-01-23T08:53:59.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.576+0000 7f93fd47f640 1 -- 172.21.15.46:0/1666275325 wait complete. 2024-01-23T08:53:59.595 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-01-23T08:53:59.595 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-23T08:53:59.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.760+0000 7f72406b9640 1 Processor -- start 2024-01-23T08:53:59.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.760+0000 7f72406b9640 1 -- start start 2024-01-23T08:53:59.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.760+0000 7f72406b9640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7238150510 0x7f72380c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:59.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.760+0000 7f72406b9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72380c7570 0x7f72380c4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:59.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.760+0000 7f72406b9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f72380c54f0 0x7f72380c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:59.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.760+0000 7f72406b9640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72380c4410 con 0x7f7238150510 2024-01-23T08:53:59.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.760+0000 7f72406b9640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72380c2a80 con 0x7f72380c54f0 2024-01-23T08:53:59.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.760+0000 7f72406b9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7238159b60 con 0x7f72380c7570 2024-01-23T08:53:59.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.808+0000 7f723e455640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7238150510 0x7f72380c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:59.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.812+0000 7f723e455640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7238150510 0x7f72380c87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47082/0 (socket says 172.21.15.46:47082) 2024-01-23T08:53:59.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.812+0000 7f723e455640 1 -- 172.21.15.46:0/2649015721 learned_addr learned my addr 172.21.15.46:0/2649015721 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:53:59.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.820+0000 7f723e455640 1 -- 172.21.15.46:0/2649015721 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72380c7570 msgr2=0x7f72380c4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:53:59.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.820+0000 7f723e455640 1 --2- 172.21.15.46:0/2649015721 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72380c7570 0x7f72380c4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:59.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.820+0000 7f723e455640 1 -- 172.21.15.46:0/2649015721 >> v2:172.21.15.175:3300/0 conn(0x7f72380c54f0 msgr2=0x7f72380c2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:53:59.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.820+0000 7f723e455640 1 --2- 172.21.15.46:0/2649015721 >> v2:172.21.15.175:3300/0 conn(0x7f72380c54f0 0x7f72380c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:59.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.820+0000 7f723e455640 1 -- 172.21.15.46:0/2649015721 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7238159e40 con 0x7f7238150510 2024-01-23T08:53:59.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.824+0000 7f723e455640 1 --2- 172.21.15.46:0/2649015721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7238150510 0x7f72380c87f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f72380c4c60 tx=0x7f72340213c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f1857d591fc57d2 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:59.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.828+0000 7f723d453640 1 -- 172.21.15.46:0/2649015721 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72340b1600 con 0x7f7238150510 2024-01-23T08:53:59.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.828+0000 7f723d453640 1 -- 172.21.15.46:0/2649015721 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72340ad050 con 0x7f7238150510 2024-01-23T08:53:59.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.828+0000 7f723d453640 1 -- 172.21.15.46:0/2649015721 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72340b1980 con 0x7f7238150510 2024-01-23T08:53:59.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.828+0000 7f72406b9640 1 -- 172.21.15.46:0/2649015721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7238150510 msgr2=0x7f72380c87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:59.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.828+0000 7f72406b9640 1 --2- 172.21.15.46:0/2649015721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7238150510 0x7f72380c87f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f72380c4c60 tx=0x7f72340213c0 comp rx=0 tx=0).stop 2024-01-23T08:53:59.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.828+0000 7f72406b9640 1 -- 172.21.15.46:0/2649015721 shutdown_connections 2024-01-23T08:53:59.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.828+0000 7f72406b9640 1 --2- 172.21.15.46:0/2649015721 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72380c7570 0x7f72380c4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:59.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.828+0000 7f72406b9640 1 --2- 172.21.15.46:0/2649015721 >> v2:172.21.15.175:3300/0 conn(0x7f72380c54f0 0x7f72380c2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:59.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.828+0000 7f72406b9640 1 --2- 172.21.15.46:0/2649015721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7238150510 0x7f72380c87f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:59.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.828+0000 7f72406b9640 1 -- 172.21.15.46:0/2649015721 >> 172.21.15.46:0/2649015721 conn(0x7f72380cba50 msgr2=0x7f72380c7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:53:59.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.828+0000 7f72406b9640 1 -- 172.21.15.46:0/2649015721 shutdown_connections 2024-01-23T08:53:59.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.828+0000 7f72406b9640 1 -- 172.21.15.46:0/2649015721 wait complete. 2024-01-23T08:53:59.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.832+0000 7f72406b9640 1 Processor -- start 2024-01-23T08:53:59.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.832+0000 7f72406b9640 1 -- start start 2024-01-23T08:53:59.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.832+0000 7f72406b9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72380c54f0 0x7f72381589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:59.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.832+0000 7f72406b9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72380c7570 0x7f7238146ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:59.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.832+0000 7f72406b9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7238150510 0x7f72381ee840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:59.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.832+0000 7f72406b9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72381eac80 con 0x7f72380c54f0 2024-01-23T08:53:59.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.832+0000 7f72406b9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72381ee3b0 con 0x7f7238150510 2024-01-23T08:53:59.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.832+0000 7f72406b9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7238153bf0 con 0x7f72380c7570 2024-01-23T08:53:59.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.832+0000 7f723e455640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72380c54f0 0x7f72381589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:59.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.832+0000 7f723e455640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72380c54f0 0x7f72381589e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47088/0 (socket says 172.21.15.46:47088) 2024-01-23T08:53:59.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.832+0000 7f723e455640 1 -- 172.21.15.46:0/1737754430 learned_addr learned my addr 172.21.15.46:0/1737754430 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:53:59.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.836+0000 7f723e455640 1 -- 172.21.15.46:0/1737754430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72380c7570 msgr2=0x7f7238146ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:59.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.836+0000 7f723e455640 1 --2- 172.21.15.46:0/1737754430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72380c7570 0x7f7238146ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:59.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.836+0000 7f723e455640 1 -- 172.21.15.46:0/1737754430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7238150510 msgr2=0x7f72381ee840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:53:59.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.836+0000 7f723e455640 1 --2- 172.21.15.46:0/1737754430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7238150510 0x7f72381ee840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:53:59.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.836+0000 7f723e455640 1 -- 172.21.15.46:0/1737754430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723400b770 con 0x7f72380c54f0 2024-01-23T08:53:59.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.840+0000 7f723e455640 1 --2- 172.21.15.46:0/1737754430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72380c54f0 0x7f72381589e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f723400ba60 tx=0x7f723401e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:53:59.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.844+0000 7f722effd640 1 -- 172.21.15.46:0/1737754430 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72340bb670 con 0x7f72380c54f0 2024-01-23T08:53:59.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.844+0000 7f722effd640 1 -- 172.21.15.46:0/1737754430 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72340bb7d0 con 0x7f72380c54f0 2024-01-23T08:53:59.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.844+0000 7f72406b9640 1 -- 172.21.15.46:0/1737754430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f723814b490 con 0x7f72380c54f0 2024-01-23T08:53:59.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.844+0000 7f722effd640 1 -- 172.21.15.46:0/1737754430 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72340bbb60 con 0x7f72380c54f0 2024-01-23T08:53:59.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.844+0000 7f72406b9640 1 -- 172.21.15.46:0/1737754430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f723814aed0 con 0x7f72380c54f0 2024-01-23T08:53:59.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.844+0000 7f72406b9640 1 -- 172.21.15.46:0/1737754430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72380c8cf0 con 0x7f72380c54f0 2024-01-23T08:53:59.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.868+0000 7f722effd640 1 -- 172.21.15.46:0/1737754430 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) v1 ==== 85763+0+0 (secure 0 0 0) 0x7f72340b8040 con 0x7f72380c54f0 2024-01-23T08:53:59.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.868+0000 7f722effd640 1 --2- 172.21.15.46:0/1737754430 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f721c0664c0 0x7f721c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:53:59.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.868+0000 7f723dc54640 1 --2- 172.21.15.46:0/1737754430 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f721c0664c0 0x7f721c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:53:59.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:53:59.872+0000 7f723dc54640 1 --2- 172.21.15.46:0/1737754430 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f721c0664c0 0x7f721c068980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f72381575b0 tx=0x7f7228006ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:00.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:00.300+0000 7f722effd640 1 -- 172.21.15.46:0/1737754430 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4846+0+0 (secure 0 0 0) 0x7f72340f67c0 con 0x7f72380c54f0 2024-01-23T08:54:00.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:00.304+0000 7f722effd640 1 -- 172.21.15.46:0/1737754430 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f72340f2400 con 0x7f72380c54f0 2024-01-23T08:54:00.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:00.656+0000 7f72406b9640 1 -- 172.21.15.46:0/1737754430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7238074340 con 0x7f72380c54f0 2024-01-23T08:54:00.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:00.708+0000 7f722effd640 1 -- 172.21.15.46:0/1737754430 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f72340b6230 con 0x7f72380c54f0 2024-01-23T08:54:00.707 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:54:00.707 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-01-23T08:54:00.707 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 1 2024-01-23T08:54:00.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:00.712+0000 7f72406b9640 1 -- 172.21.15.46:0/1737754430 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f721c0664c0 msgr2=0x7f721c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:00.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:00.712+0000 7f72406b9640 1 --2- 172.21.15.46:0/1737754430 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f721c0664c0 0x7f721c068980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f72381575b0 tx=0x7f7228006ca0 comp rx=0 tx=0).stop 2024-01-23T08:54:00.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:00.712+0000 7f72406b9640 1 -- 172.21.15.46:0/1737754430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72380c54f0 msgr2=0x7f72381589e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:00.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:00.712+0000 7f72406b9640 1 --2- 172.21.15.46:0/1737754430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72380c54f0 0x7f72381589e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f723400ba60 tx=0x7f723401e160 comp rx=0 tx=0).stop 2024-01-23T08:54:00.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:00.712+0000 7f72406b9640 1 -- 172.21.15.46:0/1737754430 shutdown_connections 2024-01-23T08:54:00.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:00.712+0000 7f72406b9640 1 --2- 172.21.15.46:0/1737754430 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f721c0664c0 0x7f721c068980 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:00.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:00.712+0000 7f72406b9640 1 --2- 172.21.15.46:0/1737754430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7238150510 0x7f72381ee840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:00.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:00.712+0000 7f72406b9640 1 --2- 172.21.15.46:0/1737754430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72380c7570 0x7f7238146ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:00.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:00.712+0000 7f72406b9640 1 --2- 172.21.15.46:0/1737754430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72380c54f0 0x7f72381589e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:00.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:00.712+0000 7f72406b9640 1 -- 172.21.15.46:0/1737754430 >> 172.21.15.46:0/1737754430 conn(0x7f72380cba50 msgr2=0x7f7238148f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:00.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:00.712+0000 7f72406b9640 1 -- 172.21.15.46:0/1737754430 shutdown_connections 2024-01-23T08:54:00.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:00.712+0000 7f72406b9640 1 -- 172.21.15.46:0/1737754430 wait complete. 2024-01-23T08:54:02.727 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-23T08:54:02.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.840+0000 7f0c44a37640 1 Processor -- start 2024-01-23T08:54:02.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.840+0000 7f0c44a37640 1 -- start start 2024-01-23T08:54:02.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.840+0000 7f0c44a37640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0c400c83c0 0x7f0c400c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:02.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.840+0000 7f0c44a37640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c400c3090 con 0x7f0c401538f0 2024-01-23T08:54:02.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.840+0000 7f0c44a37640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c40070460 con 0x7f0c400c2c20 2024-01-23T08:54:02.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.840+0000 7f0c44a37640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c4006f950 con 0x7f0c400c83c0 2024-01-23T08:54:02.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.840+0000 7f0c3dd9b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0c400c83c0 0x7f0c400c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:02.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.840+0000 7f0c3ed9d640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f0c400c2c20 0x7f0c4015cf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.46:46458/0 (socket says 172.21.15.46:46458) 2024-01-23T08:54:02.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.840+0000 7f0c3ed9d640 1 -- 172.21.15.46:0/2732370539 learned_addr learned my addr 172.21.15.46:0/2732370539 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:54:02.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.844+0000 7f0c3dd9b640 1 -- 172.21.15.46:0/2732370539 >> v1:172.21.15.175:6789/0 conn(0x7f0c400c2c20 legacy=0x7f0c4015cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:02.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.844+0000 7f0c3dd9b640 1 -- 172.21.15.46:0/2732370539 >> v1:172.21.15.46:6789/0 conn(0x7f0c401538f0 legacy=0x7f0c400c1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:02.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.844+0000 7f0c3d59a640 1 -- 172.21.15.46:0/2732370539 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427024011 0 0) 0x7f0c40070460 con 0x7f0c400c2c20 2024-01-23T08:54:02.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.844+0000 7f0c3dd9b640 1 -- 172.21.15.46:0/2732370539 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4006fbc0 con 0x7f0c400c83c0 2024-01-23T08:54:02.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.852+0000 7f0c3dd9b640 1 --2- 172.21.15.46:0/2732370539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c400c83c0 0x7f0c400c6ce0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0c340097c0 tx=0x7f0c3401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40217a51ab465870 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:02.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.856+0000 7f0c3d59a640 1 -- 172.21.15.46:0/2732370539 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c340ab610 con 0x7f0c400c83c0 2024-01-23T08:54:02.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.856+0000 7f0c3d59a640 1 -- 172.21.15.46:0/2732370539 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c340ab770 con 0x7f0c400c83c0 2024-01-23T08:54:02.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.856+0000 7f0c3d59a640 1 -- 172.21.15.46:0/2732370539 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c340abb00 con 0x7f0c400c83c0 2024-01-23T08:54:02.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.856+0000 7f0c44a37640 1 -- 172.21.15.46:0/2732370539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c400c83c0 msgr2=0x7f0c400c6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:02.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.856+0000 7f0c44a37640 1 --2- 172.21.15.46:0/2732370539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c400c83c0 0x7f0c400c6ce0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0c340097c0 tx=0x7f0c3401c410 comp rx=0 tx=0).stop 2024-01-23T08:54:02.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.856+0000 7f0c44a37640 1 -- 172.21.15.46:0/2732370539 shutdown_connections 2024-01-23T08:54:02.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.856+0000 7f0c44a37640 1 --2- 172.21.15.46:0/2732370539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c400c83c0 0x7f0c400c6ce0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:02.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.856+0000 7f0c44a37640 1 -- 172.21.15.46:0/2732370539 >> 172.21.15.46:0/2732370539 conn(0x7f0c400cbe70 msgr2=0x7f0c400cc280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:02.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.856+0000 7f0c44a37640 1 -- 172.21.15.46:0/2732370539 shutdown_connections 2024-01-23T08:54:02.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.856+0000 7f0c44a37640 1 -- 172.21.15.46:0/2732370539 wait complete. 2024-01-23T08:54:02.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.860+0000 7f0c44a37640 1 Processor -- start 2024-01-23T08:54:02.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.860+0000 7f0c44a37640 1 -- start start 2024-01-23T08:54:02.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.860+0000 7f0c44a37640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c400c2c20 0x7f0c4014c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:02.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.860+0000 7f0c44a37640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c400c83c0 0x7f0c40148410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:02.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.860+0000 7f0c44a37640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c401538f0 0x7f0c40147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:02.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.860+0000 7f0c44a37640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4014cf60 con 0x7f0c400c2c20 2024-01-23T08:54:02.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.860+0000 7f0c44a37640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c400c3db0 con 0x7f0c401538f0 2024-01-23T08:54:02.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.860+0000 7f0c44a37640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4014d190 con 0x7f0c400c83c0 2024-01-23T08:54:02.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.860+0000 7f0c3e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c400c2c20 0x7f0c4014c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:02.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.860+0000 7f0c3dd9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c400c83c0 0x7f0c40148410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:02.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.860+0000 7f0c3ed9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c401538f0 0x7f0c40147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:02.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.860+0000 7f0c3e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c400c2c20 0x7f0c4014c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51868/0 (socket says 172.21.15.46:51868) 2024-01-23T08:54:02.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.860+0000 7f0c3e59c640 1 -- 172.21.15.46:0/355737243 learned_addr learned my addr 172.21.15.46:0/355737243 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:02.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.868+0000 7f0c3e59c640 1 -- 172.21.15.46:0/355737243 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c400c83c0 msgr2=0x7f0c40148410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:02.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.868+0000 7f0c3e59c640 1 --2- 172.21.15.46:0/355737243 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c400c83c0 0x7f0c40148410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:02.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.868+0000 7f0c3e59c640 1 -- 172.21.15.46:0/355737243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c401538f0 msgr2=0x7f0c40147ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:02.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.868+0000 7f0c3e59c640 1 --2- 172.21.15.46:0/355737243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c401538f0 0x7f0c40147ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:02.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.868+0000 7f0c3e59c640 1 -- 172.21.15.46:0/355737243 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c34009420 con 0x7f0c400c2c20 2024-01-23T08:54:02.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.872+0000 7f0c3e59c640 1 --2- 172.21.15.46:0/355737243 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c400c2c20 0x7f0c4014c1f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000c450 tx=0x7f0c3000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:02.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.880+0000 7f0c2effd640 1 -- 172.21.15.46:0/355737243 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c30012830 con 0x7f0c400c2c20 2024-01-23T08:54:02.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.880+0000 7f0c2effd640 1 -- 172.21.15.46:0/355737243 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c300129b0 con 0x7f0c400c2c20 2024-01-23T08:54:02.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.880+0000 7f0c2effd640 1 -- 172.21.15.46:0/355737243 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c30012d60 con 0x7f0c400c2c20 2024-01-23T08:54:02.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.880+0000 7f0c44a37640 1 -- 172.21.15.46:0/355737243 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c4014d730 con 0x7f0c400c2c20 2024-01-23T08:54:02.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.880+0000 7f0c44a37640 1 -- 172.21.15.46:0/355737243 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c4014b710 con 0x7f0c400c2c20 2024-01-23T08:54:02.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:02.884+0000 7f0c44a37640 1 -- 172.21.15.46:0/355737243 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c40074340 con 0x7f0c400c2c20 2024-01-23T08:54:03.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:03.228+0000 7f0c2effd640 1 -- 172.21.15.46:0/355737243 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) v1 ==== 85763+0+0 (secure 0 0 0) 0x7f0c3001c460 con 0x7f0c400c2c20 2024-01-23T08:54:03.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:03.228+0000 7f0c2effd640 1 --2- 172.21.15.46:0/355737243 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f0c200664f0 0x7f0c200689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:03.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:03.228+0000 7f0c3dd9b640 1 --2- 172.21.15.46:0/355737243 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f0c200664f0 0x7f0c200689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:03.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:03.228+0000 7f0c3dd9b640 1 --2- 172.21.15.46:0/355737243 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f0c200664f0 0x7f0c200689b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0c340af000 tx=0x7f0c340a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:03.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:03.272+0000 7f0c2effd640 1 -- 172.21.15.46:0/355737243 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0c300556e0 con 0x7f0c400c2c20 2024-01-23T08:54:03.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:03.272+0000 7f0c2effd640 1 -- 172.21.15.46:0/355737243 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f0c30051a20 con 0x7f0c400c2c20 2024-01-23T08:54:03.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:03.484+0000 7f0c44a37640 1 -- 172.21.15.46:0/355737243 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c40153120 con 0x7f0c400c2c20 2024-01-23T08:54:06.100 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2024-01-23T08:54:06.177 INFO:tasks.ceph.mds.d.smithi175.stdout:starting mds.d at 2024-01-23T08:54:06.204 INFO:tasks.ceph.mds.f.smithi175.stdout:starting mds.f at 2024-01-23T08:54:06.269 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2024-01-23T08:54:09.489 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2024-01-23T08:54:09.509 INFO:tasks.ceph.mds.e.smithi046.stdout:starting mds.e at 2024-01-23T08:54:15.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:15.076+0000 7f0c2effd640 1 -- 172.21.15.46:0/355737243 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f0c30082d50 con 0x7f0c400c2c20 2024-01-23T08:54:15.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:15.092+0000 7f0c2effd640 1 -- 172.21.15.46:0/355737243 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f0c300554b0 con 0x7f0c400c2c20 2024-01-23T08:54:15.088 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:54:15.088 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-01-23T08:54:15.088 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 1 2024-01-23T08:54:15.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:15.092+0000 7f0c44a37640 1 -- 172.21.15.46:0/355737243 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f0c200664f0 msgr2=0x7f0c200689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:15.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:15.092+0000 7f0c44a37640 1 --2- 172.21.15.46:0/355737243 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f0c200664f0 0x7f0c200689b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0c340af000 tx=0x7f0c340a7000 comp rx=0 tx=0).stop 2024-01-23T08:54:15.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:15.092+0000 7f0c44a37640 1 -- 172.21.15.46:0/355737243 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c400c2c20 msgr2=0x7f0c4014c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:15.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:15.092+0000 7f0c44a37640 1 --2- 172.21.15.46:0/355737243 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c400c2c20 0x7f0c4014c1f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000c450 tx=0x7f0c3000c910 comp rx=0 tx=0).stop 2024-01-23T08:54:15.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:15.092+0000 7f0c44a37640 1 -- 172.21.15.46:0/355737243 shutdown_connections 2024-01-23T08:54:15.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:15.092+0000 7f0c44a37640 1 --2- 172.21.15.46:0/355737243 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f0c200664f0 0x7f0c200689b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:15.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:15.092+0000 7f0c44a37640 1 --2- 172.21.15.46:0/355737243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c401538f0 0x7f0c40147ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:15.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:15.092+0000 7f0c44a37640 1 --2- 172.21.15.46:0/355737243 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c400c83c0 0x7f0c40148410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:15.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:15.092+0000 7f0c44a37640 1 --2- 172.21.15.46:0/355737243 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c400c2c20 0x7f0c4014c1f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:15.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:15.092+0000 7f0c44a37640 1 -- 172.21.15.46:0/355737243 >> 172.21.15.46:0/355737243 conn(0x7f0c400cbe70 msgr2=0x7f0c40151c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:15.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:15.092+0000 7f0c44a37640 1 -- 172.21.15.46:0/355737243 shutdown_connections 2024-01-23T08:54:15.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:15.092+0000 7f0c44a37640 1 -- 172.21.15.46:0/355737243 wait complete. 2024-01-23T08:54:17.118 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-23T08:54:17.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.256+0000 7f2be2f93640 1 Processor -- start 2024-01-23T08:54:17.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.256+0000 7f2be2f93640 1 -- start start 2024-01-23T08:54:17.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.256+0000 7f2be2f93640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2bdc151600 0x7f2bdc15b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:17.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.256+0000 7f2be2f93640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bdc1519e0 0x7f2bdc0c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:17.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.256+0000 7f2be2f93640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bdc158390 con 0x7f2bdc06f350 2024-01-23T08:54:17.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.256+0000 7f2be2f93640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bdc15b0e0 con 0x7f2bdc151600 2024-01-23T08:54:17.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.256+0000 7f2be2f93640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc157b70 con 0x7f2bdc1519e0 2024-01-23T08:54:17.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.256+0000 7f2be1530640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2bdc06f350 0x7f2bdc157460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35694/0 (socket says 172.21.15.46:35694) 2024-01-23T08:54:17.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.256+0000 7f2be1530640 1 -- 172.21.15.46:0/1648668844 learned_addr learned my addr 172.21.15.46:0/1648668844 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:54:17.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.256+0000 7f2bdbfff640 1 --2- 172.21.15.46:0/1648668844 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bdc1519e0 0x7f2bdc0c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:17.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.256+0000 7f2be0d2f640 1 --2- 172.21.15.46:0/1648668844 >> v2:172.21.15.175:3300/0 conn(0x7f2bdc151600 0x7f2bdc15b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:17.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.260+0000 7f2bdb7fe640 1 -- 172.21.15.46:0/1648668844 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189457727 0 0) 0x7f2bdc158390 con 0x7f2bdc06f350 2024-01-23T08:54:17.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.260+0000 7f2bdb7fe640 1 -- 172.21.15.46:0/1648668844 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bc4003530 con 0x7f2bdc06f350 2024-01-23T08:54:17.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.264+0000 7f2bdbfff640 1 -- 172.21.15.46:0/1648668844 >> v2:172.21.15.175:3300/0 conn(0x7f2bdc151600 msgr2=0x7f2bdc15b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:17.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.264+0000 7f2bdbfff640 1 --2- 172.21.15.46:0/1648668844 >> v2:172.21.15.175:3300/0 conn(0x7f2bdc151600 0x7f2bdc15b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:17.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.264+0000 7f2bdbfff640 1 -- 172.21.15.46:0/1648668844 >> v1:172.21.15.46:6789/0 conn(0x7f2bdc06f350 legacy=0x7f2bdc157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:17.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.264+0000 7f2bdbfff640 1 -- 172.21.15.46:0/1648668844 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bdc157dd0 con 0x7f2bdc1519e0 2024-01-23T08:54:17.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.268+0000 7f2bdbfff640 1 --2- 172.21.15.46:0/1648668844 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bdc1519e0 0x7f2bdc0c7660 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2bd00097c0 tx=0x7f2bd001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d44b1681ca42162 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:17.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.280+0000 7f2bdb7fe640 1 -- 172.21.15.46:0/1648668844 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd00ab600 con 0x7f2bdc1519e0 2024-01-23T08:54:17.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.280+0000 7f2bdb7fe640 1 -- 172.21.15.46:0/1648668844 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd00a7050 con 0x7f2bdc1519e0 2024-01-23T08:54:17.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.280+0000 7f2bdb7fe640 1 -- 172.21.15.46:0/1648668844 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd00ab980 con 0x7f2bdc1519e0 2024-01-23T08:54:17.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.280+0000 7f2be2f93640 1 -- 172.21.15.46:0/1648668844 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bdc1519e0 msgr2=0x7f2bdc0c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:17.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.280+0000 7f2be2f93640 1 --2- 172.21.15.46:0/1648668844 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bdc1519e0 0x7f2bdc0c7660 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2bd00097c0 tx=0x7f2bd001c480 comp rx=0 tx=0).stop 2024-01-23T08:54:17.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.280+0000 7f2be2f93640 1 -- 172.21.15.46:0/1648668844 shutdown_connections 2024-01-23T08:54:17.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.280+0000 7f2be2f93640 1 --2- 172.21.15.46:0/1648668844 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bdc1519e0 0x7f2bdc0c7660 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:17.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.280+0000 7f2be2f93640 1 --2- 172.21.15.46:0/1648668844 >> v2:172.21.15.175:3300/0 conn(0x7f2bdc151600 0x7f2bdc15b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:17.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.280+0000 7f2be2f93640 1 -- 172.21.15.46:0/1648668844 >> 172.21.15.46:0/1648668844 conn(0x7f2bdc06d590 msgr2=0x7f2bdc066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:17.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.280+0000 7f2be2f93640 1 -- 172.21.15.46:0/1648668844 shutdown_connections 2024-01-23T08:54:17.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.280+0000 7f2be2f93640 1 -- 172.21.15.46:0/1648668844 wait complete. 2024-01-23T08:54:17.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.280+0000 7f2be2f93640 1 Processor -- start 2024-01-23T08:54:17.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.280+0000 7f2be2f93640 1 -- start start 2024-01-23T08:54:17.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.280+0000 7f2be2f93640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bdc06f350 0x7f2bdc1439c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:17.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.280+0000 7f2be2f93640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bdc151600 0x7f2bdc143f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:17.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.280+0000 7f2be2f93640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bdc1f1fa0 0x7f2bdc0c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:17.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.280+0000 7f2be2f93640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc0c2b20 con 0x7f2bdc1f1fa0 2024-01-23T08:54:17.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.280+0000 7f2be2f93640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc1432b0 con 0x7f2bdc06f350 2024-01-23T08:54:17.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.280+0000 7f2be2f93640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc143530 con 0x7f2bdc151600 2024-01-23T08:54:17.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.284+0000 7f2be1530640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bdc1f1fa0 0x7f2bdc0c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:17.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.284+0000 7f2be1530640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bdc1f1fa0 0x7f2bdc0c3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36798/0 (socket says 172.21.15.46:36798) 2024-01-23T08:54:17.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.284+0000 7f2be1530640 1 -- 172.21.15.46:0/2011486239 learned_addr learned my addr 172.21.15.46:0/2011486239 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:17.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.284+0000 7f2be0d2f640 1 --2- 172.21.15.46:0/2011486239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bdc06f350 0x7f2bdc1439c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:17.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.284+0000 7f2bdbfff640 1 --2- 172.21.15.46:0/2011486239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bdc151600 0x7f2bdc143f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:17.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.288+0000 7f2be1530640 1 -- 172.21.15.46:0/2011486239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bdc151600 msgr2=0x7f2bdc143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:17.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.288+0000 7f2be1530640 1 --2- 172.21.15.46:0/2011486239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bdc151600 0x7f2bdc143f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:17.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.288+0000 7f2be1530640 1 -- 172.21.15.46:0/2011486239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bdc06f350 msgr2=0x7f2bdc1439c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:17.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.288+0000 7f2be1530640 1 --2- 172.21.15.46:0/2011486239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bdc06f350 0x7f2bdc1439c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:17.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.288+0000 7f2be1530640 1 -- 172.21.15.46:0/2011486239 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd0009420 con 0x7f2bdc1f1fa0 2024-01-23T08:54:17.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.288+0000 7f2be1530640 1 --2- 172.21.15.46:0/2011486239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bdc1f1fa0 0x7f2bdc0c3ef0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2bd400cb70 tx=0x7f2bd400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:17.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.292+0000 7f2bd97fa640 1 -- 172.21.15.46:0/2011486239 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd400ad40 con 0x7f2bdc1f1fa0 2024-01-23T08:54:17.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.292+0000 7f2bd97fa640 1 -- 172.21.15.46:0/2011486239 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd4012400 con 0x7f2bdc1f1fa0 2024-01-23T08:54:17.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.292+0000 7f2bd97fa640 1 -- 172.21.15.46:0/2011486239 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd400aea0 con 0x7f2bdc1f1fa0 2024-01-23T08:54:17.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.292+0000 7f2be2f93640 1 -- 172.21.15.46:0/2011486239 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bdc147830 con 0x7f2bdc1f1fa0 2024-01-23T08:54:17.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.292+0000 7f2be2f93640 1 -- 172.21.15.46:0/2011486239 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bdc1f2730 con 0x7f2bdc1f1fa0 2024-01-23T08:54:17.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.296+0000 7f2be2f93640 1 -- 172.21.15.46:0/2011486239 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bdc1436a0 con 0x7f2bdc1f1fa0 2024-01-23T08:54:17.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.560+0000 7f2bd97fa640 1 -- 172.21.15.46:0/2011486239 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2bd4007070 con 0x7f2bdc1f1fa0 2024-01-23T08:54:17.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.560+0000 7f2bd97fa640 1 --2- 172.21.15.46:0/2011486239 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f2bc8066500 0x7f2bc80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:17.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.564+0000 7f2be0d2f640 1 --2- 172.21.15.46:0/2011486239 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f2bc8066500 0x7f2bc80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:17.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.564+0000 7f2be0d2f640 1 --2- 172.21.15.46:0/2011486239 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f2bc8066500 0x7f2bc80689c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc009b60 tx=0x7f2bcc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:17.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.576+0000 7f2bd97fa640 1 -- 172.21.15.46:0/2011486239 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2bd40552c0 con 0x7f2bdc1f1fa0 2024-01-23T08:54:17.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.576+0000 7f2bd97fa640 1 -- 172.21.15.46:0/2011486239 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f2bd4051600 con 0x7f2bdc1f1fa0 2024-01-23T08:54:17.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.780+0000 7f2be2f93640 1 -- 172.21.15.46:0/2011486239 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2bdc071fa0 con 0x7f2bdc1f1fa0 2024-01-23T08:54:17.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.788+0000 7f2bd97fa640 1 -- 172.21.15.46:0/2011486239 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f2bd4017070 con 0x7f2bdc1f1fa0 2024-01-23T08:54:17.785 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:54:17.785 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-01-23T08:54:17.786 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 1 2024-01-23T08:54:17.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.792+0000 7f2be2f93640 1 -- 172.21.15.46:0/2011486239 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f2bc8066500 msgr2=0x7f2bc80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:17.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.792+0000 7f2be2f93640 1 --2- 172.21.15.46:0/2011486239 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f2bc8066500 0x7f2bc80689c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc009b60 tx=0x7f2bcc009190 comp rx=0 tx=0).stop 2024-01-23T08:54:17.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.792+0000 7f2be2f93640 1 -- 172.21.15.46:0/2011486239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bdc1f1fa0 msgr2=0x7f2bdc0c3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:17.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.792+0000 7f2be2f93640 1 --2- 172.21.15.46:0/2011486239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bdc1f1fa0 0x7f2bdc0c3ef0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2bd400cb70 tx=0x7f2bd400a430 comp rx=0 tx=0).stop 2024-01-23T08:54:17.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.792+0000 7f2be2f93640 1 -- 172.21.15.46:0/2011486239 shutdown_connections 2024-01-23T08:54:17.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.792+0000 7f2be2f93640 1 --2- 172.21.15.46:0/2011486239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bdc1f1fa0 0x7f2bdc0c3ef0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:17.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.792+0000 7f2be2f93640 1 --2- 172.21.15.46:0/2011486239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bdc151600 0x7f2bdc143f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:17.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.792+0000 7f2be2f93640 1 --2- 172.21.15.46:0/2011486239 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f2bc8066500 0x7f2bc80689c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:17.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.792+0000 7f2be2f93640 1 --2- 172.21.15.46:0/2011486239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bdc06f350 0x7f2bdc1439c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:17.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.792+0000 7f2be2f93640 1 -- 172.21.15.46:0/2011486239 >> 172.21.15.46:0/2011486239 conn(0x7f2bdc06d590 msgr2=0x7f2bdc14c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:17.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.792+0000 7f2be2f93640 1 -- 172.21.15.46:0/2011486239 shutdown_connections 2024-01-23T08:54:17.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:17.792+0000 7f2be2f93640 1 -- 172.21.15.46:0/2011486239 wait complete. 2024-01-23T08:54:18.232 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T08:54:18.235 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T08:54:19.805 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-23T08:54:19.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.944+0000 7fcb67c81640 1 Processor -- start 2024-01-23T08:54:19.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.944+0000 7fcb67c81640 1 -- start start 2024-01-23T08:54:19.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.944+0000 7fcb67c81640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb6006a660 0x7fcb60157df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:19.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.944+0000 7fcb67c81640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcb60071db0 0x7fcb60072200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:19.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.944+0000 7fcb67c81640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb600c8660 con 0x7fcb60151630 2024-01-23T08:54:19.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.944+0000 7fcb67c81640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb600c78f0 con 0x7fcb60071db0 2024-01-23T08:54:19.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.944+0000 7fcb67c81640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb60158330 con 0x7fcb6006a660 2024-01-23T08:54:19.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.944+0000 7fcb6521c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb6006a660 0x7fcb60157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:19.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.948+0000 7fcb6521c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb6006a660 0x7fcb60157df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:60298/0 (socket says 172.21.15.46:60298) 2024-01-23T08:54:19.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.948+0000 7fcb6521c640 1 -- 172.21.15.46:0/3873237847 learned_addr learned my addr 172.21.15.46:0/3873237847 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:19.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.948+0000 7fcb6621e640 1 --2- 172.21.15.46:0/3873237847 >> v2:172.21.15.175:3300/0 conn(0x7fcb60071db0 0x7fcb60072200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:19.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.952+0000 7fcb6521c640 1 -- 172.21.15.46:0/3873237847 >> v2:172.21.15.175:3300/0 conn(0x7fcb60071db0 msgr2=0x7fcb60072200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:19.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.952+0000 7fcb6521c640 1 --2- 172.21.15.46:0/3873237847 >> v2:172.21.15.175:3300/0 conn(0x7fcb60071db0 0x7fcb60072200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:19.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.952+0000 7fcb6521c640 1 -- 172.21.15.46:0/3873237847 >> v1:172.21.15.175:6789/0 conn(0x7fcb60151630 legacy=0x7fcb600c4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:19.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.952+0000 7fcb6521c640 1 -- 172.21.15.46:0/3873237847 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6006be90 con 0x7fcb6006a660 2024-01-23T08:54:19.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.960+0000 7fcb6521c640 1 --2- 172.21.15.46:0/3873237847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb6006a660 0x7fcb60157df0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcb50009870 tx=0x7fcb5001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fab2471cb1f038ac server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:19.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.968+0000 7fcb64a1b640 1 -- 172.21.15.46:0/3873237847 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb500ab600 con 0x7fcb6006a660 2024-01-23T08:54:19.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.968+0000 7fcb64a1b640 1 -- 172.21.15.46:0/3873237847 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb500a7050 con 0x7fcb6006a660 2024-01-23T08:54:19.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.968+0000 7fcb64a1b640 1 -- 172.21.15.46:0/3873237847 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb500ab980 con 0x7fcb6006a660 2024-01-23T08:54:19.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.972+0000 7fcb67c81640 1 -- 172.21.15.46:0/3873237847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb6006a660 msgr2=0x7fcb60157df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:19.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.972+0000 7fcb67c81640 1 --2- 172.21.15.46:0/3873237847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb6006a660 0x7fcb60157df0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcb50009870 tx=0x7fcb5001c470 comp rx=0 tx=0).stop 2024-01-23T08:54:19.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.972+0000 7fcb67c81640 1 -- 172.21.15.46:0/3873237847 shutdown_connections 2024-01-23T08:54:19.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.972+0000 7fcb67c81640 1 --2- 172.21.15.46:0/3873237847 >> v2:172.21.15.175:3300/0 conn(0x7fcb60071db0 0x7fcb60072200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:19.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.972+0000 7fcb67c81640 1 --2- 172.21.15.46:0/3873237847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb6006a660 0x7fcb60157df0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:19.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.972+0000 7fcb67c81640 1 -- 172.21.15.46:0/3873237847 >> 172.21.15.46:0/3873237847 conn(0x7fcb600cba50 msgr2=0x7fcb600c7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:19.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.972+0000 7fcb67c81640 1 -- 172.21.15.46:0/3873237847 shutdown_connections 2024-01-23T08:54:19.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.972+0000 7fcb67c81640 1 -- 172.21.15.46:0/3873237847 wait complete. 2024-01-23T08:54:19.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.972+0000 7fcb67c81640 1 Processor -- start 2024-01-23T08:54:19.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.972+0000 7fcb67c81640 1 -- start start 2024-01-23T08:54:19.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.972+0000 7fcb67c81640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb6006a660 0x7fcb600c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:19.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.972+0000 7fcb67c81640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb60071db0 0x7fcb6014cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:19.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.972+0000 7fcb67c81640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb60151630 0x7fcb600c2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:19.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.972+0000 7fcb67c81640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb601f2460 con 0x7fcb60071db0 2024-01-23T08:54:19.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.972+0000 7fcb67c81640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb601f6450 con 0x7fcb6006a660 2024-01-23T08:54:19.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.972+0000 7fcb67c81640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb601f2700 con 0x7fcb60151630 2024-01-23T08:54:19.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.976+0000 7fcb6521c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb60071db0 0x7fcb6014cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:19.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.976+0000 7fcb6521c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb60071db0 0x7fcb6014cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36810/0 (socket says 172.21.15.46:36810) 2024-01-23T08:54:19.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.976+0000 7fcb6521c640 1 -- 172.21.15.46:0/115139154 learned_addr learned my addr 172.21.15.46:0/115139154 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:19.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.976+0000 7fcb6621e640 1 --2- 172.21.15.46:0/115139154 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb60151630 0x7fcb600c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:19.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.980+0000 7fcb6521c640 1 -- 172.21.15.46:0/115139154 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb60151630 msgr2=0x7fcb600c2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:19.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.980+0000 7fcb6521c640 1 --2- 172.21.15.46:0/115139154 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb60151630 0x7fcb600c2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:19.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.980+0000 7fcb6521c640 1 -- 172.21.15.46:0/115139154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb6006a660 msgr2=0x7fcb600c48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:19.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.980+0000 7fcb6521c640 1 --2- 172.21.15.46:0/115139154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb6006a660 0x7fcb600c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:19.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.980+0000 7fcb6521c640 1 -- 172.21.15.46:0/115139154 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb500094d0 con 0x7fcb60071db0 2024-01-23T08:54:19.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.984+0000 7fcb6521c640 1 --2- 172.21.15.46:0/115139154 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb60071db0 0x7fcb6014cbe0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcb5001a0a0 tx=0x7fcb50019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:19.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.992+0000 7fcb567fc640 1 -- 172.21.15.46:0/115139154 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb500b5640 con 0x7fcb60071db0 2024-01-23T08:54:19.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.992+0000 7fcb567fc640 1 -- 172.21.15.46:0/115139154 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb500b57a0 con 0x7fcb60071db0 2024-01-23T08:54:19.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.992+0000 7fcb67c81640 1 -- 172.21.15.46:0/115139154 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb601f29e0 con 0x7fcb60071db0 2024-01-23T08:54:19.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.992+0000 7fcb567fc640 1 -- 172.21.15.46:0/115139154 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb500b5b30 con 0x7fcb60071db0 2024-01-23T08:54:19.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.992+0000 7fcb67c81640 1 -- 172.21.15.46:0/115139154 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6013fce0 con 0x7fcb60071db0 2024-01-23T08:54:19.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:19.992+0000 7fcb67c81640 1 -- 172.21.15.46:0/115139154 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb60074340 con 0x7fcb60071db0 2024-01-23T08:54:20.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:20.016+0000 7fcb567fc640 1 -- 172.21.15.46:0/115139154 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fcb500b5c90 con 0x7fcb60071db0 2024-01-23T08:54:20.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:20.016+0000 7fcb567fc640 1 --2- 172.21.15.46:0/115139154 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fcb44066550 0x7fcb44068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:20.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:20.016+0000 7fcb65a1d640 1 --2- 172.21.15.46:0/115139154 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fcb44066550 0x7fcb44068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:20.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:20.016+0000 7fcb65a1d640 1 --2- 172.21.15.46:0/115139154 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fcb44066550 0x7fcb44068a10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c003cf0 tx=0x7fcb5c0079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:20.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:20.324+0000 7fcb567fc640 1 -- 172.21.15.46:0/115139154 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcb500abe30 con 0x7fcb60071db0 2024-01-23T08:54:20.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:20.324+0000 7fcb567fc640 1 -- 172.21.15.46:0/115139154 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fcb500ec140 con 0x7fcb60071db0 2024-01-23T08:54:20.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:20.544+0000 7fcb67c81640 1 -- 172.21.15.46:0/115139154 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb600c4fc0 con 0x7fcb60071db0 2024-01-23T08:54:20.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:20.556+0000 7fcb567fc640 1 -- 172.21.15.46:0/115139154 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7fcb500b0020 con 0x7fcb60071db0 2024-01-23T08:54:20.555 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:54:20.555 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-01-23T08:54:20.555 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 1 2024-01-23T08:54:20.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:20.560+0000 7fcb67c81640 1 -- 172.21.15.46:0/115139154 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fcb44066550 msgr2=0x7fcb44068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:20.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:20.560+0000 7fcb67c81640 1 --2- 172.21.15.46:0/115139154 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fcb44066550 0x7fcb44068a10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c003cf0 tx=0x7fcb5c0079c0 comp rx=0 tx=0).stop 2024-01-23T08:54:20.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:20.560+0000 7fcb67c81640 1 -- 172.21.15.46:0/115139154 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb60071db0 msgr2=0x7fcb6014cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:20.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:20.560+0000 7fcb67c81640 1 --2- 172.21.15.46:0/115139154 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb60071db0 0x7fcb6014cbe0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcb5001a0a0 tx=0x7fcb50019210 comp rx=0 tx=0).stop 2024-01-23T08:54:20.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:20.560+0000 7fcb67c81640 1 -- 172.21.15.46:0/115139154 shutdown_connections 2024-01-23T08:54:20.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:20.560+0000 7fcb67c81640 1 --2- 172.21.15.46:0/115139154 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb60151630 0x7fcb600c2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:20.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:20.560+0000 7fcb67c81640 1 --2- 172.21.15.46:0/115139154 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb60071db0 0x7fcb6014cbe0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:20.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:20.560+0000 7fcb67c81640 1 --2- 172.21.15.46:0/115139154 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fcb44066550 0x7fcb44068a10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:20.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:20.560+0000 7fcb67c81640 1 --2- 172.21.15.46:0/115139154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb6006a660 0x7fcb600c48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:20.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:20.560+0000 7fcb67c81640 1 -- 172.21.15.46:0/115139154 >> 172.21.15.46:0/115139154 conn(0x7fcb600cba50 msgr2=0x7fcb6014da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:20.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:20.560+0000 7fcb67c81640 1 -- 172.21.15.46:0/115139154 shutdown_connections 2024-01-23T08:54:20.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:20.560+0000 7fcb67c81640 1 -- 172.21.15.46:0/115139154 wait complete. 2024-01-23T08:54:22.576 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-23T08:54:22.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.712+0000 7ffb909e6640 1 Processor -- start 2024-01-23T08:54:22.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.712+0000 7ffb909e6640 1 -- start start 2024-01-23T08:54:22.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.716+0000 7ffb909e6640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ffb8c151800 0x7ffb8c0ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:22.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.716+0000 7ffb909e6640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8c15abb0 con 0x7ffb8c070ba0 2024-01-23T08:54:22.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.716+0000 7ffb909e6640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8c0c7e10 con 0x7ffb8c15b600 2024-01-23T08:54:22.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.716+0000 7ffb909e6640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb8c0c80f0 con 0x7ffb8c151800 2024-01-23T08:54:22.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.716+0000 7ffb8a59c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ffb8c151800 0x7ffb8c0ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:22.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.716+0000 7ffb83fff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7ffb8c15b600 0x7ffb8c158060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.46:51768/0 (socket says 172.21.15.46:51768) 2024-01-23T08:54:22.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.716+0000 7ffb83fff640 1 -- 172.21.15.46:0/1943684033 learned_addr learned my addr 172.21.15.46:0/1943684033 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:54:22.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.720+0000 7ffb8a59c640 1 -- 172.21.15.46:0/1943684033 >> v1:172.21.15.175:6789/0 conn(0x7ffb8c15b600 legacy=0x7ffb8c158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:22.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.720+0000 7ffb8a59c640 1 -- 172.21.15.46:0/1943684033 >> v1:172.21.15.46:6789/0 conn(0x7ffb8c070ba0 legacy=0x7ffb8c0c1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:22.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.720+0000 7ffb8a59c640 1 -- 172.21.15.46:0/1943684033 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8c0c83d0 con 0x7ffb8c151800 2024-01-23T08:54:22.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.724+0000 7ffb8a59c640 1 --2- 172.21.15.46:0/1943684033 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb8c151800 0x7ffb8c0ca2b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0097c0 tx=0x7ffb7c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fde0fa7f835398e server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:22.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.736+0000 7ffb89d9b640 1 -- 172.21.15.46:0/1943684033 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c0ab650 con 0x7ffb8c151800 2024-01-23T08:54:22.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.736+0000 7ffb89d9b640 1 -- 172.21.15.46:0/1943684033 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7c0ab7b0 con 0x7ffb8c151800 2024-01-23T08:54:22.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.736+0000 7ffb89d9b640 1 -- 172.21.15.46:0/1943684033 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c0abb40 con 0x7ffb8c151800 2024-01-23T08:54:22.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.736+0000 7ffb909e6640 1 -- 172.21.15.46:0/1943684033 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb8c151800 msgr2=0x7ffb8c0ca2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:22.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.736+0000 7ffb909e6640 1 --2- 172.21.15.46:0/1943684033 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb8c151800 0x7ffb8c0ca2b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0097c0 tx=0x7ffb7c01c450 comp rx=0 tx=0).stop 2024-01-23T08:54:22.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.736+0000 7ffb909e6640 1 -- 172.21.15.46:0/1943684033 shutdown_connections 2024-01-23T08:54:22.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.736+0000 7ffb909e6640 1 --2- 172.21.15.46:0/1943684033 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb8c151800 0x7ffb8c0ca2b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:22.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.736+0000 7ffb909e6640 1 -- 172.21.15.46:0/1943684033 >> 172.21.15.46:0/1943684033 conn(0x7ffb8c06ef50 msgr2=0x7ffb8c06f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:22.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.736+0000 7ffb909e6640 1 -- 172.21.15.46:0/1943684033 shutdown_connections 2024-01-23T08:54:22.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.736+0000 7ffb909e6640 1 -- 172.21.15.46:0/1943684033 wait complete. 2024-01-23T08:54:22.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.736+0000 7ffb909e6640 1 Processor -- start 2024-01-23T08:54:22.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.736+0000 7ffb909e6640 1 -- start start 2024-01-23T08:54:22.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.740+0000 7ffb909e6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb8c070ba0 0x7ffb8c06b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:22.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.740+0000 7ffb909e6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb8c151800 0x7ffb8c14a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:22.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.740+0000 7ffb909e6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb8c15b600 0x7ffb8c14bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:22.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.740+0000 7ffb909e6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c14a7a0 con 0x7ffb8c151800 2024-01-23T08:54:22.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.740+0000 7ffb909e6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c14b920 con 0x7ffb8c070ba0 2024-01-23T08:54:22.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.740+0000 7ffb909e6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c149dd0 con 0x7ffb8c15b600 2024-01-23T08:54:22.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.740+0000 7ffb83fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb8c151800 0x7ffb8c14a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:22.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.740+0000 7ffb83fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb8c151800 0x7ffb8c14a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36832/0 (socket says 172.21.15.46:36832) 2024-01-23T08:54:22.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.740+0000 7ffb83fff640 1 -- 172.21.15.46:0/3149659867 learned_addr learned my addr 172.21.15.46:0/3149659867 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:22.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.740+0000 7ffb8a59c640 1 --2- 172.21.15.46:0/3149659867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb8c070ba0 0x7ffb8c06b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:22.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.740+0000 7ffb8ad9d640 1 --2- 172.21.15.46:0/3149659867 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb8c15b600 0x7ffb8c14bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:22.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.744+0000 7ffb83fff640 1 -- 172.21.15.46:0/3149659867 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb8c15b600 msgr2=0x7ffb8c14bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:22.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.744+0000 7ffb83fff640 1 --2- 172.21.15.46:0/3149659867 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb8c15b600 0x7ffb8c14bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:22.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.744+0000 7ffb83fff640 1 -- 172.21.15.46:0/3149659867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb8c070ba0 msgr2=0x7ffb8c06b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:22.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.744+0000 7ffb83fff640 1 --2- 172.21.15.46:0/3149659867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb8c070ba0 0x7ffb8c06b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:22.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.744+0000 7ffb83fff640 1 -- 172.21.15.46:0/3149659867 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c009420 con 0x7ffb8c151800 2024-01-23T08:54:22.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.744+0000 7ffb83fff640 1 --2- 172.21.15.46:0/3149659867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb8c151800 0x7ffb8c14a260 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400c3a0 tx=0x7ffb7400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:22.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.752+0000 7ffb82ffd640 1 -- 172.21.15.46:0/3149659867 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb74005cf0 con 0x7ffb8c151800 2024-01-23T08:54:22.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.752+0000 7ffb82ffd640 1 -- 172.21.15.46:0/3149659867 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb74005e50 con 0x7ffb8c151800 2024-01-23T08:54:22.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.752+0000 7ffb909e6640 1 -- 172.21.15.46:0/3149659867 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb8c06f730 con 0x7ffb8c151800 2024-01-23T08:54:22.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.752+0000 7ffb82ffd640 1 -- 172.21.15.46:0/3149659867 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb740072f0 con 0x7ffb8c151800 2024-01-23T08:54:22.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.752+0000 7ffb909e6640 1 -- 172.21.15.46:0/3149659867 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8c156740 con 0x7ffb8c151800 2024-01-23T08:54:22.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.752+0000 7ffb909e6640 1 -- 172.21.15.46:0/3149659867 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb8c149f80 con 0x7ffb8c151800 2024-01-23T08:54:22.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.772+0000 7ffb82ffd640 1 -- 172.21.15.46:0/3149659867 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ffb74007450 con 0x7ffb8c151800 2024-01-23T08:54:22.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.772+0000 7ffb82ffd640 1 --2- 172.21.15.46:0/3149659867 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7ffb6c066550 0x7ffb6c068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:22.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.772+0000 7ffb8a59c640 1 --2- 172.21.15.46:0/3149659867 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7ffb6c066550 0x7ffb6c068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:22.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.772+0000 7ffb8a59c640 1 --2- 172.21.15.46:0/3149659867 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7ffb6c066550 0x7ffb6c068a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0af000 tx=0x7ffb7c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:22.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:22.776+0000 7ffb82ffd640 1 -- 172.21.15.46:0/3149659867 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ffb74054610 con 0x7ffb8c151800 2024-01-23T08:54:23.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:23.052+0000 7ffb82ffd640 1 -- 172.21.15.46:0/3149659867 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ffb74050950 con 0x7ffb8c151800 2024-01-23T08:54:23.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:23.252+0000 7ffb909e6640 1 -- 172.21.15.46:0/3149659867 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb8c149f40 con 0x7ffb8c151800 2024-01-23T08:54:23.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:23.264+0000 7ffb82ffd640 1 -- 172.21.15.46:0/3149659867 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1321 (secure 0 0 0) 0x7ffb74017020 con 0x7ffb8c151800 2024-01-23T08:54:23.262 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:54:23.262 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/338965660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":338965660},{"type":"v1","addr":"172.21.15.46:6837","nonce":338965660}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-01-23T08:54:23.262 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 2 2024-01-23T08:54:23.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:23.268+0000 7ffb909e6640 1 -- 172.21.15.46:0/3149659867 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7ffb6c066550 msgr2=0x7ffb6c068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:23.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:23.268+0000 7ffb909e6640 1 --2- 172.21.15.46:0/3149659867 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7ffb6c066550 0x7ffb6c068a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0af000 tx=0x7ffb7c0a7000 comp rx=0 tx=0).stop 2024-01-23T08:54:23.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:23.268+0000 7ffb909e6640 1 -- 172.21.15.46:0/3149659867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb8c151800 msgr2=0x7ffb8c14a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:23.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:23.268+0000 7ffb909e6640 1 --2- 172.21.15.46:0/3149659867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb8c151800 0x7ffb8c14a260 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400c3a0 tx=0x7ffb7400c860 comp rx=0 tx=0).stop 2024-01-23T08:54:23.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:23.268+0000 7ffb909e6640 1 -- 172.21.15.46:0/3149659867 shutdown_connections 2024-01-23T08:54:23.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:23.268+0000 7ffb909e6640 1 --2- 172.21.15.46:0/3149659867 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb8c15b600 0x7ffb8c14bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:23.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:23.268+0000 7ffb909e6640 1 --2- 172.21.15.46:0/3149659867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb8c151800 0x7ffb8c14a260 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:23.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:23.268+0000 7ffb909e6640 1 --2- 172.21.15.46:0/3149659867 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7ffb6c066550 0x7ffb6c068a10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:23.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:23.268+0000 7ffb909e6640 1 --2- 172.21.15.46:0/3149659867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb8c070ba0 0x7ffb8c06b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:23.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:23.268+0000 7ffb909e6640 1 -- 172.21.15.46:0/3149659867 >> 172.21.15.46:0/3149659867 conn(0x7ffb8c06ef50 msgr2=0x7ffb8c158990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:23.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:23.268+0000 7ffb909e6640 1 -- 172.21.15.46:0/3149659867 shutdown_connections 2024-01-23T08:54:23.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:23.268+0000 7ffb909e6640 1 -- 172.21.15.46:0/3149659867 wait complete. 2024-01-23T08:54:25.282 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-23T08:54:25.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.428+0000 7fefa67c4640 1 Processor -- start 2024-01-23T08:54:25.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.428+0000 7fefa67c4640 1 -- start start 2024-01-23T08:54:25.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.428+0000 7fefa67c4640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fefa0151790 0x7fefa006a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:25.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.428+0000 7fefa67c4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fefa00c8290 0x7fefa0072850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:25.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.428+0000 7fefa67c4640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefa01582e0 con 0x7fefa00723e0 2024-01-23T08:54:25.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.428+0000 7fefa67c4640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefa006aba0 con 0x7fefa0151790 2024-01-23T08:54:25.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.428+0000 7fefa67c4640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefa0157450 con 0x7fefa00c8290 2024-01-23T08:54:25.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.472+0000 7fefa4d61640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fefa00c8290 0x7fefa0072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:25.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.496+0000 7fefa4d61640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fefa00c8290 0x7fefa0072850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:47166/0 (socket says 172.21.15.46:47166) 2024-01-23T08:54:25.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.496+0000 7fefa4d61640 1 -- 172.21.15.46:0/2695582745 learned_addr learned my addr 172.21.15.46:0/2695582745 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:25.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.500+0000 7fefa4d61640 1 -- 172.21.15.46:0/2695582745 >> v2:172.21.15.46:3300/0 conn(0x7fefa0151790 msgr2=0x7fefa006a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:25.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.500+0000 7fefa4d61640 1 --2- 172.21.15.46:0/2695582745 >> v2:172.21.15.46:3300/0 conn(0x7fefa0151790 0x7fefa006a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:25.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.500+0000 7fefa4d61640 1 -- 172.21.15.46:0/2695582745 >> v1:172.21.15.46:6789/0 conn(0x7fefa00723e0 legacy=0x7fefa00c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:25.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.500+0000 7fefa4d61640 1 -- 172.21.15.46:0/2695582745 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa0151b70 con 0x7fefa00c8290 2024-01-23T08:54:25.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.512+0000 7fefa4d61640 1 --2- 172.21.15.46:0/2695582745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefa00c8290 0x7fefa0072850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fefa00c3880 tx=0x7fef9801f180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35312f440b682f84 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:25.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.528+0000 7fef9effd640 1 -- 172.21.15.46:0/2695582745 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef980af400 con 0x7fefa00c8290 2024-01-23T08:54:25.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.528+0000 7fef9effd640 1 -- 172.21.15.46:0/2695582745 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef980ab050 con 0x7fefa00c8290 2024-01-23T08:54:25.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.528+0000 7fef9effd640 1 -- 172.21.15.46:0/2695582745 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef980af780 con 0x7fefa00c8290 2024-01-23T08:54:25.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.528+0000 7fefa67c4640 1 -- 172.21.15.46:0/2695582745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefa00c8290 msgr2=0x7fefa0072850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:25.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.528+0000 7fefa67c4640 1 --2- 172.21.15.46:0/2695582745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefa00c8290 0x7fefa0072850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fefa00c3880 tx=0x7fef9801f180 comp rx=0 tx=0).stop 2024-01-23T08:54:25.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.532+0000 7fefa67c4640 1 -- 172.21.15.46:0/2695582745 shutdown_connections 2024-01-23T08:54:25.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.532+0000 7fefa67c4640 1 --2- 172.21.15.46:0/2695582745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefa00c8290 0x7fefa0072850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:25.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.532+0000 7fefa67c4640 1 --2- 172.21.15.46:0/2695582745 >> v2:172.21.15.46:3300/0 conn(0x7fefa0151790 0x7fefa006a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:25.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.532+0000 7fefa67c4640 1 -- 172.21.15.46:0/2695582745 >> 172.21.15.46:0/2695582745 conn(0x7fefa006de30 msgr2=0x7fefa006e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:25.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.532+0000 7fefa67c4640 1 -- 172.21.15.46:0/2695582745 shutdown_connections 2024-01-23T08:54:25.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.532+0000 7fefa67c4640 1 -- 172.21.15.46:0/2695582745 wait complete. 2024-01-23T08:54:25.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.532+0000 7fefa67c4640 1 Processor -- start 2024-01-23T08:54:25.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.532+0000 7fefa67c4640 1 -- start start 2024-01-23T08:54:25.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.532+0000 7fefa67c4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefa00723e0 0x7fefa01f2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:25.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.532+0000 7fefa67c4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fefa00c8290 0x7fefa01ef8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:25.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.532+0000 7fefa67c4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fefa0151790 0x7fefa0158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:25.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.532+0000 7fefa67c4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa01f3470 con 0x7fefa0151790 2024-01-23T08:54:25.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.532+0000 7fefa67c4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa006ffc0 con 0x7fefa00723e0 2024-01-23T08:54:25.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.532+0000 7fefa67c4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa01501e0 con 0x7fefa00c8290 2024-01-23T08:54:25.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.536+0000 7fef9f7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fefa00c8290 0x7fefa01ef8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:25.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.536+0000 7fef9f7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fefa00c8290 0x7fefa01ef8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:36496/0 (socket says 172.21.15.46:36496) 2024-01-23T08:54:25.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.536+0000 7fef9f7fe640 1 -- 172.21.15.46:0/2684053570 learned_addr learned my addr 172.21.15.46:0/2684053570 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:25.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.536+0000 7fef9ffff640 1 --2- 172.21.15.46:0/2684053570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefa00723e0 0x7fefa01f2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:25.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.544+0000 7fef9f7fe640 1 -- 172.21.15.46:0/2684053570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefa00723e0 msgr2=0x7fefa01f2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:25.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.544+0000 7fef9f7fe640 1 --2- 172.21.15.46:0/2684053570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefa00723e0 0x7fefa01f2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:25.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.544+0000 7fef9f7fe640 1 -- 172.21.15.46:0/2684053570 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fefa0151790 msgr2=0x7fefa0158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:25.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.544+0000 7fef9f7fe640 1 --2- 172.21.15.46:0/2684053570 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fefa0151790 0x7fefa0158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:25.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.544+0000 7fef9f7fe640 1 -- 172.21.15.46:0/2684053570 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef98009b30 con 0x7fefa00c8290 2024-01-23T08:54:25.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.552+0000 7fef9f7fe640 1 --2- 172.21.15.46:0/2684053570 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fefa00c8290 0x7fefa01ef8c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fef9400b3e0 tx=0x7fef9400b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:25.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.564+0000 7fef9cff9640 1 -- 172.21.15.46:0/2684053570 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef94011830 con 0x7fefa00c8290 2024-01-23T08:54:25.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.564+0000 7fef9cff9640 1 -- 172.21.15.46:0/2684053570 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef940119b0 con 0x7fefa00c8290 2024-01-23T08:54:25.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.564+0000 7fef9cff9640 1 -- 172.21.15.46:0/2684053570 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef94011d60 con 0x7fefa00c8290 2024-01-23T08:54:25.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.564+0000 7fefa67c4640 1 -- 172.21.15.46:0/2684053570 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa0150a40 con 0x7fefa00c8290 2024-01-23T08:54:25.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.564+0000 7fefa67c4640 1 -- 172.21.15.46:0/2684053570 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa0150760 con 0x7fefa00c8290 2024-01-23T08:54:25.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.564+0000 7fefa67c4640 1 -- 172.21.15.46:0/2684053570 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa0074340 con 0x7fefa00c8290 2024-01-23T08:54:25.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.972+0000 7fef9cff9640 1 -- 172.21.15.46:0/2684053570 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fef94023430 con 0x7fefa00c8290 2024-01-23T08:54:25.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.972+0000 7fef9cff9640 1 --2- 172.21.15.46:0/2684053570 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fef8c066550 0x7fef8c068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:25.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.972+0000 7fef9ffff640 1 --2- 172.21.15.46:0/2684053570 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fef8c066550 0x7fef8c068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:25.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.972+0000 7fef9ffff640 1 --2- 172.21.15.46:0/2684053570 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fef8c066550 0x7fef8c068a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fef90009990 tx=0x7fef90009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:25.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:25.992+0000 7fef9cff9640 1 -- 172.21.15.46:0/2684053570 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fef940556c0 con 0x7fefa00c8290 2024-01-23T08:54:26.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:26.044+0000 7fef9cff9640 1 -- 172.21.15.46:0/2684053570 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fef94051300 con 0x7fefa00c8290 2024-01-23T08:54:26.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:26.256+0000 7fefa67c4640 1 -- 172.21.15.46:0/2684053570 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fefa00c6ea0 con 0x7fefa00c8290 2024-01-23T08:54:34.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:34.872+0000 7fef9cff9640 1 -- 172.21.15.46:0/2684053570 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5277 (secure 0 0 0) 0x7fef94015090 con 0x7fefa00c8290 2024-01-23T08:54:34.869 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:54:34.870 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4208,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/397511399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":397511399},{"type":"v1","addr":"172.21.15.175:6835","nonce":397511399}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1620040020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1620040020},{"type":"v1","addr":"172.21.15.46:6835","nonce":1620040020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2714415350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2714415350},{"type":"v1","addr":"172.21.15.175:6833","nonce":2714415350}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4234,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3103300888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3103300888},{"type":"v1","addr":"172.21.15.175:6837","nonce":3103300888}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/338965660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":338965660},{"type":"v1","addr":"172.21.15.46:6837","nonce":338965660}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4242,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1889172114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1889172114},{"type":"v1","addr":"172.21.15.46:6839","nonce":1889172114}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-01-23T08:54:34.870 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 3 2024-01-23T08:54:34.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:34.876+0000 7fefa67c4640 1 -- 172.21.15.46:0/2684053570 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fef8c066550 msgr2=0x7fef8c068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:34.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:34.876+0000 7fefa67c4640 1 --2- 172.21.15.46:0/2684053570 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fef8c066550 0x7fef8c068a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fef90009990 tx=0x7fef90009110 comp rx=0 tx=0).stop 2024-01-23T08:54:34.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:34.876+0000 7fefa67c4640 1 -- 172.21.15.46:0/2684053570 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fefa00c8290 msgr2=0x7fefa01ef8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:34.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:34.876+0000 7fefa67c4640 1 --2- 172.21.15.46:0/2684053570 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fefa00c8290 0x7fefa01ef8c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fef9400b3e0 tx=0x7fef9400b8a0 comp rx=0 tx=0).stop 2024-01-23T08:54:34.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:34.876+0000 7fefa67c4640 1 -- 172.21.15.46:0/2684053570 shutdown_connections 2024-01-23T08:54:34.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:34.876+0000 7fefa67c4640 1 --2- 172.21.15.46:0/2684053570 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fefa0151790 0x7fefa0158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:34.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:34.876+0000 7fefa67c4640 1 --2- 172.21.15.46:0/2684053570 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fefa00c8290 0x7fefa01ef8c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:34.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:34.876+0000 7fefa67c4640 1 --2- 172.21.15.46:0/2684053570 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fef8c066550 0x7fef8c068a10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:34.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:34.876+0000 7fefa67c4640 1 --2- 172.21.15.46:0/2684053570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefa00723e0 0x7fefa01f2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:34.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:34.876+0000 7fefa67c4640 1 -- 172.21.15.46:0/2684053570 >> 172.21.15.46:0/2684053570 conn(0x7fefa006de30 msgr2=0x7fefa006e210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:34.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:34.876+0000 7fefa67c4640 1 -- 172.21.15.46:0/2684053570 shutdown_connections 2024-01-23T08:54:34.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:34.876+0000 7fefa67c4640 1 -- 172.21.15.46:0/2684053570 wait complete. 2024-01-23T08:54:34.893 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-23T08:54:35.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.032+0000 7fea5f540640 1 Processor -- start 2024-01-23T08:54:35.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.036+0000 7fea5f540640 1 -- start start 2024-01-23T08:54:35.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.036+0000 7fea5f540640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fea580c0e90 0x7fea580c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:35.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.036+0000 7fea5f540640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea580c8e80 0x7fea58159870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:35.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.036+0000 7fea5f540640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea58156ae0 con 0x7fea5814d1b0 2024-01-23T08:54:35.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.036+0000 7fea5f540640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea5806f0d0 con 0x7fea580c0e90 2024-01-23T08:54:35.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.036+0000 7fea5f540640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea58156280 con 0x7fea580c8e80 2024-01-23T08:54:35.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.136+0000 7fea5dadd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea580c8e80 0x7fea58159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:35.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.136+0000 7fea5dadd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea580c8e80 0x7fea58159870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:45570/0 (socket says 172.21.15.46:45570) 2024-01-23T08:54:35.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.136+0000 7fea5dadd640 1 -- 172.21.15.46:0/3305246639 learned_addr learned my addr 172.21.15.46:0/3305246639 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:35.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.148+0000 7fea5dadd640 1 -- 172.21.15.46:0/3305246639 >> v2:172.21.15.175:3300/0 conn(0x7fea580c0e90 msgr2=0x7fea580c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:35.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.148+0000 7fea5dadd640 1 --2- 172.21.15.46:0/3305246639 >> v2:172.21.15.175:3300/0 conn(0x7fea580c0e90 0x7fea580c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:35.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.148+0000 7fea5dadd640 1 -- 172.21.15.46:0/3305246639 >> v1:172.21.15.175:6789/0 conn(0x7fea5814d1b0 legacy=0x7fea580c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:35.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.148+0000 7fea5dadd640 1 -- 172.21.15.46:0/3305246639 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea58159db0 con 0x7fea580c8e80 2024-01-23T08:54:35.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.156+0000 7fea5dadd640 1 --2- 172.21.15.46:0/3305246639 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea580c8e80 0x7fea58159870 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fea50009e50 tx=0x7fea5001c9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83699a9b86a695ca server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:35.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.164+0000 7fea4ffff640 1 -- 172.21.15.46:0/3305246639 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea500a5850 con 0x7fea580c8e80 2024-01-23T08:54:35.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.164+0000 7fea4ffff640 1 -- 172.21.15.46:0/3305246639 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea500a59b0 con 0x7fea580c8e80 2024-01-23T08:54:35.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.164+0000 7fea4ffff640 1 -- 172.21.15.46:0/3305246639 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea500a5d40 con 0x7fea580c8e80 2024-01-23T08:54:35.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.168+0000 7fea5f540640 1 -- 172.21.15.46:0/3305246639 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea580c8e80 msgr2=0x7fea58159870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:35.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.168+0000 7fea5f540640 1 --2- 172.21.15.46:0/3305246639 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea580c8e80 0x7fea58159870 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fea50009e50 tx=0x7fea5001c9d0 comp rx=0 tx=0).stop 2024-01-23T08:54:35.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.168+0000 7fea5f540640 1 -- 172.21.15.46:0/3305246639 shutdown_connections 2024-01-23T08:54:35.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.168+0000 7fea5f540640 1 --2- 172.21.15.46:0/3305246639 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea580c8e80 0x7fea58159870 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:35.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.168+0000 7fea5f540640 1 --2- 172.21.15.46:0/3305246639 >> v2:172.21.15.175:3300/0 conn(0x7fea580c0e90 0x7fea580c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:35.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.168+0000 7fea5f540640 1 -- 172.21.15.46:0/3305246639 >> 172.21.15.46:0/3305246639 conn(0x7fea58072450 msgr2=0x7fea5806fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:35.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.168+0000 7fea5f540640 1 -- 172.21.15.46:0/3305246639 shutdown_connections 2024-01-23T08:54:35.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.168+0000 7fea5f540640 1 -- 172.21.15.46:0/3305246639 wait complete. 2024-01-23T08:54:35.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.168+0000 7fea5f540640 1 Processor -- start 2024-01-23T08:54:35.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.168+0000 7fea5f540640 1 -- start start 2024-01-23T08:54:35.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.168+0000 7fea5f540640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea580c0e90 0x7fea580c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:35.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.168+0000 7fea5f540640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea580c8e80 0x7fea581f5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:35.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.168+0000 7fea5f540640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea5814d1b0 0x7fea581551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:35.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.168+0000 7fea5f540640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea580c4c80 con 0x7fea580c8e80 2024-01-23T08:54:35.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.168+0000 7fea5f540640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea580c5b00 con 0x7fea5814d1b0 2024-01-23T08:54:35.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.168+0000 7fea5f540640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea581f2710 con 0x7fea580c0e90 2024-01-23T08:54:35.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.172+0000 7fea5d2dc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea580c0e90 0x7fea580c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:35.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.172+0000 7fea5d2dc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea580c0e90 0x7fea580c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:45584/0 (socket says 172.21.15.46:45584) 2024-01-23T08:54:35.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.172+0000 7fea5d2dc640 1 -- 172.21.15.46:0/85024155 learned_addr learned my addr 172.21.15.46:0/85024155 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:35.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.180+0000 7fea5d2dc640 1 -- 172.21.15.46:0/85024155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea5814d1b0 msgr2=0x7fea581551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:35.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.180+0000 7fea5d2dc640 1 --2- 172.21.15.46:0/85024155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea5814d1b0 0x7fea581551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:35.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.180+0000 7fea5d2dc640 1 -- 172.21.15.46:0/85024155 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea580c8e80 msgr2=0x7fea581f5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:35.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.180+0000 7fea5d2dc640 1 --2- 172.21.15.46:0/85024155 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea580c8e80 0x7fea581f5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:35.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.180+0000 7fea5d2dc640 1 -- 172.21.15.46:0/85024155 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea50009b30 con 0x7fea580c0e90 2024-01-23T08:54:35.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.188+0000 7fea5d2dc640 1 --2- 172.21.15.46:0/85024155 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea580c0e90 0x7fea580c41c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fea5400b3e0 tx=0x7fea5400b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:35.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.196+0000 7fea4dffb640 1 -- 172.21.15.46:0/85024155 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea54011830 con 0x7fea580c0e90 2024-01-23T08:54:35.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.200+0000 7fea4dffb640 1 -- 172.21.15.46:0/85024155 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea540119b0 con 0x7fea580c0e90 2024-01-23T08:54:35.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.200+0000 7fea4dffb640 1 -- 172.21.15.46:0/85024155 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea54011d60 con 0x7fea580c0e90 2024-01-23T08:54:35.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.200+0000 7fea5f540640 1 -- 172.21.15.46:0/85024155 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea580c5d50 con 0x7fea580c0e90 2024-01-23T08:54:35.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.200+0000 7fea5f540640 1 -- 172.21.15.46:0/85024155 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea581f29d0 con 0x7fea580c0e90 2024-01-23T08:54:35.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.200+0000 7fea5f540640 1 -- 172.21.15.46:0/85024155 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea580c97b0 con 0x7fea580c0e90 2024-01-23T08:54:35.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.248+0000 7fea4dffb640 1 -- 172.21.15.46:0/85024155 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fea5401a400 con 0x7fea580c0e90 2024-01-23T08:54:35.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.248+0000 7fea4dffb640 1 --2- 172.21.15.46:0/85024155 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fea3c066500 0x7fea3c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:35.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.248+0000 7fea5cadb640 1 --2- 172.21.15.46:0/85024155 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fea3c066500 0x7fea3c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:35.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.252+0000 7fea5cadb640 1 --2- 172.21.15.46:0/85024155 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fea3c066500 0x7fea3c0689c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fea5814b7e0 tx=0x7fea48006ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:35.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.256+0000 7fea4dffb640 1 -- 172.21.15.46:0/85024155 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fea54055c60 con 0x7fea580c0e90 2024-01-23T08:54:35.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.532+0000 7fea4dffb640 1 -- 172.21.15.46:0/85024155 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fea540518a0 con 0x7fea580c0e90 2024-01-23T08:54:35.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.720+0000 7fea5f540640 1 -- 172.21.15.46:0/85024155 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea58074340 con 0x7fea580c0e90 2024-01-23T08:54:35.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.848+0000 7fea4dffb640 1 -- 172.21.15.46:0/85024155 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12863 (secure 0 0 0) 0x7fea54015020 con 0x7fea580c0e90 2024-01-23T08:54:35.846 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:54:35.846 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":18,"fsid":"fdbdd393-f422-45ae-a488-2bbb0163e580","created":"2024-01-23T08:53:36.942515+0000","modified":"2024-01-23T08:54:02.392110+0000","last_up_change":"2024-01-23T08:53:57.198113+0000","last_in_change":"2024-01-23T08:53:47.852614+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-23T08:53:59.340853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f32c3d7d-e32a-42d8-b55f-db874d915a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6818","nonce":2681790976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6821","nonce":2681790976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6825","nonce":2681790976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6823","nonce":2681790976}]},"public_addr":"172.21.15.46:6818/2681790976","cluster_addr":"172.21.15.46:6821/2681790976","heartbeat_back_addr":"172.21.15.46:6825/2681790976","heartbeat_front_addr":"172.21.15.46:6823/2681790976","state":["exists","up"]},{"osd":1,"uuid":"6f3b6bd2-bbea-4d08-84d5-4407363b5eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6803","nonce":3679152623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6805","nonce":3679152623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6809","nonce":3679152623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6807","nonce":3679152623}]},"public_addr":"172.21.15.46:6803/3679152623","cluster_addr":"172.21.15.46:6805/3679152623","heartbeat_back_addr":"172.21.15.46:6809/3679152623","heartbeat_front_addr":"172.21.15.46:6807/3679152623","state":["exists","up"]},{"osd":2,"uuid":"8f110727-31e7-4f69-926b-c87481d4d28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6811","nonce":3869652274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6813","nonce":3869652274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6820","nonce":3869652274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6815","nonce":3869652274}]},"public_addr":"172.21.15.46:6811/3869652274","cluster_addr":"172.21.15.46:6813/3869652274","heartbeat_back_addr":"172.21.15.46:6820/3869652274","heartbeat_front_addr":"172.21.15.46:6815/3869652274","state":["exists","up"]},{"osd":3,"uuid":"3aa7527d-0463-4373-b9c7-e6b507a7987f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6827","nonce":4168860822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6829","nonce":4168860822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6833","nonce":4168860822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6831","nonce":4168860822}]},"public_addr":"172.21.15.46:6827/4168860822","cluster_addr":"172.21.15.46:6829/4168860822","heartbeat_back_addr":"172.21.15.46:6833/4168860822","heartbeat_front_addr":"172.21.15.46:6831/4168860822","state":["exists","up"]},{"osd":4,"uuid":"eb47a1e5-9f26-465f-b188-87c6eed63c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6805","nonce":3115257412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6808","nonce":3115257412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6815","nonce":3115257412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6812","nonce":3115257412}]},"public_addr":"172.21.15.175:6805/3115257412","cluster_addr":"172.21.15.175:6808/3115257412","heartbeat_back_addr":"172.21.15.175:6815/3115257412","heartbeat_front_addr":"172.21.15.175:6812/3115257412","state":["exists","up"]},{"osd":5,"uuid":"34048409-998c-44f3-a29d-dcad7a6c917b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6818","nonce":3146473948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6822","nonce":3146473948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6831","nonce":3146473948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6826","nonce":3146473948}]},"public_addr":"172.21.15.175:6818/3146473948","cluster_addr":"172.21.15.175:6822/3146473948","heartbeat_back_addr":"172.21.15.175:6831/3146473948","heartbeat_front_addr":"172.21.15.175:6826/3146473948","state":["exists","up"]},{"osd":6,"uuid":"f5d45d3f-9af3-44a1-a730-c260ed1654b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6801","nonce":4161180058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6804","nonce":4161180058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6814","nonce":4161180058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6809","nonce":4161180058}]},"public_addr":"172.21.15.175:6801/4161180058","cluster_addr":"172.21.15.175:6804/4161180058","heartbeat_back_addr":"172.21.15.175:6814/4161180058","heartbeat_front_addr":"172.21.15.175:6809/4161180058","state":["exists","up"]},{"osd":7,"uuid":"16d12e53-2ad3-4b5c-a789-22b45056fd9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6819","nonce":2670236415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6823","nonce":2670236415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6830","nonce":2670236415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6827","nonce":2670236415}]},"public_addr":"172.21.15.175:6819/2670236415","cluster_addr":"172.21.15.175:6823/2670236415","heartbeat_back_addr":"172.21.15.175:6830/2670236415","heartbeat_front_addr":"172.21.15.175:6827/2670236415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.847037+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.765547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.716122+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.874628+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.786580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.924885+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.285635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.898130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T08:54:35.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.852+0000 7fea5f540640 1 -- 172.21.15.46:0/85024155 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fea3c066500 msgr2=0x7fea3c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:35.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.852+0000 7fea5f540640 1 --2- 172.21.15.46:0/85024155 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fea3c066500 0x7fea3c0689c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fea5814b7e0 tx=0x7fea48006ca0 comp rx=0 tx=0).stop 2024-01-23T08:54:35.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.852+0000 7fea5f540640 1 -- 172.21.15.46:0/85024155 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea580c0e90 msgr2=0x7fea580c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:35.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.852+0000 7fea5f540640 1 --2- 172.21.15.46:0/85024155 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea580c0e90 0x7fea580c41c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fea5400b3e0 tx=0x7fea5400b8a0 comp rx=0 tx=0).stop 2024-01-23T08:54:35.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.852+0000 7fea5f540640 1 -- 172.21.15.46:0/85024155 shutdown_connections 2024-01-23T08:54:35.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.852+0000 7fea5f540640 1 --2- 172.21.15.46:0/85024155 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fea3c066500 0x7fea3c0689c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:35.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.852+0000 7fea5f540640 1 --2- 172.21.15.46:0/85024155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea5814d1b0 0x7fea581551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:35.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.852+0000 7fea5f540640 1 --2- 172.21.15.46:0/85024155 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea580c8e80 0x7fea581f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:35.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.852+0000 7fea5f540640 1 --2- 172.21.15.46:0/85024155 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea580c0e90 0x7fea580c41c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:35.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.852+0000 7fea5f540640 1 -- 172.21.15.46:0/85024155 >> 172.21.15.46:0/85024155 conn(0x7fea58072450 msgr2=0x7fea5814bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:35.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.852+0000 7fea5f540640 1 -- 172.21.15.46:0/85024155 shutdown_connections 2024-01-23T08:54:35.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.852+0000 7fea5f540640 1 -- 172.21.15.46:0/85024155 wait complete. 2024-01-23T08:54:35.869 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-23T08:53:59.340853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-23T08:54:35.869 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-23T08:54:35.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.996+0000 7f8ff0be8640 1 Processor -- start 2024-01-23T08:54:35.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.996+0000 7f8ff0be8640 1 -- start start 2024-01-23T08:54:35.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.996+0000 7f8ff0be8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fec151390 0x7f8fec157e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:35.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.996+0000 7f8ff0be8640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8fec15ad40 0x7f8fec15b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:35.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.996+0000 7f8ff0be8640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fec066b10 con 0x7f8fec06bb90 2024-01-23T08:54:35.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.996+0000 7f8ff0be8640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fec0c7560 con 0x7f8fec15ad40 2024-01-23T08:54:35.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:35.996+0000 7f8ff0be8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec0c7d80 con 0x7f8fec151390 2024-01-23T08:54:35.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.000+0000 7f8fea59c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fec151390 0x7f8fec157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:35.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.000+0000 7f8fea59c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fec151390 0x7f8fec157e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:45596/0 (socket says 172.21.15.46:45596) 2024-01-23T08:54:35.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.000+0000 7f8fea59c640 1 -- 172.21.15.46:0/1664234613 learned_addr learned my addr 172.21.15.46:0/1664234613 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:35.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.000+0000 7f8fead9d640 1 --2- 172.21.15.46:0/1664234613 >> v2:172.21.15.46:3300/0 conn(0x7f8fec15ad40 0x7f8fec15b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:36.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.004+0000 7f8fea59c640 1 -- 172.21.15.46:0/1664234613 >> v2:172.21.15.46:3300/0 conn(0x7f8fec15ad40 msgr2=0x7f8fec15b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:36.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.004+0000 7f8fea59c640 1 --2- 172.21.15.46:0/1664234613 >> v2:172.21.15.46:3300/0 conn(0x7f8fec15ad40 0x7f8fec15b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:36.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.004+0000 7f8fea59c640 1 -- 172.21.15.46:0/1664234613 >> v1:172.21.15.46:6789/0 conn(0x7f8fec06bb90 legacy=0x7f8fec0c4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:36.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.004+0000 7f8fea59c640 1 -- 172.21.15.46:0/1664234613 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fec1583a0 con 0x7f8fec151390 2024-01-23T08:54:36.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.016+0000 7f8fea59c640 1 --2- 172.21.15.46:0/1664234613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fec151390 0x7f8fec157e60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc009870 tx=0x7f8fdc01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e965d32d92831532 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:36.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.128+0000 7f8fe959a640 1 -- 172.21.15.46:0/1664234613 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc0ab600 con 0x7f8fec151390 2024-01-23T08:54:36.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.128+0000 7f8fe959a640 1 -- 172.21.15.46:0/1664234613 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fdc0a7050 con 0x7f8fec151390 2024-01-23T08:54:36.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.128+0000 7f8fe959a640 1 -- 172.21.15.46:0/1664234613 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc0ab980 con 0x7f8fec151390 2024-01-23T08:54:36.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.128+0000 7f8ff0be8640 1 -- 172.21.15.46:0/1664234613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fec151390 msgr2=0x7f8fec157e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:36.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.128+0000 7f8ff0be8640 1 --2- 172.21.15.46:0/1664234613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fec151390 0x7f8fec157e60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc009870 tx=0x7f8fdc01c4b0 comp rx=0 tx=0).stop 2024-01-23T08:54:36.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.128+0000 7f8ff0be8640 1 -- 172.21.15.46:0/1664234613 shutdown_connections 2024-01-23T08:54:36.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.128+0000 7f8ff0be8640 1 --2- 172.21.15.46:0/1664234613 >> v2:172.21.15.46:3300/0 conn(0x7f8fec15ad40 0x7f8fec15b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:36.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.128+0000 7f8ff0be8640 1 --2- 172.21.15.46:0/1664234613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fec151390 0x7f8fec157e60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:36.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.128+0000 7f8ff0be8640 1 -- 172.21.15.46:0/1664234613 >> 172.21.15.46:0/1664234613 conn(0x7f8fec0cb3e0 msgr2=0x7f8fec0cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:36.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.128+0000 7f8ff0be8640 1 -- 172.21.15.46:0/1664234613 shutdown_connections 2024-01-23T08:54:36.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.128+0000 7f8ff0be8640 1 -- 172.21.15.46:0/1664234613 wait complete. 2024-01-23T08:54:36.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.132+0000 7f8ff0be8640 1 Processor -- start 2024-01-23T08:54:36.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.132+0000 7f8ff0be8640 1 -- start start 2024-01-23T08:54:36.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.132+0000 7f8ff0be8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fec06bb90 0x7f8fec159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:36.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.132+0000 7f8ff0be8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fec151390 0x7f8fec0c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:36.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.132+0000 7f8ff0be8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fec15ad40 0x7f8fec140c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:36.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.132+0000 7f8ff0be8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec15a6f0 con 0x7f8fec151390 2024-01-23T08:54:36.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.132+0000 7f8ff0be8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec1424a0 con 0x7f8fec06bb90 2024-01-23T08:54:36.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.132+0000 7f8ff0be8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec15a430 con 0x7f8fec15ad40 2024-01-23T08:54:36.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.132+0000 7f8fe9d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fec151390 0x7f8fec0c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:36.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.132+0000 7f8fe9d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fec151390 0x7f8fec0c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49262/0 (socket says 172.21.15.46:49262) 2024-01-23T08:54:36.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.132+0000 7f8fe9d9b640 1 -- 172.21.15.46:0/3644656573 learned_addr learned my addr 172.21.15.46:0/3644656573 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:36.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.132+0000 7f8fea59c640 1 --2- 172.21.15.46:0/3644656573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fec06bb90 0x7f8fec159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:36.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.136+0000 7f8fead9d640 1 --2- 172.21.15.46:0/3644656573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fec15ad40 0x7f8fec140c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:36.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.136+0000 7f8fe9d9b640 1 -- 172.21.15.46:0/3644656573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fec15ad40 msgr2=0x7f8fec140c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:36.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.136+0000 7f8fe9d9b640 1 --2- 172.21.15.46:0/3644656573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fec15ad40 0x7f8fec140c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:36.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.136+0000 7f8fe9d9b640 1 -- 172.21.15.46:0/3644656573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fec06bb90 msgr2=0x7f8fec159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:36.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.136+0000 7f8fe9d9b640 1 --2- 172.21.15.46:0/3644656573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fec06bb90 0x7f8fec159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:36.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.136+0000 7f8fe9d9b640 1 -- 172.21.15.46:0/3644656573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fdc0094d0 con 0x7f8fec151390 2024-01-23T08:54:36.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.140+0000 7f8fe9d9b640 1 --2- 172.21.15.46:0/3644656573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fec151390 0x7f8fec0c8120 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8fe000c450 tx=0x7f8fe000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:36.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.148+0000 7f8fdaffd640 1 -- 172.21.15.46:0/3644656573 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe00052d0 con 0x7f8fec151390 2024-01-23T08:54:36.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.148+0000 7f8fdaffd640 1 -- 172.21.15.46:0/3644656573 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe0005430 con 0x7f8fec151390 2024-01-23T08:54:36.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.148+0000 7f8fdaffd640 1 -- 172.21.15.46:0/3644656573 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe0007260 con 0x7f8fec151390 2024-01-23T08:54:36.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.148+0000 7f8ff0be8640 1 -- 172.21.15.46:0/3644656573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fec141b00 con 0x7f8fec151390 2024-01-23T08:54:36.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.148+0000 7f8ff0be8640 1 -- 172.21.15.46:0/3644656573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fec1420c0 con 0x7f8fec151390 2024-01-23T08:54:36.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.148+0000 7f8ff0be8640 1 -- 172.21.15.46:0/3644656573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fec1425e0 con 0x7f8fec151390 2024-01-23T08:54:36.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.172+0000 7f8fdaffd640 1 -- 172.21.15.46:0/3644656573 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f8fe00073c0 con 0x7f8fec151390 2024-01-23T08:54:36.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.172+0000 7f8fdaffd640 1 --2- 172.21.15.46:0/3644656573 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8fcc066580 0x7f8fcc068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:36.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.172+0000 7f8fea59c640 1 --2- 172.21.15.46:0/3644656573 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8fcc066580 0x7f8fcc068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:36.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.176+0000 7f8fea59c640 1 --2- 172.21.15.46:0/3644656573 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8fcc066580 0x7f8fcc068a40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0ad000 tx=0x7f8fdc0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:36.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.176+0000 7f8fdaffd640 1 -- 172.21.15.46:0/3644656573 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8fe00552b0 con 0x7f8fec151390 2024-01-23T08:54:36.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.484+0000 7f8fdaffd640 1 -- 172.21.15.46:0/3644656573 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f8fe00515f0 con 0x7f8fec151390 2024-01-23T08:54:36.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.664+0000 7f8ff0be8640 1 -- 172.21.15.46:0/3644656573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8fec1425e0 con 0x7f8fec151390 2024-01-23T08:54:36.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.784+0000 7f8fdaffd640 1 -- 172.21.15.46:0/3644656573 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8fec1425e0 con 0x7f8fec151390 2024-01-23T08:54:36.783 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-01-23T08:54:36.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.788+0000 7f8ff0be8640 1 -- 172.21.15.46:0/3644656573 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8fcc066580 msgr2=0x7f8fcc068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:36.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.788+0000 7f8ff0be8640 1 --2- 172.21.15.46:0/3644656573 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8fcc066580 0x7f8fcc068a40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0ad000 tx=0x7f8fdc0a6000 comp rx=0 tx=0).stop 2024-01-23T08:54:36.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.788+0000 7f8ff0be8640 1 -- 172.21.15.46:0/3644656573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fec151390 msgr2=0x7f8fec0c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:36.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.788+0000 7f8ff0be8640 1 --2- 172.21.15.46:0/3644656573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fec151390 0x7f8fec0c8120 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8fe000c450 tx=0x7f8fe000c910 comp rx=0 tx=0).stop 2024-01-23T08:54:36.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.788+0000 7f8ff0be8640 1 -- 172.21.15.46:0/3644656573 shutdown_connections 2024-01-23T08:54:36.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.788+0000 7f8ff0be8640 1 --2- 172.21.15.46:0/3644656573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fec15ad40 0x7f8fec140c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:36.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.788+0000 7f8ff0be8640 1 --2- 172.21.15.46:0/3644656573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fec151390 0x7f8fec0c8120 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:36.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.788+0000 7f8ff0be8640 1 --2- 172.21.15.46:0/3644656573 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8fcc066580 0x7f8fcc068a40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:36.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.788+0000 7f8ff0be8640 1 --2- 172.21.15.46:0/3644656573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fec06bb90 0x7f8fec159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:36.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.788+0000 7f8ff0be8640 1 -- 172.21.15.46:0/3644656573 >> 172.21.15.46:0/3644656573 conn(0x7f8fec0cb3e0 msgr2=0x7f8fec147640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:36.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.788+0000 7f8ff0be8640 1 -- 172.21.15.46:0/3644656573 shutdown_connections 2024-01-23T08:54:36.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.788+0000 7f8ff0be8640 1 -- 172.21.15.46:0/3644656573 wait complete. 2024-01-23T08:54:36.809 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-23T08:54:36.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.940+0000 7f54364d1640 1 Processor -- start 2024-01-23T08:54:36.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.940+0000 7f54364d1640 1 -- start start 2024-01-23T08:54:36.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.940+0000 7f54364d1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f543006a660 0x7f5430157df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:36.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.940+0000 7f54364d1640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5430071db0 0x7f5430072200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:36.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.940+0000 7f54364d1640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54300c8660 con 0x7f5430151630 2024-01-23T08:54:36.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.940+0000 7f54364d1640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54300c78f0 con 0x7f5430071db0 2024-01-23T08:54:36.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.940+0000 7f54364d1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5430158330 con 0x7f543006a660 2024-01-23T08:54:36.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.940+0000 7f5434a6e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5430071db0 0x7f5430072200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:36.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.940+0000 7f542ffff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5430151630 0x7f54300c4b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33050/0 (socket says 172.21.15.46:33050) 2024-01-23T08:54:36.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.940+0000 7f542ffff640 1 -- 172.21.15.46:0/3688248308 learned_addr learned my addr 172.21.15.46:0/3688248308 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:54:36.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.940+0000 7f542f7fe640 1 --2- 172.21.15.46:0/3688248308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f543006a660 0x7f5430157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:36.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.944+0000 7f5434a6e640 1 -- 172.21.15.46:0/3688248308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f543006a660 msgr2=0x7f5430157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:36.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.944+0000 7f5434a6e640 1 --2- 172.21.15.46:0/3688248308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f543006a660 0x7f5430157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:36.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.944+0000 7f5434a6e640 1 -- 172.21.15.46:0/3688248308 >> v1:172.21.15.46:6789/0 conn(0x7f5430151630 legacy=0x7f54300c4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:36.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.944+0000 7f5434a6e640 1 -- 172.21.15.46:0/3688248308 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543006be90 con 0x7f5430071db0 2024-01-23T08:54:36.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.952+0000 7f5434a6e640 1 --2- 172.21.15.46:0/3688248308 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5430071db0 0x7f5430072200 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5428009d90 tx=0x7f542801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a38e50911b122a server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:36.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.964+0000 7f542effd640 1 -- 172.21.15.46:0/3688248308 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54280a5780 con 0x7f5430071db0 2024-01-23T08:54:36.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.964+0000 7f542effd640 1 -- 172.21.15.46:0/3688248308 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54280a58e0 con 0x7f5430071db0 2024-01-23T08:54:36.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.964+0000 7f542effd640 1 -- 172.21.15.46:0/3688248308 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54280a5c70 con 0x7f5430071db0 2024-01-23T08:54:36.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.964+0000 7f54364d1640 1 -- 172.21.15.46:0/3688248308 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5430071db0 msgr2=0x7f5430072200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:36.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.964+0000 7f54364d1640 1 --2- 172.21.15.46:0/3688248308 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5430071db0 0x7f5430072200 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5428009d90 tx=0x7f542801c8c0 comp rx=0 tx=0).stop 2024-01-23T08:54:36.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.964+0000 7f54364d1640 1 -- 172.21.15.46:0/3688248308 shutdown_connections 2024-01-23T08:54:36.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.964+0000 7f54364d1640 1 --2- 172.21.15.46:0/3688248308 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5430071db0 0x7f5430072200 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:36.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.964+0000 7f54364d1640 1 --2- 172.21.15.46:0/3688248308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f543006a660 0x7f5430157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:36.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.964+0000 7f54364d1640 1 -- 172.21.15.46:0/3688248308 >> 172.21.15.46:0/3688248308 conn(0x7f54300cba50 msgr2=0x7f54300c7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:36.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.964+0000 7f54364d1640 1 -- 172.21.15.46:0/3688248308 shutdown_connections 2024-01-23T08:54:36.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.964+0000 7f54364d1640 1 -- 172.21.15.46:0/3688248308 wait complete. 2024-01-23T08:54:36.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.968+0000 7f54364d1640 1 Processor -- start 2024-01-23T08:54:36.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.968+0000 7f54364d1640 1 -- start start 2024-01-23T08:54:36.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.968+0000 7f54364d1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f543006a660 0x7f54300ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:36.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.968+0000 7f54364d1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5430071db0 0x7f54301445f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:36.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.968+0000 7f54364d1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5430151630 0x7f5430143550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:36.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.968+0000 7f54364d1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543013f7e0 con 0x7f543006a660 2024-01-23T08:54:36.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.968+0000 7f54364d1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54300cace0 con 0x7f5430151630 2024-01-23T08:54:36.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.968+0000 7f54364d1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54301565d0 con 0x7f5430071db0 2024-01-23T08:54:36.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.968+0000 7f542ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f543006a660 0x7f54300ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:36.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.968+0000 7f542ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f543006a660 0x7f54300ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49276/0 (socket says 172.21.15.46:49276) 2024-01-23T08:54:36.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.968+0000 7f542ffff640 1 -- 172.21.15.46:0/3610198184 learned_addr learned my addr 172.21.15.46:0/3610198184 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:36.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.968+0000 7f5434a6e640 1 --2- 172.21.15.46:0/3610198184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5430151630 0x7f5430143550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:36.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.968+0000 7f542f7fe640 1 --2- 172.21.15.46:0/3610198184 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5430071db0 0x7f54301445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:36.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.972+0000 7f542ffff640 1 -- 172.21.15.46:0/3610198184 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5430071db0 msgr2=0x7f54301445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:36.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.972+0000 7f542ffff640 1 --2- 172.21.15.46:0/3610198184 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5430071db0 0x7f54301445f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:36.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.972+0000 7f542ffff640 1 -- 172.21.15.46:0/3610198184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5430151630 msgr2=0x7f5430143550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:36.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.972+0000 7f542ffff640 1 --2- 172.21.15.46:0/3610198184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5430151630 0x7f5430143550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:36.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.972+0000 7f542ffff640 1 -- 172.21.15.46:0/3610198184 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5428009a70 con 0x7f543006a660 2024-01-23T08:54:36.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.976+0000 7f542ffff640 1 --2- 172.21.15.46:0/3610198184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f543006a660 0x7f54300ca590 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f542000c3a0 tx=0x7f542000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:36.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.980+0000 7f542cff9640 1 -- 172.21.15.46:0/3610198184 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5420005cf0 con 0x7f543006a660 2024-01-23T08:54:36.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.980+0000 7f542cff9640 1 -- 172.21.15.46:0/3610198184 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5420005e50 con 0x7f543006a660 2024-01-23T08:54:36.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.980+0000 7f542cff9640 1 -- 172.21.15.46:0/3610198184 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54200072f0 con 0x7f543006a660 2024-01-23T08:54:36.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.980+0000 7f54364d1640 1 -- 172.21.15.46:0/3610198184 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54300c9250 con 0x7f543006a660 2024-01-23T08:54:36.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.980+0000 7f54364d1640 1 -- 172.21.15.46:0/3610198184 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54300c9dd0 con 0x7f543006a660 2024-01-23T08:54:36.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:36.980+0000 7f54364d1640 1 -- 172.21.15.46:0/3610198184 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5430074340 con 0x7f543006a660 2024-01-23T08:54:36.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.000+0000 7f542cff9640 1 -- 172.21.15.46:0/3610198184 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5420007450 con 0x7f543006a660 2024-01-23T08:54:36.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.004+0000 7f542cff9640 1 --2- 172.21.15.46:0/3610198184 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f541c066580 0x7f541c068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:36.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.004+0000 7f542f7fe640 1 --2- 172.21.15.46:0/3610198184 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f541c066580 0x7f541c068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:36.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.004+0000 7f542f7fe640 1 --2- 172.21.15.46:0/3610198184 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f541c066580 0x7f541c068a40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f54301f14f0 tx=0x7f5424009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:37.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.324+0000 7f542cff9640 1 -- 172.21.15.46:0/3610198184 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5420054830 con 0x7f543006a660 2024-01-23T08:54:37.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.324+0000 7f542cff9640 1 -- 172.21.15.46:0/3610198184 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5420050b70 con 0x7f543006a660 2024-01-23T08:54:37.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.500+0000 7f54364d1640 1 -- 172.21.15.46:0/3610198184 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f54300c8db0 con 0x7f543006a660 2024-01-23T08:54:37.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.508+0000 7f542cff9640 1 -- 172.21.15.46:0/3610198184 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5420017070 con 0x7f543006a660 2024-01-23T08:54:37.506 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:54:37.506 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2024-01-23T08:54:37.506 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-01-23T08:54:37.506 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2024-01-23T08:54:37.506 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2024-01-23T08:54:37.506 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-01-23T08:54:37.506 INFO:teuthology.orchestra.run.smithi046.stdout:] 2024-01-23T08:54:37.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.512+0000 7f54364d1640 1 -- 172.21.15.46:0/3610198184 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f541c066580 msgr2=0x7f541c068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:37.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.512+0000 7f54364d1640 1 --2- 172.21.15.46:0/3610198184 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f541c066580 0x7f541c068a40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f54301f14f0 tx=0x7f5424009190 comp rx=0 tx=0).stop 2024-01-23T08:54:37.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.512+0000 7f54364d1640 1 -- 172.21.15.46:0/3610198184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f543006a660 msgr2=0x7f54300ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:37.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.512+0000 7f54364d1640 1 --2- 172.21.15.46:0/3610198184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f543006a660 0x7f54300ca590 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f542000c3a0 tx=0x7f542000c860 comp rx=0 tx=0).stop 2024-01-23T08:54:37.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.512+0000 7f54364d1640 1 -- 172.21.15.46:0/3610198184 shutdown_connections 2024-01-23T08:54:37.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.512+0000 7f54364d1640 1 --2- 172.21.15.46:0/3610198184 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f541c066580 0x7f541c068a40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:37.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.512+0000 7f54364d1640 1 --2- 172.21.15.46:0/3610198184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5430151630 0x7f5430143550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:37.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.512+0000 7f54364d1640 1 --2- 172.21.15.46:0/3610198184 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5430071db0 0x7f54301445f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:37.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.512+0000 7f54364d1640 1 --2- 172.21.15.46:0/3610198184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f543006a660 0x7f54300ca590 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:37.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.512+0000 7f54364d1640 1 -- 172.21.15.46:0/3610198184 >> 172.21.15.46:0/3610198184 conn(0x7f54300cba50 msgr2=0x7f54300c4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:37.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.512+0000 7f54364d1640 1 -- 172.21.15.46:0/3610198184 shutdown_connections 2024-01-23T08:54:37.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.512+0000 7f54364d1640 1 -- 172.21.15.46:0/3610198184 wait complete. 2024-01-23T08:54:37.526 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-23T08:54:37.526 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-23T08:54:37.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.660+0000 7f6d65ea9640 1 Processor -- start 2024-01-23T08:54:37.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.660+0000 7f6d65ea9640 1 -- start start 2024-01-23T08:54:37.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.660+0000 7f6d65ea9640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6d60151840 0x7f6d6006e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:37.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.660+0000 7f6d65ea9640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d600c7070 con 0x7f6d6006f860 2024-01-23T08:54:37.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.660+0000 7f6d65ea9640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d600c7880 con 0x7f6d600cc9f0 2024-01-23T08:54:37.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.660+0000 7f6d65ea9640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d60151c20 con 0x7f6d60151840 2024-01-23T08:54:37.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.664+0000 7f6d5effd640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f6d600cc9f0 0x7f6d6015b370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.46:53844/0 (socket says 172.21.15.46:53844) 2024-01-23T08:54:37.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.664+0000 7f6d5effd640 1 -- 172.21.15.46:0/1958506043 learned_addr learned my addr 172.21.15.46:0/1958506043 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:54:37.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.700+0000 7f6d5f7fe640 1 --2- 172.21.15.46:0/1958506043 >> v2:172.21.15.46:3300/0 conn(0x7f6d60151840 0x7f6d6006e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:37.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.704+0000 7f6d5f7fe640 1 -- 172.21.15.46:0/1958506043 >> v1:172.21.15.175:6789/0 conn(0x7f6d600cc9f0 legacy=0x7f6d6015b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:37.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.704+0000 7f6d5f7fe640 1 -- 172.21.15.46:0/1958506043 >> v1:172.21.15.46:6789/0 conn(0x7f6d6006f860 legacy=0x7f6d60161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:37.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.704+0000 7f6d5f7fe640 1 -- 172.21.15.46:0/1958506043 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d600c72c0 con 0x7f6d60151840 2024-01-23T08:54:37.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.724+0000 7f6d5f7fe640 1 --2- 172.21.15.46:0/1958506043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d60151840 0x7f6d6006e740 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6d50009d90 tx=0x7f6d5001f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac93d3938807c40 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:37.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.728+0000 7f6d5e7fc640 1 -- 172.21.15.46:0/1958506043 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d500af600 con 0x7f6d60151840 2024-01-23T08:54:37.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.728+0000 7f6d5e7fc640 1 -- 172.21.15.46:0/1958506043 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d500ab050 con 0x7f6d60151840 2024-01-23T08:54:37.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.728+0000 7f6d5e7fc640 1 -- 172.21.15.46:0/1958506043 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d500af980 con 0x7f6d60151840 2024-01-23T08:54:37.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.732+0000 7f6d65ea9640 1 -- 172.21.15.46:0/1958506043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d60151840 msgr2=0x7f6d6006e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:37.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.732+0000 7f6d65ea9640 1 --2- 172.21.15.46:0/1958506043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d60151840 0x7f6d6006e740 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6d50009d90 tx=0x7f6d5001f130 comp rx=0 tx=0).stop 2024-01-23T08:54:37.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.732+0000 7f6d65ea9640 1 -- 172.21.15.46:0/1958506043 shutdown_connections 2024-01-23T08:54:37.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.732+0000 7f6d65ea9640 1 --2- 172.21.15.46:0/1958506043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d60151840 0x7f6d6006e740 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:37.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.732+0000 7f6d65ea9640 1 -- 172.21.15.46:0/1958506043 >> 172.21.15.46:0/1958506043 conn(0x7f6d60072690 msgr2=0x7f6d600cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:37.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.732+0000 7f6d65ea9640 1 -- 172.21.15.46:0/1958506043 shutdown_connections 2024-01-23T08:54:37.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.732+0000 7f6d65ea9640 1 -- 172.21.15.46:0/1958506043 wait complete. 2024-01-23T08:54:37.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.732+0000 7f6d65ea9640 1 Processor -- start 2024-01-23T08:54:37.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.732+0000 7f6d65ea9640 1 -- start start 2024-01-23T08:54:37.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.736+0000 7f6d65ea9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d6006f860 0x7f6d601ecde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:37.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.736+0000 7f6d65ea9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d600cc9f0 0x7f6d6014d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:37.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.736+0000 7f6d65ea9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d60151840 0x7f6d600c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:37.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.736+0000 7f6d65ea9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d601f08a0 con 0x7f6d6006f860 2024-01-23T08:54:37.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.736+0000 7f6d65ea9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d601f0b80 con 0x7f6d60151840 2024-01-23T08:54:37.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.736+0000 7f6d65ea9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d601f0e60 con 0x7f6d600cc9f0 2024-01-23T08:54:37.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.736+0000 7f6d5f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d6006f860 0x7f6d601ecde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:37.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.736+0000 7f6d5f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d6006f860 0x7f6d601ecde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49284/0 (socket says 172.21.15.46:49284) 2024-01-23T08:54:37.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.736+0000 7f6d5f7fe640 1 -- 172.21.15.46:0/969335171 learned_addr learned my addr 172.21.15.46:0/969335171 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:37.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.740+0000 7f6d5f7fe640 1 -- 172.21.15.46:0/969335171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d600cc9f0 msgr2=0x7f6d6014d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:37.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.740+0000 7f6d5f7fe640 1 --2- 172.21.15.46:0/969335171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d600cc9f0 0x7f6d6014d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:37.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.740+0000 7f6d5f7fe640 1 -- 172.21.15.46:0/969335171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d60151840 msgr2=0x7f6d600c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:37.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.740+0000 7f6d5f7fe640 1 --2- 172.21.15.46:0/969335171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d60151840 0x7f6d600c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:37.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.740+0000 7f6d5f7fe640 1 -- 172.21.15.46:0/969335171 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d50009a70 con 0x7f6d6006f860 2024-01-23T08:54:37.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.744+0000 7f6d5f7fe640 1 --2- 172.21.15.46:0/969335171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d6006f860 0x7f6d601ecde0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6d5001bd40 tx=0x7f6d5001bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:37.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.748+0000 7f6d57fff640 1 -- 172.21.15.46:0/969335171 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d500b9610 con 0x7f6d6006f860 2024-01-23T08:54:37.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.748+0000 7f6d57fff640 1 -- 172.21.15.46:0/969335171 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d500b9770 con 0x7f6d6006f860 2024-01-23T08:54:37.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.748+0000 7f6d57fff640 1 -- 172.21.15.46:0/969335171 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d500b9b20 con 0x7f6d6006f860 2024-01-23T08:54:37.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.748+0000 7f6d65ea9640 1 -- 172.21.15.46:0/969335171 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d601f1140 con 0x7f6d6006f860 2024-01-23T08:54:37.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.748+0000 7f6d65ea9640 1 -- 172.21.15.46:0/969335171 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d6006b5f0 con 0x7f6d6006f860 2024-01-23T08:54:37.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.752+0000 7f6d65ea9640 1 -- 172.21.15.46:0/969335171 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d601f1330 con 0x7f6d6006f860 2024-01-23T08:54:37.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.772+0000 7f6d57fff640 1 -- 172.21.15.46:0/969335171 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6d500b6050 con 0x7f6d6006f860 2024-01-23T08:54:37.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.772+0000 7f6d57fff640 1 --2- 172.21.15.46:0/969335171 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6d40066580 0x7f6d40068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:37.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.772+0000 7f6d5effd640 1 --2- 172.21.15.46:0/969335171 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6d40066580 0x7f6d40068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:37.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.772+0000 7f6d5effd640 1 --2- 172.21.15.46:0/969335171 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6d40066580 0x7f6d40068a40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6d60155290 tx=0x7f6d48007a50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:37.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:37.776+0000 7f6d57fff640 1 -- 172.21.15.46:0/969335171 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6d500afe30 con 0x7f6d6006f860 2024-01-23T08:54:38.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:38.068+0000 7f6d57fff640 1 -- 172.21.15.46:0/969335171 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6d500f01e0 con 0x7f6d6006f860 2024-01-23T08:54:38.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:38.256+0000 7f6d65ea9640 1 -- 172.21.15.46:0/969335171 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6d601f0fa0 con 0x7f6d6006f860 2024-01-23T08:54:39.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.500+0000 7f6d57fff640 1 -- 172.21.15.46:0/969335171 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6d601f0fa0 con 0x7f6d6006f860 2024-01-23T08:54:39.496 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2024-01-23T08:54:39.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.504+0000 7f6d65ea9640 1 -- 172.21.15.46:0/969335171 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6d40066580 msgr2=0x7f6d40068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:39.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.504+0000 7f6d65ea9640 1 --2- 172.21.15.46:0/969335171 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6d40066580 0x7f6d40068a40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6d60155290 tx=0x7f6d48007a50 comp rx=0 tx=0).stop 2024-01-23T08:54:39.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.504+0000 7f6d65ea9640 1 -- 172.21.15.46:0/969335171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d6006f860 msgr2=0x7f6d601ecde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:39.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.504+0000 7f6d65ea9640 1 --2- 172.21.15.46:0/969335171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d6006f860 0x7f6d601ecde0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6d5001bd40 tx=0x7f6d5001bed0 comp rx=0 tx=0).stop 2024-01-23T08:54:39.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.504+0000 7f6d65ea9640 1 -- 172.21.15.46:0/969335171 shutdown_connections 2024-01-23T08:54:39.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.504+0000 7f6d65ea9640 1 --2- 172.21.15.46:0/969335171 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6d40066580 0x7f6d40068a40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:39.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.504+0000 7f6d65ea9640 1 --2- 172.21.15.46:0/969335171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d60151840 0x7f6d600c4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:39.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.504+0000 7f6d65ea9640 1 --2- 172.21.15.46:0/969335171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d600cc9f0 0x7f6d6014d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:39.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.504+0000 7f6d65ea9640 1 --2- 172.21.15.46:0/969335171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d6006f860 0x7f6d601ecde0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:39.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.504+0000 7f6d65ea9640 1 -- 172.21.15.46:0/969335171 >> 172.21.15.46:0/969335171 conn(0x7f6d60072690 msgr2=0x7f6d60150460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:39.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.504+0000 7f6d65ea9640 1 -- 172.21.15.46:0/969335171 shutdown_connections 2024-01-23T08:54:39.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.504+0000 7f6d65ea9640 1 -- 172.21.15.46:0/969335171 wait complete. 2024-01-23T08:54:39.526 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-01-23T08:54:39.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.672+0000 7fa4784af640 1 Processor -- start 2024-01-23T08:54:39.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.672+0000 7fa4784af640 1 -- start start 2024-01-23T08:54:39.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.672+0000 7fa4784af640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa4700c2e00 0x7fa4700c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:39.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.672+0000 7fa4784af640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa47006e460 0x7fa47015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:39.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.672+0000 7fa4784af640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa470156a20 con 0x7fa470150500 2024-01-23T08:54:39.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.672+0000 7fa4784af640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa470156d00 con 0x7fa47006e460 2024-01-23T08:54:39.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.672+0000 7fa4784af640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa470156fe0 con 0x7fa4700c2e00 2024-01-23T08:54:39.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.672+0000 7fa475a4a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa4700c2e00 0x7fa4700c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:39.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.672+0000 7fa47624b640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fa470150500 0x7fa470156250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.46:53858/0 (socket says 172.21.15.46:53858) 2024-01-23T08:54:39.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.672+0000 7fa47624b640 1 -- 172.21.15.46:0/3710063226 learned_addr learned my addr 172.21.15.46:0/3710063226 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:54:39.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.672+0000 7fa476a4c640 1 --2- 172.21.15.46:0/3710063226 >> v2:172.21.15.46:3300/0 conn(0x7fa47006e460 0x7fa47015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:39.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.680+0000 7fa476a4c640 1 -- 172.21.15.46:0/3710063226 >> v2:172.21.15.175:3300/0 conn(0x7fa4700c2e00 msgr2=0x7fa4700c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:39.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.680+0000 7fa476a4c640 1 --2- 172.21.15.46:0/3710063226 >> v2:172.21.15.175:3300/0 conn(0x7fa4700c2e00 0x7fa4700c5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:39.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.680+0000 7fa476a4c640 1 -- 172.21.15.46:0/3710063226 >> v1:172.21.15.175:6789/0 conn(0x7fa470150500 legacy=0x7fa470156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:39.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.680+0000 7fa476a4c640 1 -- 172.21.15.46:0/3710063226 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4701599e0 con 0x7fa47006e460 2024-01-23T08:54:39.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.684+0000 7fa476a4c640 1 --2- 172.21.15.46:0/3710063226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa47006e460 0x7fa47015a1e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa4700c3240 tx=0x7fa46801f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c262266a6c7be4 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:39.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.688+0000 7fa475249640 1 -- 172.21.15.46:0/3710063226 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4680b0440 con 0x7fa47006e460 2024-01-23T08:54:39.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.688+0000 7fa475249640 1 -- 172.21.15.46:0/3710063226 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4680b05a0 con 0x7fa47006e460 2024-01-23T08:54:39.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.688+0000 7fa475249640 1 -- 172.21.15.46:0/3710063226 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4680b0930 con 0x7fa47006e460 2024-01-23T08:54:39.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.688+0000 7fa4784af640 1 -- 172.21.15.46:0/3710063226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa47006e460 msgr2=0x7fa47015a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:39.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.688+0000 7fa4784af640 1 --2- 172.21.15.46:0/3710063226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa47006e460 0x7fa47015a1e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa4700c3240 tx=0x7fa46801f0f0 comp rx=0 tx=0).stop 2024-01-23T08:54:39.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.688+0000 7fa4784af640 1 -- 172.21.15.46:0/3710063226 shutdown_connections 2024-01-23T08:54:39.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.688+0000 7fa4784af640 1 --2- 172.21.15.46:0/3710063226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa47006e460 0x7fa47015a1e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:39.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.688+0000 7fa4784af640 1 --2- 172.21.15.46:0/3710063226 >> v2:172.21.15.175:3300/0 conn(0x7fa4700c2e00 0x7fa4700c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:39.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.688+0000 7fa4784af640 1 -- 172.21.15.46:0/3710063226 >> 172.21.15.46:0/3710063226 conn(0x7fa47006b770 msgr2=0x7fa47006bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:39.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.688+0000 7fa4784af640 1 -- 172.21.15.46:0/3710063226 shutdown_connections 2024-01-23T08:54:39.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.688+0000 7fa4784af640 1 -- 172.21.15.46:0/3710063226 wait complete. 2024-01-23T08:54:39.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.692+0000 7fa4784af640 1 Processor -- start 2024-01-23T08:54:39.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.692+0000 7fa4784af640 1 -- start start 2024-01-23T08:54:39.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.692+0000 7fa4784af640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa47006e460 0x7fa4701ef2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:39.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.692+0000 7fa4784af640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4700c2e00 0x7fa4700c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:39.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.692+0000 7fa4784af640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa470150500 0x7fa4700c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:39.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.692+0000 7fa4784af640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa470156150 con 0x7fa470150500 2024-01-23T08:54:39.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.692+0000 7fa4784af640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa470155c40 con 0x7fa4700c2e00 2024-01-23T08:54:39.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.692+0000 7fa4784af640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4700caed0 con 0x7fa47006e460 2024-01-23T08:54:39.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.692+0000 7fa476a4c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa470150500 0x7fa4700c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:39.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.692+0000 7fa476a4c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa470150500 0x7fa4700c47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49290/0 (socket says 172.21.15.46:49290) 2024-01-23T08:54:39.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.692+0000 7fa476a4c640 1 -- 172.21.15.46:0/479432356 learned_addr learned my addr 172.21.15.46:0/479432356 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:39.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.696+0000 7fa476a4c640 1 -- 172.21.15.46:0/479432356 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa47006e460 msgr2=0x7fa4701ef2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:39.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.696+0000 7fa476a4c640 1 --2- 172.21.15.46:0/479432356 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa47006e460 0x7fa4701ef2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:39.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.696+0000 7fa476a4c640 1 -- 172.21.15.46:0/479432356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4700c2e00 msgr2=0x7fa4700c4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:39.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.696+0000 7fa476a4c640 1 --2- 172.21.15.46:0/479432356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4700c2e00 0x7fa4700c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:39.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.696+0000 7fa476a4c640 1 -- 172.21.15.46:0/479432356 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa468009a70 con 0x7fa470150500 2024-01-23T08:54:39.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.696+0000 7fa476a4c640 1 --2- 172.21.15.46:0/479432356 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa470150500 0x7fa4700c47b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa46801bd00 tx=0x7fa46801be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:39.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.700+0000 7fa466ffd640 1 -- 172.21.15.46:0/479432356 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4680b0440 con 0x7fa470150500 2024-01-23T08:54:39.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.700+0000 7fa466ffd640 1 -- 172.21.15.46:0/479432356 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4680ba610 con 0x7fa470150500 2024-01-23T08:54:39.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.700+0000 7fa466ffd640 1 -- 172.21.15.46:0/479432356 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4680ba9c0 con 0x7fa470150500 2024-01-23T08:54:39.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.700+0000 7fa4784af640 1 -- 172.21.15.46:0/479432356 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4700c3d90 con 0x7fa470150500 2024-01-23T08:54:39.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.700+0000 7fa4784af640 1 -- 172.21.15.46:0/479432356 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa470155e70 con 0x7fa470150500 2024-01-23T08:54:39.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.704+0000 7fa4784af640 1 -- 172.21.15.46:0/479432356 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4700c3bf0 con 0x7fa470150500 2024-01-23T08:54:39.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.996+0000 7fa466ffd640 1 -- 172.21.15.46:0/479432356 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa4680b7050 con 0x7fa470150500 2024-01-23T08:54:39.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.996+0000 7fa466ffd640 1 --2- 172.21.15.46:0/479432356 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa454066530 0x7fa4540689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:39.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:39.996+0000 7fa47624b640 1 --2- 172.21.15.46:0/479432356 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa454066530 0x7fa4540689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:39.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.000+0000 7fa47624b640 1 --2- 172.21.15.46:0/479432356 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa454066530 0x7fa4540689f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa46c001560 tx=0x7fa46c007a50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:40.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.020+0000 7fa466ffd640 1 -- 172.21.15.46:0/479432356 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fa4680f3df0 con 0x7fa470150500 2024-01-23T08:54:40.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.020+0000 7fa466ffd640 1 -- 172.21.15.46:0/479432356 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa4680efa30 con 0x7fa470150500 2024-01-23T08:54:40.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.204+0000 7fa4784af640 1 -- 172.21.15.46:0/479432356 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fa4700c3bf0 con 0x7fa470150500 2024-01-23T08:54:40.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.672+0000 7fa466ffd640 1 -- 172.21.15.46:0/479432356 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) v1 ==== 171+0+0 (secure 0 0 0) 0x7fa4700c3bf0 con 0x7fa470150500 2024-01-23T08:54:40.673 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2024-01-23T08:54:40.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.680+0000 7fa4784af640 1 -- 172.21.15.46:0/479432356 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa454066530 msgr2=0x7fa4540689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:40.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.680+0000 7fa4784af640 1 --2- 172.21.15.46:0/479432356 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa454066530 0x7fa4540689f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa46c001560 tx=0x7fa46c007a50 comp rx=0 tx=0).stop 2024-01-23T08:54:40.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.680+0000 7fa4784af640 1 -- 172.21.15.46:0/479432356 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa470150500 msgr2=0x7fa4700c47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:40.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.680+0000 7fa4784af640 1 --2- 172.21.15.46:0/479432356 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa470150500 0x7fa4700c47b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa46801bd00 tx=0x7fa46801be90 comp rx=0 tx=0).stop 2024-01-23T08:54:40.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.680+0000 7fa4784af640 1 -- 172.21.15.46:0/479432356 shutdown_connections 2024-01-23T08:54:40.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.680+0000 7fa4784af640 1 --2- 172.21.15.46:0/479432356 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa470150500 0x7fa4700c47b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:40.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.680+0000 7fa4784af640 1 --2- 172.21.15.46:0/479432356 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa454066530 0x7fa4540689f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:40.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.680+0000 7fa4784af640 1 --2- 172.21.15.46:0/479432356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4700c2e00 0x7fa4700c4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:40.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.680+0000 7fa4784af640 1 --2- 172.21.15.46:0/479432356 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa47006e460 0x7fa4701ef2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:40.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.680+0000 7fa4784af640 1 -- 172.21.15.46:0/479432356 >> 172.21.15.46:0/479432356 conn(0x7fa47006b770 msgr2=0x7fa4700cbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:40.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.680+0000 7fa4784af640 1 -- 172.21.15.46:0/479432356 shutdown_connections 2024-01-23T08:54:40.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.680+0000 7fa4784af640 1 -- 172.21.15.46:0/479432356 wait complete. 2024-01-23T08:54:40.703 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-23T08:54:40.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.832+0000 7fed84c16640 1 Processor -- start 2024-01-23T08:54:40.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.832+0000 7fed84c16640 1 -- start start 2024-01-23T08:54:40.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.832+0000 7fed84c16640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed800c8310 0x7fed80151190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:40.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.832+0000 7fed84c16640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed8015a9d0 con 0x7fed80071970 2024-01-23T08:54:40.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.832+0000 7fed84c16640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed801573e0 con 0x7fed800c7f30 2024-01-23T08:54:40.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.832+0000 7fed84c16640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8006e1a0 con 0x7fed800c8310 2024-01-23T08:54:40.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.832+0000 7fed7ed9d640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fed80071970 0x7fed8015ae60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33068/0 (socket says 172.21.15.46:33068) 2024-01-23T08:54:40.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.832+0000 7fed7ed9d640 1 -- 172.21.15.46:0/2692581582 learned_addr learned my addr 172.21.15.46:0/2692581582 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:54:40.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.856+0000 7fed7dd9b640 1 --2- 172.21.15.46:0/2692581582 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed800c8310 0x7fed80151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:40.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.872+0000 7fed7d59a640 1 -- 172.21.15.46:0/2692581582 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829807521 0 0) 0x7fed8015a9d0 con 0x7fed80071970 2024-01-23T08:54:40.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.872+0000 7fed7d59a640 1 -- 172.21.15.46:0/2692581582 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed68003530 con 0x7fed80071970 2024-01-23T08:54:40.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.872+0000 7fed7dd9b640 1 -- 172.21.15.46:0/2692581582 >> v1:172.21.15.175:6789/0 conn(0x7fed800c7f30 legacy=0x7fed8006da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:40.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.872+0000 7fed7dd9b640 1 -- 172.21.15.46:0/2692581582 >> v1:172.21.15.46:6789/0 conn(0x7fed80071970 legacy=0x7fed8015ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:40.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.872+0000 7fed7dd9b640 1 -- 172.21.15.46:0/2692581582 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed801576a0 con 0x7fed800c8310 2024-01-23T08:54:40.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.896+0000 7fed7dd9b640 1 --2- 172.21.15.46:0/2692581582 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed800c8310 0x7fed80151190 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fed740097f0 tx=0x7fed7401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dceb8761e25fbb6d server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:40.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.904+0000 7fed7d59a640 1 -- 172.21.15.46:0/2692581582 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed740a8970 con 0x7fed800c8310 2024-01-23T08:54:40.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.904+0000 7fed7d59a640 1 -- 172.21.15.46:0/2692581582 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed740a8ad0 con 0x7fed800c8310 2024-01-23T08:54:40.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.904+0000 7fed7d59a640 1 -- 172.21.15.46:0/2692581582 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed740a8e60 con 0x7fed800c8310 2024-01-23T08:54:40.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.904+0000 7fed84c16640 1 -- 172.21.15.46:0/2692581582 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed800c8310 msgr2=0x7fed80151190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:40.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.904+0000 7fed84c16640 1 --2- 172.21.15.46:0/2692581582 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed800c8310 0x7fed80151190 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fed740097f0 tx=0x7fed7401ec70 comp rx=0 tx=0).stop 2024-01-23T08:54:40.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.904+0000 7fed84c16640 1 -- 172.21.15.46:0/2692581582 shutdown_connections 2024-01-23T08:54:40.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.904+0000 7fed84c16640 1 --2- 172.21.15.46:0/2692581582 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed800c8310 0x7fed80151190 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:40.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.904+0000 7fed84c16640 1 -- 172.21.15.46:0/2692581582 >> 172.21.15.46:0/2692581582 conn(0x7fed8006aa60 msgr2=0x7fed8006ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:40.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.904+0000 7fed84c16640 1 -- 172.21.15.46:0/2692581582 shutdown_connections 2024-01-23T08:54:40.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.904+0000 7fed84c16640 1 -- 172.21.15.46:0/2692581582 wait complete. 2024-01-23T08:54:40.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.904+0000 7fed84c16640 1 Processor -- start 2024-01-23T08:54:40.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.904+0000 7fed84c16640 1 -- start start 2024-01-23T08:54:40.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.908+0000 7fed84c16640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed80071970 0x7fed80146e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:40.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.908+0000 7fed84c16640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed800c7f30 0x7fed800c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:40.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.908+0000 7fed84c16640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed800c8310 0x7fed801f2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:40.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.908+0000 7fed84c16640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed800c4540 con 0x7fed800c8310 2024-01-23T08:54:40.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.908+0000 7fed84c16640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed800c6040 con 0x7fed800c7f30 2024-01-23T08:54:40.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.908+0000 7fed84c16640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed80147520 con 0x7fed80071970 2024-01-23T08:54:40.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.908+0000 7fed7dd9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed800c7f30 0x7fed800c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:40.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.908+0000 7fed7dd9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed800c7f30 0x7fed800c9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:57072/0 (socket says 172.21.15.46:57072) 2024-01-23T08:54:40.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.908+0000 7fed7dd9b640 1 -- 172.21.15.46:0/1104418685 learned_addr learned my addr 172.21.15.46:0/1104418685 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:40.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.908+0000 7fed7e59c640 1 --2- 172.21.15.46:0/1104418685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed80071970 0x7fed80146e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:40.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.916+0000 7fed7dd9b640 1 -- 172.21.15.46:0/1104418685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed80071970 msgr2=0x7fed80146e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:40.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.916+0000 7fed7dd9b640 1 --2- 172.21.15.46:0/1104418685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed80071970 0x7fed80146e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:40.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.916+0000 7fed7dd9b640 1 -- 172.21.15.46:0/1104418685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed800c8310 msgr2=0x7fed801f2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:40.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.916+0000 7fed7dd9b640 1 --2- 172.21.15.46:0/1104418685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed800c8310 0x7fed801f2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:40.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.916+0000 7fed7dd9b640 1 -- 172.21.15.46:0/1104418685 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed74009420 con 0x7fed800c7f30 2024-01-23T08:54:40.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.920+0000 7fed7dd9b640 1 --2- 172.21.15.46:0/1104418685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed800c7f30 0x7fed800c9fb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fed740097f0 tx=0x7fed7401ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:40.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.940+0000 7fed6effd640 1 -- 172.21.15.46:0/1104418685 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed740b0d90 con 0x7fed800c7f30 2024-01-23T08:54:40.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.940+0000 7fed6effd640 1 -- 172.21.15.46:0/1104418685 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed740bc450 con 0x7fed800c7f30 2024-01-23T08:54:40.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.940+0000 7fed6effd640 1 -- 172.21.15.46:0/1104418685 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed740bc800 con 0x7fed800c7f30 2024-01-23T08:54:40.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.940+0000 7fed84c16640 1 -- 172.21.15.46:0/1104418685 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed800c12c0 con 0x7fed800c7f30 2024-01-23T08:54:40.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.940+0000 7fed84c16640 1 -- 172.21.15.46:0/1104418685 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed800c1880 con 0x7fed800c7f30 2024-01-23T08:54:40.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:40.940+0000 7fed84c16640 1 -- 172.21.15.46:0/1104418685 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed80071f50 con 0x7fed800c7f30 2024-01-23T08:54:41.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:41.236+0000 7fed6effd640 1 -- 172.21.15.46:0/1104418685 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fed740bc960 con 0x7fed800c7f30 2024-01-23T08:54:41.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:41.236+0000 7fed6effd640 1 --2- 172.21.15.46:0/1104418685 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fed60066550 0x7fed60068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:41.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:41.236+0000 7fed6effd640 1 -- 172.21.15.46:0/1104418685 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fed740f4330 con 0x7fed800c7f30 2024-01-23T08:54:41.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:41.236+0000 7fed7e59c640 1 --2- 172.21.15.46:0/1104418685 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fed60066550 0x7fed60068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:41.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:41.236+0000 7fed7e59c640 1 --2- 172.21.15.46:0/1104418685 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fed60066550 0x7fed60068a10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fed70007fd0 tx=0x7fed70007e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:41.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:41.264+0000 7fed6effd640 1 -- 172.21.15.46:0/1104418685 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fed740eff70 con 0x7fed800c7f30 2024-01-23T08:54:41.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:41.488+0000 7fed84c16640 1 -- 172.21.15.46:0/1104418685 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fed80071f50 con 0x7fed800c7f30 2024-01-23T08:54:43.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.600+0000 7fed6effd640 1 -- 172.21.15.46:0/1104418685 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fed740b5020 con 0x7fed800c7f30 2024-01-23T08:54:43.598 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 2 and data pool 3 2024-01-23T08:54:43.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.604+0000 7fed84c16640 1 -- 172.21.15.46:0/1104418685 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fed60066550 msgr2=0x7fed60068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:43.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.604+0000 7fed84c16640 1 --2- 172.21.15.46:0/1104418685 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fed60066550 0x7fed60068a10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fed70007fd0 tx=0x7fed70007e40 comp rx=0 tx=0).stop 2024-01-23T08:54:43.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.604+0000 7fed84c16640 1 -- 172.21.15.46:0/1104418685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed800c7f30 msgr2=0x7fed800c9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:43.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.604+0000 7fed84c16640 1 --2- 172.21.15.46:0/1104418685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed800c7f30 0x7fed800c9fb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fed740097f0 tx=0x7fed7401ba10 comp rx=0 tx=0).stop 2024-01-23T08:54:43.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.604+0000 7fed84c16640 1 -- 172.21.15.46:0/1104418685 shutdown_connections 2024-01-23T08:54:43.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.604+0000 7fed84c16640 1 --2- 172.21.15.46:0/1104418685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed800c8310 0x7fed801f2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:43.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.604+0000 7fed84c16640 1 --2- 172.21.15.46:0/1104418685 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fed60066550 0x7fed60068a10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:43.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.604+0000 7fed84c16640 1 --2- 172.21.15.46:0/1104418685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed800c7f30 0x7fed800c9fb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:43.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.604+0000 7fed84c16640 1 --2- 172.21.15.46:0/1104418685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed80071970 0x7fed80146e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:43.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.604+0000 7fed84c16640 1 -- 172.21.15.46:0/1104418685 >> 172.21.15.46:0/1104418685 conn(0x7fed8006aa60 msgr2=0x7fed80072330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:43.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.604+0000 7fed84c16640 1 -- 172.21.15.46:0/1104418685 shutdown_connections 2024-01-23T08:54:43.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.604+0000 7fed84c16640 1 -- 172.21.15.46:0/1104418685 wait complete. 2024-01-23T08:54:43.625 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-01-23T08:54:43.625 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-01-23T08:54:43.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.752+0000 7f6da9876640 1 Processor -- start 2024-01-23T08:54:43.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.752+0000 7f6da9876640 1 -- start start 2024-01-23T08:54:43.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.752+0000 7f6da9876640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6da4150610 0x7f6da40c6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:43.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.752+0000 7f6da9876640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6da406f860 0x7f6da4156c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:43.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.752+0000 7f6da9876640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6da406eb70 0x7f6da406b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:43.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.752+0000 7f6da9876640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da41509f0 con 0x7f6da4150610 2024-01-23T08:54:43.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.752+0000 7f6da9876640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da406e420 con 0x7f6da406f860 2024-01-23T08:54:43.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.752+0000 7f6da9876640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da406f0e0 con 0x7f6da406eb70 2024-01-23T08:54:43.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.752+0000 7f6da2ffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6da4150610 0x7f6da40c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:43.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.752+0000 7f6da2ffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6da4150610 0x7f6da40c6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48904/0 (socket says 172.21.15.46:48904) 2024-01-23T08:54:43.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.752+0000 7f6da2ffd640 1 -- 172.21.15.46:0/1396209493 learned_addr learned my addr 172.21.15.46:0/1396209493 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:43.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.752+0000 7f6da27fc640 1 --2- 172.21.15.46:0/1396209493 >> v2:172.21.15.175:3300/0 conn(0x7f6da406f860 0x7f6da4156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:43.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.756+0000 7f6da2ffd640 1 -- 172.21.15.46:0/1396209493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6da406eb70 msgr2=0x7f6da406b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:43.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.756+0000 7f6da2ffd640 1 --2- 172.21.15.46:0/1396209493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6da406eb70 0x7f6da406b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:43.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.756+0000 7f6da2ffd640 1 -- 172.21.15.46:0/1396209493 >> v2:172.21.15.175:3300/0 conn(0x7f6da406f860 msgr2=0x7f6da4156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:43.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.756+0000 7f6da2ffd640 1 --2- 172.21.15.46:0/1396209493 >> v2:172.21.15.175:3300/0 conn(0x7f6da406f860 0x7f6da4156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:43.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.756+0000 7f6da2ffd640 1 -- 172.21.15.46:0/1396209493 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da406de60 con 0x7f6da4150610 2024-01-23T08:54:43.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.760+0000 7f6da2ffd640 1 --2- 172.21.15.46:0/1396209493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6da4150610 0x7f6da40c6870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6da40ccea0 tx=0x7f6d9c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de1a71dabbeb6e9e server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:43.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.764+0000 7f6da1ffb640 1 -- 172.21.15.46:0/1396209493 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c0aa5f0 con 0x7f6da4150610 2024-01-23T08:54:43.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.764+0000 7f6da1ffb640 1 -- 172.21.15.46:0/1396209493 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9c0aa750 con 0x7f6da4150610 2024-01-23T08:54:43.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.764+0000 7f6da1ffb640 1 -- 172.21.15.46:0/1396209493 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c0aaae0 con 0x7f6da4150610 2024-01-23T08:54:43.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.764+0000 7f6da9876640 1 -- 172.21.15.46:0/1396209493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6da4150610 msgr2=0x7f6da40c6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:43.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.764+0000 7f6da9876640 1 --2- 172.21.15.46:0/1396209493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6da4150610 0x7f6da40c6870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6da40ccea0 tx=0x7f6d9c01c4d0 comp rx=0 tx=0).stop 2024-01-23T08:54:43.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.764+0000 7f6da9876640 1 -- 172.21.15.46:0/1396209493 shutdown_connections 2024-01-23T08:54:43.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.764+0000 7f6da9876640 1 --2- 172.21.15.46:0/1396209493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6da406eb70 0x7f6da406b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:43.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.764+0000 7f6da9876640 1 --2- 172.21.15.46:0/1396209493 >> v2:172.21.15.175:3300/0 conn(0x7f6da406f860 0x7f6da4156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:43.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.764+0000 7f6da9876640 1 --2- 172.21.15.46:0/1396209493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6da4150610 0x7f6da40c6870 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:43.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.764+0000 7f6da9876640 1 -- 172.21.15.46:0/1396209493 >> 172.21.15.46:0/1396209493 conn(0x7f6da4072690 msgr2=0x7f6da40cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:43.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.764+0000 7f6da9876640 1 -- 172.21.15.46:0/1396209493 shutdown_connections 2024-01-23T08:54:43.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.764+0000 7f6da9876640 1 -- 172.21.15.46:0/1396209493 wait complete. 2024-01-23T08:54:43.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.768+0000 7f6da9876640 1 Processor -- start 2024-01-23T08:54:43.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.768+0000 7f6da9876640 1 -- start start 2024-01-23T08:54:43.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.768+0000 7f6da9876640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6da406eb70 0x7f6da40c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:43.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.768+0000 7f6da9876640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6da406f860 0x7f6da40c4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:43.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.768+0000 7f6da9876640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6da4150610 0x7f6da40c7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:43.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.768+0000 7f6da9876640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da41f4a00 con 0x7f6da406eb70 2024-01-23T08:54:43.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.768+0000 7f6da9876640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40ca260 con 0x7f6da4150610 2024-01-23T08:54:43.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.768+0000 7f6da9876640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da41f3b10 con 0x7f6da406f860 2024-01-23T08:54:43.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.768+0000 7f6da2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6da406eb70 0x7f6da40c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:43.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.768+0000 7f6da2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6da406eb70 0x7f6da40c9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48918/0 (socket says 172.21.15.46:48918) 2024-01-23T08:54:43.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.768+0000 7f6da2ffd640 1 -- 172.21.15.46:0/410247510 learned_addr learned my addr 172.21.15.46:0/410247510 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:43.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.772+0000 7f6da37fe640 1 --2- 172.21.15.46:0/410247510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6da4150610 0x7f6da40c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:43.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.772+0000 7f6da2ffd640 1 -- 172.21.15.46:0/410247510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6da406f860 msgr2=0x7f6da40c4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:43.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.772+0000 7f6da2ffd640 1 --2- 172.21.15.46:0/410247510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6da406f860 0x7f6da40c4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:43.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.772+0000 7f6da2ffd640 1 -- 172.21.15.46:0/410247510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6da4150610 msgr2=0x7f6da40c7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:43.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.772+0000 7f6da2ffd640 1 --2- 172.21.15.46:0/410247510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6da4150610 0x7f6da40c7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:43.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.772+0000 7f6da2ffd640 1 -- 172.21.15.46:0/410247510 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9c0094d0 con 0x7f6da406eb70 2024-01-23T08:54:43.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.776+0000 7f6da2ffd640 1 --2- 172.21.15.46:0/410247510 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6da406eb70 0x7f6da40c9c70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c01cd70 tx=0x7f6d9c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:43.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.780+0000 7f6d9bfff640 1 -- 172.21.15.46:0/410247510 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c0bd5f0 con 0x7f6da406eb70 2024-01-23T08:54:43.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.784+0000 7f6d9bfff640 1 -- 172.21.15.46:0/410247510 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9c0bd750 con 0x7f6da406eb70 2024-01-23T08:54:43.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.784+0000 7f6da9876640 1 -- 172.21.15.46:0/410247510 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da41f3df0 con 0x7f6da406eb70 2024-01-23T08:54:43.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.784+0000 7f6d9bfff640 1 -- 172.21.15.46:0/410247510 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c0bdae0 con 0x7f6da406eb70 2024-01-23T08:54:43.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.784+0000 7f6da9876640 1 -- 172.21.15.46:0/410247510 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6da41f43b0 con 0x7f6da406eb70 2024-01-23T08:54:43.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.784+0000 7f6da9876640 1 -- 172.21.15.46:0/410247510 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6da4074340 con 0x7f6da406eb70 2024-01-23T08:54:43.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.804+0000 7f6d9bfff640 1 -- 172.21.15.46:0/410247510 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6d9c0b33f0 con 0x7f6da406eb70 2024-01-23T08:54:43.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.804+0000 7f6d9bfff640 1 --2- 172.21.15.46:0/410247510 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6d84066550 0x7f6d84068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:43.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.804+0000 7f6da27fc640 1 --2- 172.21.15.46:0/410247510 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6d84066550 0x7f6d84068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:43.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.804+0000 7f6da27fc640 1 --2- 172.21.15.46:0/410247510 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6d84066550 0x7f6d84068a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c006aa0 tx=0x7f6d8c006a30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:43.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:43.808+0000 7f6d9bfff640 1 -- 172.21.15.46:0/410247510 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d9c0a7070 con 0x7f6da406eb70 2024-01-23T08:54:44.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:44.107+0000 7f6d9bfff640 1 -- 172.21.15.46:0/410247510 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6d9c0ebcf0 con 0x7f6da406eb70 2024-01-23T08:54:44.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:44.319+0000 7f6da9876640 1 -- 172.21.15.46:0/410247510 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f6da414fe10 con 0x7f6da406eb70 2024-01-23T08:54:45.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.391+0000 7f6d9bfff640 1 -- 172.21.15.46:0/410247510 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v24) v1 ==== 157+0+0 (secure 0 0 0) 0x7f6d9c0ef310 con 0x7f6da406eb70 2024-01-23T08:54:45.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.395+0000 7f6da9876640 1 -- 172.21.15.46:0/410247510 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6d84066550 msgr2=0x7f6d84068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:45.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.395+0000 7f6da9876640 1 --2- 172.21.15.46:0/410247510 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6d84066550 0x7f6d84068a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c006aa0 tx=0x7f6d8c006a30 comp rx=0 tx=0).stop 2024-01-23T08:54:45.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.395+0000 7f6da9876640 1 -- 172.21.15.46:0/410247510 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6da406eb70 msgr2=0x7f6da40c9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:45.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.395+0000 7f6da9876640 1 --2- 172.21.15.46:0/410247510 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6da406eb70 0x7f6da40c9c70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c01cd70 tx=0x7f6d9c01ad10 comp rx=0 tx=0).stop 2024-01-23T08:54:45.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.395+0000 7f6da9876640 1 -- 172.21.15.46:0/410247510 shutdown_connections 2024-01-23T08:54:45.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.395+0000 7f6da9876640 1 --2- 172.21.15.46:0/410247510 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6d84066550 0x7f6d84068a10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:45.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.395+0000 7f6da9876640 1 --2- 172.21.15.46:0/410247510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6da4150610 0x7f6da40c7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:45.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.395+0000 7f6da9876640 1 --2- 172.21.15.46:0/410247510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6da406f860 0x7f6da40c4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:45.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.395+0000 7f6da9876640 1 --2- 172.21.15.46:0/410247510 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6da406eb70 0x7f6da40c9c70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:45.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.395+0000 7f6da9876640 1 -- 172.21.15.46:0/410247510 >> 172.21.15.46:0/410247510 conn(0x7f6da4072690 msgr2=0x7f6da4155ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:45.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.395+0000 7f6da9876640 1 -- 172.21.15.46:0/410247510 shutdown_connections 2024-01-23T08:54:45.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.395+0000 7f6da9876640 1 -- 172.21.15.46:0/410247510 wait complete. 2024-01-23T08:54:45.413 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-01-23T08:54:45.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.555+0000 7fb757043640 1 Processor -- start 2024-01-23T08:54:45.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.555+0000 7fb757043640 1 -- start start 2024-01-23T08:54:45.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.555+0000 7fb757043640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7500c8fe0 0x7fb7500c1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:45.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.555+0000 7fb757043640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7500c80a0 con 0x7fb750151830 2024-01-23T08:54:45.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.555+0000 7fb757043640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75006f070 con 0x7fb7500c7b40 2024-01-23T08:54:45.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.555+0000 7fb757043640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75006ee60 con 0x7fb7500c8fe0 2024-01-23T08:54:45.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.563+0000 7fb7555e0640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fb7500c7b40 0x7fb7500c9a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.46:59230/0 (socket says 172.21.15.46:59230) 2024-01-23T08:54:45.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.563+0000 7fb7555e0640 1 -- 172.21.15.46:0/3406011037 learned_addr learned my addr 172.21.15.46:0/3406011037 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:54:45.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.567+0000 7fb74ffff640 1 --2- 172.21.15.46:0/3406011037 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7500c8fe0 0x7fb7500c1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:45.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.627+0000 7fb74f7fe640 1 -- 172.21.15.46:0/3406011037 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2988201582 0 0) 0x7fb7500c80a0 con 0x7fb750151830 2024-01-23T08:54:45.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.627+0000 7fb74f7fe640 1 -- 172.21.15.46:0/3406011037 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb738003530 con 0x7fb750151830 2024-01-23T08:54:45.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.639+0000 7fb74f7fe640 1 -- 172.21.15.46:0/3406011037 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2320969489 0 0) 0x7fb738003530 con 0x7fb750151830 2024-01-23T08:54:45.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.639+0000 7fb74f7fe640 1 -- 172.21.15.46:0/3406011037 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7500c8fe0 msgr2=0x7fb7500c1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:45.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.639+0000 7fb74f7fe640 1 --2- 172.21.15.46:0/3406011037 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7500c8fe0 0x7fb7500c1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:45.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.639+0000 7fb74f7fe640 1 -- 172.21.15.46:0/3406011037 >> v1:172.21.15.175:6789/0 conn(0x7fb7500c7b40 legacy=0x7fb7500c9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:45.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.639+0000 7fb74f7fe640 1 -- 172.21.15.46:0/3406011037 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75006f350 con 0x7fb750151830 2024-01-23T08:54:45.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.639+0000 7fb74f7fe640 1 -- 172.21.15.46:0/3406011037 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466917103 0 0) 0x7fb740001680 con 0x7fb750151830 2024-01-23T08:54:45.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.639+0000 7fb74f7fe640 1 -- 172.21.15.46:0/3406011037 >> v1:172.21.15.46:6789/0 conn(0x7fb750151830 legacy=0x7fb75015b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:45.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.639+0000 7fb74f7fe640 1 --2- 172.21.15.46:0/3406011037 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7500c8fe0 0x7fb738003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:45.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.639+0000 7fb74f7fe640 1 --2- 172.21.15.46:0/3406011037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb738003ff0 0x7fb7380047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:45.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.639+0000 7fb74f7fe640 1 --2- 172.21.15.46:0/3406011037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb738004d10 0x7fb738005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:45.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.639+0000 7fb74f7fe640 1 -- 172.21.15.46:0/3406011037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75006ee60 con 0x7fb738003ff0 2024-01-23T08:54:45.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.639+0000 7fb74f7fe640 1 -- 172.21.15.46:0/3406011037 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73800bb50 con 0x7fb738004d10 2024-01-23T08:54:45.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.639+0000 7fb74f7fe640 1 -- 172.21.15.46:0/3406011037 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb73800bd10 con 0x7fb7500c8fe0 2024-01-23T08:54:45.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.643+0000 7fb74ffff640 1 --2- 172.21.15.46:0/3406011037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb738003ff0 0x7fb7380047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:45.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.651+0000 7fb7555e0640 1 --2- 172.21.15.46:0/3406011037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb738004d10 0x7fb738005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:45.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.651+0000 7fb74ffff640 1 -- 172.21.15.46:0/3406011037 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7500c8fe0 msgr2=0x7fb738003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:45.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.651+0000 7fb74ffff640 1 --2- 172.21.15.46:0/3406011037 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7500c8fe0 0x7fb738003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:45.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.651+0000 7fb74ffff640 1 -- 172.21.15.46:0/3406011037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb738004d10 msgr2=0x7fb738005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:45.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.651+0000 7fb74ffff640 1 --2- 172.21.15.46:0/3406011037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb738004d10 0x7fb738005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:45.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.651+0000 7fb74ffff640 1 -- 172.21.15.46:0/3406011037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb738003530 con 0x7fb738003ff0 2024-01-23T08:54:45.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.663+0000 7fb74ffff640 1 --2- 172.21.15.46:0/3406011037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb738003ff0 0x7fb7380047d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb744009ae0 tx=0x7fb74401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4f72a52ca34903 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:45.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.671+0000 7fb74f7fe640 1 -- 172.21.15.46:0/3406011037 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7440a5680 con 0x7fb738003ff0 2024-01-23T08:54:45.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.671+0000 7fb74f7fe640 1 -- 172.21.15.46:0/3406011037 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7440a57e0 con 0x7fb738003ff0 2024-01-23T08:54:45.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.671+0000 7fb74f7fe640 1 -- 172.21.15.46:0/3406011037 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7440a5bd0 con 0x7fb738003ff0 2024-01-23T08:54:45.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.671+0000 7fb757043640 1 -- 172.21.15.46:0/3406011037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb738003ff0 msgr2=0x7fb7380047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:45.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.671+0000 7fb757043640 1 --2- 172.21.15.46:0/3406011037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb738003ff0 0x7fb7380047d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb744009ae0 tx=0x7fb74401ca90 comp rx=0 tx=0).stop 2024-01-23T08:54:45.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.671+0000 7fb7555e0640 1 -- 172.21.15.46:0/3406011037 reap_dead start 2024-01-23T08:54:45.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.671+0000 7fb757043640 1 -- 172.21.15.46:0/3406011037 shutdown_connections 2024-01-23T08:54:45.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.671+0000 7fb757043640 1 -- 172.21.15.46:0/3406011037 >> 172.21.15.46:0/3406011037 conn(0x7fb750070e80 msgr2=0x7fb750071290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:45.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.671+0000 7fb757043640 1 -- 172.21.15.46:0/3406011037 shutdown_connections 2024-01-23T08:54:45.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.671+0000 7fb757043640 1 -- 172.21.15.46:0/3406011037 wait complete. 2024-01-23T08:54:45.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.675+0000 7fb757043640 1 Processor -- start 2024-01-23T08:54:45.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.675+0000 7fb757043640 1 -- start start 2024-01-23T08:54:45.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.675+0000 7fb757043640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb738003ff0 0x7fb750159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:45.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.675+0000 7fb757043640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7501526f0 0x7fb7500c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:45.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.675+0000 7fb757043640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb750153090 0x7fb750153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:45.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.675+0000 7fb757043640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb750152c70 con 0x7fb7501526f0 2024-01-23T08:54:45.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.675+0000 7fb757043640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7501ef3b0 con 0x7fb738003ff0 2024-01-23T08:54:45.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.675+0000 7fb757043640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb750153a50 con 0x7fb750153090 2024-01-23T08:54:45.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.679+0000 7fb74ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7501526f0 0x7fb7500c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:45.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.679+0000 7fb74ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7501526f0 0x7fb7500c6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48934/0 (socket says 172.21.15.46:48934) 2024-01-23T08:54:45.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.679+0000 7fb74ffff640 1 -- 172.21.15.46:0/1600752080 learned_addr learned my addr 172.21.15.46:0/1600752080 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:45.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.679+0000 7fb7555e0640 1 --2- 172.21.15.46:0/1600752080 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb750153090 0x7fb750153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:45.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.679+0000 7fb754ddf640 1 --2- 172.21.15.46:0/1600752080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb738003ff0 0x7fb750159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:45.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.683+0000 7fb74ffff640 1 -- 172.21.15.46:0/1600752080 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb750153090 msgr2=0x7fb750153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:45.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.683+0000 7fb74ffff640 1 --2- 172.21.15.46:0/1600752080 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb750153090 0x7fb750153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:45.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.683+0000 7fb74ffff640 1 -- 172.21.15.46:0/1600752080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb738003ff0 msgr2=0x7fb750159d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:45.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.683+0000 7fb74ffff640 1 --2- 172.21.15.46:0/1600752080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb738003ff0 0x7fb750159d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:45.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.683+0000 7fb74ffff640 1 -- 172.21.15.46:0/1600752080 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7501ef5c0 con 0x7fb7501526f0 2024-01-23T08:54:45.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.683+0000 7fb74ffff640 1 --2- 172.21.15.46:0/1600752080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7501526f0 0x7fb7500c6310 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb74401c8c0 tx=0x7fb738005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:45.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.687+0000 7fb74d7fa640 1 -- 172.21.15.46:0/1600752080 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7440be070 con 0x7fb7501526f0 2024-01-23T08:54:45.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.691+0000 7fb757043640 1 -- 172.21.15.46:0/1600752080 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7501ef8a0 con 0x7fb7501526f0 2024-01-23T08:54:45.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.691+0000 7fb74d7fa640 1 -- 172.21.15.46:0/1600752080 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb744004020 con 0x7fb7501526f0 2024-01-23T08:54:45.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.691+0000 7fb74d7fa640 1 -- 172.21.15.46:0/1600752080 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7440043d0 con 0x7fb7501526f0 2024-01-23T08:54:45.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.691+0000 7fb757043640 1 -- 172.21.15.46:0/1600752080 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7501efe60 con 0x7fb7501526f0 2024-01-23T08:54:45.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.691+0000 7fb757043640 1 -- 172.21.15.46:0/1600752080 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb750152db0 con 0x7fb7501526f0 2024-01-23T08:54:45.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.723+0000 7fb74d7fa640 1 -- 172.21.15.46:0/1600752080 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb7440c9020 con 0x7fb7501526f0 2024-01-23T08:54:45.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.727+0000 7fb74d7fa640 1 --2- 172.21.15.46:0/1600752080 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fb73c066580 0x7fb73c068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:45.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.727+0000 7fb754ddf640 1 --2- 172.21.15.46:0/1600752080 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fb73c066580 0x7fb73c068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:45.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:45.727+0000 7fb754ddf640 1 --2- 172.21.15.46:0/1600752080 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fb73c066580 0x7fb73c068a40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb740003fd0 tx=0x7fb74000c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:46.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:46.035+0000 7fb74d7fa640 1 -- 172.21.15.46:0/1600752080 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fb7440ef310 con 0x7fb7501526f0 2024-01-23T08:54:46.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:46.035+0000 7fb74d7fa640 1 -- 172.21.15.46:0/1600752080 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb7440eb650 con 0x7fb7501526f0 2024-01-23T08:54:46.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:46.239+0000 7fb757043640 1 -- 172.21.15.46:0/1600752080 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb750152db0 con 0x7fb7501526f0 2024-01-23T08:54:48.274 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T08:54:48.277 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T08:54:48.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.315+0000 7fb74d7fa640 1 -- 172.21.15.46:0/1600752080 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v26) v1 ==== 228+0+0 (secure 0 0 0) 0x7fb750152db0 con 0x7fb7501526f0 2024-01-23T08:54:48.314 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data_ec' created 2024-01-23T08:54:48.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.319+0000 7fb757043640 1 -- 172.21.15.46:0/1600752080 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fb73c066580 msgr2=0x7fb73c068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:48.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.319+0000 7fb757043640 1 --2- 172.21.15.46:0/1600752080 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fb73c066580 0x7fb73c068a40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb740003fd0 tx=0x7fb74000c040 comp rx=0 tx=0).stop 2024-01-23T08:54:48.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.319+0000 7fb757043640 1 -- 172.21.15.46:0/1600752080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7501526f0 msgr2=0x7fb7500c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:48.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.319+0000 7fb757043640 1 --2- 172.21.15.46:0/1600752080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7501526f0 0x7fb7500c6310 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb74401c8c0 tx=0x7fb738005800 comp rx=0 tx=0).stop 2024-01-23T08:54:48.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.319+0000 7fb757043640 1 -- 172.21.15.46:0/1600752080 shutdown_connections 2024-01-23T08:54:48.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.319+0000 7fb757043640 1 --2- 172.21.15.46:0/1600752080 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb750153090 0x7fb750153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:48.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.319+0000 7fb757043640 1 --2- 172.21.15.46:0/1600752080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7501526f0 0x7fb7500c6310 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:48.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.319+0000 7fb757043640 1 --2- 172.21.15.46:0/1600752080 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fb73c066580 0x7fb73c068a40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:48.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.319+0000 7fb757043640 1 --2- 172.21.15.46:0/1600752080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb738003ff0 0x7fb750159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:48.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.319+0000 7fb757043640 1 -- 172.21.15.46:0/1600752080 >> 172.21.15.46:0/1600752080 conn(0x7fb750070e80 msgr2=0x7fb7500c2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:48.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.319+0000 7fb757043640 1 -- 172.21.15.46:0/1600752080 shutdown_connections 2024-01-23T08:54:48.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.319+0000 7fb757043640 1 -- 172.21.15.46:0/1600752080 wait complete. 2024-01-23T08:54:48.336 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-01-23T08:54:48.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.523+0000 7f454b0ae640 1 Processor -- start 2024-01-23T08:54:48.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.523+0000 7f454b0ae640 1 -- start start 2024-01-23T08:54:48.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.527+0000 7f454b0ae640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4544151370 0x7f4544066680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:48.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.527+0000 7f454b0ae640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4544157d90 0x7f45440c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:48.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.527+0000 7f454b0ae640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f454406ec20 con 0x7f454406a6d0 2024-01-23T08:54:48.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.527+0000 7f454b0ae640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45441582b0 con 0x7f4544157d90 2024-01-23T08:54:48.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.527+0000 7f454b0ae640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454406b7b0 con 0x7f4544151370 2024-01-23T08:54:48.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.527+0000 7f454964b640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f454406a6d0 0x7f45440c6650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:55104/0 (socket says 172.21.15.46:55104) 2024-01-23T08:54:48.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.527+0000 7f454964b640 1 -- 172.21.15.46:0/1623664182 learned_addr learned my addr 172.21.15.46:0/1623664182 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:54:48.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.527+0000 7f4548e4a640 1 --2- 172.21.15.46:0/1623664182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4544151370 0x7f4544066680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:48.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.527+0000 7f45437fe640 1 -- 172.21.15.46:0/1623664182 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2216476135 0 0) 0x7f454406ec20 con 0x7f454406a6d0 2024-01-23T08:54:48.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.527+0000 7f45437fe640 1 -- 172.21.15.46:0/1623664182 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4534003530 con 0x7f454406a6d0 2024-01-23T08:54:48.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.531+0000 7f45437fe640 1 -- 172.21.15.46:0/1623664182 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1112115669 0 0) 0x7f4534003530 con 0x7f454406a6d0 2024-01-23T08:54:48.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.531+0000 7f45437fe640 1 -- 172.21.15.46:0/1623664182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4544151370 msgr2=0x7f4544066680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:48.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.531+0000 7f45437fe640 1 --2- 172.21.15.46:0/1623664182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4544151370 0x7f4544066680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:48.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.531+0000 7f45437fe640 1 -- 172.21.15.46:0/1623664182 >> v2:172.21.15.175:3300/0 conn(0x7f4544157d90 msgr2=0x7f45440c4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:48.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.531+0000 7f45437fe640 1 --2- 172.21.15.46:0/1623664182 >> v2:172.21.15.175:3300/0 conn(0x7f4544157d90 0x7f45440c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:48.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.531+0000 7f45437fe640 1 -- 172.21.15.46:0/1623664182 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454406ba90 con 0x7f454406a6d0 2024-01-23T08:54:48.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.531+0000 7f45437fe640 1 -- 172.21.15.46:0/1623664182 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466917103 0 0) 0x7f453c001a00 con 0x7f454406a6d0 2024-01-23T08:54:48.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.531+0000 7f45437fe640 1 -- 172.21.15.46:0/1623664182 >> v1:172.21.15.46:6789/0 conn(0x7f454406a6d0 legacy=0x7f45440c6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:48.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.531+0000 7f45437fe640 1 --2- 172.21.15.46:0/1623664182 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4534003980 0x7f4534003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:48.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.531+0000 7f45437fe640 1 --2- 172.21.15.46:0/1623664182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45340047d0 0x7f4534004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:48.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.531+0000 7f45437fe640 1 --2- 172.21.15.46:0/1623664182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4544151370 0x7f4534005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:48.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.531+0000 7f45437fe640 1 -- 172.21.15.46:0/1623664182 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45441582b0 con 0x7f4534003980 2024-01-23T08:54:48.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.531+0000 7f45437fe640 1 -- 172.21.15.46:0/1623664182 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454406b7b0 con 0x7f45340047d0 2024-01-23T08:54:48.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.531+0000 7f45437fe640 1 -- 172.21.15.46:0/1623664182 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f453400bac0 con 0x7f4544151370 2024-01-23T08:54:48.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.535+0000 7f4548e4a640 1 --2- 172.21.15.46:0/1623664182 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4534003980 0x7f4534003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:48.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.539+0000 7f4548e4a640 1 -- 172.21.15.46:0/1623664182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4544151370 msgr2=0x7f4534005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:48.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.539+0000 7f4548e4a640 1 --2- 172.21.15.46:0/1623664182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4544151370 0x7f4534005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:48.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.539+0000 7f4548e4a640 1 -- 172.21.15.46:0/1623664182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45340047d0 msgr2=0x7f4534004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:48.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.539+0000 7f4548e4a640 1 --2- 172.21.15.46:0/1623664182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45340047d0 0x7f4534004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:48.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.539+0000 7f4548e4a640 1 -- 172.21.15.46:0/1623664182 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4534003530 con 0x7f4534003980 2024-01-23T08:54:48.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.543+0000 7f4548e4a640 1 --2- 172.21.15.46:0/1623664182 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4534003980 0x7f4534003da0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4538009ab0 tx=0x7f453801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f7e6bddebcfaab server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:48.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.547+0000 7f45437fe640 1 -- 172.21.15.46:0/1623664182 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45380a6510 con 0x7f4534003980 2024-01-23T08:54:48.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.547+0000 7f45437fe640 1 -- 172.21.15.46:0/1623664182 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45380a6670 con 0x7f4534003980 2024-01-23T08:54:48.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.547+0000 7f45437fe640 1 -- 172.21.15.46:0/1623664182 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45380a6a20 con 0x7f4534003980 2024-01-23T08:54:48.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.547+0000 7f454b0ae640 1 -- 172.21.15.46:0/1623664182 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4534003980 msgr2=0x7f4534003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:48.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.547+0000 7f454b0ae640 1 --2- 172.21.15.46:0/1623664182 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4534003980 0x7f4534003da0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4538009ab0 tx=0x7f453801ca20 comp rx=0 tx=0).stop 2024-01-23T08:54:48.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.547+0000 7f454964b640 1 -- 172.21.15.46:0/1623664182 reap_dead start 2024-01-23T08:54:48.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.547+0000 7f454b0ae640 1 -- 172.21.15.46:0/1623664182 shutdown_connections 2024-01-23T08:54:48.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.547+0000 7f454b0ae640 1 -- 172.21.15.46:0/1623664182 >> 172.21.15.46:0/1623664182 conn(0x7f45440cb450 msgr2=0x7f45440cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:48.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.547+0000 7f454b0ae640 1 -- 172.21.15.46:0/1623664182 shutdown_connections 2024-01-23T08:54:48.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.547+0000 7f454b0ae640 1 -- 172.21.15.46:0/1623664182 wait complete. 2024-01-23T08:54:48.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.547+0000 7f454b0ae640 1 Processor -- start 2024-01-23T08:54:48.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.547+0000 7f454b0ae640 1 -- start start 2024-01-23T08:54:48.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.551+0000 7f454b0ae640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f454414c710 0x7f45441f31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:48.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.551+0000 7f454b0ae640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f454414caf0 0x7f454415a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:48.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.551+0000 7f454b0ae640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f454415a540 0x7f4544143b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:48.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.551+0000 7f454b0ae640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45441f36f0 con 0x7f454414caf0 2024-01-23T08:54:48.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.551+0000 7f454b0ae640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4544160470 con 0x7f454415a540 2024-01-23T08:54:48.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.551+0000 7f454b0ae640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4544160050 con 0x7f454414c710 2024-01-23T08:54:48.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.551+0000 7f4543fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f454414caf0 0x7f454415a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:48.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.551+0000 7f4543fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f454414caf0 0x7f454415a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48950/0 (socket says 172.21.15.46:48950) 2024-01-23T08:54:48.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.551+0000 7f4543fff640 1 -- 172.21.15.46:0/91408155 learned_addr learned my addr 172.21.15.46:0/91408155 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:48.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.551+0000 7f4548e4a640 1 --2- 172.21.15.46:0/91408155 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f454414c710 0x7f45441f31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:48.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.555+0000 7f4543fff640 1 -- 172.21.15.46:0/91408155 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f454414c710 msgr2=0x7f45441f31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:48.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.555+0000 7f4543fff640 1 --2- 172.21.15.46:0/91408155 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f454414c710 0x7f45441f31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:48.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.555+0000 7f4543fff640 1 -- 172.21.15.46:0/91408155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f454415a540 msgr2=0x7f4544143b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:48.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.555+0000 7f4543fff640 1 --2- 172.21.15.46:0/91408155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f454415a540 0x7f4544143b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:48.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.555+0000 7f4543fff640 1 -- 172.21.15.46:0/91408155 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454415a9a0 con 0x7f454414caf0 2024-01-23T08:54:48.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.555+0000 7f4543fff640 1 --2- 172.21.15.46:0/91408155 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f454414caf0 0x7f454415a000 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f453000b550 tx=0x7f453000ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:48.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.559+0000 7f45417fa640 1 -- 172.21.15.46:0/91408155 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4530010890 con 0x7f454414caf0 2024-01-23T08:54:48.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.559+0000 7f45417fa640 1 -- 172.21.15.46:0/91408155 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45300109f0 con 0x7f454414caf0 2024-01-23T08:54:48.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.559+0000 7f45417fa640 1 -- 172.21.15.46:0/91408155 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4530010da0 con 0x7f454414caf0 2024-01-23T08:54:48.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.559+0000 7f454b0ae640 1 -- 172.21.15.46:0/91408155 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45441606c0 con 0x7f454414caf0 2024-01-23T08:54:48.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.559+0000 7f454b0ae640 1 -- 172.21.15.46:0/91408155 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45440c2cd0 con 0x7f454414caf0 2024-01-23T08:54:48.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.563+0000 7f454b0ae640 1 -- 172.21.15.46:0/91408155 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4544074340 con 0x7f454414caf0 2024-01-23T08:54:48.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.919+0000 7f45417fa640 1 -- 172.21.15.46:0/91408155 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f4530023480 con 0x7f454414caf0 2024-01-23T08:54:48.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.919+0000 7f45417fa640 1 --2- 172.21.15.46:0/91408155 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4528066550 0x7f4528068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:48.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.919+0000 7f4548e4a640 1 --2- 172.21.15.46:0/91408155 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4528066550 0x7f4528068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:48.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.923+0000 7f4548e4a640 1 --2- 172.21.15.46:0/91408155 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4528066550 0x7f4528068a10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f45380af000 tx=0x7f45380046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:48.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.955+0000 7f45417fa640 1 -- 172.21.15.46:0/91408155 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f4530055350 con 0x7f454414caf0 2024-01-23T08:54:48.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:48.955+0000 7f45417fa640 1 -- 172.21.15.46:0/91408155 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f4530051690 con 0x7f454414caf0 2024-01-23T08:54:49.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.127+0000 7f454b0ae640 1 -- 172.21.15.46:0/91408155 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f4544066460 con 0x7f454414caf0 2024-01-23T08:54:49.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.623+0000 7f45417fa640 1 -- 172.21.15.46:0/91408155 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7f453001e0c0 con 0x7f454414caf0 2024-01-23T08:54:49.621 INFO:teuthology.orchestra.run.smithi046.stderr:set pool 4 allow_ec_overwrites to true 2024-01-23T08:54:49.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.627+0000 7f454b0ae640 1 -- 172.21.15.46:0/91408155 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4528066550 msgr2=0x7f4528068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:49.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.627+0000 7f454b0ae640 1 --2- 172.21.15.46:0/91408155 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4528066550 0x7f4528068a10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f45380af000 tx=0x7f45380046d0 comp rx=0 tx=0).stop 2024-01-23T08:54:49.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.627+0000 7f454b0ae640 1 -- 172.21.15.46:0/91408155 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f454414caf0 msgr2=0x7f454415a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:49.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.627+0000 7f454b0ae640 1 --2- 172.21.15.46:0/91408155 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f454414caf0 0x7f454415a000 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f453000b550 tx=0x7f453000ba10 comp rx=0 tx=0).stop 2024-01-23T08:54:49.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.627+0000 7f454b0ae640 1 -- 172.21.15.46:0/91408155 shutdown_connections 2024-01-23T08:54:49.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.627+0000 7f454b0ae640 1 --2- 172.21.15.46:0/91408155 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4528066550 0x7f4528068a10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:49.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.627+0000 7f454b0ae640 1 --2- 172.21.15.46:0/91408155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f454415a540 0x7f4544143b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:49.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.627+0000 7f454b0ae640 1 --2- 172.21.15.46:0/91408155 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f454414caf0 0x7f454415a000 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:49.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.627+0000 7f454b0ae640 1 --2- 172.21.15.46:0/91408155 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f454414c710 0x7f45441f31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:49.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.627+0000 7f454b0ae640 1 -- 172.21.15.46:0/91408155 >> 172.21.15.46:0/91408155 conn(0x7f45440cb450 msgr2=0x7f45440ca970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:49.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.627+0000 7f454b0ae640 1 -- 172.21.15.46:0/91408155 shutdown_connections 2024-01-23T08:54:49.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.627+0000 7f454b0ae640 1 -- 172.21.15.46:0/91408155 wait complete. 2024-01-23T08:54:49.651 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-01-23T08:54:49.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.795+0000 7ff98f7f6640 1 Processor -- start 2024-01-23T08:54:49.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.795+0000 7ff98f7f6640 1 -- start start 2024-01-23T08:54:49.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.799+0000 7ff98f7f6640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff9880cf660 0x7ff9880c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:49.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.799+0000 7ff98f7f6640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff98815da50 0x7ff988159800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:49.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.799+0000 7ff98f7f6640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff98815a2b0 con 0x7ff9880cf280 2024-01-23T08:54:49.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.799+0000 7ff98f7f6640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff98815d630 con 0x7ff98815da50 2024-01-23T08:54:49.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.799+0000 7ff98f7f6640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff98815a590 con 0x7ff9880cf660 2024-01-23T08:54:49.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.799+0000 7ff98dd93640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff98815da50 0x7ff988159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:49.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.799+0000 7ff98dd93640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff98815da50 0x7ff988159800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48962/0 (socket says 172.21.15.46:48962) 2024-01-23T08:54:49.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.799+0000 7ff98dd93640 1 -- 172.21.15.46:0/1792991400 learned_addr learned my addr 172.21.15.46:0/1792991400 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:49.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.799+0000 7ff98dd93640 1 -- 172.21.15.46:0/1792991400 >> v2:172.21.15.175:3300/0 conn(0x7ff9880cf660 msgr2=0x7ff9880c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:49.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.799+0000 7ff98dd93640 1 --2- 172.21.15.46:0/1792991400 >> v2:172.21.15.175:3300/0 conn(0x7ff9880cf660 0x7ff9880c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:49.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.799+0000 7ff98dd93640 1 -- 172.21.15.46:0/1792991400 >> v1:172.21.15.175:6789/0 conn(0x7ff9880cf280 legacy=0x7ff9880c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:49.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.799+0000 7ff98dd93640 1 -- 172.21.15.46:0/1792991400 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98815cf70 con 0x7ff98815da50 2024-01-23T08:54:49.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.803+0000 7ff98dd93640 1 --2- 172.21.15.46:0/1792991400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff98815da50 0x7ff988159800 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff980009870 tx=0x7ff98001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe5316e188ea35e server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:49.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.815+0000 7ff97ffff640 1 -- 172.21.15.46:0/1792991400 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9800ac630 con 0x7ff98815da50 2024-01-23T08:54:49.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.815+0000 7ff97ffff640 1 -- 172.21.15.46:0/1792991400 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9800ac790 con 0x7ff98815da50 2024-01-23T08:54:49.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.815+0000 7ff97ffff640 1 -- 172.21.15.46:0/1792991400 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9800acb20 con 0x7ff98815da50 2024-01-23T08:54:49.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.815+0000 7ff98f7f6640 1 -- 172.21.15.46:0/1792991400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff98815da50 msgr2=0x7ff988159800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:49.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.815+0000 7ff98f7f6640 1 --2- 172.21.15.46:0/1792991400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff98815da50 0x7ff988159800 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff980009870 tx=0x7ff98001c4c0 comp rx=0 tx=0).stop 2024-01-23T08:54:49.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.815+0000 7ff98f7f6640 1 -- 172.21.15.46:0/1792991400 shutdown_connections 2024-01-23T08:54:49.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.815+0000 7ff98f7f6640 1 --2- 172.21.15.46:0/1792991400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff98815da50 0x7ff988159800 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:49.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.815+0000 7ff98f7f6640 1 --2- 172.21.15.46:0/1792991400 >> v2:172.21.15.175:3300/0 conn(0x7ff9880cf660 0x7ff9880c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:49.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.815+0000 7ff98f7f6640 1 -- 172.21.15.46:0/1792991400 >> 172.21.15.46:0/1792991400 conn(0x7ff98808afa0 msgr2=0x7ff98808b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:49.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.815+0000 7ff98f7f6640 1 -- 172.21.15.46:0/1792991400 shutdown_connections 2024-01-23T08:54:49.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.815+0000 7ff98f7f6640 1 -- 172.21.15.46:0/1792991400 wait complete. 2024-01-23T08:54:49.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.815+0000 7ff98f7f6640 1 Processor -- start 2024-01-23T08:54:49.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.815+0000 7ff98f7f6640 1 -- start start 2024-01-23T08:54:49.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.819+0000 7ff98f7f6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9880cf280 0x7ff98815bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:49.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.819+0000 7ff98f7f6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9880cf660 0x7ff988142740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:49.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.819+0000 7ff98f7f6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff98815da50 0x7ff9880b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:49.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.819+0000 7ff98f7f6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9880b4970 con 0x7ff9880cf660 2024-01-23T08:54:49.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.819+0000 7ff98f7f6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98815b7e0 con 0x7ff9880cf280 2024-01-23T08:54:49.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.819+0000 7ff98f7f6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9880b4690 con 0x7ff98815da50 2024-01-23T08:54:49.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.827+0000 7ff98dd93640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff98815da50 0x7ff9880b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:49.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.831+0000 7ff98dd93640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff98815da50 0x7ff9880b3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:57420/0 (socket says 172.21.15.46:57420) 2024-01-23T08:54:49.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.831+0000 7ff98dd93640 1 -- 172.21.15.46:0/2474775214 learned_addr learned my addr 172.21.15.46:0/2474775214 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:49.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.839+0000 7ff98dd93640 1 -- 172.21.15.46:0/2474775214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9880cf280 msgr2=0x7ff98815bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:49.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.839+0000 7ff98dd93640 1 --2- 172.21.15.46:0/2474775214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9880cf280 0x7ff98815bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:49.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.839+0000 7ff98dd93640 1 -- 172.21.15.46:0/2474775214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9880cf660 msgr2=0x7ff988142740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:49.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.839+0000 7ff98dd93640 1 --2- 172.21.15.46:0/2474775214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9880cf660 0x7ff988142740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:49.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.839+0000 7ff98dd93640 1 -- 172.21.15.46:0/2474775214 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9800094d0 con 0x7ff98815da50 2024-01-23T08:54:49.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.843+0000 7ff98dd93640 1 --2- 172.21.15.46:0/2474775214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff98815da50 0x7ff9880b3bc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff98001ab70 tx=0x7ff980019260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:49.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.847+0000 7ff97dffb640 1 -- 172.21.15.46:0/2474775214 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9800b6810 con 0x7ff98815da50 2024-01-23T08:54:49.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.847+0000 7ff97dffb640 1 -- 172.21.15.46:0/2474775214 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9800b6970 con 0x7ff98815da50 2024-01-23T08:54:49.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.847+0000 7ff98f7f6640 1 -- 172.21.15.46:0/2474775214 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9880b4f80 con 0x7ff98815da50 2024-01-23T08:54:49.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.847+0000 7ff97dffb640 1 -- 172.21.15.46:0/2474775214 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9800b6d00 con 0x7ff98815da50 2024-01-23T08:54:49.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.847+0000 7ff98f7f6640 1 -- 172.21.15.46:0/2474775214 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff988152490 con 0x7ff98815da50 2024-01-23T08:54:49.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:49.847+0000 7ff98f7f6640 1 -- 172.21.15.46:0/2474775214 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff988074340 con 0x7ff98815da50 2024-01-23T08:54:50.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:50.163+0000 7ff97dffb640 1 -- 172.21.15.46:0/2474775214 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff9800c2460 con 0x7ff98815da50 2024-01-23T08:54:50.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:50.163+0000 7ff97dffb640 1 --2- 172.21.15.46:0/2474775214 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7ff96c066550 0x7ff96c068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:50.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:50.163+0000 7ff98d592640 1 --2- 172.21.15.46:0/2474775214 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7ff96c066550 0x7ff96c068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:50.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:50.163+0000 7ff98d592640 1 --2- 172.21.15.46:0/2474775214 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7ff96c066550 0x7ff96c068a10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff984001c90 tx=0x7ff984007d20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:50.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:50.171+0000 7ff97dffb640 1 -- 172.21.15.46:0/2474775214 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6428+0+0 (secure 0 0 0) 0x7ff9800f09c0 con 0x7ff98815da50 2024-01-23T08:54:50.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:50.199+0000 7ff97dffb640 1 -- 172.21.15.46:0/2474775214 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff9800ec600 con 0x7ff98815da50 2024-01-23T08:54:50.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:50.407+0000 7ff98f7f6640 1 -- 172.21.15.46:0/2474775214 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7ff9880ca950 con 0x7ff98815da50 2024-01-23T08:54:51.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.635+0000 7ff97dffb640 1 -- 172.21.15.46:0/2474775214 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7ff9800a8070 con 0x7ff98815da50 2024-01-23T08:54:51.635 INFO:teuthology.orchestra.run.smithi046.stderr:added data pool 4 to fsmap 2024-01-23T08:54:51.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.639+0000 7ff98f7f6640 1 -- 172.21.15.46:0/2474775214 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7ff96c066550 msgr2=0x7ff96c068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:51.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.639+0000 7ff98f7f6640 1 --2- 172.21.15.46:0/2474775214 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7ff96c066550 0x7ff96c068a10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff984001c90 tx=0x7ff984007d20 comp rx=0 tx=0).stop 2024-01-23T08:54:51.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.639+0000 7ff98f7f6640 1 -- 172.21.15.46:0/2474775214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff98815da50 msgr2=0x7ff9880b3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:51.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.639+0000 7ff98f7f6640 1 --2- 172.21.15.46:0/2474775214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff98815da50 0x7ff9880b3bc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff98001ab70 tx=0x7ff980019260 comp rx=0 tx=0).stop 2024-01-23T08:54:51.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.639+0000 7ff98f7f6640 1 -- 172.21.15.46:0/2474775214 shutdown_connections 2024-01-23T08:54:51.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.639+0000 7ff98f7f6640 1 --2- 172.21.15.46:0/2474775214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff98815da50 0x7ff9880b3bc0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:51.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.639+0000 7ff98f7f6640 1 --2- 172.21.15.46:0/2474775214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9880cf660 0x7ff988142740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:51.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.639+0000 7ff98f7f6640 1 --2- 172.21.15.46:0/2474775214 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7ff96c066550 0x7ff96c068a10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:51.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.639+0000 7ff98f7f6640 1 --2- 172.21.15.46:0/2474775214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9880cf280 0x7ff98815bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:51.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.639+0000 7ff98f7f6640 1 -- 172.21.15.46:0/2474775214 >> 172.21.15.46:0/2474775214 conn(0x7ff98808afa0 msgr2=0x7ff9881519c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:51.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.639+0000 7ff98f7f6640 1 -- 172.21.15.46:0/2474775214 shutdown_connections 2024-01-23T08:54:51.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.639+0000 7ff98f7f6640 1 -- 172.21.15.46:0/2474775214 wait complete. 2024-01-23T08:54:51.661 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-23T08:54:51.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.791+0000 7f723c8d1640 1 Processor -- start 2024-01-23T08:54:51.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.791+0000 7f723c8d1640 1 -- start start 2024-01-23T08:54:51.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.791+0000 7f723c8d1640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7238150610 0x7f72381563f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:51.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.791+0000 7f723c8d1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72380c0e90 0x7f7238160d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:51.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.791+0000 7f723c8d1640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f723806f7c0 con 0x7f72380c67e0 2024-01-23T08:54:51.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.791+0000 7f723c8d1640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72380c2980 con 0x7f7238150610 2024-01-23T08:54:51.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.791+0000 7f723c8d1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f723806fa10 con 0x7f72380c0e90 2024-01-23T08:54:51.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.791+0000 7f723659c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7238150610 0x7f72381563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:51.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.791+0000 7f7236d9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72380c0e90 0x7f7238160d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:51.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.795+0000 7f723659c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7238150610 0x7f72381563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:54924/0 (socket says 172.21.15.46:54924) 2024-01-23T08:54:51.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.795+0000 7f723659c640 1 -- 172.21.15.46:0/852656062 learned_addr learned my addr 172.21.15.46:0/852656062 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:51.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.799+0000 7f723659c640 1 -- 172.21.15.46:0/852656062 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72380c0e90 msgr2=0x7f7238160d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:51.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.799+0000 7f723659c640 1 --2- 172.21.15.46:0/852656062 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72380c0e90 0x7f7238160d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:51.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.799+0000 7f723659c640 1 -- 172.21.15.46:0/852656062 >> v1:172.21.15.175:6789/0 conn(0x7f72380c67e0 legacy=0x7f72380c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:51.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.799+0000 7f723659c640 1 -- 172.21.15.46:0/852656062 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7238070570 con 0x7f7238150610 2024-01-23T08:54:51.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.807+0000 7f723659c640 1 --2- 172.21.15.46:0/852656062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7238150610 0x7f72381563f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7230009e50 tx=0x7f723001f1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=699aa830aac9b4a server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:51.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.823+0000 7f723559a640 1 -- 172.21.15.46:0/852656062 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72300af400 con 0x7f7238150610 2024-01-23T08:54:51.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.823+0000 7f723559a640 1 -- 172.21.15.46:0/852656062 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72300ab050 con 0x7f7238150610 2024-01-23T08:54:51.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.823+0000 7f723559a640 1 -- 172.21.15.46:0/852656062 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72300af780 con 0x7f7238150610 2024-01-23T08:54:51.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.823+0000 7f723c8d1640 1 -- 172.21.15.46:0/852656062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7238150610 msgr2=0x7f72381563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:51.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.823+0000 7f723c8d1640 1 --2- 172.21.15.46:0/852656062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7238150610 0x7f72381563f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7230009e50 tx=0x7f723001f1c0 comp rx=0 tx=0).stop 2024-01-23T08:54:51.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.823+0000 7f723c8d1640 1 -- 172.21.15.46:0/852656062 shutdown_connections 2024-01-23T08:54:51.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.823+0000 7f723c8d1640 1 --2- 172.21.15.46:0/852656062 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72380c0e90 0x7f7238160d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:51.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.823+0000 7f723c8d1640 1 --2- 172.21.15.46:0/852656062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7238150610 0x7f72381563f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:51.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.823+0000 7f723c8d1640 1 -- 172.21.15.46:0/852656062 >> 172.21.15.46:0/852656062 conn(0x7f723806de30 msgr2=0x7f723806e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:51.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.823+0000 7f723c8d1640 1 -- 172.21.15.46:0/852656062 shutdown_connections 2024-01-23T08:54:51.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.823+0000 7f723c8d1640 1 -- 172.21.15.46:0/852656062 wait complete. 2024-01-23T08:54:51.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.827+0000 7f723c8d1640 1 Processor -- start 2024-01-23T08:54:51.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.827+0000 7f723c8d1640 1 -- start start 2024-01-23T08:54:51.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.827+0000 7f723c8d1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72380c0e90 0x7f72381ed490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:51.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.827+0000 7f723c8d1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72380c67e0 0x7f7238145e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:51.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.827+0000 7f723c8d1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7238150610 0x7f72380c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:51.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.827+0000 7f723c8d1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72380c5e80 con 0x7f7238150610 2024-01-23T08:54:51.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.827+0000 7f723c8d1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72381ee900 con 0x7f72380c67e0 2024-01-23T08:54:51.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.827+0000 7f723c8d1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72380c32c0 con 0x7f72380c0e90 2024-01-23T08:54:51.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.831+0000 7f723659c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72380c0e90 0x7f72381ed490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:51.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.835+0000 7f723659c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72380c0e90 0x7f72381ed490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:57450/0 (socket says 172.21.15.46:57450) 2024-01-23T08:54:51.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.835+0000 7f723659c640 1 -- 172.21.15.46:0/1965863000 learned_addr learned my addr 172.21.15.46:0/1965863000 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:51.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.843+0000 7f7235d9b640 1 --2- 172.21.15.46:0/1965863000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72380c67e0 0x7f7238145e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:51.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.875+0000 7f7236d9d640 1 --2- 172.21.15.46:0/1965863000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7238150610 0x7f72380c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:51.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.883+0000 7f7236d9d640 1 -- 172.21.15.46:0/1965863000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72380c0e90 msgr2=0x7f72381ed490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:51.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.883+0000 7f7236d9d640 1 --2- 172.21.15.46:0/1965863000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72380c0e90 0x7f72381ed490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:51.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.883+0000 7f7236d9d640 1 -- 172.21.15.46:0/1965863000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72380c67e0 msgr2=0x7f7238145e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:51.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.883+0000 7f7236d9d640 1 --2- 172.21.15.46:0/1965863000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72380c67e0 0x7f7238145e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:51.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.883+0000 7f7236d9d640 1 -- 172.21.15.46:0/1965863000 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7230009b30 con 0x7f7238150610 2024-01-23T08:54:51.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.887+0000 7f7236d9d640 1 --2- 172.21.15.46:0/1965863000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7238150610 0x7f72380c4640 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f722800e800 tx=0x7f722800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:51.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.895+0000 7f722effd640 1 -- 172.21.15.46:0/1965863000 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72280095b0 con 0x7f7238150610 2024-01-23T08:54:51.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.895+0000 7f722effd640 1 -- 172.21.15.46:0/1965863000 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f722800c940 con 0x7f7238150610 2024-01-23T08:54:51.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.895+0000 7f723c8d1640 1 -- 172.21.15.46:0/1965863000 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72380c2f90 con 0x7f7238150610 2024-01-23T08:54:51.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.895+0000 7f722effd640 1 -- 172.21.15.46:0/1965863000 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722800ccf0 con 0x7f7238150610 2024-01-23T08:54:51.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.895+0000 7f723c8d1640 1 -- 172.21.15.46:0/1965863000 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72380c3880 con 0x7f7238150610 2024-01-23T08:54:51.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:51.899+0000 7f723c8d1640 1 -- 172.21.15.46:0/1965863000 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72380c2dd0 con 0x7f7238150610 2024-01-23T08:54:52.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.235+0000 7f722effd640 1 -- 172.21.15.46:0/1965863000 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f7228013470 con 0x7f7238150610 2024-01-23T08:54:52.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.239+0000 7f722effd640 1 --2- 172.21.15.46:0/1965863000 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7218066580 0x7f7218068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:52.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.239+0000 7f723659c640 1 --2- 172.21.15.46:0/1965863000 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7218066580 0x7f7218068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:52.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.239+0000 7f723659c640 1 --2- 172.21.15.46:0/1965863000 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7218066580 0x7f7218068a40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7230000f90 tx=0x7f72300aa000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:52.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.275+0000 7f722effd640 1 -- 172.21.15.46:0/1965863000 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7228055720 con 0x7f7238150610 2024-01-23T08:54:52.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.275+0000 7f722effd640 1 -- 172.21.15.46:0/1965863000 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f7228051a60 con 0x7f7238150610 2024-01-23T08:54:52.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.507+0000 7f723c8d1640 1 -- 172.21.15.46:0/1965863000 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7238074340 con 0x7f7238150610 2024-01-23T08:54:52.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.571+0000 7f722effd640 1 -- 172.21.15.46:0/1965863000 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6517 (secure 0 0 0) 0x7f7228021090 con 0x7f7238150610 2024-01-23T08:54:52.568 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:54:52.568 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4208,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/397511399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":397511399},{"type":"v1","addr":"172.21.15.175:6835","nonce":397511399}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1620040020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1620040020},{"type":"v1","addr":"172.21.15.46:6835","nonce":1620040020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2714415350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2714415350},{"type":"v1","addr":"172.21.15.175:6833","nonce":2714415350}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4234,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3103300888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3103300888},{"type":"v1","addr":"172.21.15.175:6837","nonce":3103300888}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/338965660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":338965660},{"type":"v1","addr":"172.21.15.46:6837","nonce":338965660}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-23T08:54:42.028655+0000","modified":"2024-01-23T08:54:50.479618+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4242},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4242":{"gid":4242,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":9,"addr":"172.21.15.46:6839/1889172114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1889172114},{"type":"v1","addr":"172.21.15.46:6839","nonce":1889172114}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-01-23T08:54:52.569 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 7 2024-01-23T08:54:52.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.571+0000 7f723c8d1640 1 -- 172.21.15.46:0/1965863000 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7218066580 msgr2=0x7f7218068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:52.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.571+0000 7f723c8d1640 1 --2- 172.21.15.46:0/1965863000 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7218066580 0x7f7218068a40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7230000f90 tx=0x7f72300aa000 comp rx=0 tx=0).stop 2024-01-23T08:54:52.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.571+0000 7f723c8d1640 1 -- 172.21.15.46:0/1965863000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7238150610 msgr2=0x7f72380c4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:52.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.571+0000 7f723c8d1640 1 --2- 172.21.15.46:0/1965863000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7238150610 0x7f72380c4640 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f722800e800 tx=0x7f722800ecc0 comp rx=0 tx=0).stop 2024-01-23T08:54:52.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.571+0000 7f723c8d1640 1 -- 172.21.15.46:0/1965863000 shutdown_connections 2024-01-23T08:54:52.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.571+0000 7f723c8d1640 1 --2- 172.21.15.46:0/1965863000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7238150610 0x7f72380c4640 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:52.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.571+0000 7f723c8d1640 1 --2- 172.21.15.46:0/1965863000 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7218066580 0x7f7218068a40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:52.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.571+0000 7f723c8d1640 1 --2- 172.21.15.46:0/1965863000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72380c67e0 0x7f7238145e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:52.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.571+0000 7f723c8d1640 1 --2- 172.21.15.46:0/1965863000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72380c0e90 0x7f72381ed490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:52.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.571+0000 7f723c8d1640 1 -- 172.21.15.46:0/1965863000 >> 172.21.15.46:0/1965863000 conn(0x7f723806de30 msgr2=0x7f72380ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:52.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.571+0000 7f723c8d1640 1 -- 172.21.15.46:0/1965863000 shutdown_connections 2024-01-23T08:54:52.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.571+0000 7f723c8d1640 1 -- 172.21.15.46:0/1965863000 wait complete. 2024-01-23T08:54:52.591 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-23T08:54:52.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.731+0000 7fe042d02640 1 Processor -- start 2024-01-23T08:54:52.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.731+0000 7fe042d02640 1 -- start start 2024-01-23T08:54:52.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.735+0000 7fe042d02640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe03c0c4820 0x7fe03c072260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:52.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.735+0000 7fe042d02640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe03c06fc40 con 0x7fe03c150140 2024-01-23T08:54:52.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.735+0000 7fe042d02640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe03c06fee0 con 0x7fe03c0c4c00 2024-01-23T08:54:52.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.735+0000 7fe042d02640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c0c2980 con 0x7fe03c0c4820 2024-01-23T08:54:52.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.735+0000 7fe04129f640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe03c150140 0x7fe03c0c66d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:55118/0 (socket says 172.21.15.46:55118) 2024-01-23T08:54:52.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.735+0000 7fe04129f640 1 -- 172.21.15.46:0/2657210004 learned_addr learned my addr 172.21.15.46:0/2657210004 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:54:52.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.735+0000 7fe040a9e640 1 --2- 172.21.15.46:0/2657210004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe03c0c4820 0x7fe03c072260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:52.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.739+0000 7fe03b7fe640 1 -- 172.21.15.46:0/2657210004 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2844555277 0 0) 0x7fe03c06fc40 con 0x7fe03c150140 2024-01-23T08:54:52.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.739+0000 7fe03b7fe640 1 -- 172.21.15.46:0/2657210004 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe028005740 con 0x7fe03c150140 2024-01-23T08:54:52.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.743+0000 7fe03b7fe640 1 -- 172.21.15.46:0/2657210004 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3729029116 0 0) 0x7fe03c06fee0 con 0x7fe03c0c4c00 2024-01-23T08:54:52.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.743+0000 7fe03b7fe640 1 -- 172.21.15.46:0/2657210004 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe03c06fc40 con 0x7fe03c0c4c00 2024-01-23T08:54:52.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.743+0000 7fe040a9e640 1 -- 172.21.15.46:0/2657210004 >> v1:172.21.15.175:6789/0 conn(0x7fe03c0c4c00 legacy=0x7fe03c14fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:52.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.743+0000 7fe040a9e640 1 -- 172.21.15.46:0/2657210004 >> v1:172.21.15.46:6789/0 conn(0x7fe03c150140 legacy=0x7fe03c0c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:52.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.743+0000 7fe040a9e640 1 -- 172.21.15.46:0/2657210004 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03c0c2c60 con 0x7fe03c0c4820 2024-01-23T08:54:52.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.747+0000 7fe040a9e640 1 --2- 172.21.15.46:0/2657210004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe03c0c4820 0x7fe03c072260 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe0240097f0 tx=0x7fe02401ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6db48540165ffd46 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:52.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.759+0000 7fe03b7fe640 1 -- 172.21.15.46:0/2657210004 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0240a89b0 con 0x7fe03c0c4820 2024-01-23T08:54:52.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.759+0000 7fe03b7fe640 1 -- 172.21.15.46:0/2657210004 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0240a8b10 con 0x7fe03c0c4820 2024-01-23T08:54:52.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.759+0000 7fe03b7fe640 1 -- 172.21.15.46:0/2657210004 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0240a8ea0 con 0x7fe03c0c4820 2024-01-23T08:54:52.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.759+0000 7fe042d02640 1 -- 172.21.15.46:0/2657210004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe03c0c4820 msgr2=0x7fe03c072260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:52.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.759+0000 7fe042d02640 1 --2- 172.21.15.46:0/2657210004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe03c0c4820 0x7fe03c072260 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe0240097f0 tx=0x7fe02401ecb0 comp rx=0 tx=0).stop 2024-01-23T08:54:52.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.759+0000 7fe042d02640 1 -- 172.21.15.46:0/2657210004 shutdown_connections 2024-01-23T08:54:52.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.759+0000 7fe042d02640 1 --2- 172.21.15.46:0/2657210004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe03c0c4820 0x7fe03c072260 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:52.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.759+0000 7fe042d02640 1 -- 172.21.15.46:0/2657210004 >> 172.21.15.46:0/2657210004 conn(0x7fe03c071740 msgr2=0x7fe03c071b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:52.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.759+0000 7fe042d02640 1 -- 172.21.15.46:0/2657210004 shutdown_connections 2024-01-23T08:54:52.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.759+0000 7fe042d02640 1 -- 172.21.15.46:0/2657210004 wait complete. 2024-01-23T08:54:52.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.759+0000 7fe042d02640 1 Processor -- start 2024-01-23T08:54:52.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.759+0000 7fe042d02640 1 -- start start 2024-01-23T08:54:52.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.763+0000 7fe042d02640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe03c0c4820 0x7fe03c14c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:52.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.763+0000 7fe042d02640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe03c0c4c00 0x7fe03c071d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:52.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.763+0000 7fe042d02640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe03c150140 0x7fe03c1ef150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:52.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.763+0000 7fe042d02640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c1e1f40 con 0x7fe03c150140 2024-01-23T08:54:52.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.763+0000 7fe042d02640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c14c580 con 0x7fe03c0c4820 2024-01-23T08:54:52.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.763+0000 7fe042d02640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c1f3090 con 0x7fe03c0c4c00 2024-01-23T08:54:52.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.763+0000 7fe04129f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe03c150140 0x7fe03c1ef150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:52.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.763+0000 7fe04129f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe03c150140 0x7fe03c1ef150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48992/0 (socket says 172.21.15.46:48992) 2024-01-23T08:54:52.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.763+0000 7fe04129f640 1 -- 172.21.15.46:0/4177864077 learned_addr learned my addr 172.21.15.46:0/4177864077 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:52.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.763+0000 7fe040a9e640 1 --2- 172.21.15.46:0/4177864077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe03c0c4820 0x7fe03c14c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:52.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.763+0000 7fe03bfff640 1 --2- 172.21.15.46:0/4177864077 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe03c0c4c00 0x7fe03c071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:52.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.767+0000 7fe04129f640 1 -- 172.21.15.46:0/4177864077 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe03c0c4c00 msgr2=0x7fe03c071d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:52.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.767+0000 7fe04129f640 1 --2- 172.21.15.46:0/4177864077 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe03c0c4c00 0x7fe03c071d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:52.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.767+0000 7fe04129f640 1 -- 172.21.15.46:0/4177864077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe03c0c4820 msgr2=0x7fe03c14c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:52.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.767+0000 7fe04129f640 1 --2- 172.21.15.46:0/4177864077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe03c0c4820 0x7fe03c14c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:52.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.767+0000 7fe04129f640 1 -- 172.21.15.46:0/4177864077 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe024009420 con 0x7fe03c150140 2024-01-23T08:54:52.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.771+0000 7fe04129f640 1 --2- 172.21.15.46:0/4177864077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe03c150140 0x7fe03c1ef150 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe03400ca70 tx=0x7fe03400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:52.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.775+0000 7fe0397fa640 1 -- 172.21.15.46:0/4177864077 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03400ab70 con 0x7fe03c150140 2024-01-23T08:54:52.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.775+0000 7fe0397fa640 1 -- 172.21.15.46:0/4177864077 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03400acd0 con 0x7fe03c150140 2024-01-23T08:54:52.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.775+0000 7fe042d02640 1 -- 172.21.15.46:0/4177864077 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe03c1f3520 con 0x7fe03c150140 2024-01-23T08:54:52.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.775+0000 7fe0397fa640 1 -- 172.21.15.46:0/4177864077 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe034012640 con 0x7fe03c150140 2024-01-23T08:54:52.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.775+0000 7fe042d02640 1 -- 172.21.15.46:0/4177864077 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe03c1f2760 con 0x7fe03c150140 2024-01-23T08:54:52.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:52.775+0000 7fe042d02640 1 -- 172.21.15.46:0/4177864077 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe03c074340 con 0x7fe03c150140 2024-01-23T08:54:53.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.079+0000 7fe0397fa640 1 -- 172.21.15.46:0/4177864077 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe034007070 con 0x7fe03c150140 2024-01-23T08:54:53.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.079+0000 7fe0397fa640 1 --2- 172.21.15.46:0/4177864077 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fe01c066550 0x7fe01c068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:53.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.079+0000 7fe040a9e640 1 --2- 172.21.15.46:0/4177864077 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fe01c066550 0x7fe01c068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:53.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.079+0000 7fe040a9e640 1 --2- 172.21.15.46:0/4177864077 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fe01c066550 0x7fe01c068a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe0240b2000 tx=0x7fe0240aa070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:53.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.115+0000 7fe0397fa640 1 -- 172.21.15.46:0/4177864077 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe03400ae40 con 0x7fe03c150140 2024-01-23T08:54:53.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.115+0000 7fe0397fa640 1 -- 172.21.15.46:0/4177864077 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe0340514a0 con 0x7fe03c150140 2024-01-23T08:54:53.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.311+0000 7fe042d02640 1 -- 172.21.15.46:0/4177864077 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe03c1f31d0 con 0x7fe03c150140 2024-01-23T08:54:53.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.575+0000 7fe0397fa640 1 -- 172.21.15.46:0/4177864077 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18363 (secure 0 0 0) 0x7fe034054ac0 con 0x7fe03c150140 2024-01-23T08:54:53.573 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:54:53.573 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":28,"fsid":"fdbdd393-f422-45ae-a488-2bbb0163e580","created":"2024-01-23T08:53:36.942515+0000","modified":"2024-01-23T08:54:50.465916+0000","last_up_change":"2024-01-23T08:53:57.198113+0000","last_in_change":"2024-01-23T08:53:47.852614+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-23T08:53:59.340853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-23T08:54:38.278770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-23T08:54:40.216521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-23T08:54:47.311079+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f32c3d7d-e32a-42d8-b55f-db874d915a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6818","nonce":2681790976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6821","nonce":2681790976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6825","nonce":2681790976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6823","nonce":2681790976}]},"public_addr":"172.21.15.46:6818/2681790976","cluster_addr":"172.21.15.46:6821/2681790976","heartbeat_back_addr":"172.21.15.46:6825/2681790976","heartbeat_front_addr":"172.21.15.46:6823/2681790976","state":["exists","up"]},{"osd":1,"uuid":"6f3b6bd2-bbea-4d08-84d5-4407363b5eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6803","nonce":3679152623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6805","nonce":3679152623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6809","nonce":3679152623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6807","nonce":3679152623}]},"public_addr":"172.21.15.46:6803/3679152623","cluster_addr":"172.21.15.46:6805/3679152623","heartbeat_back_addr":"172.21.15.46:6809/3679152623","heartbeat_front_addr":"172.21.15.46:6807/3679152623","state":["exists","up"]},{"osd":2,"uuid":"8f110727-31e7-4f69-926b-c87481d4d28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6811","nonce":3869652274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6813","nonce":3869652274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6820","nonce":3869652274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6815","nonce":3869652274}]},"public_addr":"172.21.15.46:6811/3869652274","cluster_addr":"172.21.15.46:6813/3869652274","heartbeat_back_addr":"172.21.15.46:6820/3869652274","heartbeat_front_addr":"172.21.15.46:6815/3869652274","state":["exists","up"]},{"osd":3,"uuid":"3aa7527d-0463-4373-b9c7-e6b507a7987f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6827","nonce":4168860822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6829","nonce":4168860822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6833","nonce":4168860822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6831","nonce":4168860822}]},"public_addr":"172.21.15.46:6827/4168860822","cluster_addr":"172.21.15.46:6829/4168860822","heartbeat_back_addr":"172.21.15.46:6833/4168860822","heartbeat_front_addr":"172.21.15.46:6831/4168860822","state":["exists","up"]},{"osd":4,"uuid":"eb47a1e5-9f26-465f-b188-87c6eed63c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6805","nonce":3115257412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6808","nonce":3115257412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6815","nonce":3115257412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6812","nonce":3115257412}]},"public_addr":"172.21.15.175:6805/3115257412","cluster_addr":"172.21.15.175:6808/3115257412","heartbeat_back_addr":"172.21.15.175:6815/3115257412","heartbeat_front_addr":"172.21.15.175:6812/3115257412","state":["exists","up"]},{"osd":5,"uuid":"34048409-998c-44f3-a29d-dcad7a6c917b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6818","nonce":3146473948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6822","nonce":3146473948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6831","nonce":3146473948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6826","nonce":3146473948}]},"public_addr":"172.21.15.175:6818/3146473948","cluster_addr":"172.21.15.175:6822/3146473948","heartbeat_back_addr":"172.21.15.175:6831/3146473948","heartbeat_front_addr":"172.21.15.175:6826/3146473948","state":["exists","up"]},{"osd":6,"uuid":"f5d45d3f-9af3-44a1-a730-c260ed1654b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6801","nonce":4161180058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6804","nonce":4161180058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6814","nonce":4161180058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6809","nonce":4161180058}]},"public_addr":"172.21.15.175:6801/4161180058","cluster_addr":"172.21.15.175:6804/4161180058","heartbeat_back_addr":"172.21.15.175:6814/4161180058","heartbeat_front_addr":"172.21.15.175:6809/4161180058","state":["exists","up"]},{"osd":7,"uuid":"16d12e53-2ad3-4b5c-a789-22b45056fd9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6819","nonce":2670236415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6823","nonce":2670236415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6830","nonce":2670236415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6827","nonce":2670236415}]},"public_addr":"172.21.15.175:6819/2670236415","cluster_addr":"172.21.15.175:6823/2670236415","heartbeat_back_addr":"172.21.15.175:6830/2670236415","heartbeat_front_addr":"172.21.15.175:6827/2670236415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.847037+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.765547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.716122+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.874628+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.786580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.924885+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.285635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.898130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T08:54:53.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.579+0000 7fe042d02640 1 -- 172.21.15.46:0/4177864077 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fe01c066550 msgr2=0x7fe01c068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:53.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.579+0000 7fe042d02640 1 --2- 172.21.15.46:0/4177864077 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fe01c066550 0x7fe01c068a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe0240b2000 tx=0x7fe0240aa070 comp rx=0 tx=0).stop 2024-01-23T08:54:53.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.579+0000 7fe042d02640 1 -- 172.21.15.46:0/4177864077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe03c150140 msgr2=0x7fe03c1ef150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:53.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.579+0000 7fe042d02640 1 --2- 172.21.15.46:0/4177864077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe03c150140 0x7fe03c1ef150 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe03400ca70 tx=0x7fe03400cf30 comp rx=0 tx=0).stop 2024-01-23T08:54:53.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.579+0000 7fe042d02640 1 -- 172.21.15.46:0/4177864077 shutdown_connections 2024-01-23T08:54:53.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.579+0000 7fe042d02640 1 --2- 172.21.15.46:0/4177864077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe03c150140 0x7fe03c1ef150 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:53.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.579+0000 7fe042d02640 1 --2- 172.21.15.46:0/4177864077 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe03c0c4c00 0x7fe03c071d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:53.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.579+0000 7fe042d02640 1 --2- 172.21.15.46:0/4177864077 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fe01c066550 0x7fe01c068a10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:53.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.579+0000 7fe042d02640 1 --2- 172.21.15.46:0/4177864077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe03c0c4820 0x7fe03c14c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:53.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.579+0000 7fe042d02640 1 -- 172.21.15.46:0/4177864077 >> 172.21.15.46:0/4177864077 conn(0x7fe03c071740 msgr2=0x7fe03c066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:53.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.579+0000 7fe042d02640 1 -- 172.21.15.46:0/4177864077 shutdown_connections 2024-01-23T08:54:53.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.579+0000 7fe042d02640 1 -- 172.21.15.46:0/4177864077 wait complete. 2024-01-23T08:54:53.601 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-23T08:54:53.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.735+0000 7f872dd50640 1 Processor -- start 2024-01-23T08:54:53.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.735+0000 7f872dd50640 1 -- start start 2024-01-23T08:54:53.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.735+0000 7f872dd50640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8728151600 0x7f872815b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:53.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.735+0000 7f872dd50640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f872806f350 0x7f87280c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:53.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.735+0000 7f872dd50640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8728158390 con 0x7f87281519e0 2024-01-23T08:54:53.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.735+0000 7f872dd50640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f872815b0e0 con 0x7f872806f350 2024-01-23T08:54:53.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.735+0000 7f872dd50640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8728157b70 con 0x7f8728151600 2024-01-23T08:54:53.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.735+0000 7f8727fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f872806f350 0x7f87280c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:53.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.735+0000 7f8727fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f872806f350 0x7f87280c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44816/0 (socket says 172.21.15.46:44816) 2024-01-23T08:54:53.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.735+0000 7f8727fff640 1 -- 172.21.15.46:0/3269882908 learned_addr learned my addr 172.21.15.46:0/3269882908 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:53.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.735+0000 7f87277fe640 1 --2- 172.21.15.46:0/3269882908 >> v2:172.21.15.175:3300/0 conn(0x7f8728151600 0x7f872815b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:53.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.739+0000 7f8727fff640 1 -- 172.21.15.46:0/3269882908 >> v2:172.21.15.175:3300/0 conn(0x7f8728151600 msgr2=0x7f872815b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:53.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.739+0000 7f8727fff640 1 --2- 172.21.15.46:0/3269882908 >> v2:172.21.15.175:3300/0 conn(0x7f8728151600 0x7f872815b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:53.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.739+0000 7f8727fff640 1 -- 172.21.15.46:0/3269882908 >> v1:172.21.15.175:6789/0 conn(0x7f87281519e0 legacy=0x7f8728157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:53.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.739+0000 7f8727fff640 1 -- 172.21.15.46:0/3269882908 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8728157dd0 con 0x7f872806f350 2024-01-23T08:54:53.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.743+0000 7f8727fff640 1 --2- 172.21.15.46:0/3269882908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f872806f350 0x7f87280c7660 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8728066e80 tx=0x7f872001c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2277d58548e76e19 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:53.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.747+0000 7f8726ffd640 1 -- 172.21.15.46:0/3269882908 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87200a5740 con 0x7f872806f350 2024-01-23T08:54:53.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.747+0000 7f8726ffd640 1 -- 172.21.15.46:0/3269882908 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87200a58a0 con 0x7f872806f350 2024-01-23T08:54:53.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.747+0000 7f8726ffd640 1 -- 172.21.15.46:0/3269882908 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87200a5c30 con 0x7f872806f350 2024-01-23T08:54:53.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.747+0000 7f872dd50640 1 -- 172.21.15.46:0/3269882908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f872806f350 msgr2=0x7f87280c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:53.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.747+0000 7f872dd50640 1 --2- 172.21.15.46:0/3269882908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f872806f350 0x7f87280c7660 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8728066e80 tx=0x7f872001c990 comp rx=0 tx=0).stop 2024-01-23T08:54:53.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.747+0000 7f872dd50640 1 -- 172.21.15.46:0/3269882908 shutdown_connections 2024-01-23T08:54:53.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.747+0000 7f872dd50640 1 --2- 172.21.15.46:0/3269882908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f872806f350 0x7f87280c7660 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:53.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.747+0000 7f872dd50640 1 --2- 172.21.15.46:0/3269882908 >> v2:172.21.15.175:3300/0 conn(0x7f8728151600 0x7f872815b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:53.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.747+0000 7f872dd50640 1 -- 172.21.15.46:0/3269882908 >> 172.21.15.46:0/3269882908 conn(0x7f872806d590 msgr2=0x7f8728066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:53.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.747+0000 7f872dd50640 1 -- 172.21.15.46:0/3269882908 shutdown_connections 2024-01-23T08:54:53.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.747+0000 7f872dd50640 1 -- 172.21.15.46:0/3269882908 wait complete. 2024-01-23T08:54:53.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.751+0000 7f872dd50640 1 Processor -- start 2024-01-23T08:54:53.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.751+0000 7f872dd50640 1 -- start start 2024-01-23T08:54:53.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.751+0000 7f872dd50640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f872806f350 0x7f872813ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:53.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.751+0000 7f872dd50640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8728151600 0x7f87280c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:53.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.751+0000 7f872dd50640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87280c4350 0x7f87280c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:53.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.751+0000 7f872dd50640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87280c9410 con 0x7f8728151600 2024-01-23T08:54:53.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.751+0000 7f872dd50640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87280c8c60 con 0x7f87280c4350 2024-01-23T08:54:53.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.751+0000 7f872dd50640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87280c6dd0 con 0x7f872806f350 2024-01-23T08:54:53.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.751+0000 7f871ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8728151600 0x7f87280c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:53.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.751+0000 7f871ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8728151600 0x7f87280c3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44832/0 (socket says 172.21.15.46:44832) 2024-01-23T08:54:53.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.751+0000 7f871ffff640 1 -- 172.21.15.46:0/1992249899 learned_addr learned my addr 172.21.15.46:0/1992249899 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:53.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.751+0000 7f87277fe640 1 --2- 172.21.15.46:0/1992249899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f872806f350 0x7f872813ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:53.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.751+0000 7f8727fff640 1 --2- 172.21.15.46:0/1992249899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87280c4350 0x7f87280c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:53.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.755+0000 7f871ffff640 1 -- 172.21.15.46:0/1992249899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f872806f350 msgr2=0x7f872813ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:53.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.755+0000 7f871ffff640 1 --2- 172.21.15.46:0/1992249899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f872806f350 0x7f872813ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:53.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.755+0000 7f871ffff640 1 -- 172.21.15.46:0/1992249899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87280c4350 msgr2=0x7f87280c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:53.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.755+0000 7f871ffff640 1 --2- 172.21.15.46:0/1992249899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87280c4350 0x7f87280c9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:53.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.755+0000 7f871ffff640 1 -- 172.21.15.46:0/1992249899 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8720009b30 con 0x7f8728151600 2024-01-23T08:54:53.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.759+0000 7f871ffff640 1 --2- 172.21.15.46:0/1992249899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8728151600 0x7f87280c3e10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f871000b410 tx=0x7f871000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:53.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.763+0000 7f8724ff9640 1 -- 172.21.15.46:0/1992249899 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710004020 con 0x7f8728151600 2024-01-23T08:54:53.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.763+0000 7f8724ff9640 1 -- 172.21.15.46:0/1992249899 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8710004180 con 0x7f8728151600 2024-01-23T08:54:53.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.763+0000 7f8724ff9640 1 -- 172.21.15.46:0/1992249899 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710011630 con 0x7f8728151600 2024-01-23T08:54:53.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.763+0000 7f872dd50640 1 -- 172.21.15.46:0/1992249899 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87280c38d0 con 0x7f8728151600 2024-01-23T08:54:53.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.763+0000 7f872dd50640 1 -- 172.21.15.46:0/1992249899 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87280c47e0 con 0x7f8728151600 2024-01-23T08:54:53.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.763+0000 7f872dd50640 1 -- 172.21.15.46:0/1992249899 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87280c34f0 con 0x7f8728151600 2024-01-23T08:54:53.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.783+0000 7f8724ff9640 1 -- 172.21.15.46:0/1992249899 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f8710011790 con 0x7f8728151600 2024-01-23T08:54:53.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.783+0000 7f8724ff9640 1 --2- 172.21.15.46:0/1992249899 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8708066550 0x7f8708068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:53.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.783+0000 7f87277fe640 1 --2- 172.21.15.46:0/1992249899 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8708066550 0x7f8708068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:53.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.783+0000 7f87277fe640 1 --2- 172.21.15.46:0/1992249899 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8708066550 0x7f8708068a10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8718007a60 tx=0x7f8718008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:53.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:53.787+0000 7f8724ff9640 1 -- 172.21.15.46:0/1992249899 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8710025e20 con 0x7f8728151600 2024-01-23T08:54:54.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.083+0000 7f8724ff9640 1 -- 172.21.15.46:0/1992249899 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f8710051150 con 0x7f8728151600 2024-01-23T08:54:54.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.259+0000 7f872dd50640 1 -- 172.21.15.46:0/1992249899 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87280c38d0 con 0x7f8728151600 2024-01-23T08:54:54.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.311+0000 7f8724ff9640 1 -- 172.21.15.46:0/1992249899 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f87280c38d0 con 0x7f8728151600 2024-01-23T08:54:54.308 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:54:54.308 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":28,"fsid":"fdbdd393-f422-45ae-a488-2bbb0163e580","created":"2024-01-23T08:53:36.942515+0000","modified":"2024-01-23T08:54:50.465916+0000","last_up_change":"2024-01-23T08:53:57.198113+0000","last_in_change":"2024-01-23T08:53:47.852614+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-23T08:53:59.340853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-23T08:54:38.278770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-23T08:54:40.216521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-23T08:54:47.311079+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f32c3d7d-e32a-42d8-b55f-db874d915a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6818","nonce":2681790976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6821","nonce":2681790976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6825","nonce":2681790976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6823","nonce":2681790976}]},"public_addr":"172.21.15.46:6818/2681790976","cluster_addr":"172.21.15.46:6821/2681790976","heartbeat_back_addr":"172.21.15.46:6825/2681790976","heartbeat_front_addr":"172.21.15.46:6823/2681790976","state":["exists","up"]},{"osd":1,"uuid":"6f3b6bd2-bbea-4d08-84d5-4407363b5eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6803","nonce":3679152623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6805","nonce":3679152623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6809","nonce":3679152623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6807","nonce":3679152623}]},"public_addr":"172.21.15.46:6803/3679152623","cluster_addr":"172.21.15.46:6805/3679152623","heartbeat_back_addr":"172.21.15.46:6809/3679152623","heartbeat_front_addr":"172.21.15.46:6807/3679152623","state":["exists","up"]},{"osd":2,"uuid":"8f110727-31e7-4f69-926b-c87481d4d28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6811","nonce":3869652274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6813","nonce":3869652274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6820","nonce":3869652274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6815","nonce":3869652274}]},"public_addr":"172.21.15.46:6811/3869652274","cluster_addr":"172.21.15.46:6813/3869652274","heartbeat_back_addr":"172.21.15.46:6820/3869652274","heartbeat_front_addr":"172.21.15.46:6815/3869652274","state":["exists","up"]},{"osd":3,"uuid":"3aa7527d-0463-4373-b9c7-e6b507a7987f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6827","nonce":4168860822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6829","nonce":4168860822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6833","nonce":4168860822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6831","nonce":4168860822}]},"public_addr":"172.21.15.46:6827/4168860822","cluster_addr":"172.21.15.46:6829/4168860822","heartbeat_back_addr":"172.21.15.46:6833/4168860822","heartbeat_front_addr":"172.21.15.46:6831/4168860822","state":["exists","up"]},{"osd":4,"uuid":"eb47a1e5-9f26-465f-b188-87c6eed63c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6805","nonce":3115257412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6808","nonce":3115257412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6815","nonce":3115257412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6812","nonce":3115257412}]},"public_addr":"172.21.15.175:6805/3115257412","cluster_addr":"172.21.15.175:6808/3115257412","heartbeat_back_addr":"172.21.15.175:6815/3115257412","heartbeat_front_addr":"172.21.15.175:6812/3115257412","state":["exists","up"]},{"osd":5,"uuid":"34048409-998c-44f3-a29d-dcad7a6c917b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6818","nonce":3146473948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6822","nonce":3146473948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6831","nonce":3146473948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6826","nonce":3146473948}]},"public_addr":"172.21.15.175:6818/3146473948","cluster_addr":"172.21.15.175:6822/3146473948","heartbeat_back_addr":"172.21.15.175:6831/3146473948","heartbeat_front_addr":"172.21.15.175:6826/3146473948","state":["exists","up"]},{"osd":6,"uuid":"f5d45d3f-9af3-44a1-a730-c260ed1654b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6801","nonce":4161180058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6804","nonce":4161180058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6814","nonce":4161180058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6809","nonce":4161180058}]},"public_addr":"172.21.15.175:6801/4161180058","cluster_addr":"172.21.15.175:6804/4161180058","heartbeat_back_addr":"172.21.15.175:6814/4161180058","heartbeat_front_addr":"172.21.15.175:6809/4161180058","state":["exists","up"]},{"osd":7,"uuid":"16d12e53-2ad3-4b5c-a789-22b45056fd9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6819","nonce":2670236415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6823","nonce":2670236415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6830","nonce":2670236415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6827","nonce":2670236415}]},"public_addr":"172.21.15.175:6819/2670236415","cluster_addr":"172.21.15.175:6823/2670236415","heartbeat_back_addr":"172.21.15.175:6830/2670236415","heartbeat_front_addr":"172.21.15.175:6827/2670236415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.847037+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.765547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.716122+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.874628+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.786580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.924885+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.285635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.898130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T08:54:54.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.311+0000 7f872dd50640 1 -- 172.21.15.46:0/1992249899 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8708066550 msgr2=0x7f8708068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:54.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.311+0000 7f872dd50640 1 --2- 172.21.15.46:0/1992249899 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8708066550 0x7f8708068a10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8718007a60 tx=0x7f8718008040 comp rx=0 tx=0).stop 2024-01-23T08:54:54.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.311+0000 7f872dd50640 1 -- 172.21.15.46:0/1992249899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8728151600 msgr2=0x7f87280c3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:54.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.311+0000 7f872dd50640 1 --2- 172.21.15.46:0/1992249899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8728151600 0x7f87280c3e10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f871000b410 tx=0x7f871000b8d0 comp rx=0 tx=0).stop 2024-01-23T08:54:54.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.311+0000 7f872dd50640 1 -- 172.21.15.46:0/1992249899 shutdown_connections 2024-01-23T08:54:54.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.311+0000 7f872dd50640 1 --2- 172.21.15.46:0/1992249899 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8708066550 0x7f8708068a10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:54.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.311+0000 7f872dd50640 1 --2- 172.21.15.46:0/1992249899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87280c4350 0x7f87280c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:54.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.311+0000 7f872dd50640 1 --2- 172.21.15.46:0/1992249899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8728151600 0x7f87280c3e10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:54.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.311+0000 7f872dd50640 1 --2- 172.21.15.46:0/1992249899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f872806f350 0x7f872813ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:54.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.311+0000 7f872dd50640 1 -- 172.21.15.46:0/1992249899 >> 172.21.15.46:0/1992249899 conn(0x7f872806d590 msgr2=0x7f87280c1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:54.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.311+0000 7f872dd50640 1 -- 172.21.15.46:0/1992249899 shutdown_connections 2024-01-23T08:54:54.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.311+0000 7f872dd50640 1 -- 172.21.15.46:0/1992249899 wait complete. 2024-01-23T08:54:54.344 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-23T08:54:54.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.463+0000 7fe155ef0640 1 Processor -- start 2024-01-23T08:54:54.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.463+0000 7fe155ef0640 1 -- start start 2024-01-23T08:54:54.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.467+0000 7fe155ef0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1500cb370 0x7fe150071a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:54.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.467+0000 7fe155ef0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe1500bffd0 0x7fe150159f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:54.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.467+0000 7fe155ef0640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe150071f40 con 0x7fe1500cb750 2024-01-23T08:54:54.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.467+0000 7fe155ef0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1500722a0 con 0x7fe1500bffd0 2024-01-23T08:54:54.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.467+0000 7fe155ef0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe150072580 con 0x7fe1500cb370 2024-01-23T08:54:54.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.467+0000 7fe14ffff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe1500cb750 0x7fe15014ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59128/0 (socket says 172.21.15.46:59128) 2024-01-23T08:54:54.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.467+0000 7fe14ffff640 1 -- 172.21.15.46:0/689403036 learned_addr learned my addr 172.21.15.46:0/689403036 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:54:54.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.471+0000 7fe14f7fe640 1 --2- 172.21.15.46:0/689403036 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1500cb370 0x7fe150071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:54.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.471+0000 7fe14e7fc640 1 -- 172.21.15.46:0/689403036 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3309930260 0 0) 0x7fe150071f40 con 0x7fe1500cb750 2024-01-23T08:54:54.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.471+0000 7fe14e7fc640 1 -- 172.21.15.46:0/689403036 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe13c003530 con 0x7fe1500cb750 2024-01-23T08:54:54.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.475+0000 7fe14effd640 1 --2- 172.21.15.46:0/689403036 >> v2:172.21.15.175:3300/0 conn(0x7fe1500bffd0 0x7fe150159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:54.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.479+0000 7fe14e7fc640 1 -- 172.21.15.46:0/689403036 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4075778994 0 0) 0x7fe13c003530 con 0x7fe1500cb750 2024-01-23T08:54:54.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.479+0000 7fe14e7fc640 1 -- 172.21.15.46:0/689403036 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1500cb370 msgr2=0x7fe150071a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:54.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.479+0000 7fe14e7fc640 1 --2- 172.21.15.46:0/689403036 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1500cb370 0x7fe150071a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:54.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.479+0000 7fe14e7fc640 1 -- 172.21.15.46:0/689403036 >> v2:172.21.15.175:3300/0 conn(0x7fe1500bffd0 msgr2=0x7fe150159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:54.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.479+0000 7fe14e7fc640 1 --2- 172.21.15.46:0/689403036 >> v2:172.21.15.175:3300/0 conn(0x7fe1500bffd0 0x7fe150159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:54.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.479+0000 7fe14e7fc640 1 -- 172.21.15.46:0/689403036 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe150072860 con 0x7fe1500cb750 2024-01-23T08:54:54.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.479+0000 7fe14e7fc640 1 -- 172.21.15.46:0/689403036 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466917103 0 0) 0x7fe148001680 con 0x7fe1500cb750 2024-01-23T08:54:54.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.479+0000 7fe14e7fc640 1 -- 172.21.15.46:0/689403036 >> v1:172.21.15.46:6789/0 conn(0x7fe1500cb750 legacy=0x7fe15014ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:54.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.479+0000 7fe14e7fc640 1 --2- 172.21.15.46:0/689403036 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1500cb370 0x7fe13c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:54.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.479+0000 7fe14e7fc640 1 --2- 172.21.15.46:0/689403036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe13c003f50 0x7fe13c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:54.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.479+0000 7fe14e7fc640 1 --2- 172.21.15.46:0/689403036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe13c004d10 0x7fe13c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:54.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.479+0000 7fe14e7fc640 1 -- 172.21.15.46:0/689403036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1500722a0 con 0x7fe13c004d10 2024-01-23T08:54:54.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.479+0000 7fe14e7fc640 1 -- 172.21.15.46:0/689403036 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe150072580 con 0x7fe13c003f50 2024-01-23T08:54:54.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.479+0000 7fe14e7fc640 1 -- 172.21.15.46:0/689403036 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe13c00bad0 con 0x7fe1500cb370 2024-01-23T08:54:54.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.483+0000 7fe14f7fe640 1 --2- 172.21.15.46:0/689403036 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1500cb370 0x7fe13c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:54.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.483+0000 7fe14effd640 1 --2- 172.21.15.46:0/689403036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe13c003f50 0x7fe13c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:54.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.487+0000 7fe14ffff640 1 --2- 172.21.15.46:0/689403036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe13c004d10 0x7fe13c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:54.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.491+0000 7fe14ffff640 1 -- 172.21.15.46:0/689403036 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1500cb370 msgr2=0x7fe13c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:54.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.491+0000 7fe14ffff640 1 --2- 172.21.15.46:0/689403036 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1500cb370 0x7fe13c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:54.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.491+0000 7fe14ffff640 1 -- 172.21.15.46:0/689403036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe13c003f50 msgr2=0x7fe13c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:54.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.491+0000 7fe14ffff640 1 --2- 172.21.15.46:0/689403036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe13c003f50 0x7fe13c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:54.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.491+0000 7fe14ffff640 1 -- 172.21.15.46:0/689403036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13c003530 con 0x7fe13c004d10 2024-01-23T08:54:54.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.495+0000 7fe14ffff640 1 --2- 172.21.15.46:0/689403036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe13c004d10 0x7fe13c005190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe14800c190 tx=0x7fe14801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b5e829c2628e900 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:54.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.499+0000 7fe14e7fc640 1 -- 172.21.15.46:0/689403036 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1480058e0 con 0x7fe13c004d10 2024-01-23T08:54:54.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.499+0000 7fe14e7fc640 1 -- 172.21.15.46:0/689403036 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe148005a60 con 0x7fe13c004d10 2024-01-23T08:54:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.499+0000 7fe14e7fc640 1 -- 172.21.15.46:0/689403036 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe148005e90 con 0x7fe13c004d10 2024-01-23T08:54:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.499+0000 7fe155ef0640 1 -- 172.21.15.46:0/689403036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe13c004d10 msgr2=0x7fe13c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.499+0000 7fe155ef0640 1 --2- 172.21.15.46:0/689403036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe13c004d10 0x7fe13c005190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe14800c190 tx=0x7fe14801cc20 comp rx=0 tx=0).stop 2024-01-23T08:54:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.499+0000 7fe14ffff640 1 -- 172.21.15.46:0/689403036 reap_dead start 2024-01-23T08:54:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.499+0000 7fe155ef0640 1 -- 172.21.15.46:0/689403036 shutdown_connections 2024-01-23T08:54:54.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.499+0000 7fe155ef0640 1 -- 172.21.15.46:0/689403036 >> 172.21.15.46:0/689403036 conn(0x7fe15006d590 msgr2=0x7fe150066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:54.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.499+0000 7fe155ef0640 1 -- 172.21.15.46:0/689403036 shutdown_connections 2024-01-23T08:54:54.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.499+0000 7fe155ef0640 1 -- 172.21.15.46:0/689403036 wait complete. 2024-01-23T08:54:54.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.503+0000 7fe155ef0640 1 Processor -- start 2024-01-23T08:54:54.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.503+0000 7fe155ef0640 1 -- start start 2024-01-23T08:54:54.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.503+0000 7fe155ef0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe13c004d10 0x7fe1501592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:54.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.503+0000 7fe155ef0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1501e2280 0x7fe15014f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:54.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.503+0000 7fe155ef0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1501e4cb0 0x7fe1501483a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:54.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.503+0000 7fe155ef0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15014c670 con 0x7fe1501e2280 2024-01-23T08:54:54.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.503+0000 7fe155ef0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe150158e50 con 0x7fe1501e4cb0 2024-01-23T08:54:54.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.503+0000 7fe155ef0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe150158a20 con 0x7fe13c004d10 2024-01-23T08:54:54.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.503+0000 7fe14effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1501e2280 0x7fe15014f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:54.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.503+0000 7fe14effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1501e2280 0x7fe15014f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44856/0 (socket says 172.21.15.46:44856) 2024-01-23T08:54:54.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.503+0000 7fe14effd640 1 -- 172.21.15.46:0/2970847714 learned_addr learned my addr 172.21.15.46:0/2970847714 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:54.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.503+0000 7fe14f7fe640 1 --2- 172.21.15.46:0/2970847714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe13c004d10 0x7fe1501592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:54.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.503+0000 7fe14ffff640 1 --2- 172.21.15.46:0/2970847714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1501e4cb0 0x7fe1501483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:54.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.507+0000 7fe14effd640 1 -- 172.21.15.46:0/2970847714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe13c004d10 msgr2=0x7fe1501592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:54.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.507+0000 7fe14effd640 1 --2- 172.21.15.46:0/2970847714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe13c004d10 0x7fe1501592a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:54.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.507+0000 7fe14effd640 1 -- 172.21.15.46:0/2970847714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1501e4cb0 msgr2=0x7fe1501483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:54.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.507+0000 7fe14effd640 1 --2- 172.21.15.46:0/2970847714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1501e4cb0 0x7fe1501483a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:54.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.507+0000 7fe14effd640 1 -- 172.21.15.46:0/2970847714 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1501597e0 con 0x7fe1501e2280 2024-01-23T08:54:54.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.511+0000 7fe14effd640 1 --2- 172.21.15.46:0/2970847714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1501e2280 0x7fe15014f2b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe1380045e0 tx=0x7fe138003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:54.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.515+0000 7fe147fff640 1 -- 172.21.15.46:0/2970847714 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe138007cd0 con 0x7fe1501e2280 2024-01-23T08:54:54.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.515+0000 7fe147fff640 1 -- 172.21.15.46:0/2970847714 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe138007e30 con 0x7fe1501e2280 2024-01-23T08:54:54.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.515+0000 7fe147fff640 1 -- 172.21.15.46:0/2970847714 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe138015660 con 0x7fe1501e2280 2024-01-23T08:54:54.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.515+0000 7fe155ef0640 1 -- 172.21.15.46:0/2970847714 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe15014c3b0 con 0x7fe1501e2280 2024-01-23T08:54:54.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.515+0000 7fe155ef0640 1 -- 172.21.15.46:0/2970847714 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1501f28d0 con 0x7fe1501e2280 2024-01-23T08:54:54.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.515+0000 7fe155ef0640 1 -- 172.21.15.46:0/2970847714 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1501f2710 con 0x7fe1501e2280 2024-01-23T08:54:54.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.539+0000 7fe147fff640 1 -- 172.21.15.46:0/2970847714 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe1380157c0 con 0x7fe1501e2280 2024-01-23T08:54:54.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.539+0000 7fe147fff640 1 --2- 172.21.15.46:0/2970847714 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fe130066550 0x7fe130068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:54.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.539+0000 7fe14f7fe640 1 --2- 172.21.15.46:0/2970847714 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fe130066550 0x7fe130068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:54.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.539+0000 7fe14f7fe640 1 --2- 172.21.15.46:0/2970847714 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fe130066550 0x7fe130068a10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe140009be0 tx=0x7fe140009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:54.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.863+0000 7fe147fff640 1 -- 172.21.15.46:0/2970847714 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe138056ce0 con 0x7fe1501e2280 2024-01-23T08:54:54.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:54.863+0000 7fe147fff640 1 -- 172.21.15.46:0/2970847714 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe138052920 con 0x7fe1501e2280 2024-01-23T08:54:55.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.067+0000 7fe155ef0640 1 -- 172.21.15.46:0/2970847714 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe150074340 con 0x7fe1501e2280 2024-01-23T08:54:55.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.135+0000 7fe147fff640 1 -- 172.21.15.46:0/2970847714 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6517 (secure 0 0 0) 0x7fe138055f40 con 0x7fe1501e2280 2024-01-23T08:54:55.132 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:54:55.132 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4208,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/397511399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":397511399},{"type":"v1","addr":"172.21.15.175:6835","nonce":397511399}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1620040020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1620040020},{"type":"v1","addr":"172.21.15.46:6835","nonce":1620040020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2714415350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2714415350},{"type":"v1","addr":"172.21.15.175:6833","nonce":2714415350}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4234,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3103300888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3103300888},{"type":"v1","addr":"172.21.15.175:6837","nonce":3103300888}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/338965660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":338965660},{"type":"v1","addr":"172.21.15.46:6837","nonce":338965660}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-23T08:54:42.028655+0000","modified":"2024-01-23T08:54:50.479618+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4242},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4242":{"gid":4242,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":9,"addr":"172.21.15.46:6839/1889172114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1889172114},{"type":"v1","addr":"172.21.15.46:6839","nonce":1889172114}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-01-23T08:54:55.132 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 7 2024-01-23T08:54:55.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.135+0000 7fe155ef0640 1 -- 172.21.15.46:0/2970847714 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fe130066550 msgr2=0x7fe130068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:55.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.135+0000 7fe155ef0640 1 --2- 172.21.15.46:0/2970847714 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fe130066550 0x7fe130068a10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe140009be0 tx=0x7fe140009190 comp rx=0 tx=0).stop 2024-01-23T08:54:55.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.135+0000 7fe155ef0640 1 -- 172.21.15.46:0/2970847714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1501e2280 msgr2=0x7fe15014f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:55.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.135+0000 7fe155ef0640 1 --2- 172.21.15.46:0/2970847714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1501e2280 0x7fe15014f2b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe1380045e0 tx=0x7fe138003f70 comp rx=0 tx=0).stop 2024-01-23T08:54:55.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.135+0000 7fe155ef0640 1 -- 172.21.15.46:0/2970847714 shutdown_connections 2024-01-23T08:54:55.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.135+0000 7fe155ef0640 1 --2- 172.21.15.46:0/2970847714 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fe130066550 0x7fe130068a10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:55.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.135+0000 7fe155ef0640 1 --2- 172.21.15.46:0/2970847714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1501e4cb0 0x7fe1501483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:55.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.135+0000 7fe155ef0640 1 --2- 172.21.15.46:0/2970847714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1501e2280 0x7fe15014f2b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:55.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.135+0000 7fe155ef0640 1 --2- 172.21.15.46:0/2970847714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe13c004d10 0x7fe1501592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:55.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.135+0000 7fe155ef0640 1 -- 172.21.15.46:0/2970847714 >> 172.21.15.46:0/2970847714 conn(0x7fe15006d590 msgr2=0x7fe150149790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:55.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.139+0000 7fe155ef0640 1 -- 172.21.15.46:0/2970847714 shutdown_connections 2024-01-23T08:54:55.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.139+0000 7fe155ef0640 1 -- 172.21.15.46:0/2970847714 wait complete. 2024-01-23T08:54:55.157 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-23T08:54:55.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.279+0000 7f4672c05640 1 Processor -- start 2024-01-23T08:54:55.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.279+0000 7f4672c05640 1 -- start start 2024-01-23T08:54:55.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.279+0000 7f4672c05640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f466c151600 0x7f466c15b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:55.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.279+0000 7f4672c05640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f466c1519e0 0x7f466c0c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:55.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.279+0000 7f4672c05640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f466c158390 con 0x7f466c06f350 2024-01-23T08:54:55.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.279+0000 7f4672c05640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f466c15b0e0 con 0x7f466c1519e0 2024-01-23T08:54:55.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.279+0000 7f4672c05640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466c157b70 con 0x7f466c151600 2024-01-23T08:54:55.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.319+0000 7f466bfff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f466c1519e0 0x7f466c0c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:55.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.319+0000 7f466bfff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f466c1519e0 0x7f466c0c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:40120/0 (socket says 172.21.15.46:40120) 2024-01-23T08:54:55.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.319+0000 7f466bfff640 1 -- 172.21.15.46:0/933690107 learned_addr learned my addr 172.21.15.46:0/933690107 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:55.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.323+0000 7f46709a1640 1 --2- 172.21.15.46:0/933690107 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f466c151600 0x7f466c15b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:55.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.327+0000 7f466bfff640 1 -- 172.21.15.46:0/933690107 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f466c151600 msgr2=0x7f466c15b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:55.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.327+0000 7f466bfff640 1 --2- 172.21.15.46:0/933690107 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f466c151600 0x7f466c15b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:55.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.327+0000 7f466bfff640 1 -- 172.21.15.46:0/933690107 >> v1:172.21.15.175:6789/0 conn(0x7f466c06f350 legacy=0x7f466c157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:55.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.327+0000 7f466bfff640 1 -- 172.21.15.46:0/933690107 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466c157dd0 con 0x7f466c1519e0 2024-01-23T08:54:55.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.343+0000 7f466bfff640 1 --2- 172.21.15.46:0/933690107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f466c1519e0 0x7f466c0c7660 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4664009e50 tx=0x7f466401c9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=614dfa3987976d2d server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:55.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.355+0000 7f466b7fe640 1 -- 172.21.15.46:0/933690107 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46640a5740 con 0x7f466c1519e0 2024-01-23T08:54:55.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.355+0000 7f466b7fe640 1 -- 172.21.15.46:0/933690107 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46640a58a0 con 0x7f466c1519e0 2024-01-23T08:54:55.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.355+0000 7f466b7fe640 1 -- 172.21.15.46:0/933690107 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46640a5c30 con 0x7f466c1519e0 2024-01-23T08:54:55.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.355+0000 7f4672c05640 1 -- 172.21.15.46:0/933690107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f466c1519e0 msgr2=0x7f466c0c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:55.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.355+0000 7f4672c05640 1 --2- 172.21.15.46:0/933690107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f466c1519e0 0x7f466c0c7660 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4664009e50 tx=0x7f466401c9d0 comp rx=0 tx=0).stop 2024-01-23T08:54:55.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.355+0000 7f4672c05640 1 -- 172.21.15.46:0/933690107 shutdown_connections 2024-01-23T08:54:55.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.355+0000 7f4672c05640 1 --2- 172.21.15.46:0/933690107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f466c1519e0 0x7f466c0c7660 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:55.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.355+0000 7f4672c05640 1 --2- 172.21.15.46:0/933690107 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f466c151600 0x7f466c15b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:55.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.355+0000 7f4672c05640 1 -- 172.21.15.46:0/933690107 >> 172.21.15.46:0/933690107 conn(0x7f466c06d590 msgr2=0x7f466c066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:55.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.355+0000 7f4672c05640 1 -- 172.21.15.46:0/933690107 shutdown_connections 2024-01-23T08:54:55.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.355+0000 7f4672c05640 1 -- 172.21.15.46:0/933690107 wait complete. 2024-01-23T08:54:55.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.359+0000 7f4672c05640 1 Processor -- start 2024-01-23T08:54:55.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.359+0000 7f4672c05640 1 -- start start 2024-01-23T08:54:55.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.363+0000 7f4672c05640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f466c06f350 0x7f466c145230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:55.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.363+0000 7f4672c05640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f466c151600 0x7f466c14eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:55.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.363+0000 7f4672c05640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f466c0ca890 0x7f466c13f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:55.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.363+0000 7f4672c05640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c142210 con 0x7f466c0ca890 2024-01-23T08:54:55.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.363+0000 7f4672c05640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c14ff10 con 0x7f466c151600 2024-01-23T08:54:55.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.363+0000 7f4672c05640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466c1441b0 con 0x7f466c06f350 2024-01-23T08:54:55.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.363+0000 7f46711a2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f466c0ca890 0x7f466c13f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:55.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.367+0000 7f46711a2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f466c0ca890 0x7f466c13f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44870/0 (socket says 172.21.15.46:44870) 2024-01-23T08:54:55.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.367+0000 7f46711a2640 1 -- 172.21.15.46:0/1280798153 learned_addr learned my addr 172.21.15.46:0/1280798153 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:55.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.367+0000 7f466bfff640 1 --2- 172.21.15.46:0/1280798153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f466c151600 0x7f466c14eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:55.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.367+0000 7f46709a1640 1 --2- 172.21.15.46:0/1280798153 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f466c06f350 0x7f466c145230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:55.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.375+0000 7f46711a2640 1 -- 172.21.15.46:0/1280798153 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f466c06f350 msgr2=0x7f466c145230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:55.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.375+0000 7f46711a2640 1 --2- 172.21.15.46:0/1280798153 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f466c06f350 0x7f466c145230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:55.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.375+0000 7f46711a2640 1 -- 172.21.15.46:0/1280798153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f466c151600 msgr2=0x7f466c14eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:55.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.375+0000 7f46711a2640 1 --2- 172.21.15.46:0/1280798153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f466c151600 0x7f466c14eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:55.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.375+0000 7f46711a2640 1 -- 172.21.15.46:0/1280798153 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4664009b30 con 0x7f466c0ca890 2024-01-23T08:54:55.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.379+0000 7f46711a2640 1 --2- 172.21.15.46:0/1280798153 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f466c0ca890 0x7f466c13f550 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f465c00b410 tx=0x7f465c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:55.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.387+0000 7f46697fa640 1 -- 172.21.15.46:0/1280798153 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c011830 con 0x7f466c0ca890 2024-01-23T08:54:55.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.387+0000 7f46697fa640 1 -- 172.21.15.46:0/1280798153 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465c0119d0 con 0x7f466c0ca890 2024-01-23T08:54:55.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.387+0000 7f4672c05640 1 -- 172.21.15.46:0/1280798153 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f466c1501b0 con 0x7f466c0ca890 2024-01-23T08:54:55.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.387+0000 7f46697fa640 1 -- 172.21.15.46:0/1280798153 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c011d80 con 0x7f466c0ca890 2024-01-23T08:54:55.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.387+0000 7f4672c05640 1 -- 172.21.15.46:0/1280798153 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f466c143b70 con 0x7f466c0ca890 2024-01-23T08:54:55.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.391+0000 7f4672c05640 1 -- 172.21.15.46:0/1280798153 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f466c145770 con 0x7f466c0ca890 2024-01-23T08:54:55.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.843+0000 7f46697fa640 1 -- 172.21.15.46:0/1280798153 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f465c01a400 con 0x7f466c0ca890 2024-01-23T08:54:55.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.843+0000 7f46697fa640 1 --2- 172.21.15.46:0/1280798153 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f464c066580 0x7f464c068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:55.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.843+0000 7f46709a1640 1 --2- 172.21.15.46:0/1280798153 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f464c066580 0x7f464c068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:55.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.847+0000 7f46709a1640 1 --2- 172.21.15.46:0/1280798153 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f464c066580 0x7f464c068a40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4654009ac0 tx=0x7f4654009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:55.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.879+0000 7f46697fa640 1 -- 172.21.15.46:0/1280798153 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f465c0553b0 con 0x7f466c0ca890 2024-01-23T08:54:55.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:55.879+0000 7f46697fa640 1 -- 172.21.15.46:0/1280798153 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f465c0516f0 con 0x7f466c0ca890 2024-01-23T08:54:56.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:56.071+0000 7f4672c05640 1 -- 172.21.15.46:0/1280798153 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f466c071fa0 con 0x7f466c0ca890 2024-01-23T08:54:56.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:56.167+0000 7f46697fa640 1 -- 172.21.15.46:0/1280798153 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f465c054d10 con 0x7f466c0ca890 2024-01-23T08:54:56.164 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:54:56.164 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":28,"fsid":"fdbdd393-f422-45ae-a488-2bbb0163e580","created":"2024-01-23T08:53:36.942515+0000","modified":"2024-01-23T08:54:50.465916+0000","last_up_change":"2024-01-23T08:53:57.198113+0000","last_in_change":"2024-01-23T08:53:47.852614+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-23T08:53:59.340853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-23T08:54:38.278770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-23T08:54:40.216521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-23T08:54:47.311079+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f32c3d7d-e32a-42d8-b55f-db874d915a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6818","nonce":2681790976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6821","nonce":2681790976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6825","nonce":2681790976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6823","nonce":2681790976}]},"public_addr":"172.21.15.46:6818/2681790976","cluster_addr":"172.21.15.46:6821/2681790976","heartbeat_back_addr":"172.21.15.46:6825/2681790976","heartbeat_front_addr":"172.21.15.46:6823/2681790976","state":["exists","up"]},{"osd":1,"uuid":"6f3b6bd2-bbea-4d08-84d5-4407363b5eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6803","nonce":3679152623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6805","nonce":3679152623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6809","nonce":3679152623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6807","nonce":3679152623}]},"public_addr":"172.21.15.46:6803/3679152623","cluster_addr":"172.21.15.46:6805/3679152623","heartbeat_back_addr":"172.21.15.46:6809/3679152623","heartbeat_front_addr":"172.21.15.46:6807/3679152623","state":["exists","up"]},{"osd":2,"uuid":"8f110727-31e7-4f69-926b-c87481d4d28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6811","nonce":3869652274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6813","nonce":3869652274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6820","nonce":3869652274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6815","nonce":3869652274}]},"public_addr":"172.21.15.46:6811/3869652274","cluster_addr":"172.21.15.46:6813/3869652274","heartbeat_back_addr":"172.21.15.46:6820/3869652274","heartbeat_front_addr":"172.21.15.46:6815/3869652274","state":["exists","up"]},{"osd":3,"uuid":"3aa7527d-0463-4373-b9c7-e6b507a7987f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6827","nonce":4168860822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6829","nonce":4168860822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6833","nonce":4168860822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6831","nonce":4168860822}]},"public_addr":"172.21.15.46:6827/4168860822","cluster_addr":"172.21.15.46:6829/4168860822","heartbeat_back_addr":"172.21.15.46:6833/4168860822","heartbeat_front_addr":"172.21.15.46:6831/4168860822","state":["exists","up"]},{"osd":4,"uuid":"eb47a1e5-9f26-465f-b188-87c6eed63c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6805","nonce":3115257412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6808","nonce":3115257412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6815","nonce":3115257412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6812","nonce":3115257412}]},"public_addr":"172.21.15.175:6805/3115257412","cluster_addr":"172.21.15.175:6808/3115257412","heartbeat_back_addr":"172.21.15.175:6815/3115257412","heartbeat_front_addr":"172.21.15.175:6812/3115257412","state":["exists","up"]},{"osd":5,"uuid":"34048409-998c-44f3-a29d-dcad7a6c917b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6818","nonce":3146473948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6822","nonce":3146473948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6831","nonce":3146473948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6826","nonce":3146473948}]},"public_addr":"172.21.15.175:6818/3146473948","cluster_addr":"172.21.15.175:6822/3146473948","heartbeat_back_addr":"172.21.15.175:6831/3146473948","heartbeat_front_addr":"172.21.15.175:6826/3146473948","state":["exists","up"]},{"osd":6,"uuid":"f5d45d3f-9af3-44a1-a730-c260ed1654b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6801","nonce":4161180058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6804","nonce":4161180058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6814","nonce":4161180058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6809","nonce":4161180058}]},"public_addr":"172.21.15.175:6801/4161180058","cluster_addr":"172.21.15.175:6804/4161180058","heartbeat_back_addr":"172.21.15.175:6814/4161180058","heartbeat_front_addr":"172.21.15.175:6809/4161180058","state":["exists","up"]},{"osd":7,"uuid":"16d12e53-2ad3-4b5c-a789-22b45056fd9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6819","nonce":2670236415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6823","nonce":2670236415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6830","nonce":2670236415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6827","nonce":2670236415}]},"public_addr":"172.21.15.175:6819/2670236415","cluster_addr":"172.21.15.175:6823/2670236415","heartbeat_back_addr":"172.21.15.175:6830/2670236415","heartbeat_front_addr":"172.21.15.175:6827/2670236415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.847037+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.765547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.716122+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.874628+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.786580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.924885+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.285635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.898130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T08:54:56.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:56.171+0000 7f4672c05640 1 -- 172.21.15.46:0/1280798153 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f464c066580 msgr2=0x7f464c068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:56.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:56.171+0000 7f4672c05640 1 --2- 172.21.15.46:0/1280798153 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f464c066580 0x7f464c068a40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4654009ac0 tx=0x7f4654009190 comp rx=0 tx=0).stop 2024-01-23T08:54:56.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:56.171+0000 7f4672c05640 1 -- 172.21.15.46:0/1280798153 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f466c0ca890 msgr2=0x7f466c13f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:56.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:56.171+0000 7f4672c05640 1 --2- 172.21.15.46:0/1280798153 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f466c0ca890 0x7f466c13f550 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f465c00b410 tx=0x7f465c00b8d0 comp rx=0 tx=0).stop 2024-01-23T08:54:56.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:56.171+0000 7f4672c05640 1 -- 172.21.15.46:0/1280798153 shutdown_connections 2024-01-23T08:54:56.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:56.171+0000 7f4672c05640 1 --2- 172.21.15.46:0/1280798153 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f466c0ca890 0x7f466c13f550 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:56.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:56.171+0000 7f4672c05640 1 --2- 172.21.15.46:0/1280798153 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f464c066580 0x7f464c068a40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:56.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:56.171+0000 7f4672c05640 1 --2- 172.21.15.46:0/1280798153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f466c151600 0x7f466c14eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:56.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:56.171+0000 7f4672c05640 1 --2- 172.21.15.46:0/1280798153 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f466c06f350 0x7f466c145230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:56.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:56.171+0000 7f4672c05640 1 -- 172.21.15.46:0/1280798153 >> 172.21.15.46:0/1280798153 conn(0x7f466c06d590 msgr2=0x7f466c06e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:56.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:56.171+0000 7f4672c05640 1 -- 172.21.15.46:0/1280798153 shutdown_connections 2024-01-23T08:54:56.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:56.171+0000 7f4672c05640 1 -- 172.21.15.46:0/1280798153 wait complete. 2024-01-23T08:54:56.796 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-23T08:54:42.028655+0000', 'modified': '2024-01-23T08:54:50.479618+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4242}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4242': {'gid': 4242, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.46:6839/1889172114', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6838', 'nonce': 1889172114}, {'type': 'v1', 'addr': '172.21.15.46:6839', 'nonce': 1889172114}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-01-23T08:54:56.796 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-23T08:54:56.796 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-01-23T08:54:56.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:56.935+0000 7f33ce836640 1 Processor -- start 2024-01-23T08:54:56.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:56.935+0000 7f33ce836640 1 -- start start 2024-01-23T08:54:56.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:56.935+0000 7f33ce836640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f33c81536b0 0x7f33c80c7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:56.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:56.935+0000 7f33ce836640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c80c6a90 con 0x7f33c80c2bc0 2024-01-23T08:54:56.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:56.935+0000 7f33ce836640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c806e000 con 0x7f33c8153a90 2024-01-23T08:54:56.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:56.935+0000 7f33ce836640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c80c1330 con 0x7f33c81536b0 2024-01-23T08:54:56.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:56.947+0000 7f33c7fff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f33c81536b0 0x7f33c80c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:56.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:56.951+0000 7f33c77fe640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f33c8153a90 0x7f33c806ebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.46:53798/0 (socket says 172.21.15.46:53798) 2024-01-23T08:54:56.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:56.951+0000 7f33c77fe640 1 -- 172.21.15.46:0/266745253 learned_addr learned my addr 172.21.15.46:0/266745253 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:54:57.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.011+0000 7f33c6ffd640 1 -- 172.21.15.46:0/266745253 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3508209334 0 0) 0x7f33c80c6a90 con 0x7f33c80c2bc0 2024-01-23T08:54:57.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.011+0000 7f33c6ffd640 1 -- 172.21.15.46:0/266745253 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33b0003530 con 0x7f33c80c2bc0 2024-01-23T08:54:57.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.015+0000 7f33c6ffd640 1 -- 172.21.15.46:0/266745253 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1694241352 0 0) 0x7f33b0003530 con 0x7f33c80c2bc0 2024-01-23T08:54:57.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.015+0000 7f33c6ffd640 1 -- 172.21.15.46:0/266745253 >> v2:172.21.15.175:3300/0 conn(0x7f33c81536b0 msgr2=0x7f33c80c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:57.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.015+0000 7f33c6ffd640 1 --2- 172.21.15.46:0/266745253 >> v2:172.21.15.175:3300/0 conn(0x7f33c81536b0 0x7f33c80c7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.015+0000 7f33c6ffd640 1 -- 172.21.15.46:0/266745253 >> v1:172.21.15.175:6789/0 conn(0x7f33c8153a90 legacy=0x7f33c806ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:57.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.015+0000 7f33c6ffd640 1 -- 172.21.15.46:0/266745253 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c806e2e0 con 0x7f33c80c2bc0 2024-01-23T08:54:57.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.015+0000 7f33c6ffd640 1 -- 172.21.15.46:0/266745253 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466917103 0 0) 0x7f33c0001a00 con 0x7f33c80c2bc0 2024-01-23T08:54:57.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.015+0000 7f33c6ffd640 1 -- 172.21.15.46:0/266745253 >> v1:172.21.15.46:6789/0 conn(0x7f33c80c2bc0 legacy=0x7f33c80c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:57.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.015+0000 7f33c6ffd640 1 --2- 172.21.15.46:0/266745253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33b0003a40 0x7f33b0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:57.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.015+0000 7f33c6ffd640 1 --2- 172.21.15.46:0/266745253 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33b00047d0 0x7f33b0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:57.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.015+0000 7f33c6ffd640 1 --2- 172.21.15.46:0/266745253 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33b0005390 0x7f33b000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:57.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.015+0000 7f33c6ffd640 1 -- 172.21.15.46:0/266745253 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b000c230 con 0x7f33b0003a40 2024-01-23T08:54:57.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.015+0000 7f33c6ffd640 1 -- 172.21.15.46:0/266745253 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b000c3a0 con 0x7f33b00047d0 2024-01-23T08:54:57.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.015+0000 7f33c6ffd640 1 -- 172.21.15.46:0/266745253 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b000c560 con 0x7f33b0005390 2024-01-23T08:54:57.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.023+0000 7f33c7fff640 1 --2- 172.21.15.46:0/266745253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33b0003a40 0x7f33b0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:57.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.031+0000 7f33c7fff640 1 -- 172.21.15.46:0/266745253 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33b0005390 msgr2=0x7f33b000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:57.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.031+0000 7f33c7fff640 1 --2- 172.21.15.46:0/266745253 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33b0005390 0x7f33b000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.031+0000 7f33c7fff640 1 -- 172.21.15.46:0/266745253 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33b00047d0 msgr2=0x7f33b0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:57.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.031+0000 7f33c7fff640 1 --2- 172.21.15.46:0/266745253 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33b00047d0 0x7f33b0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.031+0000 7f33c7fff640 1 -- 172.21.15.46:0/266745253 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b0003530 con 0x7f33b0003a40 2024-01-23T08:54:57.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.031+0000 7f33ccdd3640 1 -- 172.21.15.46:0/266745253 reap_dead start 2024-01-23T08:54:57.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.035+0000 7f33c7fff640 1 --2- 172.21.15.46:0/266745253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33b0003a40 0x7f33b0003e60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f33bc00a990 tx=0x7f33bc01c570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4857183d7c2a33 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:57.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.047+0000 7f33c6ffd640 1 -- 172.21.15.46:0/266745253 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc0aa620 con 0x7f33b0003a40 2024-01-23T08:54:57.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.047+0000 7f33c6ffd640 1 -- 172.21.15.46:0/266745253 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33bc0aa780 con 0x7f33b0003a40 2024-01-23T08:54:57.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.047+0000 7f33c6ffd640 1 -- 172.21.15.46:0/266745253 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc0aab70 con 0x7f33b0003a40 2024-01-23T08:54:57.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.047+0000 7f33ce836640 1 -- 172.21.15.46:0/266745253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33b0003a40 msgr2=0x7f33b0003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:57.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.047+0000 7f33ce836640 1 --2- 172.21.15.46:0/266745253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33b0003a40 0x7f33b0003e60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f33bc00a990 tx=0x7f33bc01c570 comp rx=0 tx=0).stop 2024-01-23T08:54:57.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.047+0000 7f33ce836640 1 -- 172.21.15.46:0/266745253 shutdown_connections 2024-01-23T08:54:57.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.047+0000 7f33ce836640 1 --2- 172.21.15.46:0/266745253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33b0003a40 0x7f33b0003e60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.047+0000 7f33ce836640 1 -- 172.21.15.46:0/266745253 >> 172.21.15.46:0/266745253 conn(0x7f33c806b770 msgr2=0x7f33c806bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:57.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.047+0000 7f33ce836640 1 -- 172.21.15.46:0/266745253 shutdown_connections 2024-01-23T08:54:57.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.047+0000 7f33ce836640 1 -- 172.21.15.46:0/266745253 wait complete. 2024-01-23T08:54:57.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.051+0000 7f33ce836640 1 Processor -- start 2024-01-23T08:54:57.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.051+0000 7f33ce836640 1 -- start start 2024-01-23T08:54:57.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.055+0000 7f33ce836640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33b0003a40 0x7f33c813fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:57.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.055+0000 7f33ce836640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33c814d440 0x7f33c8153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:57.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.055+0000 7f33ce836640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33c81543c0 0x7f33c8147740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:57.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.055+0000 7f33ce836640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c8154da0 con 0x7f33c81543c0 2024-01-23T08:54:57.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.055+0000 7f33ce836640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c814f830 con 0x7f33b0003a40 2024-01-23T08:54:57.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.055+0000 7f33ce836640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c80cb530 con 0x7f33c814d440 2024-01-23T08:54:57.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.055+0000 7f33ccdd3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33c81543c0 0x7f33c8147740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:57.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.055+0000 7f33ccdd3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33c81543c0 0x7f33c8147740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44888/0 (socket says 172.21.15.46:44888) 2024-01-23T08:54:57.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.055+0000 7f33ccdd3640 1 -- 172.21.15.46:0/2322407653 learned_addr learned my addr 172.21.15.46:0/2322407653 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:57.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.055+0000 7f33c77fe640 1 --2- 172.21.15.46:0/2322407653 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33c814d440 0x7f33c8153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:57.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.063+0000 7f33ccdd3640 1 -- 172.21.15.46:0/2322407653 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33c814d440 msgr2=0x7f33c8153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:57.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.063+0000 7f33ccdd3640 1 --2- 172.21.15.46:0/2322407653 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33c814d440 0x7f33c8153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.063+0000 7f33ccdd3640 1 -- 172.21.15.46:0/2322407653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33b0003a40 msgr2=0x7f33c813fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:57.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.063+0000 7f33ccdd3640 1 --2- 172.21.15.46:0/2322407653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33b0003a40 0x7f33c813fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.063+0000 7f33ccdd3640 1 -- 172.21.15.46:0/2322407653 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c814e850 con 0x7f33c81543c0 2024-01-23T08:54:57.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.067+0000 7f33ccdd3640 1 --2- 172.21.15.46:0/2322407653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33c81543c0 0x7f33c8147740 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f33c80c98d0 tx=0x7f33c000fb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:57.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.075+0000 7f33c4ff9640 1 -- 172.21.15.46:0/2322407653 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c0007d60 con 0x7f33c81543c0 2024-01-23T08:54:57.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.075+0000 7f33c4ff9640 1 -- 172.21.15.46:0/2322407653 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c000fed0 con 0x7f33c81543c0 2024-01-23T08:54:57.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.075+0000 7f33ce836640 1 -- 172.21.15.46:0/2322407653 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c814eb30 con 0x7f33c81543c0 2024-01-23T08:54:57.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.075+0000 7f33c4ff9640 1 -- 172.21.15.46:0/2322407653 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c000d850 con 0x7f33c81543c0 2024-01-23T08:54:57.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.075+0000 7f33ce836640 1 -- 172.21.15.46:0/2322407653 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c814ee10 con 0x7f33c81543c0 2024-01-23T08:54:57.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.075+0000 7f33d1993000 1 Processor -- start 2024-01-23T08:54:57.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.075+0000 7f33d1993000 1 -- start start 2024-01-23T08:54:57.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.079+0000 7f33d1993000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f22e1f7730 0x55f22e1f7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:57.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.079+0000 7f33d1993000 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f22e2327d0 0x55f22e232bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:57.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.079+0000 7f33d1993000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f22e2330f0 0x55f22e23da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:57.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.079+0000 7f33d1993000 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f22e04dd70 con 0x55f22e2327d0 2024-01-23T08:54:57.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.079+0000 7f33d1993000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f22e049ba0 con 0x55f22e1f7730 2024-01-23T08:54:57.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.079+0000 7f33d1993000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f22e0470d0 con 0x55f22e2330f0 2024-01-23T08:54:57.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.079+0000 7f33c77fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f22e2330f0 0x55f22e23da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:57.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.079+0000 7f33c77fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f22e2330f0 0x55f22e23da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:42460/0 (socket says 172.21.15.46:42460) 2024-01-23T08:54:57.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.079+0000 7f33c77fe640 1 -- 172.21.15.46:0/2255982628 learned_addr learned my addr 172.21.15.46:0/2255982628 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:57.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.087+0000 7f33c77fe640 1 -- 172.21.15.46:0/2255982628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f22e1f7730 msgr2=0x55f22e1f7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:57.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.087+0000 7f33c77fe640 1 --2- 172.21.15.46:0/2255982628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f22e1f7730 0x55f22e1f7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.087+0000 7f33c77fe640 1 -- 172.21.15.46:0/2255982628 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f22e2327d0 msgr2=0x55f22e232bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:57.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.087+0000 7f33c77fe640 1 --2- 172.21.15.46:0/2255982628 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f22e2327d0 0x55f22e232bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.087+0000 7f33c77fe640 1 -- 172.21.15.46:0/2255982628 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f22dd39890 con 0x55f22e2330f0 2024-01-23T08:54:57.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.091+0000 7f33c77fe640 1 --2- 172.21.15.46:0/2255982628 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f22e2330f0 0x55f22e23da60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f33b8006ea0 tx=0x7f33b8006f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ed5d5e3f644333f server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:57.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.103+0000 7f33adffb640 1 -- 172.21.15.46:0/2255982628 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b80062d0 con 0x55f22e2330f0 2024-01-23T08:54:57.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.103+0000 7f33adffb640 1 -- 172.21.15.46:0/2255982628 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b8006450 con 0x55f22e2330f0 2024-01-23T08:54:57.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.103+0000 7f33adffb640 1 -- 172.21.15.46:0/2255982628 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b80047f0 con 0x55f22e2330f0 2024-01-23T08:54:57.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.103+0000 7f33d1993000 1 -- 172.21.15.46:0/2255982628 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f22e2330f0 msgr2=0x55f22e23da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:57.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.103+0000 7f33d1993000 1 --2- 172.21.15.46:0/2255982628 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f22e2330f0 0x55f22e23da60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f33b8006ea0 tx=0x7f33b8006f90 comp rx=0 tx=0).stop 2024-01-23T08:54:57.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.103+0000 7f33d1993000 1 -- 172.21.15.46:0/2255982628 shutdown_connections 2024-01-23T08:54:57.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.103+0000 7f33d1993000 1 --2- 172.21.15.46:0/2255982628 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f22e2330f0 0x55f22e23da60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.103+0000 7f33d1993000 1 --2- 172.21.15.46:0/2255982628 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f22e2327d0 0x55f22e232bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.103+0000 7f33d1993000 1 --2- 172.21.15.46:0/2255982628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f22e1f7730 0x55f22e1f7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.103+0000 7f33d1993000 1 -- 172.21.15.46:0/2255982628 >> 172.21.15.46:0/2255982628 conn(0x55f22e22e580 msgr2=0x55f22e230970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:57.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.103+0000 7f33d1993000 1 -- 172.21.15.46:0/2255982628 shutdown_connections 2024-01-23T08:54:57.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.103+0000 7f33d1993000 1 -- 172.21.15.46:0/2255982628 wait complete. 2024-01-23T08:54:57.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.103+0000 7f33d1993000 1 -- start start 2024-01-23T08:54:57.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.103+0000 7f33d1993000 1 Processor -- start 2024-01-23T08:54:57.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.103+0000 7f33d1993000 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f22e1f7730 0x55f22e22cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:57.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.103+0000 7f33d1993000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f22e2327d0 0x55f22e22d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:57.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.103+0000 7f33d1993000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f22e2330f0 0x55f22e239950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:57.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.103+0000 7f33d1993000 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f22e0429c0 con 0x55f22e1f7730 2024-01-23T08:54:57.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.103+0000 7f33d1993000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f22dffa040 con 0x55f22e2330f0 2024-01-23T08:54:57.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.103+0000 7f33d1993000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f22dfffee0 con 0x55f22e2327d0 2024-01-23T08:54:57.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.103+0000 7f33d1993000 10 client.0 _ll_register_callbacks cb 0x55f22dffd1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-23T08:54:57.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.107+0000 7f33c77fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f22e2330f0 0x55f22e239950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:57.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.107+0000 7f33c77fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f22e2330f0 0x55f22e239950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:40154/0 (socket says 172.21.15.46:40154) 2024-01-23T08:54:57.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.107+0000 7f33c77fe640 1 -- 172.21.15.46:0/4103119951 learned_addr learned my addr 172.21.15.46:0/4103119951 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:57.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.107+0000 7f33c7fff640 1 --2- 172.21.15.46:0/4103119951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f22e2327d0 0x55f22e22d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:57.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.115+0000 7f33c77fe640 1 -- 172.21.15.46:0/4103119951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f22e2327d0 msgr2=0x55f22e22d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:57.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.115+0000 7f33c77fe640 1 --2- 172.21.15.46:0/4103119951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f22e2327d0 0x55f22e22d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.115+0000 7f33c77fe640 1 -- 172.21.15.46:0/4103119951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f22e1f7730 msgr2=0x55f22e22cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:57.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.115+0000 7f33c77fe640 1 --2- 172.21.15.46:0/4103119951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f22e1f7730 0x55f22e22cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.115+0000 7f33c77fe640 1 -- 172.21.15.46:0/4103119951 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c806e000 con 0x55f22e2330f0 2024-01-23T08:54:57.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.119+0000 7f33c4ff9640 1 -- 172.21.15.46:0/2322407653 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f33c000d9b0 con 0x7f33c81543c0 2024-01-23T08:54:57.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.119+0000 7f33c4ff9640 1 --2- 172.21.15.46:0/2322407653 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f33b40664f0 0x7f33b40689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:57.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.119+0000 7f33c7fff640 1 --2- 172.21.15.46:0/2322407653 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f33b40664f0 0x7f33b40689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:57.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.119+0000 7f33c7fff640 1 --2- 172.21.15.46:0/2322407653 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f33b40664f0 0x7f33b40689b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f33bc0ae000 tx=0x7f33bc0b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:57.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.123+0000 7f33c77fe640 1 --2- 172.21.15.46:0/4103119951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f22e2330f0 0x55f22e239950 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f33b8018040 tx=0x7f33b8007dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d365c53a2f84a6 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:57.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.123+0000 7f33a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-01-23T08:54:57.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.123+0000 7f33c4ff9640 1 -- 172.21.15.46:0/2322407653 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f33c0058170 con 0x7f33c81543c0 2024-01-23T08:54:57.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.135+0000 7f33a6ffd640 1 -- 172.21.15.46:0/4103119951 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b80069c0 con 0x55f22e2330f0 2024-01-23T08:54:57.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.135+0000 7f33a6ffd640 1 -- 172.21.15.46:0/4103119951 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f33b8004d00 con 0x55f22e2330f0 2024-01-23T08:54:57.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.135+0000 7f33d1993000 1 -- 172.21.15.46:0/4103119951 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f22dfc8e30 con 0x55f22e2330f0 2024-01-23T08:54:57.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.283+0000 7f33a6ffd640 1 -- 172.21.15.46:0/4103119951 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33b8001650 con 0x55f22e2330f0 2024-01-23T08:54:57.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.283+0000 7f33d1993000 10 client.4321 fetch_fsmap learned FSMap version 7 2024-01-23T08:54:57.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.283+0000 7f33d1993000 1 -- 172.21.15.46:0/4103119951 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55f22e0025e0 con 0x55f22e2330f0 2024-01-23T08:54:57.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.291+0000 7f33a6ffd640 1 -- 172.21.15.46:0/4103119951 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f22dfc8e30 con 0x55f22e2330f0 2024-01-23T08:54:57.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.291+0000 7f33a6ffd640 1 -- 172.21.15.46:0/4103119951 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 7) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f33b80017b0 con 0x55f22e2330f0 2024-01-23T08:54:57.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.295+0000 7f33d1993000 10 client.4321 fetch_fsmap finished waiting for FSMap version 7 2024-01-23T08:54:57.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.295+0000 7f33d1993000 10 client.4321 resolve_mds: resolved name 'e' to daemon mds.e 2024-01-23T08:54:57.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.295+0000 7f33d1993000 20 client.4321 populate_metadata read hostname 'smithi046' 2024-01-23T08:54:57.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.295+0000 7f33d1993000 1 --2- 172.21.15.46:0/4103119951 >> [v2:172.21.15.46:6838/1889172114,v1:172.21.15.46:6839/1889172114] conn(0x55f22e23a690 0x55f22e23aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:57.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.295+0000 7f33d1993000 4 client.4321 mds_command: new command op to 4242 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:54:57.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.295+0000 7f33d1993000 1 -- 172.21.15.46:0/4103119951 --> [v2:172.21.15.46:6838/1889172114,v1:172.21.15.46:6839/1889172114] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f22dfff870 con 0x55f22e23a690 2024-01-23T08:54:57.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.319+0000 7f33c77fe640 1 --2- 172.21.15.46:0/4103119951 >> [v2:172.21.15.46:6838/1889172114,v1:172.21.15.46:6839/1889172114] conn(0x55f22e23a690 0x55f22e23aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:57.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.471+0000 7f33c77fe640 1 --2- 172.21.15.46:0/4103119951 >> [v2:172.21.15.46:6838/1889172114,v1:172.21.15.46:6839/1889172114] conn(0x55f22e23a690 0x55f22e23aa70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a6bacdf3c98c10c server_cookie=d1597b36cdee2a21 in_seq=0 out_seq=0 2024-01-23T08:54:57.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.471+0000 7f33a6ffd640 10 client.4321 ms_handle_connect on v2:172.21.15.46:6838/1889172114 2024-01-23T08:54:57.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.707+0000 7f33a6ffd640 1 -- 172.21.15.46:0/4103119951 <== mds.0 v2:172.21.15.46:6838/1889172114 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f22dfff870 con 0x55f22e23a690 2024-01-23T08:54:57.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.707+0000 7f33a6ffd640 10 client.4321 handle_command_reply: tid=0 2024-01-23T08:54:57.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.707+0000 7f33d1993000 1 client.4321 shutdown 2024-01-23T08:54:57.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.707+0000 7f33d1993000 1 -- 172.21.15.46:0/4103119951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f22e2330f0 msgr2=0x55f22e239950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:57.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.707+0000 7f33d1993000 1 --2- 172.21.15.46:0/4103119951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f22e2330f0 0x55f22e239950 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f33b8018040 tx=0x7f33b8007dd0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.707+0000 7f33d1993000 1 -- 172.21.15.46:0/4103119951 shutdown_connections 2024-01-23T08:54:57.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.707+0000 7f33d1993000 1 --2- 172.21.15.46:0/4103119951 >> [v2:172.21.15.46:6838/1889172114,v1:172.21.15.46:6839/1889172114] conn(0x55f22e23a690 0x55f22e23aa70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.707+0000 7f33d1993000 1 --2- 172.21.15.46:0/4103119951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f22e2330f0 0x55f22e239950 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.707+0000 7f33d1993000 1 --2- 172.21.15.46:0/4103119951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f22e2327d0 0x55f22e22d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.707+0000 7f33d1993000 1 --2- 172.21.15.46:0/4103119951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f22e1f7730 0x55f22e22cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.707+0000 7f33a6ffd640 0 client.4321 ms_handle_reset on v2:172.21.15.46:6838/1889172114 2024-01-23T08:54:57.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.707+0000 7f33d1993000 1 -- 172.21.15.46:0/4103119951 >> 172.21.15.46:0/4103119951 conn(0x55f22e22e580 msgr2=0x55f22e22dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:57.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.707+0000 7f33d1993000 1 -- 172.21.15.46:0/4103119951 shutdown_connections 2024-01-23T08:54:57.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.707+0000 7f33d1993000 1 -- 172.21.15.46:0/4103119951 wait complete. 2024-01-23T08:54:57.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.707+0000 7f33d1993000 20 client.4321 trim_cache size 0 max 16384 2024-01-23T08:54:57.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.735+0000 7f33d1993000 1 Processor -- start 2024-01-23T08:54:57.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.739+0000 7f33d1993000 1 -- start start 2024-01-23T08:54:57.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.739+0000 7f33d1993000 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f22e1f7730 0x55f22e231da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:57.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.739+0000 7f33d1993000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f22e2327d0 0x55f22e2451f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:57.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.739+0000 7f33d1993000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f22e2330f0 0x55f22e245730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:57.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.739+0000 7f33d1993000 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f22dcfa940 con 0x55f22e1f7730 2024-01-23T08:54:57.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.739+0000 7f33d1993000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f22e039a40 con 0x55f22e2330f0 2024-01-23T08:54:57.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.739+0000 7f33d1993000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f22e0401d0 con 0x55f22e2327d0 2024-01-23T08:54:57.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.739+0000 7f33c7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f22e1f7730 0x55f22e231da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:57.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.739+0000 7f33ccdd3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f22e2330f0 0x55f22e245730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:57.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.739+0000 7f33c7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f22e1f7730 0x55f22e231da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44910/0 (socket says 172.21.15.46:44910) 2024-01-23T08:54:57.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.739+0000 7f33c7fff640 1 -- 172.21.15.46:0/3249057048 learned_addr learned my addr 172.21.15.46:0/3249057048 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:57.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.743+0000 7f33c77fe640 1 --2- 172.21.15.46:0/3249057048 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f22e2327d0 0x55f22e2451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:57.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.747+0000 7f33c7fff640 1 -- 172.21.15.46:0/3249057048 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f22e2327d0 msgr2=0x55f22e2451f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:57.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.747+0000 7f33c7fff640 1 --2- 172.21.15.46:0/3249057048 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f22e2327d0 0x55f22e2451f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.747+0000 7f33c7fff640 1 -- 172.21.15.46:0/3249057048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f22e2330f0 msgr2=0x55f22e245730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:57.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.747+0000 7f33c7fff640 1 --2- 172.21.15.46:0/3249057048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f22e2330f0 0x55f22e245730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.747+0000 7f33c7fff640 1 -- 172.21.15.46:0/3249057048 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f22dfe88e0 con 0x55f22e1f7730 2024-01-23T08:54:57.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.747+0000 7f33c7fff640 1 --2- 172.21.15.46:0/3249057048 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f22e1f7730 0x55f22e231da0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f33bc00a7e0 tx=0x7f33bc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8634e8335e1f8cf2 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:57.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.755+0000 7f33ad7fa640 1 -- 172.21.15.46:0/3249057048 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc0c3070 con 0x55f22e1f7730 2024-01-23T08:54:57.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.755+0000 7f33ad7fa640 1 -- 172.21.15.46:0/3249057048 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33bc0be860 con 0x55f22e1f7730 2024-01-23T08:54:57.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.755+0000 7f33ad7fa640 1 -- 172.21.15.46:0/3249057048 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc0bebd0 con 0x55f22e1f7730 2024-01-23T08:54:57.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.755+0000 7f33d1993000 1 -- 172.21.15.46:0/3249057048 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f22e1f7730 msgr2=0x55f22e231da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:57.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.755+0000 7f33d1993000 1 --2- 172.21.15.46:0/3249057048 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f22e1f7730 0x55f22e231da0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f33bc00a7e0 tx=0x7f33bc004740 comp rx=0 tx=0).stop 2024-01-23T08:54:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.755+0000 7f33d1993000 1 -- 172.21.15.46:0/3249057048 shutdown_connections 2024-01-23T08:54:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.755+0000 7f33d1993000 1 --2- 172.21.15.46:0/3249057048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f22e2330f0 0x55f22e245730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.755+0000 7f33d1993000 1 --2- 172.21.15.46:0/3249057048 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f22e2327d0 0x55f22e2451f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.755+0000 7f33d1993000 1 --2- 172.21.15.46:0/3249057048 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f22e1f7730 0x55f22e231da0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.755+0000 7f33d1993000 1 -- 172.21.15.46:0/3249057048 >> 172.21.15.46:0/3249057048 conn(0x55f22e22e580 msgr2=0x55f22e23c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.755+0000 7f33d1993000 1 -- 172.21.15.46:0/3249057048 shutdown_connections 2024-01-23T08:54:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.755+0000 7f33d1993000 1 -- 172.21.15.46:0/3249057048 wait complete. 2024-01-23T08:54:57.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.755+0000 7f33d1993000 1 -- start start 2024-01-23T08:54:57.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.755+0000 7f33d1993000 1 Processor -- start 2024-01-23T08:54:57.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.755+0000 7f33d1993000 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f22e1f7730 0x55f22e298060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:57.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.755+0000 7f33d1993000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f22e2327d0 0x55f22e2985a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:57.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.755+0000 7f33d1993000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f22e2330f0 0x55f22e1f55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:57.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.755+0000 7f33d1993000 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f22e03e330 con 0x55f22e1f7730 2024-01-23T08:54:57.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.755+0000 7f33d1993000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f22dfdccf0 con 0x55f22e2327d0 2024-01-23T08:54:57.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.755+0000 7f33d1993000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f22e009eb0 con 0x55f22e2330f0 2024-01-23T08:54:57.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.755+0000 7f33d1993000 10 client.0 _ll_register_callbacks cb 0x55f22e06fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-23T08:54:57.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.759+0000 7f33c7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f22e1f7730 0x55f22e298060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:57.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.759+0000 7f33c7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f22e1f7730 0x55f22e298060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44922/0 (socket says 172.21.15.46:44922) 2024-01-23T08:54:57.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.759+0000 7f33c7fff640 1 -- 172.21.15.46:0/2684362528 learned_addr learned my addr 172.21.15.46:0/2684362528 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:57.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.759+0000 7f33ccdd3640 1 --2- 172.21.15.46:0/2684362528 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f22e2330f0 0x55f22e1f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:57.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.759+0000 7f33c77fe640 1 --2- 172.21.15.46:0/2684362528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f22e2327d0 0x55f22e2985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:57.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.763+0000 7f33c7fff640 1 -- 172.21.15.46:0/2684362528 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f22e2330f0 msgr2=0x55f22e1f55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:57.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.763+0000 7f33c7fff640 1 --2- 172.21.15.46:0/2684362528 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f22e2330f0 0x55f22e1f55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.763+0000 7f33c7fff640 1 -- 172.21.15.46:0/2684362528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f22e2327d0 msgr2=0x55f22e2985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:57.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.763+0000 7f33c7fff640 1 --2- 172.21.15.46:0/2684362528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f22e2327d0 0x55f22e2985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.763+0000 7f33c7fff640 1 -- 172.21.15.46:0/2684362528 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b0003530 con 0x55f22e1f7730 2024-01-23T08:54:57.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.763+0000 7f33c7fff640 1 --2- 172.21.15.46:0/2684362528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f22e1f7730 0x55f22e298060 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f33bc00a120 tx=0x7f33bc019310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebbd9637a8af967d server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:57.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.763+0000 7f33a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-01-23T08:54:57.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.767+0000 7f33a6ffd640 1 -- 172.21.15.46:0/2684362528 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc0c3070 con 0x55f22e1f7730 2024-01-23T08:54:57.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.767+0000 7f33a6ffd640 1 -- 172.21.15.46:0/2684362528 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f33bc0b8070 con 0x55f22e1f7730 2024-01-23T08:54:57.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.767+0000 7f33d1993000 1 -- 172.21.15.46:0/2684362528 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f22dff44f0 con 0x55f22e1f7730 2024-01-23T08:54:57.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.771+0000 7f33a6ffd640 1 -- 172.21.15.46:0/2684362528 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33bc0beb90 con 0x55f22e1f7730 2024-01-23T08:54:57.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.771+0000 7f33d1993000 10 client.4353 fetch_fsmap learned FSMap version 7 2024-01-23T08:54:57.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.771+0000 7f33d1993000 1 -- 172.21.15.46:0/2684362528 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55f22dd39cc0 con 0x55f22e1f7730 2024-01-23T08:54:57.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.775+0000 7f33a6ffd640 1 -- 172.21.15.46:0/2684362528 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f22dff44f0 con 0x55f22e1f7730 2024-01-23T08:54:57.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.775+0000 7f33a6ffd640 1 -- 172.21.15.46:0/2684362528 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 7) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f33bc0d0030 con 0x55f22e1f7730 2024-01-23T08:54:57.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.775+0000 7f33d1993000 10 client.4353 fetch_fsmap finished waiting for FSMap version 7 2024-01-23T08:54:57.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.775+0000 7f33d1993000 10 client.4353 resolve_mds: resolved name 'e' to daemon mds.e 2024-01-23T08:54:57.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.775+0000 7f33d1993000 20 client.4353 populate_metadata read hostname 'smithi046' 2024-01-23T08:54:57.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.775+0000 7f33d1993000 1 --2- 172.21.15.46:0/2684362528 >> [v2:172.21.15.46:6838/1889172114,v1:172.21.15.46:6839/1889172114] conn(0x55f22e1f5f70 0x55f22e1f6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:57.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.779+0000 7f33d1993000 4 client.4353 mds_command: new command op to 4242 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-23T08:54:57.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.779+0000 7f33d1993000 1 -- 172.21.15.46:0/2684362528 --> [v2:172.21.15.46:6838/1889172114,v1:172.21.15.46:6839/1889172114] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f22e041310 con 0x55f22e1f5f70 2024-01-23T08:54:57.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.779+0000 7f33c77fe640 1 --2- 172.21.15.46:0/2684362528 >> [v2:172.21.15.46:6838/1889172114,v1:172.21.15.46:6839/1889172114] conn(0x55f22e1f5f70 0x55f22e1f6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:57.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.779+0000 7f33a6ffd640 10 client.4353 ms_handle_connect on v2:172.21.15.46:6838/1889172114 2024-01-23T08:54:57.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.779+0000 7f33c77fe640 1 --2- 172.21.15.46:0/2684362528 >> [v2:172.21.15.46:6838/1889172114,v1:172.21.15.46:6839/1889172114] conn(0x55f22e1f5f70 0x55f22e1f6350 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=754aa5fd9a867455 server_cookie=bc8d524ed1fb066f in_seq=0 out_seq=0 2024-01-23T08:54:57.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.803+0000 7f33a6ffd640 1 -- 172.21.15.46:0/2684362528 <== mds.0 v2:172.21.15.46:6838/1889172114 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55f22e041310 con 0x55f22e1f5f70 2024-01-23T08:54:57.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.803+0000 7f33a6ffd640 10 client.4353 handle_command_reply: tid=0 2024-01-23T08:54:57.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.803+0000 7f33d1993000 1 client.4353 shutdown 2024-01-23T08:54:57.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.803+0000 7f33d1993000 1 -- 172.21.15.46:0/2684362528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f22e1f7730 msgr2=0x55f22e298060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:57.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.803+0000 7f33d1993000 1 --2- 172.21.15.46:0/2684362528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f22e1f7730 0x55f22e298060 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f33bc00a120 tx=0x7f33bc019310 comp rx=0 tx=0).stop 2024-01-23T08:54:57.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.803+0000 7f33d1993000 1 -- 172.21.15.46:0/2684362528 shutdown_connections 2024-01-23T08:54:57.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.803+0000 7f33d1993000 1 --2- 172.21.15.46:0/2684362528 >> [v2:172.21.15.46:6838/1889172114,v1:172.21.15.46:6839/1889172114] conn(0x55f22e1f5f70 0x55f22e1f6350 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.803+0000 7f33d1993000 1 --2- 172.21.15.46:0/2684362528 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f22e2330f0 0x55f22e1f55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.803+0000 7f33d1993000 1 --2- 172.21.15.46:0/2684362528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f22e2327d0 0x55f22e2985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.803+0000 7f33d1993000 1 --2- 172.21.15.46:0/2684362528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f22e1f7730 0x55f22e298060 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.803+0000 7f33a6ffd640 0 client.4353 ms_handle_reset on v2:172.21.15.46:6838/1889172114 2024-01-23T08:54:57.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.803+0000 7f33d1993000 1 -- 172.21.15.46:0/2684362528 >> 172.21.15.46:0/2684362528 conn(0x55f22e22e580 msgr2=0x55f22e23b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:57.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.803+0000 7f33d1993000 1 -- 172.21.15.46:0/2684362528 shutdown_connections 2024-01-23T08:54:57.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.803+0000 7f33d1993000 1 -- 172.21.15.46:0/2684362528 wait complete. 2024-01-23T08:54:57.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.803+0000 7f33d1993000 20 client.4353 trim_cache size 0 max 16384 2024-01-23T08:54:57.804 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-23T08:54:57.804 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "fdbdd393-f422-45ae-a488-2bbb0163e580", 2024-01-23T08:54:57.804 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2024-01-23T08:54:57.804 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4242, 2024-01-23T08:54:57.804 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-01-23T08:54:57.804 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-01-23T08:54:57.804 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-01-23T08:54:57.804 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 14.199536633999999, 2024-01-23T08:54:57.804 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 7, 2024-01-23T08:54:57.804 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 28, 2024-01-23T08:54:57.805 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 28, 2024-01-23T08:54:57.805 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 48.221065496000001 2024-01-23T08:54:57.805 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-23T08:54:57.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.807+0000 7f33ce836640 1 -- 172.21.15.46:0/2322407653 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f33b40664f0 msgr2=0x7f33b40689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:57.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.807+0000 7f33ce836640 1 --2- 172.21.15.46:0/2322407653 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f33b40664f0 0x7f33b40689b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f33bc0ae000 tx=0x7f33bc0b5040 comp rx=0 tx=0).stop 2024-01-23T08:54:57.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.807+0000 7f33ce836640 1 -- 172.21.15.46:0/2322407653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33c81543c0 msgr2=0x7f33c8147740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:57.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.807+0000 7f33ce836640 1 --2- 172.21.15.46:0/2322407653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33c81543c0 0x7f33c8147740 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f33c80c98d0 tx=0x7f33c000fb90 comp rx=0 tx=0).stop 2024-01-23T08:54:57.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.807+0000 7f33ce836640 1 -- 172.21.15.46:0/2322407653 shutdown_connections 2024-01-23T08:54:57.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.807+0000 7f33ce836640 1 --2- 172.21.15.46:0/2322407653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33c81543c0 0x7f33c8147740 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.807+0000 7f33ce836640 1 --2- 172.21.15.46:0/2322407653 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33c814d440 0x7f33c8153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.807+0000 7f33ce836640 1 --2- 172.21.15.46:0/2322407653 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f33b40664f0 0x7f33b40689b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.807+0000 7f33ce836640 1 --2- 172.21.15.46:0/2322407653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33b0003a40 0x7f33c813fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.807+0000 7f33ce836640 1 -- 172.21.15.46:0/2322407653 >> 172.21.15.46:0/2322407653 conn(0x7f33c806b770 msgr2=0x7f33c814fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:57.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.807+0000 7f33ce836640 1 -- 172.21.15.46:0/2322407653 shutdown_connections 2024-01-23T08:54:57.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.807+0000 7f33ce836640 1 -- 172.21.15.46:0/2322407653 wait complete. 2024-01-23T08:54:57.823 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-23T08:54:57.823 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-01-23T08:54:57.823 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-23T08:54:57.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.951+0000 7f60a7c13640 1 Processor -- start 2024-01-23T08:54:57.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.951+0000 7f60a7c13640 1 -- start start 2024-01-23T08:54:57.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.951+0000 7f60a7c13640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60a006fe10 0x7f60a00c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:57.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.951+0000 7f60a7c13640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f60a00c8b00 0x7f60a0164060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:57.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.951+0000 7f60a7c13640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a015d3e0 con 0x7f60a01539b0 2024-01-23T08:54:57.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.951+0000 7f60a7c13640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a00c6430 con 0x7f60a00c8b00 2024-01-23T08:54:57.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.951+0000 7f60a7c13640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a00cc4c0 con 0x7f60a006fe10 2024-01-23T08:54:57.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.951+0000 7f60a51ae640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60a006fe10 0x7f60a00c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:57.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.955+0000 7f60a51ae640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60a006fe10 0x7f60a00c85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:42506/0 (socket says 172.21.15.46:42506) 2024-01-23T08:54:57.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.955+0000 7f60a51ae640 1 -- 172.21.15.46:0/2106593361 learned_addr learned my addr 172.21.15.46:0/2106593361 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:57.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.959+0000 7f60a51ae640 1 -- 172.21.15.46:0/2106593361 >> v2:172.21.15.46:3300/0 conn(0x7f60a00c8b00 msgr2=0x7f60a0164060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:57.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.959+0000 7f60a51ae640 1 --2- 172.21.15.46:0/2106593361 >> v2:172.21.15.46:3300/0 conn(0x7f60a00c8b00 0x7f60a0164060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:57.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.959+0000 7f60a51ae640 1 -- 172.21.15.46:0/2106593361 >> v1:172.21.15.46:6789/0 conn(0x7f60a01539b0 legacy=0x7f60a015ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:54:57.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.959+0000 7f60a51ae640 1 -- 172.21.15.46:0/2106593361 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a0070230 con 0x7f60a006fe10 2024-01-23T08:54:57.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:57.979+0000 7f60a51ae640 1 --2- 172.21.15.46:0/2106593361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60a006fe10 0x7f60a00c85c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f609c009870 tx=0x7f609c01ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b732f1c486743968 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:58.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.071+0000 7f60a49ad640 1 -- 172.21.15.46:0/2106593361 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c0a89b0 con 0x7f60a006fe10 2024-01-23T08:54:58.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.071+0000 7f60a49ad640 1 -- 172.21.15.46:0/2106593361 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609c0a8b10 con 0x7f60a006fe10 2024-01-23T08:54:58.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.071+0000 7f60a49ad640 1 -- 172.21.15.46:0/2106593361 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c0a8ea0 con 0x7f60a006fe10 2024-01-23T08:54:58.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.071+0000 7f60a7c13640 1 -- 172.21.15.46:0/2106593361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60a006fe10 msgr2=0x7f60a00c85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:58.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.071+0000 7f60a7c13640 1 --2- 172.21.15.46:0/2106593361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60a006fe10 0x7f60a00c85c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f609c009870 tx=0x7f609c01ecf0 comp rx=0 tx=0).stop 2024-01-23T08:54:58.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.071+0000 7f60a7c13640 1 -- 172.21.15.46:0/2106593361 shutdown_connections 2024-01-23T08:54:58.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.071+0000 7f60a7c13640 1 --2- 172.21.15.46:0/2106593361 >> v2:172.21.15.46:3300/0 conn(0x7f60a00c8b00 0x7f60a0164060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:58.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.071+0000 7f60a7c13640 1 --2- 172.21.15.46:0/2106593361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60a006fe10 0x7f60a00c85c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:58.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.071+0000 7f60a7c13640 1 -- 172.21.15.46:0/2106593361 >> 172.21.15.46:0/2106593361 conn(0x7f60a006b770 msgr2=0x7f60a006bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:58.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.071+0000 7f60a7c13640 1 -- 172.21.15.46:0/2106593361 shutdown_connections 2024-01-23T08:54:58.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.071+0000 7f60a7c13640 1 -- 172.21.15.46:0/2106593361 wait complete. 2024-01-23T08:54:58.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.071+0000 7f60a7c13640 1 Processor -- start 2024-01-23T08:54:58.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.075+0000 7f60a7c13640 1 -- start start 2024-01-23T08:54:58.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.075+0000 7f60a7c13640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60a006fe10 0x7f60a014e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:58.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.075+0000 7f60a7c13640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60a00c8b00 0x7f60a0155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:58.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.075+0000 7f60a7c13640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60a01539b0 0x7f60a0155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:58.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.075+0000 7f60a7c13640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a01545c0 con 0x7f60a006fe10 2024-01-23T08:54:58.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.075+0000 7f60a7c13640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a0158d80 con 0x7f60a01539b0 2024-01-23T08:54:58.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.075+0000 7f60a7c13640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a01550c0 con 0x7f60a00c8b00 2024-01-23T08:54:58.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.075+0000 7f60a59af640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60a006fe10 0x7f60a014e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:58.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.075+0000 7f60a59af640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60a006fe10 0x7f60a014e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44940/0 (socket says 172.21.15.46:44940) 2024-01-23T08:54:58.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.075+0000 7f60a59af640 1 -- 172.21.15.46:0/3733810515 learned_addr learned my addr 172.21.15.46:0/3733810515 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:54:58.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.075+0000 7f60a61b0640 1 --2- 172.21.15.46:0/3733810515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60a01539b0 0x7f60a0155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:58.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.079+0000 7f60a59af640 1 -- 172.21.15.46:0/3733810515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60a00c8b00 msgr2=0x7f60a0155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:58.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.079+0000 7f60a59af640 1 --2- 172.21.15.46:0/3733810515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60a00c8b00 0x7f60a0155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:58.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.079+0000 7f60a59af640 1 -- 172.21.15.46:0/3733810515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60a01539b0 msgr2=0x7f60a0155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:58.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.079+0000 7f60a59af640 1 --2- 172.21.15.46:0/3733810515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60a01539b0 0x7f60a0155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:58.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.079+0000 7f60a59af640 1 -- 172.21.15.46:0/3733810515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609c0094d0 con 0x7f60a006fe10 2024-01-23T08:54:58.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.083+0000 7f60a59af640 1 --2- 172.21.15.46:0/3733810515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60a006fe10 0x7f60a014e4a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f609000c480 tx=0x7f609000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:58.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.087+0000 7f60967fc640 1 -- 172.21.15.46:0/3733810515 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6090012830 con 0x7f60a006fe10 2024-01-23T08:54:58.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.087+0000 7f60967fc640 1 -- 172.21.15.46:0/3733810515 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60900129b0 con 0x7f60a006fe10 2024-01-23T08:54:58.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.087+0000 7f60967fc640 1 -- 172.21.15.46:0/3733810515 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6090012d60 con 0x7f60a006fe10 2024-01-23T08:54:58.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.087+0000 7f60a7c13640 1 -- 172.21.15.46:0/3733810515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a0157590 con 0x7f60a006fe10 2024-01-23T08:54:58.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.087+0000 7f60a7c13640 1 -- 172.21.15.46:0/3733810515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a01587c0 con 0x7f60a006fe10 2024-01-23T08:54:58.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.087+0000 7f60a7c13640 1 -- 172.21.15.46:0/3733810515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a0074340 con 0x7f60a006fe10 2024-01-23T08:54:58.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.383+0000 7f60967fc640 1 -- 172.21.15.46:0/3733810515 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f609001c460 con 0x7f60a006fe10 2024-01-23T08:54:58.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.383+0000 7f60967fc640 1 --2- 172.21.15.46:0/3733810515 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6084066550 0x7f6084068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:54:58.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.387+0000 7f60a51ae640 1 --2- 172.21.15.46:0/3733810515 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6084066550 0x7f6084068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:54:58.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.387+0000 7f60a51ae640 1 --2- 172.21.15.46:0/3733810515 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6084066550 0x7f6084068a10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f609c0b2000 tx=0x7f609c004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:54:58.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.423+0000 7f60967fc640 1 -- 172.21.15.46:0/3733810515 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6090055ea0 con 0x7f60a006fe10 2024-01-23T08:54:58.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.423+0000 7f60967fc640 1 -- 172.21.15.46:0/3733810515 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6090051ae0 con 0x7f60a006fe10 2024-01-23T08:54:58.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.639+0000 7f60a7c13640 1 -- 172.21.15.46:0/3733810515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f60a0154e70 con 0x7f60a006fe10 2024-01-23T08:54:58.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.659+0000 7f60967fc640 1 -- 172.21.15.46:0/3733810515 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f6090055100 con 0x7f60a006fe10 2024-01-23T08:54:58.659 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-23T08:54:58.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.663+0000 7f60a7c13640 1 -- 172.21.15.46:0/3733810515 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6084066550 msgr2=0x7f6084068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:58.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.663+0000 7f60a7c13640 1 --2- 172.21.15.46:0/3733810515 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6084066550 0x7f6084068a10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f609c0b2000 tx=0x7f609c004740 comp rx=0 tx=0).stop 2024-01-23T08:54:58.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.663+0000 7f60a7c13640 1 -- 172.21.15.46:0/3733810515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60a006fe10 msgr2=0x7f60a014e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:54:58.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.663+0000 7f60a7c13640 1 --2- 172.21.15.46:0/3733810515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60a006fe10 0x7f60a014e4a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f609000c480 tx=0x7f609000c940 comp rx=0 tx=0).stop 2024-01-23T08:54:58.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.663+0000 7f60a7c13640 1 -- 172.21.15.46:0/3733810515 shutdown_connections 2024-01-23T08:54:58.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.663+0000 7f60a7c13640 1 --2- 172.21.15.46:0/3733810515 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6084066550 0x7f6084068a10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:58.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.663+0000 7f60a7c13640 1 --2- 172.21.15.46:0/3733810515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60a01539b0 0x7f60a0155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:58.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.663+0000 7f60a7c13640 1 --2- 172.21.15.46:0/3733810515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60a00c8b00 0x7f60a0155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:58.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.663+0000 7f60a7c13640 1 --2- 172.21.15.46:0/3733810515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60a006fe10 0x7f60a014e4a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:54:58.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.663+0000 7f60a7c13640 1 -- 172.21.15.46:0/3733810515 >> 172.21.15.46:0/3733810515 conn(0x7f60a006b770 msgr2=0x7f60a00ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:54:58.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.663+0000 7f60a7c13640 1 -- 172.21.15.46:0/3733810515 shutdown_connections 2024-01-23T08:54:58.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:54:58.663+0000 7f60a7c13640 1 -- 172.21.15.46:0/3733810515 wait complete. 2024-01-23T08:54:58.681 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-23T08:54:58.681 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-23T08:54:58.681 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2024-01-23T08:54:58.681 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-01-23T08:54:58.681 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-01-23T08:54:58.681 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-23T08:54:58.681 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-23T08:54:58.681 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-23T08:54:58.682 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-01-23T08:54:58.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:54:58.682 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2024-01-23T08:54:58.687 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-23T08:54:58.687 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-23T08:54:58.687 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2024-01-23T08:54:58.687 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-01-23T08:54:58.687 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2024-01-23T08:54:58.687 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-01-23T08:54:58.688 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-23T08:54:58.688 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2024-01-23T08:54:58.688 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2024-01-23T08:54:58.688 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-23T08:54:58.688 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2024-01-23T08:54:58.688 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2024-01-23T08:54:58.688 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-23T08:54:58.688 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2024-01-23T08:54:58.688 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2024-01-23T08:54:58.688 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-23T08:54:58.688 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42071sec preferred_lft 42071sec 2024-01-23T08:54:58.688 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2024-01-23T08:54:58.689 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-01-23T08:54:58.689 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-23T08:54:58.689 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2024-01-23T08:54:58.689 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2024-01-23T08:54:58.689 INFO:teuthology.orchestra.run.smithi046.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-23T08:54:58.689 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 02:42:e6:9d:71:a8 brd ff:ff:ff:ff:ff:ff 2024-01-23T08:54:58.689 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-23T08:54:58.689 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-01-23T08:54:58.691 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-23T08:54:58.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:54:58.692 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-23T08:54:58.692 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-23T08:54:58.692 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add name ceph-brx type bridge 2024-01-23T08:54:58.692 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr flush dev ceph-brx 2024-01-23T08:54:58.692 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set ceph-brx up 2024-01-23T08:54:58.692 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-23T08:54:58.692 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-23T08:54:58.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:54:58.775 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-23T08:54:58.828 INFO:teuthology.orchestra.run.smithi046.stdout:1 2024-01-23T08:54:58.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:54:58.829 DEBUG:teuthology.orchestra.run.smithi046:> route 2024-01-23T08:54:58.899 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2024-01-23T08:54:58.899 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-23T08:54:58.899 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-23T08:54:58.899 INFO:teuthology.orchestra.run.smithi046.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-23T08:54:58.899 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-23T08:54:58.900 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-23T08:54:58.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:54:58.900 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-23T08:54:58.900 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-23T08:54:58.900 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-23T08:54:58.900 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-23T08:54:58.900 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-23T08:54:58.900 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-23T08:54:58.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:54:58.971 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-01-23T08:54:59.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:54:59.021 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list-id 2024-01-23T08:54:59.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:54:59.068 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-23T08:54:59.068 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-23T08:54:59.068 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-23T08:54:59.069 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-01-23T08:54:59.069 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-23T08:54:59.137 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-01-23T08:54:59.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:54:59.138 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-23T08:54:59.138 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-23T08:54:59.138 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-01-23T08:54:59.138 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-23T08:54:59.138 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-01-23T08:54:59.138 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-01-23T08:54:59.138 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-01-23T08:54:59.138 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-23T08:54:59.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:54:59.244 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-23T08:54:59.244 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-23T08:54:59.244 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2024-01-23T08:54:59.244 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set dev brx.0 master ceph-brx 2024-01-23T08:54:59.244 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-23T08:54:59.264 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-01-23T08:54:59.264 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-23T08:54:59.264 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-01-23T08:54:59.315 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-01-23T08:54:59.315 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-23T08:54:59.315 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-01-23T08:54:59.363 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-23T08:54:59.421 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-23T08:54:59.470 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-23T08:54:59.470 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-23T08:54:59.470 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-23T08:54:59.470 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-23T08:54:59.470 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-23T08:54:59.470 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-23T08:54:59.470 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-23T08:54:59.470 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-23T08:54:59.471 INFO:teuthology.orchestra.run.smithi046.stdout:/run/lock 2024-01-23T08:54:59.471 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-23T08:54:59.471 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-23T08:54:59.471 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-23T08:54:59.471 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-23T08:54:59.471 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-23T08:54:59.471 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-23T08:54:59.471 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-23T08:54:59.471 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-23T08:54:59.471 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/fs/nfsd 2024-01-23T08:54:59.471 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-23T08:54:59.471 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-23T08:54:59.471 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysusers.service 2024-01-23T08:54:59.471 INFO:teuthology.orchestra.run.smithi046.stdout:/run/rpc_pipefs 2024-01-23T08:54:59.471 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-23T08:54:59.472 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-23T08:54:59.472 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-23T08:54:59.472 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-23T08:54:59.472 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-23T08:54:59.472 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-23T08:54:59.472 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-23T08:54:59.472 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-23T08:54:59.472 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-23T08:54:59.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:54:59.473 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-23T08:54:59.520 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-23T08:54:59.521 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-01-23T08:54:59.564 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-23T08:54:59.578 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-23T08:54:59.629 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-23T08:54:59.629 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-23T08:54:59.629 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-23T08:54:59.629 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-23T08:54:59.629 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-23T08:54:59.629 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-23T08:54:59.629 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-23T08:54:59.629 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-23T08:54:59.629 INFO:teuthology.orchestra.run.smithi046.stdout:/run/lock 2024-01-23T08:54:59.629 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-23T08:54:59.629 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-23T08:54:59.630 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-23T08:54:59.630 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-23T08:54:59.630 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-23T08:54:59.630 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-23T08:54:59.630 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-23T08:54:59.630 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-23T08:54:59.630 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/fs/nfsd 2024-01-23T08:54:59.630 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-23T08:54:59.630 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-23T08:54:59.630 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysusers.service 2024-01-23T08:54:59.630 INFO:teuthology.orchestra.run.smithi046.stdout:/run/rpc_pipefs 2024-01-23T08:54:59.630 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-23T08:54:59.630 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-23T08:54:59.630 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-23T08:54:59.630 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-23T08:54:59.631 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-23T08:54:59.631 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-23T08:54:59.631 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-23T08:54:59.631 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-23T08:54:59.631 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-23T08:54:59.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:54:59.632 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-23T08:54:59.669 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi046.stderr:2024-01-23T08:54:59.671+0000 7f25e4035580 -1 init, newargv = 0x563241e01cb0 newargc=15 2024-01-23T08:54:59.669 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi046.stderr:ceph-fuse[33407]: starting ceph client 2024-01-23T08:55:00.050 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi046.stderr:ceph-fuse[33407]: starting fuse 2024-01-23T08:55:00.775 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-23T08:55:00.790 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-23T08:55:00.838 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-23T08:55:00.838 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-23T08:55:00.838 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-23T08:55:00.839 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-23T08:55:00.839 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-23T08:55:00.839 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-23T08:55:00.839 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-23T08:55:00.839 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-23T08:55:00.839 INFO:teuthology.orchestra.run.smithi046.stdout:/run/lock 2024-01-23T08:55:00.839 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-23T08:55:00.839 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-23T08:55:00.839 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-23T08:55:00.839 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-23T08:55:00.839 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-23T08:55:00.839 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-23T08:55:00.839 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-23T08:55:00.839 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-23T08:55:00.840 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/fs/nfsd 2024-01-23T08:55:00.840 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-23T08:55:00.840 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-23T08:55:00.840 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysusers.service 2024-01-23T08:55:00.840 INFO:teuthology.orchestra.run.smithi046.stdout:/run/rpc_pipefs 2024-01-23T08:55:00.840 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-23T08:55:00.840 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-23T08:55:00.840 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-23T08:55:00.840 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-23T08:55:00.840 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-23T08:55:00.840 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-23T08:55:00.840 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-23T08:55:00.840 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-23T08:55:00.841 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-23T08:55:00.841 INFO:teuthology.orchestra.run.smithi046.stdout:/home/ubuntu/cephtest/mnt.admin 2024-01-23T08:55:00.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:55:00.841 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-23T08:55:00.888 INFO:teuthology.orchestra.run.smithi046.stdout:45 2024-01-23T08:55:00.888 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-01-23T08:55:00.888 DEBUG:teuthology.orchestra.run.smithi046:> sudo stdin-killer -- python3 -c ' 2024-01-23T08:55:00.888 DEBUG:teuthology.orchestra.run.smithi046:> import glob 2024-01-23T08:55:00.888 DEBUG:teuthology.orchestra.run.smithi046:> import re 2024-01-23T08:55:00.888 DEBUG:teuthology.orchestra.run.smithi046:> import os 2024-01-23T08:55:00.889 DEBUG:teuthology.orchestra.run.smithi046:> import subprocess 2024-01-23T08:55:00.889 DEBUG:teuthology.orchestra.run.smithi046:> 2024-01-23T08:55:00.889 DEBUG:teuthology.orchestra.run.smithi046:> def _find_admin_socket(client_name): 2024-01-23T08:55:00.889 DEBUG:teuthology.orchestra.run.smithi046:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-01-23T08:55:00.889 DEBUG:teuthology.orchestra.run.smithi046:> files = glob.glob(asok_path) 2024-01-23T08:55:00.889 DEBUG:teuthology.orchestra.run.smithi046:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-01-23T08:55:00.889 DEBUG:teuthology.orchestra.run.smithi046:> 2024-01-23T08:55:00.889 DEBUG:teuthology.orchestra.run.smithi046:> # Given a non-glob path, it better be there 2024-01-23T08:55:00.889 DEBUG:teuthology.orchestra.run.smithi046:> if "*" not in asok_path: 2024-01-23T08:55:00.889 DEBUG:teuthology.orchestra.run.smithi046:> assert(len(files) == 1) 2024-01-23T08:55:00.889 DEBUG:teuthology.orchestra.run.smithi046:> return files[0] 2024-01-23T08:55:00.889 DEBUG:teuthology.orchestra.run.smithi046:> 2024-01-23T08:55:00.889 DEBUG:teuthology.orchestra.run.smithi046:> for f in files: 2024-01-23T08:55:00.889 DEBUG:teuthology.orchestra.run.smithi046:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-23T08:55:00.889 DEBUG:teuthology.orchestra.run.smithi046:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-23T08:55:00.889 DEBUG:teuthology.orchestra.run.smithi046:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-23T08:55:00.890 DEBUG:teuthology.orchestra.run.smithi046:> contents = proc_f.read() 2024-01-23T08:55:00.890 DEBUG:teuthology.orchestra.run.smithi046:> if mountpoint in contents: 2024-01-23T08:55:00.890 DEBUG:teuthology.orchestra.run.smithi046:> return f 2024-01-23T08:55:00.890 DEBUG:teuthology.orchestra.run.smithi046:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-23T08:55:00.890 DEBUG:teuthology.orchestra.run.smithi046:> 2024-01-23T08:55:00.890 DEBUG:teuthology.orchestra.run.smithi046:> print(_find_admin_socket("client.admin")) 2024-01-23T08:55:00.890 DEBUG:teuthology.orchestra.run.smithi046:> ' 2024-01-23T08:55:01.015 INFO:teuthology.orchestra.run.smithi046.stdout:/var/run/ceph/ceph-client.admin.33407.asok 2024-01-23T08:55:01.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-01-23T08:55:01.028 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.33407.asok 2024-01-23T08:55:01.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:55:01.028 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.33407.asok status 2024-01-23T08:55:01.184 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-23T08:55:01.184 INFO:teuthology.orchestra.run.smithi046.stdout: "metadata": { 2024-01-23T08:55:01.184 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_sha1": "0edf41a622739843d6b978b179ff3227b476dd9d", 2024-01-23T08:55:01.184 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_version": "ceph version 19.0.0-766-g0edf41a6 (0edf41a622739843d6b978b179ff3227b476dd9d) squid (dev)", 2024-01-23T08:55:01.184 INFO:teuthology.orchestra.run.smithi046.stdout: "entity_id": "admin", 2024-01-23T08:55:01.184 INFO:teuthology.orchestra.run.smithi046.stdout: "hostname": "smithi046", 2024-01-23T08:55:01.184 INFO:teuthology.orchestra.run.smithi046.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-01-23T08:55:01.184 INFO:teuthology.orchestra.run.smithi046.stdout: "pid": "33407", 2024-01-23T08:55:01.184 INFO:teuthology.orchestra.run.smithi046.stdout: "root": "/" 2024-01-23T08:55:01.185 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-01-23T08:55:01.185 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_count": 0, 2024-01-23T08:55:01.185 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_pinned_count": 0, 2024-01-23T08:55:01.185 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4362, 2024-01-23T08:55:01.185 INFO:teuthology.orchestra.run.smithi046.stdout: "inst": { 2024-01-23T08:55:01.185 INFO:teuthology.orchestra.run.smithi046.stdout: "name": { 2024-01-23T08:55:01.185 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "client", 2024-01-23T08:55:01.185 INFO:teuthology.orchestra.run.smithi046.stdout: "num": 4362 2024-01-23T08:55:01.185 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-01-23T08:55:01.185 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2024-01-23T08:55:01.185 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-01-23T08:55:01.185 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "192.168.0.1:0", 2024-01-23T08:55:01.185 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 196435976 2024-01-23T08:55:01.186 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-01-23T08:55:01.186 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-01-23T08:55:01.186 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2024-01-23T08:55:01.186 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-01-23T08:55:01.186 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "192.168.0.1:0", 2024-01-23T08:55:01.186 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 196435976 2024-01-23T08:55:01.186 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-01-23T08:55:01.186 INFO:teuthology.orchestra.run.smithi046.stdout: "inst_str": "client.4362 192.168.0.1:0/196435976", 2024-01-23T08:55:01.186 INFO:teuthology.orchestra.run.smithi046.stdout: "addr_str": "192.168.0.1:0/196435976", 2024-01-23T08:55:01.186 INFO:teuthology.orchestra.run.smithi046.stdout: "inode_count": 1, 2024-01-23T08:55:01.186 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_epoch": 7, 2024-01-23T08:55:01.186 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch": 28, 2024-01-23T08:55:01.186 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch_barrier": 0, 2024-01-23T08:55:01.186 INFO:teuthology.orchestra.run.smithi046.stdout: "blocklisted": false, 2024-01-23T08:55:01.186 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs" 2024-01-23T08:55:01.187 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-23T08:55:01.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:55:01.199 DEBUG:teuthology.orchestra.run.smithi046:> stat --file-system '--printf=%T 2024-01-23T08:55:01.199 DEBUG:teuthology.orchestra.run.smithi046:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-01-23T08:55:01.221 INFO:teuthology.orchestra.run.smithi046.stdout:fuseblk 2024-01-23T08:55:01.221 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-01-23T08:55:01.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:55:01.222 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-01-23T08:55:01.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:55:01.387 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-01-23T08:55:01.715 INFO:teuthology.orchestra.run.smithi046.stdout:# file: . 2024-01-23T08:55:01.715 INFO:teuthology.orchestra.run.smithi046.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-01-23T08:55:01.715 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:55:01.716 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:55:01.716 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-23T08:55:01.722 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-23T08:55:01.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.895+0000 7ff26d8da640 1 Processor -- start 2024-01-23T08:55:01.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.895+0000 7ff26d8da640 1 -- start start 2024-01-23T08:55:01.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.899+0000 7ff26d8da640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2681519e0 0x7ff26815b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:01.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.899+0000 7ff26d8da640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff26806f350 0x7ff2680c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:01.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.899+0000 7ff26d8da640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff268158390 con 0x7ff268151600 2024-01-23T08:55:01.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.899+0000 7ff26d8da640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff26815b0e0 con 0x7ff26806f350 2024-01-23T08:55:01.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.899+0000 7ff26d8da640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff268157b70 con 0x7ff2681519e0 2024-01-23T08:55:01.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.899+0000 7ff266ffd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff268151600 0x7ff268157460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59156/0 (socket says 172.21.15.46:59156) 2024-01-23T08:55:01.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.899+0000 7ff266ffd640 1 -- 172.21.15.46:0/3242276569 learned_addr learned my addr 172.21.15.46:0/3242276569 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:01.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.899+0000 7ff2667fc640 1 --2- 172.21.15.46:0/3242276569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2681519e0 0x7ff26815b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:01.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.903+0000 7ff2677fe640 1 --2- 172.21.15.46:0/3242276569 >> v2:172.21.15.46:3300/0 conn(0x7ff26806f350 0x7ff2680c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:01.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.903+0000 7ff265ffb640 1 -- 172.21.15.46:0/3242276569 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3060945565 0 0) 0x7ff268158390 con 0x7ff268151600 2024-01-23T08:55:01.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.903+0000 7ff265ffb640 1 -- 172.21.15.46:0/3242276569 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff250003530 con 0x7ff268151600 2024-01-23T08:55:01.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.907+0000 7ff2667fc640 1 -- 172.21.15.46:0/3242276569 >> v2:172.21.15.46:3300/0 conn(0x7ff26806f350 msgr2=0x7ff2680c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:01.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.907+0000 7ff2667fc640 1 --2- 172.21.15.46:0/3242276569 >> v2:172.21.15.46:3300/0 conn(0x7ff26806f350 0x7ff2680c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:01.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.907+0000 7ff2667fc640 1 -- 172.21.15.46:0/3242276569 >> v1:172.21.15.46:6789/0 conn(0x7ff268151600 legacy=0x7ff268157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:01.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.907+0000 7ff2667fc640 1 -- 172.21.15.46:0/3242276569 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff268157dd0 con 0x7ff2681519e0 2024-01-23T08:55:01.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.911+0000 7ff2667fc640 1 --2- 172.21.15.46:0/3242276569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2681519e0 0x7ff26815b570 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0097c0 tx=0x7ff25c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d28ffddd8c8b2300 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:01.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.923+0000 7ff265ffb640 1 -- 172.21.15.46:0/3242276569 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c0ab600 con 0x7ff2681519e0 2024-01-23T08:55:01.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.923+0000 7ff265ffb640 1 -- 172.21.15.46:0/3242276569 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25c0a7050 con 0x7ff2681519e0 2024-01-23T08:55:01.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.923+0000 7ff265ffb640 1 -- 172.21.15.46:0/3242276569 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c0ab980 con 0x7ff2681519e0 2024-01-23T08:55:01.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.923+0000 7ff26d8da640 1 -- 172.21.15.46:0/3242276569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2681519e0 msgr2=0x7ff26815b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:01.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.923+0000 7ff26d8da640 1 --2- 172.21.15.46:0/3242276569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2681519e0 0x7ff26815b570 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0097c0 tx=0x7ff25c01c480 comp rx=0 tx=0).stop 2024-01-23T08:55:01.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.923+0000 7ff26d8da640 1 -- 172.21.15.46:0/3242276569 shutdown_connections 2024-01-23T08:55:01.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.923+0000 7ff26d8da640 1 --2- 172.21.15.46:0/3242276569 >> v2:172.21.15.46:3300/0 conn(0x7ff26806f350 0x7ff2680c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:01.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.923+0000 7ff26d8da640 1 --2- 172.21.15.46:0/3242276569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2681519e0 0x7ff26815b570 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:01.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.923+0000 7ff26d8da640 1 -- 172.21.15.46:0/3242276569 >> 172.21.15.46:0/3242276569 conn(0x7ff26806d590 msgr2=0x7ff268066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:01.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.923+0000 7ff26d8da640 1 -- 172.21.15.46:0/3242276569 shutdown_connections 2024-01-23T08:55:01.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.923+0000 7ff26d8da640 1 -- 172.21.15.46:0/3242276569 wait complete. 2024-01-23T08:55:01.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.923+0000 7ff26d8da640 1 Processor -- start 2024-01-23T08:55:01.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.923+0000 7ff26d8da640 1 -- start start 2024-01-23T08:55:01.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.927+0000 7ff26d8da640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff26806f350 0x7ff2680c4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:01.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.927+0000 7ff26d8da640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff268151600 0x7ff2680c16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:01.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.927+0000 7ff26d8da640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2681f5a30 0x7ff268141570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:01.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.927+0000 7ff26d8da640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2680c4850 con 0x7ff2681f5a30 2024-01-23T08:55:01.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.927+0000 7ff26d8da640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2680c1080 con 0x7ff26806f350 2024-01-23T08:55:01.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.927+0000 7ff26d8da640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2680c2870 con 0x7ff268151600 2024-01-23T08:55:01.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.927+0000 7ff2677fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2681f5a30 0x7ff268141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:01.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.927+0000 7ff2677fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2681f5a30 0x7ff268141570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44954/0 (socket says 172.21.15.46:44954) 2024-01-23T08:55:01.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.927+0000 7ff2677fe640 1 -- 172.21.15.46:0/2787081404 learned_addr learned my addr 172.21.15.46:0/2787081404 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:01.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.927+0000 7ff266ffd640 1 --2- 172.21.15.46:0/2787081404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff26806f350 0x7ff2680c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:01.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.931+0000 7ff2667fc640 1 --2- 172.21.15.46:0/2787081404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff268151600 0x7ff2680c16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:01.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.931+0000 7ff2677fe640 1 -- 172.21.15.46:0/2787081404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff268151600 msgr2=0x7ff2680c16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:01.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.931+0000 7ff2677fe640 1 --2- 172.21.15.46:0/2787081404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff268151600 0x7ff2680c16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:01.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.931+0000 7ff2677fe640 1 -- 172.21.15.46:0/2787081404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff26806f350 msgr2=0x7ff2680c4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:01.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.931+0000 7ff2677fe640 1 --2- 172.21.15.46:0/2787081404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff26806f350 0x7ff2680c4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:01.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.931+0000 7ff2677fe640 1 -- 172.21.15.46:0/2787081404 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff25c009420 con 0x7ff2681f5a30 2024-01-23T08:55:01.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.931+0000 7ff2677fe640 1 --2- 172.21.15.46:0/2787081404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2681f5a30 0x7ff268141570 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff260009dd0 tx=0x7ff26000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:01.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.935+0000 7ff24ffff640 1 -- 172.21.15.46:0/2787081404 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff260014480 con 0x7ff2681f5a30 2024-01-23T08:55:01.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.935+0000 7ff24ffff640 1 -- 172.21.15.46:0/2787081404 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26000f040 con 0x7ff2681f5a30 2024-01-23T08:55:01.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.935+0000 7ff24ffff640 1 -- 172.21.15.46:0/2787081404 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff260014840 con 0x7ff2681f5a30 2024-01-23T08:55:01.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.935+0000 7ff26d8da640 1 -- 172.21.15.46:0/2787081404 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2681f52c0 con 0x7ff2681f5a30 2024-01-23T08:55:01.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.935+0000 7ff26d8da640 1 -- 172.21.15.46:0/2787081404 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff268145a00 con 0x7ff2681f5a30 2024-01-23T08:55:01.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:01.939+0000 7ff26d8da640 1 -- 172.21.15.46:0/2787081404 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff268071fa0 con 0x7ff2681f5a30 2024-01-23T08:55:02.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.231+0000 7ff24ffff640 1 -- 172.21.15.46:0/2787081404 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7ff2600149a0 con 0x7ff2681f5a30 2024-01-23T08:55:02.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.235+0000 7ff24ffff640 1 --2- 172.21.15.46:0/2787081404 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7ff254066580 0x7ff254068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:02.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.235+0000 7ff266ffd640 1 --2- 172.21.15.46:0/2787081404 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7ff254066580 0x7ff254068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:02.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.235+0000 7ff266ffd640 1 --2- 172.21.15.46:0/2787081404 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7ff254066580 0x7ff254068a40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff258007fd0 tx=0x7ff258009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:02.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.263+0000 7ff24ffff640 1 -- 172.21.15.46:0/2787081404 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff260056ac0 con 0x7ff2681f5a30 2024-01-23T08:55:02.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.263+0000 7ff24ffff640 1 -- 172.21.15.46:0/2787081404 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7ff260052700 con 0x7ff2681f5a30 2024-01-23T08:55:02.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.443+0000 7ff26d8da640 1 -- 172.21.15.46:0/2787081404 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff268074340 con 0x7ff2681f5a30 2024-01-23T08:55:02.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.519+0000 7ff24ffff640 1 -- 172.21.15.46:0/2787081404 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18363 (secure 0 0 0) 0x7ff260018020 con 0x7ff2681f5a30 2024-01-23T08:55:02.518 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:55:02.518 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":28,"fsid":"fdbdd393-f422-45ae-a488-2bbb0163e580","created":"2024-01-23T08:53:36.942515+0000","modified":"2024-01-23T08:54:50.465916+0000","last_up_change":"2024-01-23T08:53:57.198113+0000","last_in_change":"2024-01-23T08:53:47.852614+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-23T08:53:59.340853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-23T08:54:38.278770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-23T08:54:40.216521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-23T08:54:47.311079+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f32c3d7d-e32a-42d8-b55f-db874d915a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6818","nonce":2681790976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6821","nonce":2681790976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6825","nonce":2681790976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6823","nonce":2681790976}]},"public_addr":"172.21.15.46:6818/2681790976","cluster_addr":"172.21.15.46:6821/2681790976","heartbeat_back_addr":"172.21.15.46:6825/2681790976","heartbeat_front_addr":"172.21.15.46:6823/2681790976","state":["exists","up"]},{"osd":1,"uuid":"6f3b6bd2-bbea-4d08-84d5-4407363b5eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6803","nonce":3679152623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6805","nonce":3679152623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6809","nonce":3679152623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6807","nonce":3679152623}]},"public_addr":"172.21.15.46:6803/3679152623","cluster_addr":"172.21.15.46:6805/3679152623","heartbeat_back_addr":"172.21.15.46:6809/3679152623","heartbeat_front_addr":"172.21.15.46:6807/3679152623","state":["exists","up"]},{"osd":2,"uuid":"8f110727-31e7-4f69-926b-c87481d4d28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6811","nonce":3869652274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6813","nonce":3869652274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6820","nonce":3869652274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6815","nonce":3869652274}]},"public_addr":"172.21.15.46:6811/3869652274","cluster_addr":"172.21.15.46:6813/3869652274","heartbeat_back_addr":"172.21.15.46:6820/3869652274","heartbeat_front_addr":"172.21.15.46:6815/3869652274","state":["exists","up"]},{"osd":3,"uuid":"3aa7527d-0463-4373-b9c7-e6b507a7987f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6827","nonce":4168860822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6829","nonce":4168860822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6833","nonce":4168860822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6831","nonce":4168860822}]},"public_addr":"172.21.15.46:6827/4168860822","cluster_addr":"172.21.15.46:6829/4168860822","heartbeat_back_addr":"172.21.15.46:6833/4168860822","heartbeat_front_addr":"172.21.15.46:6831/4168860822","state":["exists","up"]},{"osd":4,"uuid":"eb47a1e5-9f26-465f-b188-87c6eed63c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6805","nonce":3115257412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6808","nonce":3115257412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6815","nonce":3115257412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6812","nonce":3115257412}]},"public_addr":"172.21.15.175:6805/3115257412","cluster_addr":"172.21.15.175:6808/3115257412","heartbeat_back_addr":"172.21.15.175:6815/3115257412","heartbeat_front_addr":"172.21.15.175:6812/3115257412","state":["exists","up"]},{"osd":5,"uuid":"34048409-998c-44f3-a29d-dcad7a6c917b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6818","nonce":3146473948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6822","nonce":3146473948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6831","nonce":3146473948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6826","nonce":3146473948}]},"public_addr":"172.21.15.175:6818/3146473948","cluster_addr":"172.21.15.175:6822/3146473948","heartbeat_back_addr":"172.21.15.175:6831/3146473948","heartbeat_front_addr":"172.21.15.175:6826/3146473948","state":["exists","up"]},{"osd":6,"uuid":"f5d45d3f-9af3-44a1-a730-c260ed1654b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6801","nonce":4161180058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6804","nonce":4161180058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6814","nonce":4161180058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6809","nonce":4161180058}]},"public_addr":"172.21.15.175:6801/4161180058","cluster_addr":"172.21.15.175:6804/4161180058","heartbeat_back_addr":"172.21.15.175:6814/4161180058","heartbeat_front_addr":"172.21.15.175:6809/4161180058","state":["exists","up"]},{"osd":7,"uuid":"16d12e53-2ad3-4b5c-a789-22b45056fd9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6819","nonce":2670236415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6823","nonce":2670236415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6830","nonce":2670236415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6827","nonce":2670236415}]},"public_addr":"172.21.15.175:6819/2670236415","cluster_addr":"172.21.15.175:6823/2670236415","heartbeat_back_addr":"172.21.15.175:6830/2670236415","heartbeat_front_addr":"172.21.15.175:6827/2670236415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.847037+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.765547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.716122+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.874628+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.786580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.924885+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.285635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.898130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T08:55:02.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.523+0000 7ff26d8da640 1 -- 172.21.15.46:0/2787081404 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7ff254066580 msgr2=0x7ff254068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:02.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.523+0000 7ff26d8da640 1 --2- 172.21.15.46:0/2787081404 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7ff254066580 0x7ff254068a40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff258007fd0 tx=0x7ff258009040 comp rx=0 tx=0).stop 2024-01-23T08:55:02.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.523+0000 7ff26d8da640 1 -- 172.21.15.46:0/2787081404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2681f5a30 msgr2=0x7ff268141570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:02.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.523+0000 7ff26d8da640 1 --2- 172.21.15.46:0/2787081404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2681f5a30 0x7ff268141570 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff260009dd0 tx=0x7ff26000c490 comp rx=0 tx=0).stop 2024-01-23T08:55:02.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.523+0000 7ff26d8da640 1 -- 172.21.15.46:0/2787081404 shutdown_connections 2024-01-23T08:55:02.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.523+0000 7ff26d8da640 1 --2- 172.21.15.46:0/2787081404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2681f5a30 0x7ff268141570 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:02.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.523+0000 7ff26d8da640 1 --2- 172.21.15.46:0/2787081404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff268151600 0x7ff2680c16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:02.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.523+0000 7ff26d8da640 1 --2- 172.21.15.46:0/2787081404 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7ff254066580 0x7ff254068a40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:02.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.523+0000 7ff26d8da640 1 --2- 172.21.15.46:0/2787081404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff26806f350 0x7ff2680c4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:02.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.523+0000 7ff26d8da640 1 -- 172.21.15.46:0/2787081404 >> 172.21.15.46:0/2787081404 conn(0x7ff26806d590 msgr2=0x7ff2680c4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:02.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.523+0000 7ff26d8da640 1 -- 172.21.15.46:0/2787081404 shutdown_connections 2024-01-23T08:55:02.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.523+0000 7ff26d8da640 1 -- 172.21.15.46:0/2787081404 wait complete. 2024-01-23T08:55:02.540 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-23T08:53:59.340853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-23T08:54:38.278770+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-23T08:54:40.216521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-23T08:54:47.311079+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-23T08:55:02.541 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-23T08:55:02.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.679+0000 7f262a989640 1 Processor -- start 2024-01-23T08:55:02.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.679+0000 7f262a989640 1 -- start start 2024-01-23T08:55:02.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.679+0000 7f262a989640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f262415a600 0x7f26240c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:02.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.679+0000 7f262a989640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f262415a170 con 0x7f26240cf9e0 2024-01-23T08:55:02.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.679+0000 7f262a989640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26240b27a0 con 0x7f26240c9920 2024-01-23T08:55:02.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.679+0000 7f262a989640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2624159950 con 0x7f262415a600 2024-01-23T08:55:02.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.679+0000 7f2628f26640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f26240cf9e0 0x7f2624164270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59158/0 (socket says 172.21.15.46:59158) 2024-01-23T08:55:02.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.679+0000 7f2628f26640 1 -- 172.21.15.46:0/43596577 learned_addr learned my addr 172.21.15.46:0/43596577 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:02.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.683+0000 7f26237fe640 1 --2- 172.21.15.46:0/43596577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f262415a600 0x7f26240c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:02.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.683+0000 7f2622ffd640 1 -- 172.21.15.46:0/43596577 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2663360731 0 0) 0x7f262415a170 con 0x7f26240cf9e0 2024-01-23T08:55:02.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.683+0000 7f2622ffd640 1 -- 172.21.15.46:0/43596577 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f260c003530 con 0x7f26240cf9e0 2024-01-23T08:55:02.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.691+0000 7f2622ffd640 1 -- 172.21.15.46:0/43596577 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2257254046 0 0) 0x7f260c003530 con 0x7f26240cf9e0 2024-01-23T08:55:02.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.691+0000 7f2622ffd640 1 -- 172.21.15.46:0/43596577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f262415a600 msgr2=0x7f26240c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:02.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.691+0000 7f2622ffd640 1 --2- 172.21.15.46:0/43596577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f262415a600 0x7f26240c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:02.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.691+0000 7f2622ffd640 1 -- 172.21.15.46:0/43596577 >> v1:172.21.15.175:6789/0 conn(0x7f26240c9920 legacy=0x7f26240b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:02.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.691+0000 7f2622ffd640 1 -- 172.21.15.46:0/43596577 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26240ca680 con 0x7f26240cf9e0 2024-01-23T08:55:02.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.691+0000 7f2622ffd640 1 -- 172.21.15.46:0/43596577 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466917103 0 0) 0x7f261c001a00 con 0x7f26240cf9e0 2024-01-23T08:55:02.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.691+0000 7f2622ffd640 1 -- 172.21.15.46:0/43596577 >> v1:172.21.15.46:6789/0 conn(0x7f26240cf9e0 legacy=0x7f2624164270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:02.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.691+0000 7f2622ffd640 1 --2- 172.21.15.46:0/43596577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f260c003a20 0x7f260c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:02.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.691+0000 7f2622ffd640 1 --2- 172.21.15.46:0/43596577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f260c0047d0 0x7f260c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:02.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.691+0000 7f2622ffd640 1 --2- 172.21.15.46:0/43596577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f262415a600 0x7f260c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:02.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.691+0000 7f2622ffd640 1 -- 172.21.15.46:0/43596577 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c00bac0 con 0x7f260c0047d0 2024-01-23T08:55:02.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.691+0000 7f2622ffd640 1 -- 172.21.15.46:0/43596577 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c00bc30 con 0x7f260c003a20 2024-01-23T08:55:02.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.691+0000 7f2622ffd640 1 -- 172.21.15.46:0/43596577 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260c00bdf0 con 0x7f262415a600 2024-01-23T08:55:02.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.695+0000 7f26237fe640 1 --2- 172.21.15.46:0/43596577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f260c0047d0 0x7f260c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:02.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.699+0000 7f2628f26640 1 --2- 172.21.15.46:0/43596577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f262415a600 0x7f260c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:02.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.699+0000 7f26237fe640 1 -- 172.21.15.46:0/43596577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f262415a600 msgr2=0x7f260c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:02.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.699+0000 7f26237fe640 1 --2- 172.21.15.46:0/43596577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f262415a600 0x7f260c0051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:02.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.699+0000 7f26237fe640 1 -- 172.21.15.46:0/43596577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f260c003a20 msgr2=0x7f260c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:02.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.699+0000 7f26237fe640 1 --2- 172.21.15.46:0/43596577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f260c003a20 0x7f260c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:02.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.699+0000 7f26237fe640 1 -- 172.21.15.46:0/43596577 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c003530 con 0x7f260c0047d0 2024-01-23T08:55:02.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.703+0000 7f26237fe640 1 --2- 172.21.15.46:0/43596577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f260c0047d0 0x7f260c004c50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2618009ae0 tx=0x7f261801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440e9d3926aee9e2 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:02.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.707+0000 7f2622ffd640 1 -- 172.21.15.46:0/43596577 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26180a5640 con 0x7f260c0047d0 2024-01-23T08:55:02.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.707+0000 7f2622ffd640 1 -- 172.21.15.46:0/43596577 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26180a57a0 con 0x7f260c0047d0 2024-01-23T08:55:02.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.707+0000 7f2622ffd640 1 -- 172.21.15.46:0/43596577 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26180a5b50 con 0x7f260c0047d0 2024-01-23T08:55:02.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.707+0000 7f262a989640 1 -- 172.21.15.46:0/43596577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f260c0047d0 msgr2=0x7f260c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:02.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.707+0000 7f262a989640 1 --2- 172.21.15.46:0/43596577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f260c0047d0 0x7f260c004c50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2618009ae0 tx=0x7f261801ca50 comp rx=0 tx=0).stop 2024-01-23T08:55:02.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.707+0000 7f2628f26640 1 -- 172.21.15.46:0/43596577 reap_dead start 2024-01-23T08:55:02.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.707+0000 7f262a989640 1 -- 172.21.15.46:0/43596577 shutdown_connections 2024-01-23T08:55:02.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.707+0000 7f262a989640 1 -- 172.21.15.46:0/43596577 >> 172.21.15.46:0/43596577 conn(0x7f262408afa0 msgr2=0x7f262408b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:02.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.707+0000 7f262a989640 1 -- 172.21.15.46:0/43596577 shutdown_connections 2024-01-23T08:55:02.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.707+0000 7f262a989640 1 -- 172.21.15.46:0/43596577 wait complete. 2024-01-23T08:55:02.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.707+0000 7f262a989640 1 Processor -- start 2024-01-23T08:55:02.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.707+0000 7f262a989640 1 -- start start 2024-01-23T08:55:02.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.711+0000 7f262a989640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f260c0047d0 0x7f262415acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:02.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.711+0000 7f262a989640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26240c6870 0x7f262415b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:02.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.711+0000 7f262a989640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26241f2600 0x7f26241f2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:02.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.711+0000 7f262a989640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2624154940 con 0x7f260c0047d0 2024-01-23T08:55:02.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.711+0000 7f262a989640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2624150560 con 0x7f26241f2600 2024-01-23T08:55:02.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.711+0000 7f262a989640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262414f670 con 0x7f26240c6870 2024-01-23T08:55:02.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.711+0000 7f2623fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f260c0047d0 0x7f262415acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:02.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.711+0000 7f2623fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f260c0047d0 0x7f262415acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44976/0 (socket says 172.21.15.46:44976) 2024-01-23T08:55:02.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.711+0000 7f2623fff640 1 -- 172.21.15.46:0/3887455820 learned_addr learned my addr 172.21.15.46:0/3887455820 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:02.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.711+0000 7f26237fe640 1 --2- 172.21.15.46:0/3887455820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26240c6870 0x7f262415b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:02.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.715+0000 7f2623fff640 1 -- 172.21.15.46:0/3887455820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26240c6870 msgr2=0x7f262415b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:02.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.715+0000 7f2623fff640 1 --2- 172.21.15.46:0/3887455820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26240c6870 0x7f262415b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:02.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.715+0000 7f2623fff640 1 -- 172.21.15.46:0/3887455820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26241f2600 msgr2=0x7f26241f2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:02.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.715+0000 7f2623fff640 1 --2- 172.21.15.46:0/3887455820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26241f2600 0x7f26241f2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:02.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.715+0000 7f2623fff640 1 -- 172.21.15.46:0/3887455820 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262414f950 con 0x7f260c0047d0 2024-01-23T08:55:02.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.719+0000 7f2623fff640 1 --2- 172.21.15.46:0/3887455820 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f260c0047d0 0x7f262415acf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f261400c480 tx=0x7f261400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:02.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.739+0000 7f2620ff9640 1 -- 172.21.15.46:0/3887455820 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2614005480 con 0x7f260c0047d0 2024-01-23T08:55:02.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.739+0000 7f2620ff9640 1 -- 172.21.15.46:0/3887455820 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2614003600 con 0x7f260c0047d0 2024-01-23T08:55:02.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.739+0000 7f262a989640 1 -- 172.21.15.46:0/3887455820 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f262414fc30 con 0x7f260c0047d0 2024-01-23T08:55:02.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.739+0000 7f2620ff9640 1 -- 172.21.15.46:0/3887455820 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26140039d0 con 0x7f260c0047d0 2024-01-23T08:55:02.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.739+0000 7f262a989640 1 -- 172.21.15.46:0/3887455820 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26241501f0 con 0x7f260c0047d0 2024-01-23T08:55:02.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:02.739+0000 7f262a989640 1 -- 172.21.15.46:0/3887455820 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f262406d7f0 con 0x7f260c0047d0 2024-01-23T08:55:03.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.039+0000 7f2620ff9640 1 -- 172.21.15.46:0/3887455820 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2614003b30 con 0x7f260c0047d0 2024-01-23T08:55:03.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.039+0000 7f2620ff9640 1 --2- 172.21.15.46:0/3887455820 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f2610066550 0x7f2610068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:03.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.043+0000 7f26237fe640 1 --2- 172.21.15.46:0/3887455820 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f2610066550 0x7f2610068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:03.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.043+0000 7f26237fe640 1 --2- 172.21.15.46:0/3887455820 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f2610066550 0x7f2610068a10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f26180af000 tx=0x7f26180046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:03.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.075+0000 7f2620ff9640 1 -- 172.21.15.46:0/3887455820 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f26140548e0 con 0x7f260c0047d0 2024-01-23T08:55:03.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.075+0000 7f2620ff9640 1 -- 172.21.15.46:0/3887455820 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f2614050c20 con 0x7f260c0047d0 2024-01-23T08:55:03.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.255+0000 7f262a989640 1 -- 172.21.15.46:0/3887455820 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2624074340 con 0x7f260c0047d0 2024-01-23T08:55:03.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.267+0000 7f2620ff9640 1 -- 172.21.15.46:0/3887455820 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f26140170a0 con 0x7f260c0047d0 2024-01-23T08:55:03.264 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-01-23T08:55:03.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.267+0000 7f262a989640 1 -- 172.21.15.46:0/3887455820 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f2610066550 msgr2=0x7f2610068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:03.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.267+0000 7f262a989640 1 --2- 172.21.15.46:0/3887455820 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f2610066550 0x7f2610068a10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f26180af000 tx=0x7f26180046d0 comp rx=0 tx=0).stop 2024-01-23T08:55:03.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.267+0000 7f262a989640 1 -- 172.21.15.46:0/3887455820 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f260c0047d0 msgr2=0x7f262415acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:03.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.267+0000 7f262a989640 1 --2- 172.21.15.46:0/3887455820 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f260c0047d0 0x7f262415acf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f261400c480 tx=0x7f261400c940 comp rx=0 tx=0).stop 2024-01-23T08:55:03.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.271+0000 7f262a989640 1 -- 172.21.15.46:0/3887455820 shutdown_connections 2024-01-23T08:55:03.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.271+0000 7f262a989640 1 --2- 172.21.15.46:0/3887455820 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f2610066550 0x7f2610068a10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:03.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.271+0000 7f262a989640 1 --2- 172.21.15.46:0/3887455820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26241f2600 0x7f26241f2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:03.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.271+0000 7f262a989640 1 --2- 172.21.15.46:0/3887455820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26240c6870 0x7f262415b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:03.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.271+0000 7f262a989640 1 --2- 172.21.15.46:0/3887455820 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f260c0047d0 0x7f262415acf0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:03.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.271+0000 7f262a989640 1 -- 172.21.15.46:0/3887455820 >> 172.21.15.46:0/3887455820 conn(0x7f262408afa0 msgr2=0x7f26240b2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:03.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.271+0000 7f262a989640 1 -- 172.21.15.46:0/3887455820 shutdown_connections 2024-01-23T08:55:03.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.271+0000 7f262a989640 1 -- 172.21.15.46:0/3887455820 wait complete. 2024-01-23T08:55:03.284 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-23T08:55:03.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.411+0000 7f8d62fb6640 1 Processor -- start 2024-01-23T08:55:03.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.411+0000 7f8d62fb6640 1 -- start start 2024-01-23T08:55:03.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.415+0000 7f8d62fb6640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8d5c0c8160 0x7f8d5c0c3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:03.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.415+0000 7f8d62fb6640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d5c0c3200 con 0x7f8d5c0c8dc0 2024-01-23T08:55:03.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.415+0000 7f8d62fb6640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d5c0c9230 con 0x7f8d5c151640 2024-01-23T08:55:03.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.415+0000 7f8d62fb6640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d5c0b0530 con 0x7f8d5c0c8160 2024-01-23T08:55:03.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.415+0000 7f8d61553640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8d5c0c8dc0 0x7f8d5c15a960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:51492/0 (socket says 172.21.15.46:51492) 2024-01-23T08:55:03.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.415+0000 7f8d61553640 1 -- 172.21.15.46:0/354770358 learned_addr learned my addr 172.21.15.46:0/354770358 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:03.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.419+0000 7f8d537fe640 1 -- 172.21.15.46:0/354770358 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2348441842 0 0) 0x7f8d5c0c3200 con 0x7f8d5c0c8dc0 2024-01-23T08:55:03.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.419+0000 7f8d537fe640 1 -- 172.21.15.46:0/354770358 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d44003530 con 0x7f8d5c0c8dc0 2024-01-23T08:55:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.423+0000 7f8d537fe640 1 -- 172.21.15.46:0/354770358 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 765640689 0 0) 0x7f8d44003530 con 0x7f8d5c0c8dc0 2024-01-23T08:55:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.423+0000 7f8d537fe640 1 -- 172.21.15.46:0/354770358 >> v2:172.21.15.175:3300/0 conn(0x7f8d5c0c8160 msgr2=0x7f8d5c0c3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.423+0000 7f8d537fe640 1 --2- 172.21.15.46:0/354770358 >> v2:172.21.15.175:3300/0 conn(0x7f8d5c0c8160 0x7f8d5c0c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.423+0000 7f8d537fe640 1 -- 172.21.15.46:0/354770358 >> v1:172.21.15.175:6789/0 conn(0x7f8d5c151640 legacy=0x7f8d5c0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.423+0000 7f8d537fe640 1 -- 172.21.15.46:0/354770358 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5c15b4f0 con 0x7f8d5c0c8dc0 2024-01-23T08:55:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.423+0000 7f8d537fe640 1 -- 172.21.15.46:0/354770358 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466917103 0 0) 0x7f8d54001a00 con 0x7f8d5c0c8dc0 2024-01-23T08:55:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.423+0000 7f8d537fe640 1 -- 172.21.15.46:0/354770358 >> v1:172.21.15.46:6789/0 conn(0x7f8d5c0c8dc0 legacy=0x7f8d5c15a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.423+0000 7f8d537fe640 1 --2- 172.21.15.46:0/354770358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d440039f0 0x7f8d44003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.423+0000 7f8d537fe640 1 --2- 172.21.15.46:0/354770358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d440047d0 0x7f8d44004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.423+0000 7f8d537fe640 1 --2- 172.21.15.46:0/354770358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d44005390 0x7f8d4400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.423+0000 7f8d537fe640 1 -- 172.21.15.46:0/354770358 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c0b0530 con 0x7f8d44005390 2024-01-23T08:55:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.423+0000 7f8d537fe640 1 -- 172.21.15.46:0/354770358 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4400c1f0 con 0x7f8d440047d0 2024-01-23T08:55:03.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.423+0000 7f8d537fe640 1 -- 172.21.15.46:0/354770358 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4400c3b0 con 0x7f8d440039f0 2024-01-23T08:55:03.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.423+0000 7f8d60d52640 1 --2- 172.21.15.46:0/354770358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d440039f0 0x7f8d44003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:03.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.427+0000 7f8d61553640 1 --2- 172.21.15.46:0/354770358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d44005390 0x7f8d4400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:03.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.431+0000 7f8d61553640 1 -- 172.21.15.46:0/354770358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d440039f0 msgr2=0x7f8d44003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:03.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.431+0000 7f8d61553640 1 --2- 172.21.15.46:0/354770358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d440039f0 0x7f8d44003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:03.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.431+0000 7f8d61553640 1 -- 172.21.15.46:0/354770358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d440047d0 msgr2=0x7f8d44004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:03.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.431+0000 7f8d61553640 1 --2- 172.21.15.46:0/354770358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d440047d0 0x7f8d44004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:03.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.431+0000 7f8d61553640 1 -- 172.21.15.46:0/354770358 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d44003530 con 0x7f8d44005390 2024-01-23T08:55:03.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.431+0000 7f8d61553640 1 -- 172.21.15.46:0/354770358 reap_dead start 2024-01-23T08:55:03.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.435+0000 7f8d61553640 1 --2- 172.21.15.46:0/354770358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d44005390 0x7f8d4400b990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400a870 tx=0x7f8d5401d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c66008ba7fc752 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:03.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.439+0000 7f8d537fe640 1 -- 172.21.15.46:0/354770358 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d54007370 con 0x7f8d44005390 2024-01-23T08:55:03.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.439+0000 7f8d537fe640 1 -- 172.21.15.46:0/354770358 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d540a8070 con 0x7f8d44005390 2024-01-23T08:55:03.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.439+0000 7f8d537fe640 1 -- 172.21.15.46:0/354770358 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d54007750 con 0x7f8d44005390 2024-01-23T08:55:03.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.439+0000 7f8d62fb6640 1 -- 172.21.15.46:0/354770358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d44005390 msgr2=0x7f8d4400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:03.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.439+0000 7f8d62fb6640 1 --2- 172.21.15.46:0/354770358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d44005390 0x7f8d4400b990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400a870 tx=0x7f8d5401d360 comp rx=0 tx=0).stop 2024-01-23T08:55:03.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.439+0000 7f8d62fb6640 1 -- 172.21.15.46:0/354770358 shutdown_connections 2024-01-23T08:55:03.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.439+0000 7f8d62fb6640 1 --2- 172.21.15.46:0/354770358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d44005390 0x7f8d4400b990 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:03.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.439+0000 7f8d62fb6640 1 -- 172.21.15.46:0/354770358 >> 172.21.15.46:0/354770358 conn(0x7f8d5c06a660 msgr2=0x7f8d5c06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:03.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.439+0000 7f8d62fb6640 1 -- 172.21.15.46:0/354770358 shutdown_connections 2024-01-23T08:55:03.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.439+0000 7f8d62fb6640 1 -- 172.21.15.46:0/354770358 wait complete. 2024-01-23T08:55:03.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.443+0000 7f8d62fb6640 1 Processor -- start 2024-01-23T08:55:03.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.443+0000 7f8d62fb6640 1 -- start start 2024-01-23T08:55:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.443+0000 7f8d62fb6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d44005390 0x7f8d5c0cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.443+0000 7f8d62fb6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d5c0af210 0x7f8d5c1ef080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.443+0000 7f8d62fb6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d5c0acae0 0x7f8d5c0acf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.443+0000 7f8d62fb6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c154750 con 0x7f8d5c0af210 2024-01-23T08:55:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.443+0000 7f8d62fb6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c14a3d0 con 0x7f8d5c0acae0 2024-01-23T08:55:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.443+0000 7f8d62fb6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c1540d0 con 0x7f8d44005390 2024-01-23T08:55:03.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.443+0000 7f8d60d52640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d44005390 0x7f8d5c0cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:03.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.443+0000 7f8d53fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d5c0af210 0x7f8d5c1ef080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:03.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.443+0000 7f8d60d52640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d44005390 0x7f8d5c0cccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:42008/0 (socket says 172.21.15.46:42008) 2024-01-23T08:55:03.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.443+0000 7f8d60d52640 1 -- 172.21.15.46:0/1801670275 learned_addr learned my addr 172.21.15.46:0/1801670275 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:03.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.447+0000 7f8d53fff640 1 -- 172.21.15.46:0/1801670275 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d44005390 msgr2=0x7f8d5c0cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:03.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.447+0000 7f8d53fff640 1 --2- 172.21.15.46:0/1801670275 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d44005390 0x7f8d5c0cccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:03.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.447+0000 7f8d53fff640 1 -- 172.21.15.46:0/1801670275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d5c0acae0 msgr2=0x7f8d5c0acf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:03.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.447+0000 7f8d53fff640 1 --2- 172.21.15.46:0/1801670275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d5c0acae0 0x7f8d5c0acf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:03.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.447+0000 7f8d53fff640 1 -- 172.21.15.46:0/1801670275 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5c06d160 con 0x7f8d5c0af210 2024-01-23T08:55:03.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.451+0000 7f8d53fff640 1 --2- 172.21.15.46:0/1801670275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d5c0af210 0x7f8d5c1ef080 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8d5800b410 tx=0x7f8d5800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:03.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.455+0000 7f8d517fa640 1 -- 172.21.15.46:0/1801670275 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d58011830 con 0x7f8d5c0af210 2024-01-23T08:55:03.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.455+0000 7f8d517fa640 1 -- 172.21.15.46:0/1801670275 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d58011990 con 0x7f8d5c0af210 2024-01-23T08:55:03.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.455+0000 7f8d517fa640 1 -- 172.21.15.46:0/1801670275 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d58011d40 con 0x7f8d5c0af210 2024-01-23T08:55:03.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.455+0000 7f8d62fb6640 1 -- 172.21.15.46:0/1801670275 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d5c06d440 con 0x7f8d5c0af210 2024-01-23T08:55:03.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.455+0000 7f8d62fb6640 1 -- 172.21.15.46:0/1801670275 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d5c06d720 con 0x7f8d5c0af210 2024-01-23T08:55:03.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.455+0000 7f8d62fb6640 1 -- 172.21.15.46:0/1801670275 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d5c074340 con 0x7f8d5c0af210 2024-01-23T08:55:03.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.755+0000 7f8d517fa640 1 -- 172.21.15.46:0/1801670275 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f8d5801a400 con 0x7f8d5c0af210 2024-01-23T08:55:03.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.755+0000 7f8d517fa640 1 --2- 172.21.15.46:0/1801670275 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8d48066580 0x7f8d48068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:03.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.755+0000 7f8d60d52640 1 --2- 172.21.15.46:0/1801670275 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8d48066580 0x7f8d48068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:03.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.759+0000 7f8d60d52640 1 --2- 172.21.15.46:0/1801670275 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8d48066580 0x7f8d48068a40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c001810 tx=0x7f8d4c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:03.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.783+0000 7f8d517fa640 1 -- 172.21.15.46:0/1801670275 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8d58055970 con 0x7f8d5c0af210 2024-01-23T08:55:03.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.787+0000 7f8d517fa640 1 -- 172.21.15.46:0/1801670275 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f8d580515b0 con 0x7f8d5c0af210 2024-01-23T08:55:03.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.963+0000 7f8d62fb6640 1 -- 172.21.15.46:0/1801670275 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8d5c15a040 con 0x7f8d5c0af210 2024-01-23T08:55:03.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.979+0000 7f8d517fa640 1 -- 172.21.15.46:0/1801670275 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8d580150a0 con 0x7f8d5c0af210 2024-01-23T08:55:03.976 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-23T08:55:03.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.983+0000 7f8d62fb6640 1 -- 172.21.15.46:0/1801670275 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8d48066580 msgr2=0x7f8d48068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:03.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.983+0000 7f8d62fb6640 1 --2- 172.21.15.46:0/1801670275 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8d48066580 0x7f8d48068a40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c001810 tx=0x7f8d4c009040 comp rx=0 tx=0).stop 2024-01-23T08:55:03.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.983+0000 7f8d62fb6640 1 -- 172.21.15.46:0/1801670275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d5c0af210 msgr2=0x7f8d5c1ef080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:03.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.983+0000 7f8d62fb6640 1 --2- 172.21.15.46:0/1801670275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d5c0af210 0x7f8d5c1ef080 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8d5800b410 tx=0x7f8d5800b8d0 comp rx=0 tx=0).stop 2024-01-23T08:55:03.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.983+0000 7f8d62fb6640 1 -- 172.21.15.46:0/1801670275 shutdown_connections 2024-01-23T08:55:03.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.983+0000 7f8d62fb6640 1 --2- 172.21.15.46:0/1801670275 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8d48066580 0x7f8d48068a40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:03.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.983+0000 7f8d62fb6640 1 --2- 172.21.15.46:0/1801670275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d5c0acae0 0x7f8d5c0acf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:03.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.983+0000 7f8d62fb6640 1 --2- 172.21.15.46:0/1801670275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d5c0af210 0x7f8d5c1ef080 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:03.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.983+0000 7f8d62fb6640 1 --2- 172.21.15.46:0/1801670275 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d44005390 0x7f8d5c0cccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:03.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.983+0000 7f8d62fb6640 1 -- 172.21.15.46:0/1801670275 >> 172.21.15.46:0/1801670275 conn(0x7f8d5c06a660 msgr2=0x7f8d5c0c9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:03.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.983+0000 7f8d62fb6640 1 -- 172.21.15.46:0/1801670275 shutdown_connections 2024-01-23T08:55:03.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:03.983+0000 7f8d62fb6640 1 -- 172.21.15.46:0/1801670275 wait complete. 2024-01-23T08:55:04.000 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-23T08:55:04.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.131+0000 7fce13b98640 1 Processor -- start 2024-01-23T08:55:04.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.131+0000 7fce13b98640 1 -- start start 2024-01-23T08:55:04.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.131+0000 7fce13b98640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce0c14fd90 0x7fce0c072580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:04.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.131+0000 7fce13b98640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fce0c156130 0x7fce0c156540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:04.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.131+0000 7fce13b98640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce0c159fb0 con 0x7fce0c072ac0 2024-01-23T08:55:04.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.131+0000 7fce13b98640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce0c155d10 con 0x7fce0c156130 2024-01-23T08:55:04.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.131+0000 7fce13b98640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c156a80 con 0x7fce0c14fd90 2024-01-23T08:55:04.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.131+0000 7fce11133640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fce0c072ac0 0x7fce0c0710d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:51504/0 (socket says 172.21.15.46:51504) 2024-01-23T08:55:04.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.131+0000 7fce11133640 1 -- 172.21.15.46:0/670304716 learned_addr learned my addr 172.21.15.46:0/670304716 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:04.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.131+0000 7fce12135640 1 --2- 172.21.15.46:0/670304716 >> v2:172.21.15.175:3300/0 conn(0x7fce0c156130 0x7fce0c156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:04.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.131+0000 7fce11934640 1 --2- 172.21.15.46:0/670304716 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce0c14fd90 0x7fce0c072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:04.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.135+0000 7fce10932640 1 -- 172.21.15.46:0/670304716 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687408303 0 0) 0x7fce0c159fb0 con 0x7fce0c072ac0 2024-01-23T08:55:04.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.135+0000 7fce10932640 1 -- 172.21.15.46:0/670304716 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdf8005740 con 0x7fce0c072ac0 2024-01-23T08:55:04.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.139+0000 7fce10932640 1 -- 172.21.15.46:0/670304716 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4057333521 0 0) 0x7fcdf8005740 con 0x7fce0c072ac0 2024-01-23T08:55:04.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.139+0000 7fce10932640 1 -- 172.21.15.46:0/670304716 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce0c14fd90 msgr2=0x7fce0c072580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:04.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.139+0000 7fce10932640 1 --2- 172.21.15.46:0/670304716 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce0c14fd90 0x7fce0c072580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:04.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.139+0000 7fce10932640 1 -- 172.21.15.46:0/670304716 >> v2:172.21.15.175:3300/0 conn(0x7fce0c156130 msgr2=0x7fce0c156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:04.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.139+0000 7fce10932640 1 --2- 172.21.15.46:0/670304716 >> v2:172.21.15.175:3300/0 conn(0x7fce0c156130 0x7fce0c156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:04.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.139+0000 7fce10932640 1 -- 172.21.15.46:0/670304716 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0c150170 con 0x7fce0c072ac0 2024-01-23T08:55:04.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.139+0000 7fce10932640 1 -- 172.21.15.46:0/670304716 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466917103 0 0) 0x7fcdfc001680 con 0x7fce0c072ac0 2024-01-23T08:55:04.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.139+0000 7fce10932640 1 -- 172.21.15.46:0/670304716 >> v1:172.21.15.46:6789/0 conn(0x7fce0c072ac0 legacy=0x7fce0c0710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:04.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.139+0000 7fce10932640 1 --2- 172.21.15.46:0/670304716 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce0c14fd90 0x7fcdf8005c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:04.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.139+0000 7fce10932640 1 --2- 172.21.15.46:0/670304716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcdf8006140 0x7fcdf80069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:04.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.139+0000 7fce10932640 1 --2- 172.21.15.46:0/670304716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdf8006f20 0x7fcdf80073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:04.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.139+0000 7fce10932640 1 -- 172.21.15.46:0/670304716 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c155d10 con 0x7fcdf8006f20 2024-01-23T08:55:04.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.139+0000 7fce10932640 1 -- 172.21.15.46:0/670304716 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c156a80 con 0x7fcdf8006140 2024-01-23T08:55:04.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.139+0000 7fce10932640 1 -- 172.21.15.46:0/670304716 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf800ffa0 con 0x7fce0c14fd90 2024-01-23T08:55:04.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.139+0000 7fce12135640 1 --2- 172.21.15.46:0/670304716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdf8006f20 0x7fcdf80073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:04.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.147+0000 7fce12135640 1 -- 172.21.15.46:0/670304716 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce0c14fd90 msgr2=0x7fcdf8005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:04.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.147+0000 7fce12135640 1 --2- 172.21.15.46:0/670304716 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce0c14fd90 0x7fcdf8005c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:04.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.147+0000 7fce12135640 1 -- 172.21.15.46:0/670304716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcdf8006140 msgr2=0x7fcdf80069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:04.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.147+0000 7fce12135640 1 --2- 172.21.15.46:0/670304716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcdf8006140 0x7fcdf80069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:04.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.147+0000 7fce12135640 1 -- 172.21.15.46:0/670304716 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf8005740 con 0x7fcdf8006f20 2024-01-23T08:55:04.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.151+0000 7fce12135640 1 --2- 172.21.15.46:0/670304716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdf8006f20 0x7fcdf80073a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fce04009fc0 tx=0x7fce0401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a337f3e3cffc9edf server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:04.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.155+0000 7fce10932640 1 -- 172.21.15.46:0/670304716 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce040a5cb0 con 0x7fcdf8006f20 2024-01-23T08:55:04.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.155+0000 7fce10932640 1 -- 172.21.15.46:0/670304716 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0400f040 con 0x7fcdf8006f20 2024-01-23T08:55:04.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.155+0000 7fce10932640 1 -- 172.21.15.46:0/670304716 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce040ad680 con 0x7fcdf8006f20 2024-01-23T08:55:04.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.155+0000 7fce13b98640 1 -- 172.21.15.46:0/670304716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdf8006f20 msgr2=0x7fcdf80073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:04.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.155+0000 7fce13b98640 1 --2- 172.21.15.46:0/670304716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdf8006f20 0x7fcdf80073a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fce04009fc0 tx=0x7fce0401cca0 comp rx=0 tx=0).stop 2024-01-23T08:55:04.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.155+0000 7fce12135640 1 -- 172.21.15.46:0/670304716 reap_dead start 2024-01-23T08:55:04.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.155+0000 7fce13b98640 1 -- 172.21.15.46:0/670304716 shutdown_connections 2024-01-23T08:55:04.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.155+0000 7fce13b98640 1 -- 172.21.15.46:0/670304716 >> 172.21.15.46:0/670304716 conn(0x7fce0c06aa60 msgr2=0x7fce0c06ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:04.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.155+0000 7fce13b98640 1 -- 172.21.15.46:0/670304716 shutdown_connections 2024-01-23T08:55:04.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.155+0000 7fce13b98640 1 -- 172.21.15.46:0/670304716 wait complete. 2024-01-23T08:55:04.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.155+0000 7fce13b98640 1 Processor -- start 2024-01-23T08:55:04.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.155+0000 7fce13b98640 1 -- start start 2024-01-23T08:55:04.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.159+0000 7fce13b98640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce0c0711a0 0x7fce0c1517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:04.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.159+0000 7fce13b98640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce0c155750 0x7fce0c151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:04.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.159+0000 7fce13b98640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce0c071580 0x7fce0c1ee850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:04.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.159+0000 7fce13b98640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c1ee430 con 0x7fce0c155750 2024-01-23T08:55:04.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.159+0000 7fce13b98640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c1ebc10 con 0x7fce0c0711a0 2024-01-23T08:55:04.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.159+0000 7fce13b98640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c1eb090 con 0x7fce0c071580 2024-01-23T08:55:04.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.159+0000 7fce11133640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce0c155750 0x7fce0c151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:04.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.159+0000 7fce11133640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce0c155750 0x7fce0c151ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42516/0 (socket says 172.21.15.46:42516) 2024-01-23T08:55:04.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.159+0000 7fce11133640 1 -- 172.21.15.46:0/3655305353 learned_addr learned my addr 172.21.15.46:0/3655305353 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:04.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.159+0000 7fce11934640 1 --2- 172.21.15.46:0/3655305353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce0c0711a0 0x7fce0c1517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:04.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.159+0000 7fce12135640 1 --2- 172.21.15.46:0/3655305353 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce0c071580 0x7fce0c1ee850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:04.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.163+0000 7fce11133640 1 -- 172.21.15.46:0/3655305353 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce0c071580 msgr2=0x7fce0c1ee850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:04.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.163+0000 7fce11133640 1 --2- 172.21.15.46:0/3655305353 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce0c071580 0x7fce0c1ee850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:04.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.163+0000 7fce11133640 1 -- 172.21.15.46:0/3655305353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce0c0711a0 msgr2=0x7fce0c1517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:04.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.163+0000 7fce11133640 1 --2- 172.21.15.46:0/3655305353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce0c0711a0 0x7fce0c1517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:04.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.163+0000 7fce11133640 1 -- 172.21.15.46:0/3655305353 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0c1eb370 con 0x7fce0c155750 2024-01-23T08:55:04.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.167+0000 7fce11133640 1 --2- 172.21.15.46:0/3655305353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce0c155750 0x7fce0c151ce0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00caa0 tx=0x7fcdfc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:04.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.171+0000 7fce027fc640 1 -- 172.21.15.46:0/3655305353 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc004cc0 con 0x7fce0c155750 2024-01-23T08:55:04.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.171+0000 7fce027fc640 1 -- 172.21.15.46:0/3655305353 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdfc004e20 con 0x7fce0c155750 2024-01-23T08:55:04.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.171+0000 7fce027fc640 1 -- 172.21.15.46:0/3655305353 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc007310 con 0x7fce0c155750 2024-01-23T08:55:04.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.171+0000 7fce13b98640 1 -- 172.21.15.46:0/3655305353 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce0c1eb650 con 0x7fce0c155750 2024-01-23T08:55:04.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.171+0000 7fce13b98640 1 -- 172.21.15.46:0/3655305353 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce0c1eace0 con 0x7fce0c155750 2024-01-23T08:55:04.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.171+0000 7fce13b98640 1 -- 172.21.15.46:0/3655305353 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce0c074340 con 0x7fce0c155750 2024-01-23T08:55:04.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.443+0000 7fce027fc640 1 -- 172.21.15.46:0/3655305353 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fcdfc007470 con 0x7fce0c155750 2024-01-23T08:55:04.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.447+0000 7fce027fc640 1 --2- 172.21.15.46:0/3655305353 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fcdf0066580 0x7fcdf0068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:04.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.447+0000 7fce11934640 1 --2- 172.21.15.46:0/3655305353 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fcdf0066580 0x7fcdf0068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:04.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.447+0000 7fce11934640 1 --2- 172.21.15.46:0/3655305353 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fcdf0066580 0x7fcdf0068a40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fce080093b0 tx=0x7fce08009320 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:04.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.459+0000 7fce027fc640 1 -- 172.21.15.46:0/3655305353 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcdfc007720 con 0x7fce0c155750 2024-01-23T08:55:04.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.459+0000 7fce027fc640 1 -- 172.21.15.46:0/3655305353 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fcdfc050ea0 con 0x7fce0c155750 2024-01-23T08:55:04.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.647+0000 7fce13b98640 1 -- 172.21.15.46:0/3655305353 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fce0c0c5d90 con 0x7fce0c155750 2024-01-23T08:55:04.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.651+0000 7fce027fc640 1 -- 172.21.15.46:0/3655305353 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcdfc018020 con 0x7fce0c155750 2024-01-23T08:55:04.651 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-01-23T08:55:04.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.655+0000 7fce13b98640 1 -- 172.21.15.46:0/3655305353 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fcdf0066580 msgr2=0x7fcdf0068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:04.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.655+0000 7fce13b98640 1 --2- 172.21.15.46:0/3655305353 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fcdf0066580 0x7fcdf0068a40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fce080093b0 tx=0x7fce08009320 comp rx=0 tx=0).stop 2024-01-23T08:55:04.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.655+0000 7fce13b98640 1 -- 172.21.15.46:0/3655305353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce0c155750 msgr2=0x7fce0c151ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:04.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.655+0000 7fce13b98640 1 --2- 172.21.15.46:0/3655305353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce0c155750 0x7fce0c151ce0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00caa0 tx=0x7fcdfc00cf60 comp rx=0 tx=0).stop 2024-01-23T08:55:04.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.655+0000 7fce13b98640 1 -- 172.21.15.46:0/3655305353 shutdown_connections 2024-01-23T08:55:04.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.655+0000 7fce13b98640 1 --2- 172.21.15.46:0/3655305353 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce0c071580 0x7fce0c1ee850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:04.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.655+0000 7fce13b98640 1 --2- 172.21.15.46:0/3655305353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce0c155750 0x7fce0c151ce0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:04.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.655+0000 7fce13b98640 1 --2- 172.21.15.46:0/3655305353 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fcdf0066580 0x7fcdf0068a40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:04.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.655+0000 7fce13b98640 1 --2- 172.21.15.46:0/3655305353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce0c0711a0 0x7fce0c1517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:04.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.655+0000 7fce13b98640 1 -- 172.21.15.46:0/3655305353 >> 172.21.15.46:0/3655305353 conn(0x7fce0c06aa60 msgr2=0x7fce0c0c67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:04.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.655+0000 7fce13b98640 1 -- 172.21.15.46:0/3655305353 shutdown_connections 2024-01-23T08:55:04.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.655+0000 7fce13b98640 1 -- 172.21.15.46:0/3655305353 wait complete. 2024-01-23T08:55:04.670 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-23T08:55:04.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.803+0000 7f57e1d9b640 1 Processor -- start 2024-01-23T08:55:04.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.803+0000 7f57e1d9b640 1 -- start start 2024-01-23T08:55:04.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.803+0000 7f57e1d9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57dc0c2e00 0x7f57dc0c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:04.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.803+0000 7f57e1d9b640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57dc156a20 con 0x7f57dc150500 2024-01-23T08:55:04.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.803+0000 7f57e1d9b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57dc156d00 con 0x7f57dc06e460 2024-01-23T08:55:04.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.803+0000 7f57e1d9b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc156fe0 con 0x7f57dc0c2e00 2024-01-23T08:55:04.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.803+0000 7f57daffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57dc0c2e00 0x7f57dc0c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:04.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.803+0000 7f57dbfff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f57dc06e460 0x7f57dc15a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.46:53816/0 (socket says 172.21.15.46:53816) 2024-01-23T08:55:04.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.803+0000 7f57dbfff640 1 -- 172.21.15.46:0/2004397669 learned_addr learned my addr 172.21.15.46:0/2004397669 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:04.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.811+0000 7f57daffd640 1 -- 172.21.15.46:0/2004397669 >> v1:172.21.15.175:6789/0 conn(0x7f57dc06e460 legacy=0x7f57dc15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:04.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.811+0000 7f57daffd640 1 -- 172.21.15.46:0/2004397669 >> v1:172.21.15.46:6789/0 conn(0x7f57dc150500 legacy=0x7f57dc156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:04.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.811+0000 7f57daffd640 1 -- 172.21.15.46:0/2004397669 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57dc1599e0 con 0x7f57dc0c2e00 2024-01-23T08:55:04.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.819+0000 7f57daffd640 1 --2- 172.21.15.46:0/2004397669 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57dc0c2e00 0x7f57dc0c5f20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f57c40097f0 tx=0x7f57c4020e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=190dd2ed50eedc81 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:04.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.827+0000 7f57da7fc640 1 -- 172.21.15.46:0/2004397669 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c40aab80 con 0x7f57dc0c2e00 2024-01-23T08:55:04.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.827+0000 7f57da7fc640 1 -- 172.21.15.46:0/2004397669 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c40aace0 con 0x7f57dc0c2e00 2024-01-23T08:55:04.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.827+0000 7f57da7fc640 1 -- 172.21.15.46:0/2004397669 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c40b2660 con 0x7f57dc0c2e00 2024-01-23T08:55:04.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.831+0000 7f57e1d9b640 1 -- 172.21.15.46:0/2004397669 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57dc0c2e00 msgr2=0x7f57dc0c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:04.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.831+0000 7f57e1d9b640 1 --2- 172.21.15.46:0/2004397669 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57dc0c2e00 0x7f57dc0c5f20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f57c40097f0 tx=0x7f57c4020e80 comp rx=0 tx=0).stop 2024-01-23T08:55:04.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.831+0000 7f57e1d9b640 1 -- 172.21.15.46:0/2004397669 shutdown_connections 2024-01-23T08:55:04.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.831+0000 7f57e1d9b640 1 --2- 172.21.15.46:0/2004397669 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57dc0c2e00 0x7f57dc0c5f20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:04.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.831+0000 7f57e1d9b640 1 -- 172.21.15.46:0/2004397669 >> 172.21.15.46:0/2004397669 conn(0x7f57dc06b770 msgr2=0x7f57dc06bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:04.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.831+0000 7f57e1d9b640 1 -- 172.21.15.46:0/2004397669 shutdown_connections 2024-01-23T08:55:04.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.831+0000 7f57e1d9b640 1 -- 172.21.15.46:0/2004397669 wait complete. 2024-01-23T08:55:04.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.831+0000 7f57e1d9b640 1 Processor -- start 2024-01-23T08:55:04.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.831+0000 7f57e1d9b640 1 -- start start 2024-01-23T08:55:04.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.831+0000 7f57e1d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57dc06e460 0x7f57dc14eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:04.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.831+0000 7f57e1d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57dc0c2e00 0x7f57dc0c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:04.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.831+0000 7f57e1d9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57dc150500 0x7f57dc0c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:04.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.831+0000 7f57e1d9b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc155c60 con 0x7f57dc06e460 2024-01-23T08:55:04.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.831+0000 7f57e1d9b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc14e9b0 con 0x7f57dc0c2e00 2024-01-23T08:55:04.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.831+0000 7f57e1d9b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc0c4320 con 0x7f57dc150500 2024-01-23T08:55:04.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.831+0000 7f57db7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57dc06e460 0x7f57dc14eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:04.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.831+0000 7f57db7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57dc06e460 0x7f57dc14eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42524/0 (socket says 172.21.15.46:42524) 2024-01-23T08:55:04.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.831+0000 7f57db7fe640 1 -- 172.21.15.46:0/2630458313 learned_addr learned my addr 172.21.15.46:0/2630458313 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:04.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.835+0000 7f57daffd640 1 --2- 172.21.15.46:0/2630458313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57dc0c2e00 0x7f57dc0c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:04.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.835+0000 7f57dbfff640 1 --2- 172.21.15.46:0/2630458313 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57dc150500 0x7f57dc0c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:04.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.835+0000 7f57db7fe640 1 -- 172.21.15.46:0/2630458313 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57dc150500 msgr2=0x7f57dc0c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:04.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.835+0000 7f57db7fe640 1 --2- 172.21.15.46:0/2630458313 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57dc150500 0x7f57dc0c4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:04.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.835+0000 7f57db7fe640 1 -- 172.21.15.46:0/2630458313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57dc0c2e00 msgr2=0x7f57dc0c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:04.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.835+0000 7f57db7fe640 1 --2- 172.21.15.46:0/2630458313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57dc0c2e00 0x7f57dc0c47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:04.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.835+0000 7f57db7fe640 1 -- 172.21.15.46:0/2630458313 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c4009420 con 0x7f57dc06e460 2024-01-23T08:55:04.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.839+0000 7f57db7fe640 1 --2- 172.21.15.46:0/2630458313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57dc06e460 0x7f57dc14eee0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f57cc00ba80 tx=0x7f57cc00bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:04.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.843+0000 7f57d3fff640 1 -- 172.21.15.46:0/2630458313 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc00cc90 con 0x7f57dc06e460 2024-01-23T08:55:04.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.843+0000 7f57d3fff640 1 -- 172.21.15.46:0/2630458313 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57cc00cdf0 con 0x7f57dc06e460 2024-01-23T08:55:04.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.843+0000 7f57e1d9b640 1 -- 172.21.15.46:0/2630458313 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57dc0c4020 con 0x7f57dc06e460 2024-01-23T08:55:04.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.843+0000 7f57d3fff640 1 -- 172.21.15.46:0/2630458313 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc014680 con 0x7f57dc06e460 2024-01-23T08:55:04.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.843+0000 7f57e1d9b640 1 -- 172.21.15.46:0/2630458313 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57dc158cb0 con 0x7f57dc06e460 2024-01-23T08:55:04.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.847+0000 7f57e1d9b640 1 -- 172.21.15.46:0/2630458313 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57dc074340 con 0x7f57dc06e460 2024-01-23T08:55:04.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.867+0000 7f57d3fff640 1 -- 172.21.15.46:0/2630458313 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f57cc01d3b0 con 0x7f57dc06e460 2024-01-23T08:55:04.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.867+0000 7f57d3fff640 1 --2- 172.21.15.46:0/2630458313 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f57bc066550 0x7f57bc068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:04.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.867+0000 7f57daffd640 1 --2- 172.21.15.46:0/2630458313 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f57bc066550 0x7f57bc068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:04.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:04.867+0000 7f57daffd640 1 --2- 172.21.15.46:0/2630458313 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f57bc066550 0x7f57bc068a10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f57c40b4000 tx=0x7f57c4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:05.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.151+0000 7f57d3fff640 1 -- 172.21.15.46:0/2630458313 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f57cc0552b0 con 0x7f57dc06e460 2024-01-23T08:55:05.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.151+0000 7f57d3fff640 1 -- 172.21.15.46:0/2630458313 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f57cc0515f0 con 0x7f57dc06e460 2024-01-23T08:55:05.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.339+0000 7f57e1d9b640 1 -- 172.21.15.46:0/2630458313 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f57dc153ea0 con 0x7f57dc06e460 2024-01-23T08:55:05.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.355+0000 7f57d3fff640 1 -- 172.21.15.46:0/2630458313 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f57cc019070 con 0x7f57dc06e460 2024-01-23T08:55:05.352 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-23T08:55:05.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.359+0000 7f57e1d9b640 1 -- 172.21.15.46:0/2630458313 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f57bc066550 msgr2=0x7f57bc068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:05.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.359+0000 7f57e1d9b640 1 --2- 172.21.15.46:0/2630458313 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f57bc066550 0x7f57bc068a10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f57c40b4000 tx=0x7f57c4008040 comp rx=0 tx=0).stop 2024-01-23T08:55:05.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.359+0000 7f57e1d9b640 1 -- 172.21.15.46:0/2630458313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57dc06e460 msgr2=0x7f57dc14eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:05.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.359+0000 7f57e1d9b640 1 --2- 172.21.15.46:0/2630458313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57dc06e460 0x7f57dc14eee0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f57cc00ba80 tx=0x7f57cc00bf40 comp rx=0 tx=0).stop 2024-01-23T08:55:05.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.359+0000 7f57e1d9b640 1 -- 172.21.15.46:0/2630458313 shutdown_connections 2024-01-23T08:55:05.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.359+0000 7f57e1d9b640 1 --2- 172.21.15.46:0/2630458313 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f57dc150500 0x7f57dc0c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:05.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.359+0000 7f57e1d9b640 1 --2- 172.21.15.46:0/2630458313 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f57bc066550 0x7f57bc068a10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:05.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.359+0000 7f57e1d9b640 1 --2- 172.21.15.46:0/2630458313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57dc0c2e00 0x7f57dc0c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:05.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.359+0000 7f57e1d9b640 1 --2- 172.21.15.46:0/2630458313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57dc06e460 0x7f57dc14eee0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:05.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.359+0000 7f57e1d9b640 1 -- 172.21.15.46:0/2630458313 >> 172.21.15.46:0/2630458313 conn(0x7f57dc06b770 msgr2=0x7f57dc0c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:05.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.359+0000 7f57e1d9b640 1 -- 172.21.15.46:0/2630458313 shutdown_connections 2024-01-23T08:55:05.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.359+0000 7f57e1d9b640 1 -- 172.21.15.46:0/2630458313 wait complete. 2024-01-23T08:55:05.373 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-23T08:55:05.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.499+0000 7f688479b640 1 Processor -- start 2024-01-23T08:55:05.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.499+0000 7f688479b640 1 -- start start 2024-01-23T08:55:05.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.499+0000 7f688479b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f687c06feb0 0x7f687c159a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:05.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.499+0000 7f688479b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f687c0c65a0 0x7f687c0c18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:05.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.499+0000 7f688479b640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f687c0c0e90 con 0x7f687c070290 2024-01-23T08:55:05.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.499+0000 7f688479b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f687c156d20 con 0x7f687c0c65a0 2024-01-23T08:55:05.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.499+0000 7f688479b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687c156fc0 con 0x7f687c06feb0 2024-01-23T08:55:05.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.499+0000 7f6881d36640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f687c070290 0x7f687c156490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:51530/0 (socket says 172.21.15.46:51530) 2024-01-23T08:55:05.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.499+0000 7f6881d36640 1 -- 172.21.15.46:0/429657837 learned_addr learned my addr 172.21.15.46:0/429657837 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:05.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.499+0000 7f6882537640 1 --2- 172.21.15.46:0/429657837 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f687c06feb0 0x7f687c159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:05.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.499+0000 7f6882d38640 1 --2- 172.21.15.46:0/429657837 >> v2:172.21.15.175:3300/0 conn(0x7f687c0c65a0 0x7f687c0c18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:05.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.503+0000 7f6881535640 1 -- 172.21.15.46:0/429657837 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2941013322 0 0) 0x7f687c0c0e90 con 0x7f687c070290 2024-01-23T08:55:05.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.503+0000 7f6881535640 1 -- 172.21.15.46:0/429657837 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6864003530 con 0x7f687c070290 2024-01-23T08:55:05.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.507+0000 7f6882d38640 1 -- 172.21.15.46:0/429657837 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f687c06feb0 msgr2=0x7f687c159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:05.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.507+0000 7f6882d38640 1 --2- 172.21.15.46:0/429657837 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f687c06feb0 0x7f687c159a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:05.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.507+0000 7f6882d38640 1 -- 172.21.15.46:0/429657837 >> v1:172.21.15.46:6789/0 conn(0x7f687c070290 legacy=0x7f687c156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:05.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.507+0000 7f6882d38640 1 -- 172.21.15.46:0/429657837 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687c157280 con 0x7f687c0c65a0 2024-01-23T08:55:05.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.515+0000 7f6882d38640 1 --2- 172.21.15.46:0/429657837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f687c0c65a0 0x7f687c0c18e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f686c0097c0 tx=0x7f686c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=315418fbcb18e2be server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:05.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.523+0000 7f6881535640 1 -- 172.21.15.46:0/429657837 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c0ac620 con 0x7f687c0c65a0 2024-01-23T08:55:05.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.523+0000 7f6881535640 1 -- 172.21.15.46:0/429657837 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686c0ac780 con 0x7f687c0c65a0 2024-01-23T08:55:05.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.523+0000 7f6881535640 1 -- 172.21.15.46:0/429657837 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c0acb10 con 0x7f687c0c65a0 2024-01-23T08:55:05.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.523+0000 7f688479b640 1 -- 172.21.15.46:0/429657837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f687c0c65a0 msgr2=0x7f687c0c18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:05.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.523+0000 7f688479b640 1 --2- 172.21.15.46:0/429657837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f687c0c65a0 0x7f687c0c18e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f686c0097c0 tx=0x7f686c01c3c0 comp rx=0 tx=0).stop 2024-01-23T08:55:05.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.523+0000 7f688479b640 1 -- 172.21.15.46:0/429657837 shutdown_connections 2024-01-23T08:55:05.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.523+0000 7f688479b640 1 --2- 172.21.15.46:0/429657837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f687c0c65a0 0x7f687c0c18e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:05.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.523+0000 7f688479b640 1 --2- 172.21.15.46:0/429657837 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f687c06feb0 0x7f687c159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:05.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.523+0000 7f688479b640 1 -- 172.21.15.46:0/429657837 >> 172.21.15.46:0/429657837 conn(0x7f687c072890 msgr2=0x7f687c06e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:05.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.523+0000 7f688479b640 1 -- 172.21.15.46:0/429657837 shutdown_connections 2024-01-23T08:55:05.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.523+0000 7f688479b640 1 -- 172.21.15.46:0/429657837 wait complete. 2024-01-23T08:55:05.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.527+0000 7f688479b640 1 Processor -- start 2024-01-23T08:55:05.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.527+0000 7f688479b640 1 -- start start 2024-01-23T08:55:05.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.527+0000 7f688479b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f687c06feb0 0x7f687c0c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:05.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.527+0000 7f688479b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f687c070290 0x7f687c1563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:05.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.527+0000 7f688479b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f687c0c65a0 0x7f687c14d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:05.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.527+0000 7f688479b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687c1f6770 con 0x7f687c0c65a0 2024-01-23T08:55:05.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.527+0000 7f688479b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687c1f2270 con 0x7f687c070290 2024-01-23T08:55:05.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.527+0000 7f688479b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687c1f61c0 con 0x7f687c06feb0 2024-01-23T08:55:05.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.527+0000 7f6882d38640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f687c0c65a0 0x7f687c14d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:05.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.527+0000 7f6882d38640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f687c0c65a0 0x7f687c14d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42526/0 (socket says 172.21.15.46:42526) 2024-01-23T08:55:05.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.527+0000 7f6882d38640 1 -- 172.21.15.46:0/3873959241 learned_addr learned my addr 172.21.15.46:0/3873959241 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:05.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.527+0000 7f6882537640 1 --2- 172.21.15.46:0/3873959241 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f687c06feb0 0x7f687c0c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:05.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.531+0000 7f6882d38640 1 -- 172.21.15.46:0/3873959241 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f687c06feb0 msgr2=0x7f687c0c7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:05.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.531+0000 7f6882d38640 1 --2- 172.21.15.46:0/3873959241 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f687c06feb0 0x7f687c0c7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:05.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.531+0000 7f6882d38640 1 -- 172.21.15.46:0/3873959241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f687c070290 msgr2=0x7f687c1563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:05.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.531+0000 7f6882d38640 1 --2- 172.21.15.46:0/3873959241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f687c070290 0x7f687c1563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:05.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.531+0000 7f6882d38640 1 -- 172.21.15.46:0/3873959241 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686c009420 con 0x7f687c0c65a0 2024-01-23T08:55:05.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.535+0000 7f6882d38640 1 --2- 172.21.15.46:0/3873959241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f687c0c65a0 0x7f687c14d7e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f686c0097c0 tx=0x7f686c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:05.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.547+0000 7f687affd640 1 -- 172.21.15.46:0/3873959241 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c0ac620 con 0x7f687c0c65a0 2024-01-23T08:55:05.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.547+0000 7f687affd640 1 -- 172.21.15.46:0/3873959241 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686c0b5400 con 0x7f687c0c65a0 2024-01-23T08:55:05.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.547+0000 7f688479b640 1 -- 172.21.15.46:0/3873959241 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f687c0c9660 con 0x7f687c0c65a0 2024-01-23T08:55:05.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.547+0000 7f687affd640 1 -- 172.21.15.46:0/3873959241 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c0b5790 con 0x7f687c0c65a0 2024-01-23T08:55:05.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.547+0000 7f688479b640 1 -- 172.21.15.46:0/3873959241 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f687c1f2480 con 0x7f687c0c65a0 2024-01-23T08:55:05.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.547+0000 7f688479b640 1 -- 172.21.15.46:0/3873959241 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f687c074340 con 0x7f687c0c65a0 2024-01-23T08:55:05.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.851+0000 7f687affd640 1 -- 172.21.15.46:0/3873959241 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f686c0b3040 con 0x7f687c0c65a0 2024-01-23T08:55:05.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.851+0000 7f687affd640 1 --2- 172.21.15.46:0/3873959241 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6868066530 0x7f68680689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:05.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.851+0000 7f6882537640 1 --2- 172.21.15.46:0/3873959241 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6868066530 0x7f68680689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:05.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.855+0000 7f6882537640 1 --2- 172.21.15.46:0/3873959241 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6868066530 0x7f68680689f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6874011340 tx=0x7f687400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:05.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.895+0000 7f687affd640 1 -- 172.21.15.46:0/3873959241 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f686c0efa00 con 0x7f687c0c65a0 2024-01-23T08:55:05.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:05.903+0000 7f687affd640 1 -- 172.21.15.46:0/3873959241 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f686c0eb680 con 0x7f687c0c65a0 2024-01-23T08:55:06.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.095+0000 7f688479b640 1 -- 172.21.15.46:0/3873959241 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f687c06e500 con 0x7f687c0c65a0 2024-01-23T08:55:06.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.163+0000 7f687affd640 1 -- 172.21.15.46:0/3873959241 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f686c0eec60 con 0x7f687c0c65a0 2024-01-23T08:55:06.161 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2024-01-23T08:55:06.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.167+0000 7f688479b640 1 -- 172.21.15.46:0/3873959241 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6868066530 msgr2=0x7f68680689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:06.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.167+0000 7f688479b640 1 --2- 172.21.15.46:0/3873959241 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6868066530 0x7f68680689f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6874011340 tx=0x7f687400b040 comp rx=0 tx=0).stop 2024-01-23T08:55:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.167+0000 7f688479b640 1 -- 172.21.15.46:0/3873959241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f687c0c65a0 msgr2=0x7f687c14d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.167+0000 7f688479b640 1 --2- 172.21.15.46:0/3873959241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f687c0c65a0 0x7f687c14d7e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f686c0097c0 tx=0x7f686c019160 comp rx=0 tx=0).stop 2024-01-23T08:55:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.167+0000 7f688479b640 1 -- 172.21.15.46:0/3873959241 shutdown_connections 2024-01-23T08:55:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.167+0000 7f688479b640 1 --2- 172.21.15.46:0/3873959241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f687c0c65a0 0x7f687c14d7e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.167+0000 7f688479b640 1 --2- 172.21.15.46:0/3873959241 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6868066530 0x7f68680689f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.167+0000 7f688479b640 1 --2- 172.21.15.46:0/3873959241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f687c070290 0x7f687c1563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.167+0000 7f688479b640 1 --2- 172.21.15.46:0/3873959241 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f687c06feb0 0x7f687c0c7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.167+0000 7f688479b640 1 -- 172.21.15.46:0/3873959241 >> 172.21.15.46:0/3873959241 conn(0x7f687c072890 msgr2=0x7f687c0c69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.167+0000 7f688479b640 1 -- 172.21.15.46:0/3873959241 shutdown_connections 2024-01-23T08:55:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.167+0000 7f688479b640 1 -- 172.21.15.46:0/3873959241 wait complete. 2024-01-23T08:55:06.185 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:55:06.186 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-23T08:55:06.191 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-23T08:55:06.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.363+0000 7f5fea451640 1 Processor -- start 2024-01-23T08:55:06.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.363+0000 7f5fea451640 1 -- start start 2024-01-23T08:55:06.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.363+0000 7f5fea451640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5fe4151630 0x7f5fe4157df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:06.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.363+0000 7f5fea451640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5fe406a660 0x7f5fe40c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:06.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.363+0000 7f5fea451640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe40c8660 con 0x7f5fe40c50a0 2024-01-23T08:55:06.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.363+0000 7f5fea451640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fe40c78f0 con 0x7f5fe406a660 2024-01-23T08:55:06.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.363+0000 7f5fea451640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe4158330 con 0x7f5fe4151630 2024-01-23T08:55:06.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.363+0000 7f5fe37fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5fe406a660 0x7f5fe40c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:06.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.363+0000 7f5fe89ee640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5fe40c50a0 0x7f5fe4071db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:51536/0 (socket says 172.21.15.46:51536) 2024-01-23T08:55:06.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.363+0000 7f5fe89ee640 1 -- 172.21.15.46:0/2108829764 learned_addr learned my addr 172.21.15.46:0/2108829764 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:06.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.363+0000 7f5fe3fff640 1 --2- 172.21.15.46:0/2108829764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5fe4151630 0x7f5fe4157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:06.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.367+0000 7f5fe37fe640 1 -- 172.21.15.46:0/2108829764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5fe4151630 msgr2=0x7f5fe4157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:06.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.367+0000 7f5fe37fe640 1 --2- 172.21.15.46:0/2108829764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5fe4151630 0x7f5fe4157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:06.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.367+0000 7f5fe37fe640 1 -- 172.21.15.46:0/2108829764 >> v1:172.21.15.46:6789/0 conn(0x7f5fe40c50a0 legacy=0x7f5fe4071db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:06.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.367+0000 7f5fe37fe640 1 -- 172.21.15.46:0/2108829764 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe406be90 con 0x7f5fe406a660 2024-01-23T08:55:06.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.375+0000 7f5fe37fe640 1 --2- 172.21.15.46:0/2108829764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fe406a660 0x7f5fe40c4b60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40097c0 tx=0x7f5fd401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=131820055d5c6754 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:06.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.379+0000 7f5fe2ffd640 1 -- 172.21.15.46:0/2108829764 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd40ab600 con 0x7f5fe406a660 2024-01-23T08:55:06.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.379+0000 7f5fe2ffd640 1 -- 172.21.15.46:0/2108829764 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd40a7050 con 0x7f5fe406a660 2024-01-23T08:55:06.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.379+0000 7f5fe2ffd640 1 -- 172.21.15.46:0/2108829764 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd40ab980 con 0x7f5fe406a660 2024-01-23T08:55:06.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.379+0000 7f5fea451640 1 -- 172.21.15.46:0/2108829764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fe406a660 msgr2=0x7f5fe40c4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:06.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.379+0000 7f5fea451640 1 --2- 172.21.15.46:0/2108829764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fe406a660 0x7f5fe40c4b60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40097c0 tx=0x7f5fd401c3f0 comp rx=0 tx=0).stop 2024-01-23T08:55:06.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.379+0000 7f5fea451640 1 -- 172.21.15.46:0/2108829764 shutdown_connections 2024-01-23T08:55:06.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.379+0000 7f5fea451640 1 --2- 172.21.15.46:0/2108829764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fe406a660 0x7f5fe40c4b60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:06.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.379+0000 7f5fea451640 1 --2- 172.21.15.46:0/2108829764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5fe4151630 0x7f5fe4157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:06.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.379+0000 7f5fea451640 1 -- 172.21.15.46:0/2108829764 >> 172.21.15.46:0/2108829764 conn(0x7f5fe40cba50 msgr2=0x7f5fe40c7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:06.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.379+0000 7f5fea451640 1 -- 172.21.15.46:0/2108829764 shutdown_connections 2024-01-23T08:55:06.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.379+0000 7f5fea451640 1 -- 172.21.15.46:0/2108829764 wait complete. 2024-01-23T08:55:06.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.379+0000 7f5fea451640 1 Processor -- start 2024-01-23T08:55:06.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.379+0000 7f5fea451640 1 -- start start 2024-01-23T08:55:06.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.379+0000 7f5fea451640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fe406a660 0x7f5fe413c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:06.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.379+0000 7f5fea451640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5fe40c50a0 0x7f5fe41560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:06.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.379+0000 7f5fea451640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fe4151630 0x7f5fe41565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:06.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.379+0000 7f5fea451640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe41f6a50 con 0x7f5fe406a660 2024-01-23T08:55:06.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.379+0000 7f5fea451640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe41f5b60 con 0x7f5fe4151630 2024-01-23T08:55:06.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.379+0000 7f5fea451640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe41f5e40 con 0x7f5fe40c50a0 2024-01-23T08:55:06.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.383+0000 7f5fe3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fe406a660 0x7f5fe413c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:06.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.383+0000 7f5fe3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fe406a660 0x7f5fe413c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42536/0 (socket says 172.21.15.46:42536) 2024-01-23T08:55:06.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.383+0000 7f5fe3fff640 1 -- 172.21.15.46:0/1016408980 learned_addr learned my addr 172.21.15.46:0/1016408980 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:06.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.383+0000 7f5fe89ee640 1 --2- 172.21.15.46:0/1016408980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fe4151630 0x7f5fe41565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:06.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.383+0000 7f5fe37fe640 1 --2- 172.21.15.46:0/1016408980 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5fe40c50a0 0x7f5fe41560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:06.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.387+0000 7f5fe3fff640 1 -- 172.21.15.46:0/1016408980 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5fe40c50a0 msgr2=0x7f5fe41560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:06.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.387+0000 7f5fe3fff640 1 --2- 172.21.15.46:0/1016408980 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5fe40c50a0 0x7f5fe41560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:06.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.387+0000 7f5fe3fff640 1 -- 172.21.15.46:0/1016408980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fe4151630 msgr2=0x7f5fe41565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:06.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.387+0000 7f5fe3fff640 1 --2- 172.21.15.46:0/1016408980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fe4151630 0x7f5fe41565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:06.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.387+0000 7f5fe3fff640 1 -- 172.21.15.46:0/1016408980 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd4009420 con 0x7f5fe406a660 2024-01-23T08:55:06.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.387+0000 7f5fe3fff640 1 --2- 172.21.15.46:0/1016408980 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fe406a660 0x7f5fe413c020 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800e930 tx=0x7f5fd800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.391+0000 7f5fe0ff9640 1 -- 172.21.15.46:0/1016408980 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8009690 con 0x7f5fe406a660 2024-01-23T08:55:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.391+0000 7f5fe0ff9640 1 -- 172.21.15.46:0/1016408980 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd800ca00 con 0x7f5fe406a660 2024-01-23T08:55:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.391+0000 7f5fe0ff9640 1 -- 172.21.15.46:0/1016408980 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd800cd70 con 0x7f5fe406a660 2024-01-23T08:55:06.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.391+0000 7f5fea451640 1 -- 172.21.15.46:0/1016408980 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe41f6120 con 0x7f5fe406a660 2024-01-23T08:55:06.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.391+0000 7f5fea451640 1 -- 172.21.15.46:0/1016408980 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe41f66e0 con 0x7f5fe406a660 2024-01-23T08:55:06.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.395+0000 7f5fea451640 1 -- 172.21.15.46:0/1016408980 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe4074340 con 0x7f5fe406a660 2024-01-23T08:55:06.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.415+0000 7f5fe0ff9640 1 -- 172.21.15.46:0/1016408980 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5fd8013470 con 0x7f5fe406a660 2024-01-23T08:55:06.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.415+0000 7f5fe0ff9640 1 --2- 172.21.15.46:0/1016408980 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5fd0066550 0x7f5fd0068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:06.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.415+0000 7f5fe37fe640 1 --2- 172.21.15.46:0/1016408980 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5fd0066550 0x7f5fd0068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:06.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.415+0000 7f5fe37fe640 1 --2- 172.21.15.46:0/1016408980 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5fd0066550 0x7f5fd0068a10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40ad000 tx=0x7f5fd40a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:06.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.695+0000 7f5fe0ff9640 1 -- 172.21.15.46:0/1016408980 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5fd8055900 con 0x7f5fe406a660 2024-01-23T08:55:06.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.695+0000 7f5fe0ff9640 1 -- 172.21.15.46:0/1016408980 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5fd8051c40 con 0x7f5fe406a660 2024-01-23T08:55:06.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.859+0000 7f5fea451640 1 -- 172.21.15.46:0/1016408980 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fe40c9a40 con 0x7f5fe406a660 2024-01-23T08:55:06.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.955+0000 7f5fe0ff9640 1 -- 172.21.15.46:0/1016408980 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f5fd8021070 con 0x7f5fe406a660 2024-01-23T08:55:06.955 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:55:06.955 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":28,"fsid":"fdbdd393-f422-45ae-a488-2bbb0163e580","created":"2024-01-23T08:53:36.942515+0000","modified":"2024-01-23T08:54:50.465916+0000","last_up_change":"2024-01-23T08:53:57.198113+0000","last_in_change":"2024-01-23T08:53:47.852614+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-23T08:53:59.340853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-23T08:54:38.278770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-23T08:54:40.216521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-23T08:54:47.311079+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f32c3d7d-e32a-42d8-b55f-db874d915a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6818","nonce":2681790976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6821","nonce":2681790976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6825","nonce":2681790976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6823","nonce":2681790976}]},"public_addr":"172.21.15.46:6818/2681790976","cluster_addr":"172.21.15.46:6821/2681790976","heartbeat_back_addr":"172.21.15.46:6825/2681790976","heartbeat_front_addr":"172.21.15.46:6823/2681790976","state":["exists","up"]},{"osd":1,"uuid":"6f3b6bd2-bbea-4d08-84d5-4407363b5eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6803","nonce":3679152623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6805","nonce":3679152623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6809","nonce":3679152623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6807","nonce":3679152623}]},"public_addr":"172.21.15.46:6803/3679152623","cluster_addr":"172.21.15.46:6805/3679152623","heartbeat_back_addr":"172.21.15.46:6809/3679152623","heartbeat_front_addr":"172.21.15.46:6807/3679152623","state":["exists","up"]},{"osd":2,"uuid":"8f110727-31e7-4f69-926b-c87481d4d28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6811","nonce":3869652274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6813","nonce":3869652274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6820","nonce":3869652274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6815","nonce":3869652274}]},"public_addr":"172.21.15.46:6811/3869652274","cluster_addr":"172.21.15.46:6813/3869652274","heartbeat_back_addr":"172.21.15.46:6820/3869652274","heartbeat_front_addr":"172.21.15.46:6815/3869652274","state":["exists","up"]},{"osd":3,"uuid":"3aa7527d-0463-4373-b9c7-e6b507a7987f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6827","nonce":4168860822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6829","nonce":4168860822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6833","nonce":4168860822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6831","nonce":4168860822}]},"public_addr":"172.21.15.46:6827/4168860822","cluster_addr":"172.21.15.46:6829/4168860822","heartbeat_back_addr":"172.21.15.46:6833/4168860822","heartbeat_front_addr":"172.21.15.46:6831/4168860822","state":["exists","up"]},{"osd":4,"uuid":"eb47a1e5-9f26-465f-b188-87c6eed63c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6805","nonce":3115257412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6808","nonce":3115257412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6815","nonce":3115257412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6812","nonce":3115257412}]},"public_addr":"172.21.15.175:6805/3115257412","cluster_addr":"172.21.15.175:6808/3115257412","heartbeat_back_addr":"172.21.15.175:6815/3115257412","heartbeat_front_addr":"172.21.15.175:6812/3115257412","state":["exists","up"]},{"osd":5,"uuid":"34048409-998c-44f3-a29d-dcad7a6c917b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6818","nonce":3146473948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6822","nonce":3146473948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6831","nonce":3146473948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6826","nonce":3146473948}]},"public_addr":"172.21.15.175:6818/3146473948","cluster_addr":"172.21.15.175:6822/3146473948","heartbeat_back_addr":"172.21.15.175:6831/3146473948","heartbeat_front_addr":"172.21.15.175:6826/3146473948","state":["exists","up"]},{"osd":6,"uuid":"f5d45d3f-9af3-44a1-a730-c260ed1654b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6801","nonce":4161180058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6804","nonce":4161180058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6814","nonce":4161180058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6809","nonce":4161180058}]},"public_addr":"172.21.15.175:6801/4161180058","cluster_addr":"172.21.15.175:6804/4161180058","heartbeat_back_addr":"172.21.15.175:6814/4161180058","heartbeat_front_addr":"172.21.15.175:6809/4161180058","state":["exists","up"]},{"osd":7,"uuid":"16d12e53-2ad3-4b5c-a789-22b45056fd9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6819","nonce":2670236415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6823","nonce":2670236415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6830","nonce":2670236415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6827","nonce":2670236415}]},"public_addr":"172.21.15.175:6819/2670236415","cluster_addr":"172.21.15.175:6823/2670236415","heartbeat_back_addr":"172.21.15.175:6830/2670236415","heartbeat_front_addr":"172.21.15.175:6827/2670236415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.847037+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.765547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.716122+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.874628+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.786580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.924885+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.285635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.898130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T08:55:06.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.959+0000 7f5fea451640 1 -- 172.21.15.46:0/1016408980 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5fd0066550 msgr2=0x7f5fd0068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:06.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.959+0000 7f5fea451640 1 --2- 172.21.15.46:0/1016408980 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5fd0066550 0x7f5fd0068a10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40ad000 tx=0x7f5fd40a6000 comp rx=0 tx=0).stop 2024-01-23T08:55:06.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.959+0000 7f5fea451640 1 -- 172.21.15.46:0/1016408980 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fe406a660 msgr2=0x7f5fe413c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:06.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.959+0000 7f5fea451640 1 --2- 172.21.15.46:0/1016408980 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fe406a660 0x7f5fe413c020 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800e930 tx=0x7f5fd800edf0 comp rx=0 tx=0).stop 2024-01-23T08:55:06.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.959+0000 7f5fea451640 1 -- 172.21.15.46:0/1016408980 shutdown_connections 2024-01-23T08:55:06.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.959+0000 7f5fea451640 1 --2- 172.21.15.46:0/1016408980 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5fd0066550 0x7f5fd0068a10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:06.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.959+0000 7f5fea451640 1 --2- 172.21.15.46:0/1016408980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fe4151630 0x7f5fe41565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:06.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.959+0000 7f5fea451640 1 --2- 172.21.15.46:0/1016408980 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5fe40c50a0 0x7f5fe41560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:06.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.959+0000 7f5fea451640 1 --2- 172.21.15.46:0/1016408980 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fe406a660 0x7f5fe413c020 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:06.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.959+0000 7f5fea451640 1 -- 172.21.15.46:0/1016408980 >> 172.21.15.46:0/1016408980 conn(0x7f5fe40cba50 msgr2=0x7f5fe414fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:06.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.959+0000 7f5fea451640 1 -- 172.21.15.46:0/1016408980 shutdown_connections 2024-01-23T08:55:06.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:06.959+0000 7f5fea451640 1 -- 172.21.15.46:0/1016408980 wait complete. 2024-01-23T08:55:06.977 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-23T08:53:59.340853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-23T08:54:38.278770+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-23T08:54:40.216521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-23T08:54:47.311079+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-23T08:55:06.977 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-23T08:55:07.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.111+0000 7f7eedd19640 1 Processor -- start 2024-01-23T08:55:07.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.111+0000 7f7eedd19640 1 -- start start 2024-01-23T08:55:07.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.111+0000 7f7eedd19640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7ee8151740 0x7f7ee8157380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:07.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.111+0000 7f7eedd19640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ee80c7990 0x7f7ee806feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:07.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.111+0000 7f7eedd19640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee80c7500 con 0x7f7ee80c5db0 2024-01-23T08:55:07.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.111+0000 7f7eedd19640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee806f190 con 0x7f7ee8151740 2024-01-23T08:55:07.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.111+0000 7f7eedd19640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee8151b20 con 0x7f7ee80c7990 2024-01-23T08:55:07.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.111+0000 7f7ee7fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ee80c7990 0x7f7ee806feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:07.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.115+0000 7f7ee7fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ee80c7990 0x7f7ee806feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:42112/0 (socket says 172.21.15.46:42112) 2024-01-23T08:55:07.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.115+0000 7f7ee7fff640 1 -- 172.21.15.46:0/2439956714 learned_addr learned my addr 172.21.15.46:0/2439956714 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:07.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.119+0000 7f7ee7fff640 1 -- 172.21.15.46:0/2439956714 >> v2:172.21.15.46:3300/0 conn(0x7f7ee8151740 msgr2=0x7f7ee8157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:07.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.119+0000 7f7ee7fff640 1 --2- 172.21.15.46:0/2439956714 >> v2:172.21.15.46:3300/0 conn(0x7f7ee8151740 0x7f7ee8157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:07.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.119+0000 7f7ee7fff640 1 -- 172.21.15.46:0/2439956714 >> v1:172.21.15.46:6789/0 conn(0x7f7ee80c5db0 legacy=0x7f7ee806ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:07.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.119+0000 7f7ee7fff640 1 -- 172.21.15.46:0/2439956714 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee80c7e40 con 0x7f7ee80c7990 2024-01-23T08:55:07.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.123+0000 7f7ee7fff640 1 --2- 172.21.15.46:0/2439956714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ee80c7990 0x7f7ee806feb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009e50 tx=0x7f7ed801f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b8ca176cd47a3d8 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:07.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.135+0000 7f7ee67fc640 1 -- 172.21.15.46:0/2439956714 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed80af400 con 0x7f7ee80c7990 2024-01-23T08:55:07.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.135+0000 7f7ee67fc640 1 -- 172.21.15.46:0/2439956714 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed80ab050 con 0x7f7ee80c7990 2024-01-23T08:55:07.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.135+0000 7f7ee67fc640 1 -- 172.21.15.46:0/2439956714 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed80af780 con 0x7f7ee80c7990 2024-01-23T08:55:07.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.135+0000 7f7eedd19640 1 -- 172.21.15.46:0/2439956714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ee80c7990 msgr2=0x7f7ee806feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:07.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.135+0000 7f7eedd19640 1 --2- 172.21.15.46:0/2439956714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ee80c7990 0x7f7ee806feb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009e50 tx=0x7f7ed801f1c0 comp rx=0 tx=0).stop 2024-01-23T08:55:07.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.135+0000 7f7eedd19640 1 -- 172.21.15.46:0/2439956714 shutdown_connections 2024-01-23T08:55:07.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.135+0000 7f7eedd19640 1 --2- 172.21.15.46:0/2439956714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ee80c7990 0x7f7ee806feb0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:07.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.135+0000 7f7eedd19640 1 --2- 172.21.15.46:0/2439956714 >> v2:172.21.15.46:3300/0 conn(0x7f7ee8151740 0x7f7ee8157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:07.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.135+0000 7f7eedd19640 1 -- 172.21.15.46:0/2439956714 >> 172.21.15.46:0/2439956714 conn(0x7f7ee806b770 msgr2=0x7f7ee806bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:07.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.135+0000 7f7eedd19640 1 -- 172.21.15.46:0/2439956714 shutdown_connections 2024-01-23T08:55:07.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.135+0000 7f7eedd19640 1 -- 172.21.15.46:0/2439956714 wait complete. 2024-01-23T08:55:07.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.135+0000 7f7eedd19640 1 Processor -- start 2024-01-23T08:55:07.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.135+0000 7f7eedd19640 1 -- start start 2024-01-23T08:55:07.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.139+0000 7f7eedd19640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ee80c5db0 0x7f7ee81f0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:07.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.139+0000 7f7eedd19640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ee80c7990 0x7f7ee80c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:07.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.139+0000 7f7eedd19640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ee8151740 0x7f7ee8153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:07.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.139+0000 7f7eedd19640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee81f1410 con 0x7f7ee8151740 2024-01-23T08:55:07.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.139+0000 7f7eedd19640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee81ed990 con 0x7f7ee80c5db0 2024-01-23T08:55:07.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.139+0000 7f7eedd19640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee8157480 con 0x7f7ee80c7990 2024-01-23T08:55:07.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.139+0000 7f7ee77fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ee80c5db0 0x7f7ee81f0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:07.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.139+0000 7f7ee77fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ee80c5db0 0x7f7ee81f0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:54514/0 (socket says 172.21.15.46:54514) 2024-01-23T08:55:07.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.139+0000 7f7ee77fe640 1 -- 172.21.15.46:0/3185259 learned_addr learned my addr 172.21.15.46:0/3185259 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:07.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.139+0000 7f7ee6ffd640 1 --2- 172.21.15.46:0/3185259 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ee80c7990 0x7f7ee80c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:07.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.151+0000 7f7ee77fe640 1 -- 172.21.15.46:0/3185259 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ee80c7990 msgr2=0x7f7ee80c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:07.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.151+0000 7f7ee77fe640 1 --2- 172.21.15.46:0/3185259 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ee80c7990 0x7f7ee80c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:07.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.151+0000 7f7ee77fe640 1 -- 172.21.15.46:0/3185259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ee8151740 msgr2=0x7f7ee8153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:07.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.151+0000 7f7ee77fe640 1 --2- 172.21.15.46:0/3185259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ee8151740 0x7f7ee8153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:07.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.151+0000 7f7ee77fe640 1 -- 172.21.15.46:0/3185259 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed8009b30 con 0x7f7ee80c5db0 2024-01-23T08:55:07.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.155+0000 7f7ee77fe640 1 --2- 172.21.15.46:0/3185259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ee80c5db0 0x7f7ee81f0ed0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000b410 tx=0x7f7ee000b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:07.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.171+0000 7f7edffff640 1 -- 172.21.15.46:0/3185259 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0011830 con 0x7f7ee80c5db0 2024-01-23T08:55:07.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.171+0000 7f7edffff640 1 -- 172.21.15.46:0/3185259 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee0011990 con 0x7f7ee80c5db0 2024-01-23T08:55:07.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.171+0000 7f7eedd19640 1 -- 172.21.15.46:0/3185259 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee81ede20 con 0x7f7ee80c5db0 2024-01-23T08:55:07.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.171+0000 7f7edffff640 1 -- 172.21.15.46:0/3185259 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0011d40 con 0x7f7ee80c5db0 2024-01-23T08:55:07.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.171+0000 7f7eedd19640 1 -- 172.21.15.46:0/3185259 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee81ed340 con 0x7f7ee80c5db0 2024-01-23T08:55:07.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.175+0000 7f7eedd19640 1 -- 172.21.15.46:0/3185259 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee8074340 con 0x7f7ee80c5db0 2024-01-23T08:55:07.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.563+0000 7f7edffff640 1 -- 172.21.15.46:0/3185259 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f7ee001a400 con 0x7f7ee80c5db0 2024-01-23T08:55:07.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.567+0000 7f7edffff640 1 --2- 172.21.15.46:0/3185259 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7ec8066530 0x7f7ec80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:07.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.567+0000 7f7ee6ffd640 1 --2- 172.21.15.46:0/3185259 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7ec8066530 0x7f7ec80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:07.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.567+0000 7f7edffff640 1 -- 172.21.15.46:0/3185259 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7ee0055b60 con 0x7f7ee80c5db0 2024-01-23T08:55:07.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.567+0000 7f7ee6ffd640 1 --2- 172.21.15.46:0/3185259 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7ec8066530 0x7f7ec80689f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7ee80cad30 tx=0x7f7ed0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:07.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.587+0000 7f7edffff640 1 -- 172.21.15.46:0/3185259 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f7ee00517a0 con 0x7f7ee80c5db0 2024-01-23T08:55:07.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.767+0000 7f7eedd19640 1 -- 172.21.15.46:0/3185259 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7ee80709f0 con 0x7f7ee80c5db0 2024-01-23T08:55:07.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.799+0000 7f7edffff640 1 -- 172.21.15.46:0/3185259 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7ee0015020 con 0x7f7ee80c5db0 2024-01-23T08:55:07.798 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-01-23T08:55:07.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.803+0000 7f7eedd19640 1 -- 172.21.15.46:0/3185259 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7ec8066530 msgr2=0x7f7ec80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:07.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.803+0000 7f7eedd19640 1 --2- 172.21.15.46:0/3185259 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7ec8066530 0x7f7ec80689f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7ee80cad30 tx=0x7f7ed0009040 comp rx=0 tx=0).stop 2024-01-23T08:55:07.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.803+0000 7f7eedd19640 1 -- 172.21.15.46:0/3185259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ee80c5db0 msgr2=0x7f7ee81f0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:07.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.803+0000 7f7eedd19640 1 --2- 172.21.15.46:0/3185259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ee80c5db0 0x7f7ee81f0ed0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000b410 tx=0x7f7ee000b8d0 comp rx=0 tx=0).stop 2024-01-23T08:55:07.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.803+0000 7f7eedd19640 1 -- 172.21.15.46:0/3185259 shutdown_connections 2024-01-23T08:55:07.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.803+0000 7f7eedd19640 1 --2- 172.21.15.46:0/3185259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ee8151740 0x7f7ee8153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:07.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.803+0000 7f7eedd19640 1 --2- 172.21.15.46:0/3185259 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ee80c7990 0x7f7ee80c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:07.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.803+0000 7f7eedd19640 1 --2- 172.21.15.46:0/3185259 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7ec8066530 0x7f7ec80689f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:07.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.803+0000 7f7eedd19640 1 --2- 172.21.15.46:0/3185259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ee80c5db0 0x7f7ee81f0ed0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:07.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.803+0000 7f7eedd19640 1 -- 172.21.15.46:0/3185259 >> 172.21.15.46:0/3185259 conn(0x7f7ee806b770 msgr2=0x7f7ee806ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:07.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.803+0000 7f7eedd19640 1 -- 172.21.15.46:0/3185259 shutdown_connections 2024-01-23T08:55:07.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.803+0000 7f7eedd19640 1 -- 172.21.15.46:0/3185259 wait complete. 2024-01-23T08:55:07.819 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-23T08:55:07.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.951+0000 7f95e7bf0640 1 Processor -- start 2024-01-23T08:55:07.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.951+0000 7f95e7bf0640 1 -- start start 2024-01-23T08:55:07.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.951+0000 7f95e7bf0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f95e014ce60 0x7f95e00c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:07.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.951+0000 7f95e7bf0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95e00c0e90 0x7f95e00c8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:07.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.951+0000 7f95e7bf0640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e00c7a40 con 0x7f95e00c6770 2024-01-23T08:55:07.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.951+0000 7f95e7bf0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e014d240 con 0x7f95e014ce60 2024-01-23T08:55:07.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.951+0000 7f95e7bf0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e006eab0 con 0x7f95e00c0e90 2024-01-23T08:55:07.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.951+0000 7f95e598c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f95e014ce60 0x7f95e00c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:07.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.951+0000 7f95e518b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95e00c0e90 0x7f95e00c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:07.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.955+0000 7f95e598c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f95e014ce60 0x7f95e00c7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:54524/0 (socket says 172.21.15.46:54524) 2024-01-23T08:55:07.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.955+0000 7f95e598c640 1 -- 172.21.15.46:0/2094643464 learned_addr learned my addr 172.21.15.46:0/2094643464 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:07.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.963+0000 7f95e518b640 1 -- 172.21.15.46:0/2094643464 >> v2:172.21.15.175:3300/0 conn(0x7f95e014ce60 msgr2=0x7f95e00c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:07.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.963+0000 7f95e518b640 1 --2- 172.21.15.46:0/2094643464 >> v2:172.21.15.175:3300/0 conn(0x7f95e014ce60 0x7f95e00c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:07.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.963+0000 7f95e518b640 1 -- 172.21.15.46:0/2094643464 >> v1:172.21.15.175:6789/0 conn(0x7f95e00c6770 legacy=0x7f95e01598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:07.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.963+0000 7f95e518b640 1 -- 172.21.15.46:0/2094643464 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e006df20 con 0x7f95e00c0e90 2024-01-23T08:55:07.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.967+0000 7f95e518b640 1 --2- 172.21.15.46:0/2094643464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95e00c0e90 0x7f95e00c8800 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f95d00097c0 tx=0x7f95d001c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cacfa30ee091ce2 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:07.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.979+0000 7f95e498a640 1 -- 172.21.15.46:0/2094643464 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d00ab600 con 0x7f95e00c0e90 2024-01-23T08:55:07.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.979+0000 7f95e498a640 1 -- 172.21.15.46:0/2094643464 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d00a7050 con 0x7f95e00c0e90 2024-01-23T08:55:07.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.979+0000 7f95e498a640 1 -- 172.21.15.46:0/2094643464 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d00ab980 con 0x7f95e00c0e90 2024-01-23T08:55:07.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.979+0000 7f95e7bf0640 1 -- 172.21.15.46:0/2094643464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95e00c0e90 msgr2=0x7f95e00c8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:07.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.979+0000 7f95e7bf0640 1 --2- 172.21.15.46:0/2094643464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95e00c0e90 0x7f95e00c8800 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f95d00097c0 tx=0x7f95d001c440 comp rx=0 tx=0).stop 2024-01-23T08:55:07.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.979+0000 7f95e7bf0640 1 -- 172.21.15.46:0/2094643464 shutdown_connections 2024-01-23T08:55:07.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.979+0000 7f95e7bf0640 1 --2- 172.21.15.46:0/2094643464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95e00c0e90 0x7f95e00c8800 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:07.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.979+0000 7f95e7bf0640 1 --2- 172.21.15.46:0/2094643464 >> v2:172.21.15.175:3300/0 conn(0x7f95e014ce60 0x7f95e00c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:07.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.979+0000 7f95e7bf0640 1 -- 172.21.15.46:0/2094643464 >> 172.21.15.46:0/2094643464 conn(0x7f95e0072450 msgr2=0x7f95e006fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:07.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.979+0000 7f95e7bf0640 1 -- 172.21.15.46:0/2094643464 shutdown_connections 2024-01-23T08:55:07.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.979+0000 7f95e7bf0640 1 -- 172.21.15.46:0/2094643464 wait complete. 2024-01-23T08:55:07.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.983+0000 7f95e7bf0640 1 Processor -- start 2024-01-23T08:55:07.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.983+0000 7f95e7bf0640 1 -- start start 2024-01-23T08:55:07.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.983+0000 7f95e7bf0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95e00c0e90 0x7f95e01591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:07.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.983+0000 7f95e7bf0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95e00c6770 0x7f95e0159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:07.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.983+0000 7f95e7bf0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95e014ce60 0x7f95e0141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:07.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.983+0000 7f95e7bf0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e014a000 con 0x7f95e014ce60 2024-01-23T08:55:07.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.983+0000 7f95e7bf0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e013e160 con 0x7f95e00c6770 2024-01-23T08:55:07.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.983+0000 7f95e7bf0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e013e970 con 0x7f95e00c0e90 2024-01-23T08:55:07.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.983+0000 7f95e618d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95e014ce60 0x7f95e0141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:07.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.983+0000 7f95e618d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95e014ce60 0x7f95e0141360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42560/0 (socket says 172.21.15.46:42560) 2024-01-23T08:55:07.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.983+0000 7f95e618d640 1 -- 172.21.15.46:0/499557349 learned_addr learned my addr 172.21.15.46:0/499557349 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:07.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.983+0000 7f95e518b640 1 --2- 172.21.15.46:0/499557349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95e00c6770 0x7f95e0159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:07.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.983+0000 7f95e598c640 1 --2- 172.21.15.46:0/499557349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95e00c0e90 0x7f95e01591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:07.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.987+0000 7f95e618d640 1 -- 172.21.15.46:0/499557349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95e00c0e90 msgr2=0x7f95e01591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:07.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.987+0000 7f95e618d640 1 --2- 172.21.15.46:0/499557349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95e00c0e90 0x7f95e01591f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:07.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.987+0000 7f95e618d640 1 -- 172.21.15.46:0/499557349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95e00c6770 msgr2=0x7f95e0159960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:07.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.987+0000 7f95e618d640 1 --2- 172.21.15.46:0/499557349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95e00c6770 0x7f95e0159960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:07.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.987+0000 7f95e618d640 1 -- 172.21.15.46:0/499557349 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d0009420 con 0x7f95e014ce60 2024-01-23T08:55:07.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.991+0000 7f95e618d640 1 --2- 172.21.15.46:0/499557349 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95e014ce60 0x7f95e0141360 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f95d800c7b0 tx=0x7f95d800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:07.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.995+0000 7f95d67fc640 1 -- 172.21.15.46:0/499557349 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d8004b70 con 0x7f95e014ce60 2024-01-23T08:55:07.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.995+0000 7f95d67fc640 1 -- 172.21.15.46:0/499557349 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d8004cd0 con 0x7f95e014ce60 2024-01-23T08:55:07.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.995+0000 7f95d67fc640 1 -- 172.21.15.46:0/499557349 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d800aa90 con 0x7f95e014ce60 2024-01-23T08:55:07.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.995+0000 7f95e7bf0640 1 -- 172.21.15.46:0/499557349 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e013d590 con 0x7f95e014ce60 2024-01-23T08:55:07.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.995+0000 7f95e7bf0640 1 -- 172.21.15.46:0/499557349 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e013e3b0 con 0x7f95e014ce60 2024-01-23T08:55:07.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:07.999+0000 7f95e7bf0640 1 -- 172.21.15.46:0/499557349 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e0074340 con 0x7f95e014ce60 2024-01-23T08:55:08.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.019+0000 7f95d67fc640 1 -- 172.21.15.46:0/499557349 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f95d800abf0 con 0x7f95e014ce60 2024-01-23T08:55:08.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.023+0000 7f95d67fc640 1 --2- 172.21.15.46:0/499557349 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f95c4066550 0x7f95c4068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:08.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.023+0000 7f95e598c640 1 --2- 172.21.15.46:0/499557349 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f95c4066550 0x7f95c4068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:08.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.023+0000 7f95e598c640 1 --2- 172.21.15.46:0/499557349 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f95c4066550 0x7f95c4068a10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009ab0 tx=0x7f95dc009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:08.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.351+0000 7f95d67fc640 1 -- 172.21.15.46:0/499557349 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f95d80556c0 con 0x7f95e014ce60 2024-01-23T08:55:08.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.351+0000 7f95d67fc640 1 -- 172.21.15.46:0/499557349 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f95d8051a00 con 0x7f95e014ce60 2024-01-23T08:55:08.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.543+0000 7f95e7bf0640 1 -- 172.21.15.46:0/499557349 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f95e00705d0 con 0x7f95e014ce60 2024-01-23T08:55:08.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.567+0000 7f95d67fc640 1 -- 172.21.15.46:0/499557349 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f95d8055020 con 0x7f95e014ce60 2024-01-23T08:55:08.564 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-23T08:55:08.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.567+0000 7f95e7bf0640 1 -- 172.21.15.46:0/499557349 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f95c4066550 msgr2=0x7f95c4068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:08.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.567+0000 7f95e7bf0640 1 --2- 172.21.15.46:0/499557349 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f95c4066550 0x7f95c4068a10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009ab0 tx=0x7f95dc009240 comp rx=0 tx=0).stop 2024-01-23T08:55:08.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.567+0000 7f95e7bf0640 1 -- 172.21.15.46:0/499557349 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95e014ce60 msgr2=0x7f95e0141360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.567+0000 7f95e7bf0640 1 --2- 172.21.15.46:0/499557349 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95e014ce60 0x7f95e0141360 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f95d800c7b0 tx=0x7f95d800cc70 comp rx=0 tx=0).stop 2024-01-23T08:55:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.567+0000 7f95e7bf0640 1 -- 172.21.15.46:0/499557349 shutdown_connections 2024-01-23T08:55:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.567+0000 7f95e7bf0640 1 --2- 172.21.15.46:0/499557349 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95e014ce60 0x7f95e0141360 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.567+0000 7f95e7bf0640 1 --2- 172.21.15.46:0/499557349 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f95c4066550 0x7f95c4068a10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.567+0000 7f95e7bf0640 1 --2- 172.21.15.46:0/499557349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95e00c6770 0x7f95e0159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.567+0000 7f95e7bf0640 1 --2- 172.21.15.46:0/499557349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95e00c0e90 0x7f95e01591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.567+0000 7f95e7bf0640 1 -- 172.21.15.46:0/499557349 >> 172.21.15.46:0/499557349 conn(0x7f95e0072450 msgr2=0x7f95e00c25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.567+0000 7f95e7bf0640 1 -- 172.21.15.46:0/499557349 shutdown_connections 2024-01-23T08:55:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.567+0000 7f95e7bf0640 1 -- 172.21.15.46:0/499557349 wait complete. 2024-01-23T08:55:08.585 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-23T08:55:08.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.727+0000 7f48cbe33640 1 Processor -- start 2024-01-23T08:55:08.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.727+0000 7f48cbe33640 1 -- start start 2024-01-23T08:55:08.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.727+0000 7f48cbe33640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48c40c9920 0x7f48c40c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:08.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.727+0000 7f48cbe33640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c415a170 con 0x7f48c40cf9e0 2024-01-23T08:55:08.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.727+0000 7f48cbe33640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c40b27a0 con 0x7f48c415a600 2024-01-23T08:55:08.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.727+0000 7f48cbe33640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c4159950 con 0x7f48c40c9920 2024-01-23T08:55:08.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.727+0000 7f48ca3d0640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f48c40cf9e0 0x7f48c4164270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:51556/0 (socket says 172.21.15.46:51556) 2024-01-23T08:55:08.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.727+0000 7f48ca3d0640 1 -- 172.21.15.46:0/268066325 learned_addr learned my addr 172.21.15.46:0/268066325 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:08.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.727+0000 7f48c9bcf640 1 --2- 172.21.15.46:0/268066325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48c40c9920 0x7f48c40c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:08.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.731+0000 7f48c8bcd640 1 -- 172.21.15.46:0/268066325 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3787457972 0 0) 0x7f48c415a170 con 0x7f48c40cf9e0 2024-01-23T08:55:08.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.731+0000 7f48c8bcd640 1 -- 172.21.15.46:0/268066325 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48b0003530 con 0x7f48c40cf9e0 2024-01-23T08:55:08.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.735+0000 7f48c8bcd640 1 -- 172.21.15.46:0/268066325 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1313907676 0 0) 0x7f48b0003530 con 0x7f48c40cf9e0 2024-01-23T08:55:08.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.735+0000 7f48c8bcd640 1 -- 172.21.15.46:0/268066325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48c40c9920 msgr2=0x7f48c40c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:08.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.735+0000 7f48c8bcd640 1 --2- 172.21.15.46:0/268066325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48c40c9920 0x7f48c40c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:08.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.735+0000 7f48c8bcd640 1 -- 172.21.15.46:0/268066325 >> v1:172.21.15.175:6789/0 conn(0x7f48c415a600 legacy=0x7f48c40b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:08.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.735+0000 7f48c8bcd640 1 -- 172.21.15.46:0/268066325 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c40ca680 con 0x7f48c40cf9e0 2024-01-23T08:55:08.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.735+0000 7f48c8bcd640 1 -- 172.21.15.46:0/268066325 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466917103 0 0) 0x7f48bc001a00 con 0x7f48c40cf9e0 2024-01-23T08:55:08.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.735+0000 7f48c8bcd640 1 -- 172.21.15.46:0/268066325 >> v1:172.21.15.46:6789/0 conn(0x7f48c40cf9e0 legacy=0x7f48c4164270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:08.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.735+0000 7f48c8bcd640 1 --2- 172.21.15.46:0/268066325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48b0003a20 0x7f48b0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:08.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.735+0000 7f48c8bcd640 1 --2- 172.21.15.46:0/268066325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48b00047d0 0x7f48b0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:08.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.735+0000 7f48c8bcd640 1 --2- 172.21.15.46:0/268066325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48c40c9920 0x7f48b00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:08.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.735+0000 7f48c8bcd640 1 -- 172.21.15.46:0/268066325 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b000ba90 con 0x7f48b0003a20 2024-01-23T08:55:08.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.735+0000 7f48c8bcd640 1 -- 172.21.15.46:0/268066325 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b000bc00 con 0x7f48b00047d0 2024-01-23T08:55:08.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.735+0000 7f48c8bcd640 1 -- 172.21.15.46:0/268066325 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b000bdc0 con 0x7f48c40c9920 2024-01-23T08:55:08.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.735+0000 7f48c9bcf640 1 --2- 172.21.15.46:0/268066325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48b0003a20 0x7f48b0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:08.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.739+0000 7f48c9bcf640 1 -- 172.21.15.46:0/268066325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48c40c9920 msgr2=0x7f48b00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:08.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.739+0000 7f48c9bcf640 1 --2- 172.21.15.46:0/268066325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48c40c9920 0x7f48b00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:08.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.739+0000 7f48c9bcf640 1 -- 172.21.15.46:0/268066325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48b00047d0 msgr2=0x7f48b0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:08.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.739+0000 7f48c9bcf640 1 --2- 172.21.15.46:0/268066325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48b00047d0 0x7f48b0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:08.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.739+0000 7f48c9bcf640 1 -- 172.21.15.46:0/268066325 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b0003530 con 0x7f48b0003a20 2024-01-23T08:55:08.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.743+0000 7f48c9bcf640 1 --2- 172.21.15.46:0/268066325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48b0003a20 0x7f48b0003e20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f48c0009ae0 tx=0x7f48c001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c58c33f8592248cf server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:08.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.747+0000 7f48c8bcd640 1 -- 172.21.15.46:0/268066325 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c00a5570 con 0x7f48b0003a20 2024-01-23T08:55:08.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.747+0000 7f48c8bcd640 1 -- 172.21.15.46:0/268066325 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c00a56d0 con 0x7f48b0003a20 2024-01-23T08:55:08.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.747+0000 7f48c8bcd640 1 -- 172.21.15.46:0/268066325 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c00a5ac0 con 0x7f48b0003a20 2024-01-23T08:55:08.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.747+0000 7f48cbe33640 1 -- 172.21.15.46:0/268066325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48b0003a20 msgr2=0x7f48b0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:08.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.747+0000 7f48cbe33640 1 --2- 172.21.15.46:0/268066325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48b0003a20 0x7f48b0003e20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f48c0009ae0 tx=0x7f48c001ca90 comp rx=0 tx=0).stop 2024-01-23T08:55:08.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.747+0000 7f48ca3d0640 1 -- 172.21.15.46:0/268066325 reap_dead start 2024-01-23T08:55:08.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.747+0000 7f48cbe33640 1 -- 172.21.15.46:0/268066325 shutdown_connections 2024-01-23T08:55:08.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.747+0000 7f48cbe33640 1 -- 172.21.15.46:0/268066325 >> 172.21.15.46:0/268066325 conn(0x7f48c408afa0 msgr2=0x7f48c408b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:08.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.747+0000 7f48cbe33640 1 -- 172.21.15.46:0/268066325 shutdown_connections 2024-01-23T08:55:08.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.747+0000 7f48cbe33640 1 -- 172.21.15.46:0/268066325 wait complete. 2024-01-23T08:55:08.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.751+0000 7f48cbe33640 1 Processor -- start 2024-01-23T08:55:08.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.751+0000 7f48cbe33640 1 -- start start 2024-01-23T08:55:08.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.751+0000 7f48cbe33640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48c415c1d0 0x7f48c41f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:08.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.751+0000 7f48cbe33640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48c40c3030 0x7f48c40c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:08.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.751+0000 7f48cbe33640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48c415c5b0 0x7f48c4156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:08.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.751+0000 7f48cbe33640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c40c50c0 con 0x7f48c415c5b0 2024-01-23T08:55:08.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.751+0000 7f48cbe33640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c40c7ec0 con 0x7f48c415c1d0 2024-01-23T08:55:08.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.751+0000 7f48cbe33640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c41f2710 con 0x7f48c40c3030 2024-01-23T08:55:08.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.751+0000 7f48ca3d0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48c415c5b0 0x7f48c4156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:08.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.751+0000 7f48ca3d0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48c415c5b0 0x7f48c4156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42586/0 (socket says 172.21.15.46:42586) 2024-01-23T08:55:08.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.751+0000 7f48ca3d0640 1 -- 172.21.15.46:0/773207605 learned_addr learned my addr 172.21.15.46:0/773207605 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:08.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.755+0000 7f48ca3d0640 1 -- 172.21.15.46:0/773207605 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48c40c3030 msgr2=0x7f48c40c3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:08.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.755+0000 7f48ca3d0640 1 --2- 172.21.15.46:0/773207605 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48c40c3030 0x7f48c40c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:08.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.755+0000 7f48ca3d0640 1 -- 172.21.15.46:0/773207605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48c415c1d0 msgr2=0x7f48c41f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:08.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.755+0000 7f48ca3d0640 1 --2- 172.21.15.46:0/773207605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48c415c1d0 0x7f48c41f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:08.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.755+0000 7f48ca3d0640 1 -- 172.21.15.46:0/773207605 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c40c34e0 con 0x7f48c415c5b0 2024-01-23T08:55:08.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.755+0000 7f48ca3d0640 1 --2- 172.21.15.46:0/773207605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48c415c5b0 0x7f48c4156a10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f48c406b360 tx=0x7f48bc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:08.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.759+0000 7f48ba7fc640 1 -- 172.21.15.46:0/773207605 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc00acb0 con 0x7f48c415c5b0 2024-01-23T08:55:08.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.759+0000 7f48ba7fc640 1 -- 172.21.15.46:0/773207605 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48bc00ae50 con 0x7f48c415c5b0 2024-01-23T08:55:08.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.759+0000 7f48cbe33640 1 -- 172.21.15.46:0/773207605 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c41f29b0 con 0x7f48c415c5b0 2024-01-23T08:55:08.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.759+0000 7f48ba7fc640 1 -- 172.21.15.46:0/773207605 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc007310 con 0x7f48c415c5b0 2024-01-23T08:55:08.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.759+0000 7f48cbe33640 1 -- 172.21.15.46:0/773207605 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c41f2f70 con 0x7f48c415c5b0 2024-01-23T08:55:08.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:08.763+0000 7f48cbe33640 1 -- 172.21.15.46:0/773207605 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c406d7f0 con 0x7f48c415c5b0 2024-01-23T08:55:09.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.059+0000 7f48ba7fc640 1 -- 172.21.15.46:0/773207605 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f48bc007470 con 0x7f48c415c5b0 2024-01-23T08:55:09.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.059+0000 7f48ba7fc640 1 --2- 172.21.15.46:0/773207605 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f48a8066550 0x7f48a8068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:09.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.059+0000 7f48c9bcf640 1 --2- 172.21.15.46:0/773207605 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f48a8066550 0x7f48a8068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:09.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.059+0000 7f48c9bcf640 1 --2- 172.21.15.46:0/773207605 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f48a8066550 0x7f48a8068a10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f48c00af000 tx=0x7f48c0004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:09.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.091+0000 7f48ba7fc640 1 -- 172.21.15.46:0/773207605 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f48bc055760 con 0x7f48c415c5b0 2024-01-23T08:55:09.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.091+0000 7f48ba7fc640 1 -- 172.21.15.46:0/773207605 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f48bc0513a0 con 0x7f48c415c5b0 2024-01-23T08:55:09.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.275+0000 7f48cbe33640 1 -- 172.21.15.46:0/773207605 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f48c4074340 con 0x7f48c415c5b0 2024-01-23T08:55:09.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.287+0000 7f48ba7fc640 1 -- 172.21.15.46:0/773207605 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f48bc018020 con 0x7f48c415c5b0 2024-01-23T08:55:09.285 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-01-23T08:55:09.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.291+0000 7f48cbe33640 1 -- 172.21.15.46:0/773207605 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f48a8066550 msgr2=0x7f48a8068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:09.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.291+0000 7f48cbe33640 1 --2- 172.21.15.46:0/773207605 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f48a8066550 0x7f48a8068a10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f48c00af000 tx=0x7f48c0004740 comp rx=0 tx=0).stop 2024-01-23T08:55:09.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.291+0000 7f48cbe33640 1 -- 172.21.15.46:0/773207605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48c415c5b0 msgr2=0x7f48c4156a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:09.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.291+0000 7f48cbe33640 1 --2- 172.21.15.46:0/773207605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48c415c5b0 0x7f48c4156a10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f48c406b360 tx=0x7f48bc00a430 comp rx=0 tx=0).stop 2024-01-23T08:55:09.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.291+0000 7f48cbe33640 1 -- 172.21.15.46:0/773207605 shutdown_connections 2024-01-23T08:55:09.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.291+0000 7f48cbe33640 1 --2- 172.21.15.46:0/773207605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48c415c5b0 0x7f48c4156a10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:09.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.291+0000 7f48cbe33640 1 --2- 172.21.15.46:0/773207605 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48c40c3030 0x7f48c40c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:09.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.291+0000 7f48cbe33640 1 --2- 172.21.15.46:0/773207605 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f48a8066550 0x7f48a8068a10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:09.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.291+0000 7f48cbe33640 1 --2- 172.21.15.46:0/773207605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48c415c1d0 0x7f48c41f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:09.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.291+0000 7f48cbe33640 1 -- 172.21.15.46:0/773207605 >> 172.21.15.46:0/773207605 conn(0x7f48c408afa0 msgr2=0x7f48c40b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:09.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.291+0000 7f48cbe33640 1 -- 172.21.15.46:0/773207605 shutdown_connections 2024-01-23T08:55:09.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.291+0000 7f48cbe33640 1 -- 172.21.15.46:0/773207605 wait complete. 2024-01-23T08:55:09.307 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-23T08:55:09.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.447+0000 7f4b52a7d640 1 Processor -- start 2024-01-23T08:55:09.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.447+0000 7f4b52a7d640 1 -- start start 2024-01-23T08:55:09.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.447+0000 7f4b52a7d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4b4c0cf9e0 0x7f4b4c0c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:09.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.447+0000 7f4b52a7d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b4c15a170 con 0x7f4b4c15a600 2024-01-23T08:55:09.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.447+0000 7f4b52a7d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b4c0b27a0 con 0x7f4b4c0c9920 2024-01-23T08:55:09.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.447+0000 7f4b52a7d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b4c159950 con 0x7f4b4c0cf9e0 2024-01-23T08:55:09.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.447+0000 7f4b50819640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f4b4c0c9920 0x7f4b4c0b2090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.46:53854/0 (socket says 172.21.15.46:53854) 2024-01-23T08:55:09.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.447+0000 7f4b50819640 1 -- 172.21.15.46:0/1135729218 learned_addr learned my addr 172.21.15.46:0/1135729218 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:09.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.475+0000 7f4b5101a640 1 --2- 172.21.15.46:0/1135729218 >> v2:172.21.15.46:3300/0 conn(0x7f4b4c0cf9e0 0x7f4b4c0c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:09.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.483+0000 7f4b5101a640 1 -- 172.21.15.46:0/1135729218 >> v1:172.21.15.175:6789/0 conn(0x7f4b4c0c9920 legacy=0x7f4b4c0b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:09.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.483+0000 7f4b5101a640 1 -- 172.21.15.46:0/1135729218 >> v1:172.21.15.46:6789/0 conn(0x7f4b4c15a600 legacy=0x7f4b4c162260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:09.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.483+0000 7f4b5101a640 1 -- 172.21.15.46:0/1135729218 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c0ca680 con 0x7f4b4c0cf9e0 2024-01-23T08:55:09.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.487+0000 7f4b5101a640 1 --2- 172.21.15.46:0/1135729218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b4c0cf9e0 0x7f4b4c0c9d00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4b44009d90 tx=0x7f4b4401f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ea61626f97e3e8 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:09.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.495+0000 7f4b4b7fe640 1 -- 172.21.15.46:0/1135729218 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b440af600 con 0x7f4b4c0cf9e0 2024-01-23T08:55:09.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.495+0000 7f4b4b7fe640 1 -- 172.21.15.46:0/1135729218 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b440ab050 con 0x7f4b4c0cf9e0 2024-01-23T08:55:09.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.495+0000 7f4b4b7fe640 1 -- 172.21.15.46:0/1135729218 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b440af980 con 0x7f4b4c0cf9e0 2024-01-23T08:55:09.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.495+0000 7f4b52a7d640 1 -- 172.21.15.46:0/1135729218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b4c0cf9e0 msgr2=0x7f4b4c0c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:09.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.495+0000 7f4b52a7d640 1 --2- 172.21.15.46:0/1135729218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b4c0cf9e0 0x7f4b4c0c9d00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4b44009d90 tx=0x7f4b4401f130 comp rx=0 tx=0).stop 2024-01-23T08:55:09.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.495+0000 7f4b52a7d640 1 -- 172.21.15.46:0/1135729218 shutdown_connections 2024-01-23T08:55:09.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.495+0000 7f4b52a7d640 1 --2- 172.21.15.46:0/1135729218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b4c0cf9e0 0x7f4b4c0c9d00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:09.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.495+0000 7f4b52a7d640 1 -- 172.21.15.46:0/1135729218 >> 172.21.15.46:0/1135729218 conn(0x7f4b4c08afa0 msgr2=0x7f4b4c08b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:09.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.499+0000 7f4b52a7d640 1 -- 172.21.15.46:0/1135729218 shutdown_connections 2024-01-23T08:55:09.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.499+0000 7f4b52a7d640 1 -- 172.21.15.46:0/1135729218 wait complete. 2024-01-23T08:55:09.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.499+0000 7f4b52a7d640 1 Processor -- start 2024-01-23T08:55:09.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.499+0000 7f4b52a7d640 1 -- start start 2024-01-23T08:55:09.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.499+0000 7f4b52a7d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b4c0c9920 0x7f4b4c154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:09.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.499+0000 7f4b52a7d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b4c0cf9e0 0x7f4b4c154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:09.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.499+0000 7f4b52a7d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b4c15a600 0x7f4b4c1f2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:09.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.499+0000 7f4b52a7d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c156990 con 0x7f4b4c15a600 2024-01-23T08:55:09.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.499+0000 7f4b52a7d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c1575b0 con 0x7f4b4c0c9920 2024-01-23T08:55:09.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.499+0000 7f4b52a7d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c155900 con 0x7f4b4c0cf9e0 2024-01-23T08:55:09.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.503+0000 7f4b5101a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b4c15a600 0x7f4b4c1f2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:09.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.503+0000 7f4b5101a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b4c15a600 0x7f4b4c1f2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42608/0 (socket says 172.21.15.46:42608) 2024-01-23T08:55:09.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.503+0000 7f4b5101a640 1 -- 172.21.15.46:0/342676539 learned_addr learned my addr 172.21.15.46:0/342676539 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:09.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.507+0000 7f4b5101a640 1 -- 172.21.15.46:0/342676539 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b4c0cf9e0 msgr2=0x7f4b4c154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:09.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.507+0000 7f4b5101a640 1 --2- 172.21.15.46:0/342676539 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b4c0cf9e0 0x7f4b4c154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:09.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.507+0000 7f4b5101a640 1 -- 172.21.15.46:0/342676539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b4c0c9920 msgr2=0x7f4b4c154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:09.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.507+0000 7f4b5101a640 1 --2- 172.21.15.46:0/342676539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b4c0c9920 0x7f4b4c154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:09.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.507+0000 7f4b5101a640 1 -- 172.21.15.46:0/342676539 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b44009a70 con 0x7f4b4c15a600 2024-01-23T08:55:09.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.507+0000 7f4b5101a640 1 --2- 172.21.15.46:0/342676539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b4c15a600 0x7f4b4c1f2d20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4b44009d90 tx=0x7f4b4401bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:09.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.511+0000 7f4b497fa640 1 -- 172.21.15.46:0/342676539 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b440b9610 con 0x7f4b4c15a600 2024-01-23T08:55:09.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.511+0000 7f4b497fa640 1 -- 172.21.15.46:0/342676539 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b440b9770 con 0x7f4b4c15a600 2024-01-23T08:55:09.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.511+0000 7f4b497fa640 1 -- 172.21.15.46:0/342676539 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b440b9b20 con 0x7f4b4c15a600 2024-01-23T08:55:09.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.511+0000 7f4b52a7d640 1 -- 172.21.15.46:0/342676539 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b4c0c56d0 con 0x7f4b4c15a600 2024-01-23T08:55:09.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.511+0000 7f4b52a7d640 1 -- 172.21.15.46:0/342676539 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b4c155e10 con 0x7f4b4c15a600 2024-01-23T08:55:09.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.515+0000 7f4b52a7d640 1 -- 172.21.15.46:0/342676539 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b4c06d7f0 con 0x7f4b4c15a600 2024-01-23T08:55:09.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.535+0000 7f4b497fa640 1 -- 172.21.15.46:0/342676539 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f4b440b6050 con 0x7f4b4c15a600 2024-01-23T08:55:09.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.535+0000 7f4b497fa640 1 --2- 172.21.15.46:0/342676539 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4b30066580 0x7f4b30068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:09.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.535+0000 7f4b50819640 1 --2- 172.21.15.46:0/342676539 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4b30066580 0x7f4b30068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:09.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.535+0000 7f4b50819640 1 --2- 172.21.15.46:0/342676539 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4b30066580 0x7f4b30068a40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4b40001560 tx=0x7f4b40007a50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:09.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.539+0000 7f4b497fa640 1 -- 172.21.15.46:0/342676539 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4b440f46d0 con 0x7f4b4c15a600 2024-01-23T08:55:09.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:09.835+0000 7f4b497fa640 1 -- 172.21.15.46:0/342676539 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f4b440f0310 con 0x7f4b4c15a600 2024-01-23T08:55:10.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.019+0000 7f4b52a7d640 1 -- 172.21.15.46:0/342676539 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4b4c074340 con 0x7f4b4c15a600 2024-01-23T08:55:10.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.031+0000 7f4b497fa640 1 -- 172.21.15.46:0/342676539 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4b440b4020 con 0x7f4b4c15a600 2024-01-23T08:55:10.030 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-23T08:55:10.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.035+0000 7f4b52a7d640 1 -- 172.21.15.46:0/342676539 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4b30066580 msgr2=0x7f4b30068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:10.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.035+0000 7f4b52a7d640 1 --2- 172.21.15.46:0/342676539 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4b30066580 0x7f4b30068a40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4b40001560 tx=0x7f4b40007a50 comp rx=0 tx=0).stop 2024-01-23T08:55:10.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.035+0000 7f4b52a7d640 1 -- 172.21.15.46:0/342676539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b4c15a600 msgr2=0x7f4b4c1f2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:10.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.035+0000 7f4b52a7d640 1 --2- 172.21.15.46:0/342676539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b4c15a600 0x7f4b4c1f2d20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4b44009d90 tx=0x7f4b4401bed0 comp rx=0 tx=0).stop 2024-01-23T08:55:10.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.035+0000 7f4b52a7d640 1 -- 172.21.15.46:0/342676539 shutdown_connections 2024-01-23T08:55:10.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.035+0000 7f4b52a7d640 1 --2- 172.21.15.46:0/342676539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b4c15a600 0x7f4b4c1f2d20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:10.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.035+0000 7f4b52a7d640 1 --2- 172.21.15.46:0/342676539 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b4c0cf9e0 0x7f4b4c154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:10.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.035+0000 7f4b52a7d640 1 --2- 172.21.15.46:0/342676539 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4b30066580 0x7f4b30068a40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:10.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.035+0000 7f4b52a7d640 1 --2- 172.21.15.46:0/342676539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b4c0c9920 0x7f4b4c154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:10.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.035+0000 7f4b52a7d640 1 -- 172.21.15.46:0/342676539 >> 172.21.15.46:0/342676539 conn(0x7f4b4c08afa0 msgr2=0x7f4b4c158310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:10.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.035+0000 7f4b52a7d640 1 -- 172.21.15.46:0/342676539 shutdown_connections 2024-01-23T08:55:10.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.035+0000 7f4b52a7d640 1 -- 172.21.15.46:0/342676539 wait complete. 2024-01-23T08:55:10.051 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-23T08:55:10.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.179+0000 7f351dad4640 1 Processor -- start 2024-01-23T08:55:10.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.179+0000 7f351dad4640 1 -- start start 2024-01-23T08:55:10.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.179+0000 7f351dad4640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f35180c57d0 0x7f3518156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:10.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.179+0000 7f351dad4640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35180c5c40 con 0x7f35180c7cd0 2024-01-23T08:55:10.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.179+0000 7f351dad4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3518156760 con 0x7f35181503c0 2024-01-23T08:55:10.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.179+0000 7f351dad4640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35181507a0 con 0x7f35180c57d0 2024-01-23T08:55:10.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.179+0000 7f3516ffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f35180c57d0 0x7f3518156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:10.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.179+0000 7f3517fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f35180c7cd0 0x7f3518160c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:51580/0 (socket says 172.21.15.46:51580) 2024-01-23T08:55:10.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.179+0000 7f3517fff640 1 -- 172.21.15.46:0/3383784705 learned_addr learned my addr 172.21.15.46:0/3383784705 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:10.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.187+0000 7f3516ffd640 1 -- 172.21.15.46:0/3383784705 >> v1:172.21.15.175:6789/0 conn(0x7f35181503c0 legacy=0x7f3518072760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:10.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.187+0000 7f3516ffd640 1 -- 172.21.15.46:0/3383784705 >> v1:172.21.15.46:6789/0 conn(0x7f35180c7cd0 legacy=0x7f3518160c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:10.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.187+0000 7f3516ffd640 1 -- 172.21.15.46:0/3383784705 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3518071a10 con 0x7f35180c57d0 2024-01-23T08:55:10.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.199+0000 7f3516ffd640 1 --2- 172.21.15.46:0/3383784705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35180c57d0 0x7f3518156bf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f350c0097c0 tx=0x7f350c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b38d4bd5372c5a server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:10.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.211+0000 7f35167fc640 1 -- 172.21.15.46:0/3383784705 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c0a8970 con 0x7f35180c57d0 2024-01-23T08:55:10.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.211+0000 7f35167fc640 1 -- 172.21.15.46:0/3383784705 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c0a8ad0 con 0x7f35180c57d0 2024-01-23T08:55:10.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.211+0000 7f35167fc640 1 -- 172.21.15.46:0/3383784705 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c0a8e60 con 0x7f35180c57d0 2024-01-23T08:55:10.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.211+0000 7f351dad4640 1 -- 172.21.15.46:0/3383784705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35180c57d0 msgr2=0x7f3518156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:10.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.211+0000 7f351dad4640 1 --2- 172.21.15.46:0/3383784705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35180c57d0 0x7f3518156bf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f350c0097c0 tx=0x7f350c01ec70 comp rx=0 tx=0).stop 2024-01-23T08:55:10.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.211+0000 7f351dad4640 1 -- 172.21.15.46:0/3383784705 shutdown_connections 2024-01-23T08:55:10.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.211+0000 7f351dad4640 1 --2- 172.21.15.46:0/3383784705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35180c57d0 0x7f3518156bf0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:10.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.211+0000 7f351dad4640 1 -- 172.21.15.46:0/3383784705 >> 172.21.15.46:0/3383784705 conn(0x7f351806aa60 msgr2=0x7f351806ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:10.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.211+0000 7f351dad4640 1 -- 172.21.15.46:0/3383784705 shutdown_connections 2024-01-23T08:55:10.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.211+0000 7f351dad4640 1 -- 172.21.15.46:0/3383784705 wait complete. 2024-01-23T08:55:10.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.211+0000 7f351dad4640 1 Processor -- start 2024-01-23T08:55:10.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.211+0000 7f351dad4640 1 -- start start 2024-01-23T08:55:10.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.215+0000 7f351dad4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35180c57d0 0x7f351806f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:10.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.215+0000 7f351dad4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35180c7cd0 0x7f3518142cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:10.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.215+0000 7f351dad4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35181503c0 0x7f35181f3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:10.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.215+0000 7f351dad4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3518155e90 con 0x7f35181503c0 2024-01-23T08:55:10.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.215+0000 7f351dad4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35181f0e80 con 0x7f35180c7cd0 2024-01-23T08:55:10.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.215+0000 7f351dad4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351815a3d0 con 0x7f35180c57d0 2024-01-23T08:55:10.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.215+0000 7f35177fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35180c57d0 0x7f351806f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:10.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.215+0000 7f3516ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35180c7cd0 0x7f3518142cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:10.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.219+0000 7f3516ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35180c7cd0 0x7f3518142cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:54578/0 (socket says 172.21.15.46:54578) 2024-01-23T08:55:10.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.219+0000 7f3516ffd640 1 -- 172.21.15.46:0/4232503883 learned_addr learned my addr 172.21.15.46:0/4232503883 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:10.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.219+0000 7f3517fff640 1 --2- 172.21.15.46:0/4232503883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35181503c0 0x7f35181f3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:10.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.227+0000 7f3516ffd640 1 -- 172.21.15.46:0/4232503883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35180c57d0 msgr2=0x7f351806f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:10.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.227+0000 7f3516ffd640 1 --2- 172.21.15.46:0/4232503883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35180c57d0 0x7f351806f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:10.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.227+0000 7f3516ffd640 1 -- 172.21.15.46:0/4232503883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35181503c0 msgr2=0x7f35181f3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:10.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.227+0000 7f3516ffd640 1 --2- 172.21.15.46:0/4232503883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35181503c0 0x7f35181f3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:10.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.227+0000 7f3516ffd640 1 -- 172.21.15.46:0/4232503883 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c009420 con 0x7f35180c7cd0 2024-01-23T08:55:10.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.227+0000 7f35177fe640 1 --2- 172.21.15.46:0/4232503883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35180c57d0 0x7f351806f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-23T08:55:10.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.235+0000 7f3516ffd640 1 --2- 172.21.15.46:0/4232503883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35180c7cd0 0x7f3518142cd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f350c01b880 tx=0x7f350c01ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:10.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.243+0000 7f34fffff640 1 -- 172.21.15.46:0/4232503883 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c0b9610 con 0x7f35180c7cd0 2024-01-23T08:55:10.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.243+0000 7f34fffff640 1 -- 172.21.15.46:0/4232503883 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c0b9790 con 0x7f35180c7cd0 2024-01-23T08:55:10.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.243+0000 7f34fffff640 1 -- 172.21.15.46:0/4232503883 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c0b9b40 con 0x7f35180c7cd0 2024-01-23T08:55:10.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.243+0000 7f351dad4640 1 -- 172.21.15.46:0/4232503883 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f351813a260 con 0x7f35180c7cd0 2024-01-23T08:55:10.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.243+0000 7f351dad4640 1 -- 172.21.15.46:0/4232503883 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35181f3950 con 0x7f35180c7cd0 2024-01-23T08:55:10.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.243+0000 7f351dad4640 1 -- 172.21.15.46:0/4232503883 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3518074340 con 0x7f35180c7cd0 2024-01-23T08:55:10.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.583+0000 7f34fffff640 1 -- 172.21.15.46:0/4232503883 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f350c0b7040 con 0x7f35180c7cd0 2024-01-23T08:55:10.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.583+0000 7f34fffff640 1 --2- 172.21.15.46:0/4232503883 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3504066530 0x7f35040689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:10.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.583+0000 7f35177fe640 1 --2- 172.21.15.46:0/4232503883 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3504066530 0x7f35040689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:10.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.583+0000 7f35177fe640 1 --2- 172.21.15.46:0/4232503883 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3504066530 0x7f35040689f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3508007fd0 tx=0x7f3508009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:10.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.591+0000 7f34fffff640 1 -- 172.21.15.46:0/4232503883 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f350c0a8910 con 0x7f35180c7cd0 2024-01-23T08:55:10.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.619+0000 7f34fffff640 1 -- 172.21.15.46:0/4232503883 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f350c0ef570 con 0x7f35180c7cd0 2024-01-23T08:55:10.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.795+0000 7f351dad4640 1 -- 172.21.15.46:0/4232503883 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f35181f3950 con 0x7f35180c7cd0 2024-01-23T08:55:10.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.871+0000 7f34fffff640 1 -- 172.21.15.46:0/4232503883 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f35181f3950 con 0x7f35180c7cd0 2024-01-23T08:55:10.869 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2024-01-23T08:55:10.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.875+0000 7f351dad4640 1 -- 172.21.15.46:0/4232503883 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3504066530 msgr2=0x7f35040689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:10.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.875+0000 7f351dad4640 1 --2- 172.21.15.46:0/4232503883 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3504066530 0x7f35040689f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3508007fd0 tx=0x7f3508009040 comp rx=0 tx=0).stop 2024-01-23T08:55:10.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.875+0000 7f351dad4640 1 -- 172.21.15.46:0/4232503883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35180c7cd0 msgr2=0x7f3518142cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:10.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.875+0000 7f351dad4640 1 --2- 172.21.15.46:0/4232503883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35180c7cd0 0x7f3518142cd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f350c01b880 tx=0x7f350c01ba10 comp rx=0 tx=0).stop 2024-01-23T08:55:10.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.875+0000 7f351dad4640 1 -- 172.21.15.46:0/4232503883 shutdown_connections 2024-01-23T08:55:10.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.875+0000 7f351dad4640 1 --2- 172.21.15.46:0/4232503883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35181503c0 0x7f35181f3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:10.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.875+0000 7f351dad4640 1 --2- 172.21.15.46:0/4232503883 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3504066530 0x7f35040689f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:10.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.875+0000 7f351dad4640 1 --2- 172.21.15.46:0/4232503883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35180c7cd0 0x7f3518142cd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:10.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.875+0000 7f351dad4640 1 --2- 172.21.15.46:0/4232503883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35180c57d0 0x7f351806f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:10.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.875+0000 7f351dad4640 1 -- 172.21.15.46:0/4232503883 >> 172.21.15.46:0/4232503883 conn(0x7f351806aa60 msgr2=0x7f351806ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:10.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.875+0000 7f351dad4640 1 -- 172.21.15.46:0/4232503883 shutdown_connections 2024-01-23T08:55:10.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:10.875+0000 7f351dad4640 1 -- 172.21.15.46:0/4232503883 wait complete. 2024-01-23T08:55:10.896 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi046.front.sepia.ceph.com... 2024-01-23T08:55:10.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:55:10.896 DEBUG:teuthology.orchestra.run.smithi046:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-01-23T08:55:10.921 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi046.stderr:ceph-fuse[33407]: fuse finished with error 0 and tester_r 0 2024-01-23T08:55:10.922 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T08:55:17.024 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2024-01-23T08:55:17.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:55:17.025 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-01-23T08:55:17.041 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-23T08:55:17.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.215+0000 7f5a2a8eb640 1 Processor -- start 2024-01-23T08:55:17.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.219+0000 7f5a2a8eb640 1 -- start start 2024-01-23T08:55:17.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.219+0000 7f5a2a8eb640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5a241538f0 0x7f5a240c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:17.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.219+0000 7f5a2a8eb640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5a240c83c0 0x7f5a240c2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:17.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.219+0000 7f5a2a8eb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a240c1ba0 0x7f5a240c2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:17.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.219+0000 7f5a2a8eb640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a24070460 con 0x7f5a240c83c0 2024-01-23T08:55:17.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.219+0000 7f5a2a8eb640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a2406f950 con 0x7f5a241538f0 2024-01-23T08:55:17.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.219+0000 7f5a2a8eb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2406fbc0 con 0x7f5a240c1ba0 2024-01-23T08:55:17.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.219+0000 7f5a237fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5a240c83c0 0x7f5a240c2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:17.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.219+0000 7f5a237fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5a240c83c0 0x7f5a240c2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59990/0 (socket says 172.21.15.46:59990) 2024-01-23T08:55:17.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.219+0000 7f5a237fe640 1 -- 172.21.15.46:0/3691246404 learned_addr learned my addr 172.21.15.46:0/3691246404 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:17.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.219+0000 7f5a28e88640 1 --2- 172.21.15.46:0/3691246404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a240c1ba0 0x7f5a240c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:17.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.219+0000 7f5a23fff640 1 --2- 172.21.15.46:0/3691246404 >> v2:172.21.15.175:3300/0 conn(0x7f5a241538f0 0x7f5a240c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:17.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.223+0000 7f5a237fe640 1 -- 172.21.15.46:0/3691246404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a240c1ba0 msgr2=0x7f5a240c2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:17.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.223+0000 7f5a237fe640 1 --2- 172.21.15.46:0/3691246404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a240c1ba0 0x7f5a240c2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:17.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.223+0000 7f5a237fe640 1 -- 172.21.15.46:0/3691246404 >> v2:172.21.15.175:3300/0 conn(0x7f5a241538f0 msgr2=0x7f5a240c6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:17.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.223+0000 7f5a237fe640 1 --2- 172.21.15.46:0/3691246404 >> v2:172.21.15.175:3300/0 conn(0x7f5a241538f0 0x7f5a240c6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:17.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.223+0000 7f5a237fe640 1 -- 172.21.15.46:0/3691246404 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2406fea0 con 0x7f5a240c83c0 2024-01-23T08:55:17.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.223+0000 7f5a237fe640 1 --2- 172.21.15.46:0/3691246404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a240c83c0 0x7f5a240c2c20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5a240c6a00 tx=0x7f5a0c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c578b739daaabe2a server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:17.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.227+0000 7f5a22ffd640 1 -- 172.21.15.46:0/3691246404 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c0ab670 con 0x7f5a240c83c0 2024-01-23T08:55:17.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.231+0000 7f5a22ffd640 1 -- 172.21.15.46:0/3691246404 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0c0ab7d0 con 0x7f5a240c83c0 2024-01-23T08:55:17.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.231+0000 7f5a22ffd640 1 -- 172.21.15.46:0/3691246404 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c0abb60 con 0x7f5a240c83c0 2024-01-23T08:55:17.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.231+0000 7f5a2a8eb640 1 -- 172.21.15.46:0/3691246404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a240c83c0 msgr2=0x7f5a240c2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:17.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.231+0000 7f5a2a8eb640 1 --2- 172.21.15.46:0/3691246404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a240c83c0 0x7f5a240c2c20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5a240c6a00 tx=0x7f5a0c01c4d0 comp rx=0 tx=0).stop 2024-01-23T08:55:17.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.231+0000 7f5a2a8eb640 1 -- 172.21.15.46:0/3691246404 shutdown_connections 2024-01-23T08:55:17.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.231+0000 7f5a2a8eb640 1 --2- 172.21.15.46:0/3691246404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a240c1ba0 0x7f5a240c2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:17.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.231+0000 7f5a2a8eb640 1 --2- 172.21.15.46:0/3691246404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a240c83c0 0x7f5a240c2c20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:17.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.231+0000 7f5a2a8eb640 1 --2- 172.21.15.46:0/3691246404 >> v2:172.21.15.175:3300/0 conn(0x7f5a241538f0 0x7f5a240c6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:17.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.231+0000 7f5a2a8eb640 1 -- 172.21.15.46:0/3691246404 >> 172.21.15.46:0/3691246404 conn(0x7f5a240cbe70 msgr2=0x7f5a240cc280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:17.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.231+0000 7f5a2a8eb640 1 -- 172.21.15.46:0/3691246404 shutdown_connections 2024-01-23T08:55:17.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.231+0000 7f5a2a8eb640 1 -- 172.21.15.46:0/3691246404 wait complete. 2024-01-23T08:55:17.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.231+0000 7f5a2a8eb640 1 Processor -- start 2024-01-23T08:55:17.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.231+0000 7f5a2a8eb640 1 -- start start 2024-01-23T08:55:17.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.231+0000 7f5a2a8eb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a240c1ba0 0x7f5a241f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:17.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.231+0000 7f5a2a8eb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a240c83c0 0x7f5a24146730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:17.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.231+0000 7f5a2a8eb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a241538f0 0x7f5a24149680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:17.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.231+0000 7f5a2a8eb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a241f2850 con 0x7f5a240c83c0 2024-01-23T08:55:17.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.231+0000 7f5a2a8eb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2414a0f0 con 0x7f5a241538f0 2024-01-23T08:55:17.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.231+0000 7f5a2a8eb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a241f21d0 con 0x7f5a240c1ba0 2024-01-23T08:55:17.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.235+0000 7f5a28e88640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a241538f0 0x7f5a24149680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:17.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.235+0000 7f5a23fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a240c1ba0 0x7f5a241f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:17.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.235+0000 7f5a28e88640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a241538f0 0x7f5a24149680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:58956/0 (socket says 172.21.15.46:58956) 2024-01-23T08:55:17.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.235+0000 7f5a28e88640 1 -- 172.21.15.46:0/2376062953 learned_addr learned my addr 172.21.15.46:0/2376062953 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:17.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.235+0000 7f5a237fe640 1 --2- 172.21.15.46:0/2376062953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a240c83c0 0x7f5a24146730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:17.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.239+0000 7f5a237fe640 1 -- 172.21.15.46:0/2376062953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a240c1ba0 msgr2=0x7f5a241f2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:17.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.239+0000 7f5a237fe640 1 --2- 172.21.15.46:0/2376062953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a240c1ba0 0x7f5a241f2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:17.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.239+0000 7f5a237fe640 1 -- 172.21.15.46:0/2376062953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a241538f0 msgr2=0x7f5a24149680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:17.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.243+0000 7f5a237fe640 1 --2- 172.21.15.46:0/2376062953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a241538f0 0x7f5a24149680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:17.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.243+0000 7f5a237fe640 1 -- 172.21.15.46:0/2376062953 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0c0094d0 con 0x7f5a240c83c0 2024-01-23T08:55:17.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.243+0000 7f5a237fe640 1 --2- 172.21.15.46:0/2376062953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a240c83c0 0x7f5a24146730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c0ac000 tx=0x7f5a0c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:17.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.247+0000 7f5a20ff9640 1 -- 172.21.15.46:0/2376062953 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c0b4800 con 0x7f5a240c83c0 2024-01-23T08:55:17.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.247+0000 7f5a20ff9640 1 -- 172.21.15.46:0/2376062953 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0c0b4980 con 0x7f5a240c83c0 2024-01-23T08:55:17.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.247+0000 7f5a20ff9640 1 -- 172.21.15.46:0/2376062953 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c0b4d30 con 0x7f5a240c83c0 2024-01-23T08:55:17.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.247+0000 7f5a2a8eb640 1 -- 172.21.15.46:0/2376062953 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a241f61c0 con 0x7f5a240c83c0 2024-01-23T08:55:17.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.247+0000 7f5a2a8eb640 1 -- 172.21.15.46:0/2376062953 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a2415a730 con 0x7f5a240c83c0 2024-01-23T08:55:17.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.247+0000 7f5a2a8eb640 1 -- 172.21.15.46:0/2376062953 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a241f2990 con 0x7f5a240c83c0 2024-01-23T08:55:17.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.539+0000 7f5a20ff9640 1 -- 172.21.15.46:0/2376062953 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5a0c0c8420 con 0x7f5a240c83c0 2024-01-23T08:55:17.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.539+0000 7f5a20ff9640 1 --2- 172.21.15.46:0/2376062953 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5a04066550 0x7f5a04068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:17.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.539+0000 7f5a23fff640 1 --2- 172.21.15.46:0/2376062953 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5a04066550 0x7f5a04068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:17.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.539+0000 7f5a23fff640 1 --2- 172.21.15.46:0/2376062953 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5a04066550 0x7f5a04068a10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5a140079c0 tx=0x7f5a14008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:17.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.555+0000 7f5a20ff9640 1 -- 172.21.15.46:0/2376062953 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5a0c0ef8e0 con 0x7f5a240c83c0 2024-01-23T08:55:17.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.555+0000 7f5a20ff9640 1 -- 172.21.15.46:0/2376062953 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5a0c0ebc20 con 0x7f5a240c83c0 2024-01-23T08:55:17.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.723+0000 7f5a2a8eb640 1 -- 172.21.15.46:0/2376062953 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a24074340 con 0x7f5a240c83c0 2024-01-23T08:55:17.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.827+0000 7f5a20ff9640 1 -- 172.21.15.46:0/2376062953 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f5a0c0ab630 con 0x7f5a240c83c0 2024-01-23T08:55:17.825 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:55:17.825 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":28,"fsid":"fdbdd393-f422-45ae-a488-2bbb0163e580","created":"2024-01-23T08:53:36.942515+0000","modified":"2024-01-23T08:54:50.465916+0000","last_up_change":"2024-01-23T08:53:57.198113+0000","last_in_change":"2024-01-23T08:53:47.852614+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-23T08:53:59.340853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-23T08:54:38.278770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-23T08:54:40.216521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-23T08:54:47.311079+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f32c3d7d-e32a-42d8-b55f-db874d915a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6818","nonce":2681790976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6821","nonce":2681790976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6825","nonce":2681790976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6823","nonce":2681790976}]},"public_addr":"172.21.15.46:6818/2681790976","cluster_addr":"172.21.15.46:6821/2681790976","heartbeat_back_addr":"172.21.15.46:6825/2681790976","heartbeat_front_addr":"172.21.15.46:6823/2681790976","state":["exists","up"]},{"osd":1,"uuid":"6f3b6bd2-bbea-4d08-84d5-4407363b5eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6803","nonce":3679152623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6805","nonce":3679152623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6809","nonce":3679152623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6807","nonce":3679152623}]},"public_addr":"172.21.15.46:6803/3679152623","cluster_addr":"172.21.15.46:6805/3679152623","heartbeat_back_addr":"172.21.15.46:6809/3679152623","heartbeat_front_addr":"172.21.15.46:6807/3679152623","state":["exists","up"]},{"osd":2,"uuid":"8f110727-31e7-4f69-926b-c87481d4d28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6811","nonce":3869652274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6813","nonce":3869652274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6820","nonce":3869652274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6815","nonce":3869652274}]},"public_addr":"172.21.15.46:6811/3869652274","cluster_addr":"172.21.15.46:6813/3869652274","heartbeat_back_addr":"172.21.15.46:6820/3869652274","heartbeat_front_addr":"172.21.15.46:6815/3869652274","state":["exists","up"]},{"osd":3,"uuid":"3aa7527d-0463-4373-b9c7-e6b507a7987f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6827","nonce":4168860822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6829","nonce":4168860822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6833","nonce":4168860822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6831","nonce":4168860822}]},"public_addr":"172.21.15.46:6827/4168860822","cluster_addr":"172.21.15.46:6829/4168860822","heartbeat_back_addr":"172.21.15.46:6833/4168860822","heartbeat_front_addr":"172.21.15.46:6831/4168860822","state":["exists","up"]},{"osd":4,"uuid":"eb47a1e5-9f26-465f-b188-87c6eed63c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6805","nonce":3115257412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6808","nonce":3115257412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6815","nonce":3115257412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6812","nonce":3115257412}]},"public_addr":"172.21.15.175:6805/3115257412","cluster_addr":"172.21.15.175:6808/3115257412","heartbeat_back_addr":"172.21.15.175:6815/3115257412","heartbeat_front_addr":"172.21.15.175:6812/3115257412","state":["exists","up"]},{"osd":5,"uuid":"34048409-998c-44f3-a29d-dcad7a6c917b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6818","nonce":3146473948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6822","nonce":3146473948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6831","nonce":3146473948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6826","nonce":3146473948}]},"public_addr":"172.21.15.175:6818/3146473948","cluster_addr":"172.21.15.175:6822/3146473948","heartbeat_back_addr":"172.21.15.175:6831/3146473948","heartbeat_front_addr":"172.21.15.175:6826/3146473948","state":["exists","up"]},{"osd":6,"uuid":"f5d45d3f-9af3-44a1-a730-c260ed1654b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6801","nonce":4161180058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6804","nonce":4161180058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6814","nonce":4161180058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6809","nonce":4161180058}]},"public_addr":"172.21.15.175:6801/4161180058","cluster_addr":"172.21.15.175:6804/4161180058","heartbeat_back_addr":"172.21.15.175:6814/4161180058","heartbeat_front_addr":"172.21.15.175:6809/4161180058","state":["exists","up"]},{"osd":7,"uuid":"16d12e53-2ad3-4b5c-a789-22b45056fd9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6819","nonce":2670236415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6823","nonce":2670236415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6830","nonce":2670236415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6827","nonce":2670236415}]},"public_addr":"172.21.15.175:6819/2670236415","cluster_addr":"172.21.15.175:6823/2670236415","heartbeat_back_addr":"172.21.15.175:6830/2670236415","heartbeat_front_addr":"172.21.15.175:6827/2670236415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.847037+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.765547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.716122+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.874628+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.786580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.924885+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.285635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.898130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T08:55:17.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.831+0000 7f5a2a8eb640 1 -- 172.21.15.46:0/2376062953 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5a04066550 msgr2=0x7f5a04068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:17.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.831+0000 7f5a2a8eb640 1 --2- 172.21.15.46:0/2376062953 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5a04066550 0x7f5a04068a10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5a140079c0 tx=0x7f5a14008040 comp rx=0 tx=0).stop 2024-01-23T08:55:17.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.831+0000 7f5a2a8eb640 1 -- 172.21.15.46:0/2376062953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a240c83c0 msgr2=0x7f5a24146730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:17.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.831+0000 7f5a2a8eb640 1 --2- 172.21.15.46:0/2376062953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a240c83c0 0x7f5a24146730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c0ac000 tx=0x7f5a0c01ad10 comp rx=0 tx=0).stop 2024-01-23T08:55:17.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.831+0000 7f5a2a8eb640 1 -- 172.21.15.46:0/2376062953 shutdown_connections 2024-01-23T08:55:17.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.831+0000 7f5a2a8eb640 1 --2- 172.21.15.46:0/2376062953 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5a04066550 0x7f5a04068a10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:17.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.831+0000 7f5a2a8eb640 1 --2- 172.21.15.46:0/2376062953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a241538f0 0x7f5a24149680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:17.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.831+0000 7f5a2a8eb640 1 --2- 172.21.15.46:0/2376062953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a240c83c0 0x7f5a24146730 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:17.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.831+0000 7f5a2a8eb640 1 --2- 172.21.15.46:0/2376062953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a240c1ba0 0x7f5a241f2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:17.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.831+0000 7f5a2a8eb640 1 -- 172.21.15.46:0/2376062953 >> 172.21.15.46:0/2376062953 conn(0x7f5a240cbe70 msgr2=0x7f5a2406a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:17.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.831+0000 7f5a2a8eb640 1 -- 172.21.15.46:0/2376062953 shutdown_connections 2024-01-23T08:55:17.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.831+0000 7f5a2a8eb640 1 -- 172.21.15.46:0/2376062953 wait complete. 2024-01-23T08:55:17.852 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-23T08:55:17.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.979+0000 7f5350b22640 1 Processor -- start 2024-01-23T08:55:17.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.979+0000 7f5350b22640 1 -- start start 2024-01-23T08:55:17.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.979+0000 7f5350b22640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f534c0c67e0 0x7f534c0c8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:17.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.979+0000 7f5350b22640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f534c0c0e90 0x7f534c0c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:17.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.979+0000 7f5350b22640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f534c06f7c0 con 0x7f534c150610 2024-01-23T08:55:17.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.979+0000 7f5350b22640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f534c0c2980 con 0x7f534c0c0e90 2024-01-23T08:55:17.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.979+0000 7f5350b22640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534c156b00 con 0x7f534c0c67e0 2024-01-23T08:55:17.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.979+0000 7f534a59c640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f534c150610 0x7f534c1563f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41354/0 (socket says 172.21.15.46:41354) 2024-01-23T08:55:17.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.979+0000 7f534a59c640 1 -- 172.21.15.46:0/276661848 learned_addr learned my addr 172.21.15.46:0/276661848 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:17.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.979+0000 7f5343fff640 1 --2- 172.21.15.46:0/276661848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f534c0c67e0 0x7f534c0c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:17.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.983+0000 7f5349d9b640 1 -- 172.21.15.46:0/276661848 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 180550390 0 0) 0x7f534c06f7c0 con 0x7f534c150610 2024-01-23T08:55:17.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.983+0000 7f5349d9b640 1 -- 172.21.15.46:0/276661848 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5338003530 con 0x7f534c150610 2024-01-23T08:55:17.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.983+0000 7f534ad9d640 1 --2- 172.21.15.46:0/276661848 >> v2:172.21.15.175:3300/0 conn(0x7f534c0c0e90 0x7f534c0c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:17.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.987+0000 7f5343fff640 1 -- 172.21.15.46:0/276661848 >> v2:172.21.15.175:3300/0 conn(0x7f534c0c0e90 msgr2=0x7f534c0c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:17.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.987+0000 7f5343fff640 1 --2- 172.21.15.46:0/276661848 >> v2:172.21.15.175:3300/0 conn(0x7f534c0c0e90 0x7f534c0c8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:17.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.987+0000 7f5343fff640 1 -- 172.21.15.46:0/276661848 >> v1:172.21.15.46:6789/0 conn(0x7f534c150610 legacy=0x7f534c1563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:17.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.987+0000 7f5343fff640 1 -- 172.21.15.46:0/276661848 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c06fa10 con 0x7f534c0c67e0 2024-01-23T08:55:17.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:17.995+0000 7f5343fff640 1 --2- 172.21.15.46:0/276661848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f534c0c67e0 0x7f534c0c8870 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f53340097c0 tx=0x7f533401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70ce118a8e8cad7d server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:18.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.003+0000 7f5349d9b640 1 -- 172.21.15.46:0/276661848 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53340a8970 con 0x7f534c0c67e0 2024-01-23T08:55:18.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.003+0000 7f5349d9b640 1 -- 172.21.15.46:0/276661848 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53340a8ad0 con 0x7f534c0c67e0 2024-01-23T08:55:18.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.003+0000 7f5349d9b640 1 -- 172.21.15.46:0/276661848 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53340a8e60 con 0x7f534c0c67e0 2024-01-23T08:55:18.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.007+0000 7f5350b22640 1 -- 172.21.15.46:0/276661848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f534c0c67e0 msgr2=0x7f534c0c8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:18.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.007+0000 7f5350b22640 1 --2- 172.21.15.46:0/276661848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f534c0c67e0 0x7f534c0c8870 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f53340097c0 tx=0x7f533401ec70 comp rx=0 tx=0).stop 2024-01-23T08:55:18.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.007+0000 7f5350b22640 1 -- 172.21.15.46:0/276661848 shutdown_connections 2024-01-23T08:55:18.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.007+0000 7f5350b22640 1 --2- 172.21.15.46:0/276661848 >> v2:172.21.15.175:3300/0 conn(0x7f534c0c0e90 0x7f534c0c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:18.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.007+0000 7f5350b22640 1 --2- 172.21.15.46:0/276661848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f534c0c67e0 0x7f534c0c8870 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:18.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.007+0000 7f5350b22640 1 -- 172.21.15.46:0/276661848 >> 172.21.15.46:0/276661848 conn(0x7f534c06de30 msgr2=0x7f534c06e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:18.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.007+0000 7f5350b22640 1 -- 172.21.15.46:0/276661848 shutdown_connections 2024-01-23T08:55:18.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.007+0000 7f5350b22640 1 -- 172.21.15.46:0/276661848 wait complete. 2024-01-23T08:55:18.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.007+0000 7f5350b22640 1 Processor -- start 2024-01-23T08:55:18.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.007+0000 7f5350b22640 1 -- start start 2024-01-23T08:55:18.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.007+0000 7f5350b22640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f534c0c0e90 0x7f534c1f2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:18.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.007+0000 7f5350b22640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f534c0c67e0 0x7f534c155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:18.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.007+0000 7f5350b22640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f534c150610 0x7f534c14c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:18.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.007+0000 7f5350b22640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c14ac80 con 0x7f534c0c67e0 2024-01-23T08:55:18.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.007+0000 7f5350b22640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c14af40 con 0x7f534c150610 2024-01-23T08:55:18.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.007+0000 7f5350b22640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534c14b220 con 0x7f534c0c0e90 2024-01-23T08:55:18.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.007+0000 7f5343fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f534c0c67e0 0x7f534c155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:18.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.007+0000 7f5343fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f534c0c67e0 0x7f534c155640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60004/0 (socket says 172.21.15.46:60004) 2024-01-23T08:55:18.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.007+0000 7f5343fff640 1 -- 172.21.15.46:0/469523250 learned_addr learned my addr 172.21.15.46:0/469523250 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:18.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.011+0000 7f534ad9d640 1 --2- 172.21.15.46:0/469523250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f534c150610 0x7f534c14c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:18.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.011+0000 7f534a59c640 1 --2- 172.21.15.46:0/469523250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f534c0c0e90 0x7f534c1f2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:18.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.011+0000 7f5343fff640 1 -- 172.21.15.46:0/469523250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f534c0c0e90 msgr2=0x7f534c1f2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:18.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.011+0000 7f5343fff640 1 --2- 172.21.15.46:0/469523250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f534c0c0e90 0x7f534c1f2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:18.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.011+0000 7f5343fff640 1 -- 172.21.15.46:0/469523250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f534c150610 msgr2=0x7f534c14c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:18.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.011+0000 7f5343fff640 1 --2- 172.21.15.46:0/469523250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f534c150610 0x7f534c14c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:18.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.011+0000 7f5343fff640 1 -- 172.21.15.46:0/469523250 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5334009420 con 0x7f534c0c67e0 2024-01-23T08:55:18.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.015+0000 7f5343fff640 1 --2- 172.21.15.46:0/469523250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f534c0c67e0 0x7f534c155640 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f533401b880 tx=0x7f533401ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:18.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.019+0000 7f5342ffd640 1 -- 172.21.15.46:0/469523250 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53340b0d00 con 0x7f534c0c67e0 2024-01-23T08:55:18.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.019+0000 7f5342ffd640 1 -- 172.21.15.46:0/469523250 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53340b0e60 con 0x7f534c0c67e0 2024-01-23T08:55:18.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.019+0000 7f5342ffd640 1 -- 172.21.15.46:0/469523250 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53340b9640 con 0x7f534c0c67e0 2024-01-23T08:55:18.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.019+0000 7f5350b22640 1 -- 172.21.15.46:0/469523250 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534c14b500 con 0x7f534c0c67e0 2024-01-23T08:55:18.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.023+0000 7f5350b22640 1 -- 172.21.15.46:0/469523250 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534c14bd60 con 0x7f534c0c67e0 2024-01-23T08:55:18.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.023+0000 7f5350b22640 1 -- 172.21.15.46:0/469523250 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f534c074340 con 0x7f534c0c67e0 2024-01-23T08:55:18.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.319+0000 7f5342ffd640 1 -- 172.21.15.46:0/469523250 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f53340b7040 con 0x7f534c0c67e0 2024-01-23T08:55:18.318 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T08:55:18.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.323+0000 7f5342ffd640 1 --2- 172.21.15.46:0/469523250 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f532c066550 0x7f532c068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:18.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.323+0000 7f534a59c640 1 --2- 172.21.15.46:0/469523250 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f532c066550 0x7f532c068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:18.321 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T08:55:18.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.323+0000 7f534a59c640 1 --2- 172.21.15.46:0/469523250 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f532c066550 0x7f532c068a10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f533c007fd0 tx=0x7f533c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:18.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.359+0000 7f5342ffd640 1 -- 172.21.15.46:0/469523250 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f53340f3280 con 0x7f534c0c67e0 2024-01-23T08:55:18.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.359+0000 7f5342ffd640 1 -- 172.21.15.46:0/469523250 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f53340ef5c0 con 0x7f534c0c67e0 2024-01-23T08:55:18.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.531+0000 7f5350b22640 1 -- 172.21.15.46:0/469523250 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f534c0701b0 con 0x7f534c0c67e0 2024-01-23T08:55:18.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.575+0000 7f5342ffd640 1 -- 172.21.15.46:0/469523250 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f53340b5020 con 0x7f534c0c67e0 2024-01-23T08:55:18.575 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:55:18.575 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":28,"fsid":"fdbdd393-f422-45ae-a488-2bbb0163e580","created":"2024-01-23T08:53:36.942515+0000","modified":"2024-01-23T08:54:50.465916+0000","last_up_change":"2024-01-23T08:53:57.198113+0000","last_in_change":"2024-01-23T08:53:47.852614+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-23T08:53:59.340853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-23T08:54:38.278770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-23T08:54:40.216521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-23T08:54:47.311079+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f32c3d7d-e32a-42d8-b55f-db874d915a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6818","nonce":2681790976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6821","nonce":2681790976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6825","nonce":2681790976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6823","nonce":2681790976}]},"public_addr":"172.21.15.46:6818/2681790976","cluster_addr":"172.21.15.46:6821/2681790976","heartbeat_back_addr":"172.21.15.46:6825/2681790976","heartbeat_front_addr":"172.21.15.46:6823/2681790976","state":["exists","up"]},{"osd":1,"uuid":"6f3b6bd2-bbea-4d08-84d5-4407363b5eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6803","nonce":3679152623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6805","nonce":3679152623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6809","nonce":3679152623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6807","nonce":3679152623}]},"public_addr":"172.21.15.46:6803/3679152623","cluster_addr":"172.21.15.46:6805/3679152623","heartbeat_back_addr":"172.21.15.46:6809/3679152623","heartbeat_front_addr":"172.21.15.46:6807/3679152623","state":["exists","up"]},{"osd":2,"uuid":"8f110727-31e7-4f69-926b-c87481d4d28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6811","nonce":3869652274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6813","nonce":3869652274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6820","nonce":3869652274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6815","nonce":3869652274}]},"public_addr":"172.21.15.46:6811/3869652274","cluster_addr":"172.21.15.46:6813/3869652274","heartbeat_back_addr":"172.21.15.46:6820/3869652274","heartbeat_front_addr":"172.21.15.46:6815/3869652274","state":["exists","up"]},{"osd":3,"uuid":"3aa7527d-0463-4373-b9c7-e6b507a7987f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6827","nonce":4168860822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6829","nonce":4168860822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6833","nonce":4168860822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6831","nonce":4168860822}]},"public_addr":"172.21.15.46:6827/4168860822","cluster_addr":"172.21.15.46:6829/4168860822","heartbeat_back_addr":"172.21.15.46:6833/4168860822","heartbeat_front_addr":"172.21.15.46:6831/4168860822","state":["exists","up"]},{"osd":4,"uuid":"eb47a1e5-9f26-465f-b188-87c6eed63c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6805","nonce":3115257412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6808","nonce":3115257412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6815","nonce":3115257412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6812","nonce":3115257412}]},"public_addr":"172.21.15.175:6805/3115257412","cluster_addr":"172.21.15.175:6808/3115257412","heartbeat_back_addr":"172.21.15.175:6815/3115257412","heartbeat_front_addr":"172.21.15.175:6812/3115257412","state":["exists","up"]},{"osd":5,"uuid":"34048409-998c-44f3-a29d-dcad7a6c917b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6818","nonce":3146473948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6822","nonce":3146473948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6831","nonce":3146473948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6826","nonce":3146473948}]},"public_addr":"172.21.15.175:6818/3146473948","cluster_addr":"172.21.15.175:6822/3146473948","heartbeat_back_addr":"172.21.15.175:6831/3146473948","heartbeat_front_addr":"172.21.15.175:6826/3146473948","state":["exists","up"]},{"osd":6,"uuid":"f5d45d3f-9af3-44a1-a730-c260ed1654b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6801","nonce":4161180058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6804","nonce":4161180058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6814","nonce":4161180058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6809","nonce":4161180058}]},"public_addr":"172.21.15.175:6801/4161180058","cluster_addr":"172.21.15.175:6804/4161180058","heartbeat_back_addr":"172.21.15.175:6814/4161180058","heartbeat_front_addr":"172.21.15.175:6809/4161180058","state":["exists","up"]},{"osd":7,"uuid":"16d12e53-2ad3-4b5c-a789-22b45056fd9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6819","nonce":2670236415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6823","nonce":2670236415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6830","nonce":2670236415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6827","nonce":2670236415}]},"public_addr":"172.21.15.175:6819/2670236415","cluster_addr":"172.21.15.175:6823/2670236415","heartbeat_back_addr":"172.21.15.175:6830/2670236415","heartbeat_front_addr":"172.21.15.175:6827/2670236415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.847037+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.765547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.716122+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.874628+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.786580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.924885+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.285635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.898130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T08:55:18.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.579+0000 7f5350b22640 1 -- 172.21.15.46:0/469523250 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f532c066550 msgr2=0x7f532c068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:18.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.579+0000 7f5350b22640 1 --2- 172.21.15.46:0/469523250 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f532c066550 0x7f532c068a10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f533c007fd0 tx=0x7f533c009040 comp rx=0 tx=0).stop 2024-01-23T08:55:18.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.579+0000 7f5350b22640 1 -- 172.21.15.46:0/469523250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f534c0c67e0 msgr2=0x7f534c155640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:18.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.579+0000 7f5350b22640 1 --2- 172.21.15.46:0/469523250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f534c0c67e0 0x7f534c155640 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f533401b880 tx=0x7f533401ba10 comp rx=0 tx=0).stop 2024-01-23T08:55:18.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.579+0000 7f5350b22640 1 -- 172.21.15.46:0/469523250 shutdown_connections 2024-01-23T08:55:18.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.579+0000 7f5350b22640 1 --2- 172.21.15.46:0/469523250 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f532c066550 0x7f532c068a10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:18.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.579+0000 7f5350b22640 1 --2- 172.21.15.46:0/469523250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f534c150610 0x7f534c14c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:18.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.579+0000 7f5350b22640 1 --2- 172.21.15.46:0/469523250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f534c0c67e0 0x7f534c155640 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:18.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.579+0000 7f5350b22640 1 --2- 172.21.15.46:0/469523250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f534c0c0e90 0x7f534c1f2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:18.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.579+0000 7f5350b22640 1 -- 172.21.15.46:0/469523250 >> 172.21.15.46:0/469523250 conn(0x7f534c06de30 msgr2=0x7f534c0c7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:18.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.579+0000 7f5350b22640 1 -- 172.21.15.46:0/469523250 shutdown_connections 2024-01-23T08:55:18.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.579+0000 7f5350b22640 1 -- 172.21.15.46:0/469523250 wait complete. 2024-01-23T08:55:18.598 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-23T08:55:18.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.775+0000 7f8032466640 1 Processor -- start 2024-01-23T08:55:18.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.775+0000 7f8032466640 1 -- start start 2024-01-23T08:55:18.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.779+0000 7f8032466640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f802c153910 0x7f802c0ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:18.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.779+0000 7f8032466640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f802c06c680 0x7f802c159560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:18.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.779+0000 7f8032466640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f802c153cf0 con 0x7f802c0cd250 2024-01-23T08:55:18.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.779+0000 7f8032466640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f802c06baa0 con 0x7f802c153910 2024-01-23T08:55:18.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.779+0000 7f8032466640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f802c15a4f0 con 0x7f802c06c680 2024-01-23T08:55:18.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.779+0000 7f802bfff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f802c153910 0x7f802c0ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:18.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.779+0000 7f802bfff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f802c153910 0x7f802c0ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60018/0 (socket says 172.21.15.46:60018) 2024-01-23T08:55:18.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.779+0000 7f802bfff640 1 -- 172.21.15.46:0/3029796470 learned_addr learned my addr 172.21.15.46:0/3029796470 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:18.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.779+0000 7f8030a03640 1 --2- 172.21.15.46:0/3029796470 >> v2:172.21.15.175:3300/0 conn(0x7f802c06c680 0x7f802c159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:18.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.783+0000 7f802bfff640 1 -- 172.21.15.46:0/3029796470 >> v2:172.21.15.175:3300/0 conn(0x7f802c06c680 msgr2=0x7f802c159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:18.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.783+0000 7f802bfff640 1 --2- 172.21.15.46:0/3029796470 >> v2:172.21.15.175:3300/0 conn(0x7f802c06c680 0x7f802c159560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:18.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.783+0000 7f802bfff640 1 -- 172.21.15.46:0/3029796470 >> v1:172.21.15.175:6789/0 conn(0x7f802c0cd250 legacy=0x7f802c06bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:18.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.783+0000 7f802bfff640 1 -- 172.21.15.46:0/3029796470 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c15cc60 con 0x7f802c153910 2024-01-23T08:55:18.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.787+0000 7f802bfff640 1 --2- 172.21.15.46:0/3029796470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f802c153910 0x7f802c0ccd10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f802c0afe20 tx=0x7f801c01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d90d0d006b7072c6 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:18.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.791+0000 7f802affd640 1 -- 172.21.15.46:0/3029796470 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c0a5790 con 0x7f802c153910 2024-01-23T08:55:18.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.791+0000 7f802affd640 1 -- 172.21.15.46:0/3029796470 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801c0a58f0 con 0x7f802c153910 2024-01-23T08:55:18.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.791+0000 7f802affd640 1 -- 172.21.15.46:0/3029796470 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c0a5c80 con 0x7f802c153910 2024-01-23T08:55:18.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.791+0000 7f8032466640 1 -- 172.21.15.46:0/3029796470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f802c153910 msgr2=0x7f802c0ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:18.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.791+0000 7f8032466640 1 --2- 172.21.15.46:0/3029796470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f802c153910 0x7f802c0ccd10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f802c0afe20 tx=0x7f801c01c8d0 comp rx=0 tx=0).stop 2024-01-23T08:55:18.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.791+0000 7f8032466640 1 -- 172.21.15.46:0/3029796470 shutdown_connections 2024-01-23T08:55:18.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.791+0000 7f8032466640 1 --2- 172.21.15.46:0/3029796470 >> v2:172.21.15.175:3300/0 conn(0x7f802c06c680 0x7f802c159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:18.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.791+0000 7f8032466640 1 --2- 172.21.15.46:0/3029796470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f802c153910 0x7f802c0ccd10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:18.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.791+0000 7f8032466640 1 -- 172.21.15.46:0/3029796470 >> 172.21.15.46:0/3029796470 conn(0x7f802c06a660 msgr2=0x7f802c06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:18.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.791+0000 7f8032466640 1 -- 172.21.15.46:0/3029796470 shutdown_connections 2024-01-23T08:55:18.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.791+0000 7f8032466640 1 -- 172.21.15.46:0/3029796470 wait complete. 2024-01-23T08:55:18.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.795+0000 7f8032466640 1 Processor -- start 2024-01-23T08:55:18.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.795+0000 7f8032466640 1 -- start start 2024-01-23T08:55:18.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.795+0000 7f8032466640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f802c06c680 0x7f802c1f5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:18.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.795+0000 7f8032466640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f802c0cd250 0x7f802c0c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:18.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.795+0000 7f8032466640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f802c153910 0x7f802c070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:18.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.795+0000 7f8032466640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c1f3b20 con 0x7f802c153910 2024-01-23T08:55:18.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.795+0000 7f8032466640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c156a40 con 0x7f802c0cd250 2024-01-23T08:55:18.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.795+0000 7f8032466640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802c1f6410 con 0x7f802c06c680 2024-01-23T08:55:18.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.795+0000 7f8030a03640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f802c153910 0x7f802c070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:18.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.795+0000 7f8030a03640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f802c153910 0x7f802c070ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60026/0 (socket says 172.21.15.46:60026) 2024-01-23T08:55:18.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.795+0000 7f8030a03640 1 -- 172.21.15.46:0/786177428 learned_addr learned my addr 172.21.15.46:0/786177428 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:18.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.795+0000 7f802b7fe640 1 --2- 172.21.15.46:0/786177428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f802c0cd250 0x7f802c0c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:18.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.795+0000 7f802bfff640 1 --2- 172.21.15.46:0/786177428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f802c06c680 0x7f802c1f5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:18.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.799+0000 7f8030a03640 1 -- 172.21.15.46:0/786177428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f802c06c680 msgr2=0x7f802c1f5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:18.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.799+0000 7f8030a03640 1 --2- 172.21.15.46:0/786177428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f802c06c680 0x7f802c1f5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:18.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.799+0000 7f8030a03640 1 -- 172.21.15.46:0/786177428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f802c0cd250 msgr2=0x7f802c0c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:18.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.799+0000 7f8030a03640 1 --2- 172.21.15.46:0/786177428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f802c0cd250 0x7f802c0c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:18.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.799+0000 7f8030a03640 1 -- 172.21.15.46:0/786177428 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801c009b30 con 0x7f802c153910 2024-01-23T08:55:18.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.803+0000 7f8030a03640 1 --2- 172.21.15.46:0/786177428 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f802c153910 0x7f802c070ae0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f802400d560 tx=0x7f802400da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:18.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.807+0000 7f8028ff9640 1 -- 172.21.15.46:0/786177428 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80240125f0 con 0x7f802c153910 2024-01-23T08:55:18.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.807+0000 7f8028ff9640 1 -- 172.21.15.46:0/786177428 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8024012770 con 0x7f802c153910 2024-01-23T08:55:18.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.807+0000 7f8028ff9640 1 -- 172.21.15.46:0/786177428 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8024012b20 con 0x7f802c153910 2024-01-23T08:55:18.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.807+0000 7f8032466640 1 -- 172.21.15.46:0/786177428 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f802c15bcb0 con 0x7f802c153910 2024-01-23T08:55:18.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.807+0000 7f8032466640 1 -- 172.21.15.46:0/786177428 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f802c154350 con 0x7f802c153910 2024-01-23T08:55:18.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.807+0000 7f8032466640 1 -- 172.21.15.46:0/786177428 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f802c1f3c60 con 0x7f802c153910 2024-01-23T08:55:18.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.827+0000 7f8028ff9640 1 -- 172.21.15.46:0/786177428 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f8024012c80 con 0x7f802c153910 2024-01-23T08:55:18.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.827+0000 7f8028ff9640 1 --2- 172.21.15.46:0/786177428 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f800c066550 0x7f800c068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:18.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.827+0000 7f802bfff640 1 --2- 172.21.15.46:0/786177428 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f800c066550 0x7f800c068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:18.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:18.827+0000 7f802bfff640 1 --2- 172.21.15.46:0/786177428 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f800c066550 0x7f800c068a10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f801c0ae000 tx=0x7f801c0a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:19.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:19.107+0000 7f8028ff9640 1 -- 172.21.15.46:0/786177428 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8024055b20 con 0x7f802c153910 2024-01-23T08:55:19.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:19.107+0000 7f8028ff9640 1 -- 172.21.15.46:0/786177428 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f8024051e60 con 0x7f802c153910 2024-01-23T08:55:19.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:19.351+0000 7f8032466640 1 -- 172.21.15.46:0/786177428 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f802c1f3c60 con 0x7f802c153910 2024-01-23T08:55:20.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.535+0000 7f8028ff9640 1 -- 172.21.15.46:0/786177428 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f802c1f3c60 con 0x7f802c153910 2024-01-23T08:55:20.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.539+0000 7f8032466640 1 -- 172.21.15.46:0/786177428 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f800c066550 msgr2=0x7f800c068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:20.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.539+0000 7f8032466640 1 --2- 172.21.15.46:0/786177428 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f800c066550 0x7f800c068a10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f801c0ae000 tx=0x7f801c0a7070 comp rx=0 tx=0).stop 2024-01-23T08:55:20.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.539+0000 7f8032466640 1 -- 172.21.15.46:0/786177428 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f802c153910 msgr2=0x7f802c070ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:20.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.539+0000 7f8032466640 1 --2- 172.21.15.46:0/786177428 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f802c153910 0x7f802c070ae0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f802400d560 tx=0x7f802400da20 comp rx=0 tx=0).stop 2024-01-23T08:55:20.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.539+0000 7f8032466640 1 -- 172.21.15.46:0/786177428 shutdown_connections 2024-01-23T08:55:20.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.539+0000 7f8032466640 1 --2- 172.21.15.46:0/786177428 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f802c153910 0x7f802c070ae0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:20.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.539+0000 7f8032466640 1 --2- 172.21.15.46:0/786177428 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f800c066550 0x7f800c068a10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:20.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.539+0000 7f8032466640 1 --2- 172.21.15.46:0/786177428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f802c0cd250 0x7f802c0c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:20.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.539+0000 7f8032466640 1 --2- 172.21.15.46:0/786177428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f802c06c680 0x7f802c1f5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:20.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.539+0000 7f8032466640 1 -- 172.21.15.46:0/786177428 >> 172.21.15.46:0/786177428 conn(0x7f802c06a660 msgr2=0x7f802c157a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:20.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.539+0000 7f8032466640 1 -- 172.21.15.46:0/786177428 shutdown_connections 2024-01-23T08:55:20.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.539+0000 7f8032466640 1 -- 172.21.15.46:0/786177428 wait complete. 2024-01-23T08:55:20.563 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300} 2024-01-23T08:55:20.563 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-01-23T08:55:20.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.699+0000 7f0816c16640 1 Processor -- start 2024-01-23T08:55:20.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.699+0000 7f0816c16640 1 -- start start 2024-01-23T08:55:20.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.703+0000 7f0816c16640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f08100716d0 0x7f0810159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:20.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.703+0000 7f0816c16640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f08100cba20 0x7f08100c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:20.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.703+0000 7f0816c16640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f081015a4f0 con 0x7f0810071ab0 2024-01-23T08:55:20.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.703+0000 7f0816c16640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08100cbef0 con 0x7f08100716d0 2024-01-23T08:55:20.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.703+0000 7f0816c16640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f081015cb20 con 0x7f08100cba20 2024-01-23T08:55:20.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.703+0000 7f080ffff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f08100cba20 0x7f08100c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:20.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.703+0000 7f080ffff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f08100cba20 0x7f08100c3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:59006/0 (socket says 172.21.15.46:59006) 2024-01-23T08:55:20.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.703+0000 7f080ffff640 1 -- 172.21.15.46:0/1617814430 learned_addr learned my addr 172.21.15.46:0/1617814430 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:20.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.711+0000 7f080ffff640 1 -- 172.21.15.46:0/1617814430 >> v2:172.21.15.46:3300/0 conn(0x7f08100716d0 msgr2=0x7f0810159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:20.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.711+0000 7f080ffff640 1 --2- 172.21.15.46:0/1617814430 >> v2:172.21.15.46:3300/0 conn(0x7f08100716d0 0x7f0810159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:20.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.711+0000 7f080ffff640 1 -- 172.21.15.46:0/1617814430 >> v1:172.21.15.46:6789/0 conn(0x7f0810071ab0 legacy=0x7f0810152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:20.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.711+0000 7f080ffff640 1 -- 172.21.15.46:0/1617814430 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081015ce00 con 0x7f08100cba20 2024-01-23T08:55:20.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.719+0000 7f080ffff640 1 --2- 172.21.15.46:0/1617814430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08100cba20 0x7f08100c3e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0800009870 tx=0x7f080001ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1baa28fc12625a8 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:20.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.735+0000 7f080f7fe640 1 -- 172.21.15.46:0/1617814430 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08000a89b0 con 0x7f08100cba20 2024-01-23T08:55:20.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.735+0000 7f080f7fe640 1 -- 172.21.15.46:0/1617814430 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08000a8b10 con 0x7f08100cba20 2024-01-23T08:55:20.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.735+0000 7f080f7fe640 1 -- 172.21.15.46:0/1617814430 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08000a8ea0 con 0x7f08100cba20 2024-01-23T08:55:20.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.735+0000 7f0816c16640 1 -- 172.21.15.46:0/1617814430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08100cba20 msgr2=0x7f08100c3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:20.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.735+0000 7f0816c16640 1 --2- 172.21.15.46:0/1617814430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08100cba20 0x7f08100c3e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0800009870 tx=0x7f080001ecb0 comp rx=0 tx=0).stop 2024-01-23T08:55:20.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.735+0000 7f0816c16640 1 -- 172.21.15.46:0/1617814430 shutdown_connections 2024-01-23T08:55:20.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.735+0000 7f0816c16640 1 --2- 172.21.15.46:0/1617814430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08100cba20 0x7f08100c3e10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:20.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.735+0000 7f0816c16640 1 --2- 172.21.15.46:0/1617814430 >> v2:172.21.15.46:3300/0 conn(0x7f08100716d0 0x7f0810159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:20.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.735+0000 7f0816c16640 1 -- 172.21.15.46:0/1617814430 >> 172.21.15.46:0/1617814430 conn(0x7f0810066a60 msgr2=0x7f081006d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:20.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.735+0000 7f0816c16640 1 -- 172.21.15.46:0/1617814430 shutdown_connections 2024-01-23T08:55:20.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.735+0000 7f0816c16640 1 -- 172.21.15.46:0/1617814430 wait complete. 2024-01-23T08:55:20.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.735+0000 7f0816c16640 1 Processor -- start 2024-01-23T08:55:20.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.735+0000 7f0816c16640 1 -- start start 2024-01-23T08:55:20.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.739+0000 7f0816c16640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08100716d0 0x7f08101f0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:20.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.739+0000 7f0816c16640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0810071ab0 0x7f081015b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:20.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.739+0000 7f0816c16640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08100cba20 0x7f0810148640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:20.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.739+0000 7f0816c16640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081015bba0 con 0x7f08100cba20 2024-01-23T08:55:20.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.739+0000 7f0816c16640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081014aef0 con 0x7f08100716d0 2024-01-23T08:55:20.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.739+0000 7f0816c16640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f081014eb00 con 0x7f0810071ab0 2024-01-23T08:55:20.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.739+0000 7f08151b3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08100cba20 0x7f0810148640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:20.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.739+0000 7f08151b3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08100cba20 0x7f0810148640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60050/0 (socket says 172.21.15.46:60050) 2024-01-23T08:55:20.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.739+0000 7f08151b3640 1 -- 172.21.15.46:0/2358564326 learned_addr learned my addr 172.21.15.46:0/2358564326 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:20.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.739+0000 7f080ffff640 1 --2- 172.21.15.46:0/2358564326 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0810071ab0 0x7f081015b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:20.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.743+0000 7f08151b3640 1 -- 172.21.15.46:0/2358564326 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0810071ab0 msgr2=0x7f081015b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:20.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.743+0000 7f08151b3640 1 --2- 172.21.15.46:0/2358564326 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0810071ab0 0x7f081015b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:20.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.743+0000 7f08151b3640 1 -- 172.21.15.46:0/2358564326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08100716d0 msgr2=0x7f08101f0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:20.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.743+0000 7f08149b2640 1 --2- 172.21.15.46:0/2358564326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08100716d0 0x7f08101f0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:20.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.743+0000 7f08151b3640 1 --2- 172.21.15.46:0/2358564326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08100716d0 0x7f08101f0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:20.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.743+0000 7f08151b3640 1 -- 172.21.15.46:0/2358564326 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08000094d0 con 0x7f08100cba20 2024-01-23T08:55:20.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.747+0000 7f08151b3640 1 --2- 172.21.15.46:0/2358564326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08100cba20 0x7f0810148640 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f080800c780 tx=0x7f080800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:20.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.751+0000 7f080d7fa640 1 -- 172.21.15.46:0/2358564326 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0808003d90 con 0x7f08100cba20 2024-01-23T08:55:20.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.751+0000 7f080d7fa640 1 -- 172.21.15.46:0/2358564326 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080800ce90 con 0x7f08100cba20 2024-01-23T08:55:20.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.751+0000 7f080d7fa640 1 -- 172.21.15.46:0/2358564326 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08080052b0 con 0x7f08100cba20 2024-01-23T08:55:20.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.751+0000 7f0816c16640 1 -- 172.21.15.46:0/2358564326 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f081015abc0 con 0x7f08100cba20 2024-01-23T08:55:20.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.751+0000 7f0816c16640 1 -- 172.21.15.46:0/2358564326 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f081015ae60 con 0x7f08100cba20 2024-01-23T08:55:20.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:20.751+0000 7f0816c16640 1 -- 172.21.15.46:0/2358564326 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0810074340 con 0x7f08100cba20 2024-01-23T08:55:21.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:21.043+0000 7f080d7fa640 1 -- 172.21.15.46:0/2358564326 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f0808005410 con 0x7f08100cba20 2024-01-23T08:55:21.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:21.043+0000 7f080d7fa640 1 --2- 172.21.15.46:0/2358564326 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f07fc066580 0x7f07fc068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:21.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:21.043+0000 7f08149b2640 1 --2- 172.21.15.46:0/2358564326 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f07fc066580 0x7f07fc068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:21.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:21.047+0000 7f08149b2640 1 --2- 172.21.15.46:0/2358564326 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f07fc066580 0x7f07fc068a40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f080400a830 tx=0x7f0804008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:21.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:21.079+0000 7f080d7fa640 1 -- 172.21.15.46:0/2358564326 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0808054ae0 con 0x7f08100cba20 2024-01-23T08:55:21.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:21.079+0000 7f080d7fa640 1 -- 172.21.15.46:0/2358564326 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f0808050e20 con 0x7f08100cba20 2024-01-23T08:55:21.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:21.283+0000 7f0816c16640 1 -- 172.21.15.46:0/2358564326 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7f08100c2560 con 0x7f08100cba20 2024-01-23T08:55:21.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:21.859+0000 7f080d7fa640 1 -- 172.21.15.46:0/2358564326 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v9) v1 ==== 105+0+0 (secure 0 0 0) 0x7f08080170b0 con 0x7f08100cba20 2024-01-23T08:55:21.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:21.863+0000 7f0816c16640 1 -- 172.21.15.46:0/2358564326 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f07fc066580 msgr2=0x7f07fc068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:21.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:21.863+0000 7f0816c16640 1 --2- 172.21.15.46:0/2358564326 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f07fc066580 0x7f07fc068a40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f080400a830 tx=0x7f0804008040 comp rx=0 tx=0).stop 2024-01-23T08:55:21.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:21.863+0000 7f0816c16640 1 -- 172.21.15.46:0/2358564326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08100cba20 msgr2=0x7f0810148640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:21.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:21.863+0000 7f0816c16640 1 --2- 172.21.15.46:0/2358564326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08100cba20 0x7f0810148640 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f080800c780 tx=0x7f080800cc40 comp rx=0 tx=0).stop 2024-01-23T08:55:21.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:21.863+0000 7f0816c16640 1 -- 172.21.15.46:0/2358564326 shutdown_connections 2024-01-23T08:55:21.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:21.863+0000 7f0816c16640 1 --2- 172.21.15.46:0/2358564326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08100cba20 0x7f0810148640 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:21.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:21.863+0000 7f0816c16640 1 --2- 172.21.15.46:0/2358564326 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0810071ab0 0x7f081015b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:21.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:21.863+0000 7f0816c16640 1 --2- 172.21.15.46:0/2358564326 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f07fc066580 0x7f07fc068a40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:21.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:21.863+0000 7f0816c16640 1 --2- 172.21.15.46:0/2358564326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08100716d0 0x7f08101f0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:21.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:21.863+0000 7f0816c16640 1 -- 172.21.15.46:0/2358564326 >> 172.21.15.46:0/2358564326 conn(0x7f0810066a60 msgr2=0x7f0810151ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:21.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:21.863+0000 7f0816c16640 1 -- 172.21.15.46:0/2358564326 shutdown_connections 2024-01-23T08:55:21.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:21.863+0000 7f0816c16640 1 -- 172.21.15.46:0/2358564326 wait complete. 2024-01-23T08:55:21.891 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-23T08:55:22.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.027+0000 7f7bb8001640 1 Processor -- start 2024-01-23T08:55:22.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.027+0000 7f7bb8001640 1 -- start start 2024-01-23T08:55:22.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.027+0000 7f7bb8001640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7bb01536b0 0x7f7bb00c7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:22.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.027+0000 7f7bb8001640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bb00c2bc0 0x7f7bb00c8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:22.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.027+0000 7f7bb8001640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb00c6a90 con 0x7f7bb0153a90 2024-01-23T08:55:22.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.027+0000 7f7bb8001640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb00c1330 con 0x7f7bb01536b0 2024-01-23T08:55:22.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.027+0000 7f7bb8001640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb006e000 con 0x7f7bb00c2bc0 2024-01-23T08:55:22.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.031+0000 7f7bb5d9d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7bb01536b0 0x7f7bb00c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:22.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.031+0000 7f7bb659e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bb00c2bc0 0x7f7bb00c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:22.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.031+0000 7f7bb559c640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f7bb0153a90 0x7f7bb006ebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.46:33124/0 (socket says 172.21.15.46:33124) 2024-01-23T08:55:22.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.031+0000 7f7bb559c640 1 -- 172.21.15.46:0/13784362 learned_addr learned my addr 172.21.15.46:0/13784362 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:22.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.039+0000 7f7bb659e640 1 -- 172.21.15.46:0/13784362 >> v2:172.21.15.175:3300/0 conn(0x7f7bb01536b0 msgr2=0x7f7bb00c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:22.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.039+0000 7f7bb659e640 1 --2- 172.21.15.46:0/13784362 >> v2:172.21.15.175:3300/0 conn(0x7f7bb01536b0 0x7f7bb00c7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:22.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.039+0000 7f7bb659e640 1 -- 172.21.15.46:0/13784362 >> v1:172.21.15.175:6789/0 conn(0x7f7bb0153a90 legacy=0x7f7bb006ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:22.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.039+0000 7f7bb659e640 1 -- 172.21.15.46:0/13784362 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb006e2e0 con 0x7f7bb00c2bc0 2024-01-23T08:55:22.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.047+0000 7f7bb659e640 1 --2- 172.21.15.46:0/13784362 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bb00c2bc0 0x7f7bb00c8790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7bac009d90 tx=0x7f7bac01f100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e4e3944c9ec4447 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:22.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.059+0000 7f7bb4d9b640 1 -- 172.21.15.46:0/13784362 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac0b0440 con 0x7f7bb00c2bc0 2024-01-23T08:55:22.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.059+0000 7f7bb4d9b640 1 -- 172.21.15.46:0/13784362 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bac0b05a0 con 0x7f7bb00c2bc0 2024-01-23T08:55:22.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.059+0000 7f7bb4d9b640 1 -- 172.21.15.46:0/13784362 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac0b0930 con 0x7f7bb00c2bc0 2024-01-23T08:55:22.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.059+0000 7f7bb8001640 1 -- 172.21.15.46:0/13784362 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bb00c2bc0 msgr2=0x7f7bb00c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:22.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.059+0000 7f7bb8001640 1 --2- 172.21.15.46:0/13784362 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bb00c2bc0 0x7f7bb00c8790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7bac009d90 tx=0x7f7bac01f100 comp rx=0 tx=0).stop 2024-01-23T08:55:22.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.059+0000 7f7bb8001640 1 -- 172.21.15.46:0/13784362 shutdown_connections 2024-01-23T08:55:22.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.059+0000 7f7bb8001640 1 --2- 172.21.15.46:0/13784362 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bb00c2bc0 0x7f7bb00c8790 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:22.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.059+0000 7f7bb8001640 1 --2- 172.21.15.46:0/13784362 >> v2:172.21.15.175:3300/0 conn(0x7f7bb01536b0 0x7f7bb00c7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:22.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.059+0000 7f7bb8001640 1 -- 172.21.15.46:0/13784362 >> 172.21.15.46:0/13784362 conn(0x7f7bb006b770 msgr2=0x7f7bb006bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:22.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.059+0000 7f7bb8001640 1 -- 172.21.15.46:0/13784362 shutdown_connections 2024-01-23T08:55:22.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.059+0000 7f7bb8001640 1 -- 172.21.15.46:0/13784362 wait complete. 2024-01-23T08:55:22.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.063+0000 7f7bb8001640 1 Processor -- start 2024-01-23T08:55:22.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.063+0000 7f7bb8001640 1 -- start start 2024-01-23T08:55:22.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.063+0000 7f7bb8001640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bb00c2bc0 0x7f7bb01f25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:22.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.063+0000 7f7bb8001640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bb01536b0 0x7f7bb00c4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:22.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.063+0000 7f7bb8001640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bb014fd50 0x7f7bb00c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:22.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.063+0000 7f7bb8001640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb0143ca0 con 0x7f7bb01536b0 2024-01-23T08:55:22.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.063+0000 7f7bb8001640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb00c5d00 con 0x7f7bb014fd50 2024-01-23T08:55:22.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.063+0000 7f7bb8001640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb00c6190 con 0x7f7bb00c2bc0 2024-01-23T08:55:22.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.063+0000 7f7bb659e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bb014fd50 0x7f7bb00c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:22.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.063+0000 7f7bb5d9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bb00c2bc0 0x7f7bb01f25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:22.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.067+0000 7f7bb659e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bb014fd50 0x7f7bb00c4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:59020/0 (socket says 172.21.15.46:59020) 2024-01-23T08:55:22.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.067+0000 7f7bb659e640 1 -- 172.21.15.46:0/1528554096 learned_addr learned my addr 172.21.15.46:0/1528554096 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:22.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.079+0000 7f7bb5d9d640 1 -- 172.21.15.46:0/1528554096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bb014fd50 msgr2=0x7f7bb00c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:22.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.079+0000 7f7bb5d9d640 1 --2- 172.21.15.46:0/1528554096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bb014fd50 0x7f7bb00c4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:22.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.079+0000 7f7bb5d9d640 1 -- 172.21.15.46:0/1528554096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bb01536b0 msgr2=0x7f7bb00c4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:22.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.079+0000 7f7bb5d9d640 1 --2- 172.21.15.46:0/1528554096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bb01536b0 0x7f7bb00c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:22.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.079+0000 7f7bb5d9d640 1 -- 172.21.15.46:0/1528554096 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bac009a70 con 0x7f7bb00c2bc0 2024-01-23T08:55:22.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.087+0000 7f7bb5d9d640 1 --2- 172.21.15.46:0/1528554096 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bb00c2bc0 0x7f7bb01f25d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800e8d0 tx=0x7f7ba800ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:22.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.095+0000 7f7ba67fc640 1 -- 172.21.15.46:0/1528554096 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba800c940 con 0x7f7bb00c2bc0 2024-01-23T08:55:22.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.095+0000 7f7ba67fc640 1 -- 172.21.15.46:0/1528554096 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba800caa0 con 0x7f7bb00c2bc0 2024-01-23T08:55:22.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.095+0000 7f7ba67fc640 1 -- 172.21.15.46:0/1528554096 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba800ce10 con 0x7f7bb00c2bc0 2024-01-23T08:55:22.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.095+0000 7f7bb8001640 1 -- 172.21.15.46:0/1528554096 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb00c53f0 con 0x7f7bb00c2bc0 2024-01-23T08:55:22.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.095+0000 7f7bb8001640 1 -- 172.21.15.46:0/1528554096 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb00c3890 con 0x7f7bb00c2bc0 2024-01-23T08:55:22.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.099+0000 7f7bb8001640 1 -- 172.21.15.46:0/1528554096 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb0074340 con 0x7f7bb00c2bc0 2024-01-23T08:55:22.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.147+0000 7f7ba67fc640 1 -- 172.21.15.46:0/1528554096 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f7ba8013470 con 0x7f7bb00c2bc0 2024-01-23T08:55:22.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.151+0000 7f7ba67fc640 1 --2- 172.21.15.46:0/1528554096 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7b94066550 0x7f7b94068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:22.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.151+0000 7f7bb559c640 1 --2- 172.21.15.46:0/1528554096 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7b94066550 0x7f7b94068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:22.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.151+0000 7f7bb559c640 1 --2- 172.21.15.46:0/1528554096 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7b94066550 0x7f7b94068a10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7bb01570c0 tx=0x7f7ba0006be0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:22.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.159+0000 7f7ba67fc640 1 -- 172.21.15.46:0/1528554096 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7ba80557a0 con 0x7f7bb00c2bc0 2024-01-23T08:55:22.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.543+0000 7f7ba67fc640 1 -- 172.21.15.46:0/1528554096 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f7ba8051ae0 con 0x7f7bb00c2bc0 2024-01-23T08:55:22.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:22.755+0000 7f7bb8001640 1 -- 172.21.15.46:0/1528554096 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7bb006fb70 con 0x7f7bb00c2bc0 2024-01-23T08:55:23.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.487+0000 7f7ba67fc640 1 -- 172.21.15.46:0/1528554096 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7ba8021020 con 0x7f7bb00c2bc0 2024-01-23T08:55:23.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.487+0000 7f7bb8001640 1 -- 172.21.15.46:0/1528554096 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7b94066550 msgr2=0x7f7b94068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:23.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.487+0000 7f7bb8001640 1 --2- 172.21.15.46:0/1528554096 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7b94066550 0x7f7b94068a10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7bb01570c0 tx=0x7f7ba0006be0 comp rx=0 tx=0).stop 2024-01-23T08:55:23.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.487+0000 7f7bb8001640 1 -- 172.21.15.46:0/1528554096 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bb00c2bc0 msgr2=0x7f7bb01f25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:23.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.487+0000 7f7bb8001640 1 --2- 172.21.15.46:0/1528554096 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bb00c2bc0 0x7f7bb01f25d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800e8d0 tx=0x7f7ba800ed90 comp rx=0 tx=0).stop 2024-01-23T08:55:23.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.491+0000 7f7bb8001640 1 -- 172.21.15.46:0/1528554096 shutdown_connections 2024-01-23T08:55:23.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.491+0000 7f7bb8001640 1 --2- 172.21.15.46:0/1528554096 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7b94066550 0x7f7b94068a10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:23.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.491+0000 7f7bb8001640 1 --2- 172.21.15.46:0/1528554096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bb014fd50 0x7f7bb00c4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:23.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.491+0000 7f7bb8001640 1 --2- 172.21.15.46:0/1528554096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7bb01536b0 0x7f7bb00c4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:23.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.491+0000 7f7bb8001640 1 --2- 172.21.15.46:0/1528554096 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bb00c2bc0 0x7f7bb01f25d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:23.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.491+0000 7f7bb8001640 1 -- 172.21.15.46:0/1528554096 >> 172.21.15.46:0/1528554096 conn(0x7f7bb006b770 msgr2=0x7f7bb00c8830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:23.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.491+0000 7f7bb8001640 1 -- 172.21.15.46:0/1528554096 shutdown_connections 2024-01-23T08:55:23.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.491+0000 7f7bb8001640 1 -- 172.21.15.46:0/1528554096 wait complete. 2024-01-23T08:55:23.510 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-01-23T08:55:23.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.639+0000 7fcc2f72f640 1 Processor -- start 2024-01-23T08:55:23.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.639+0000 7fcc2f72f640 1 -- start start 2024-01-23T08:55:23.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.639+0000 7fcc2f72f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc280c6190 0x7fcc280c3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:23.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.639+0000 7fcc2f72f640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcc280c7620 0x7fcc281507a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:23.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.639+0000 7fcc2f72f640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc280c5220 con 0x7fcc280c6570 2024-01-23T08:55:23.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.639+0000 7fcc2f72f640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc280c5a50 con 0x7fcc280c7620 2024-01-23T08:55:23.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.639+0000 7fcc2f72f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc28157260 con 0x7fcc280c6190 2024-01-23T08:55:23.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.639+0000 7fcc2dccc640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcc280c7620 0x7fcc281507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:23.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.639+0000 7fcc2ccca640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fcc280c6570 0x7fcc28150090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35218/0 (socket says 172.21.15.46:35218) 2024-01-23T08:55:23.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.639+0000 7fcc2ccca640 1 -- 172.21.15.46:0/332374079 learned_addr learned my addr 172.21.15.46:0/332374079 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:23.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.643+0000 7fcc2dccc640 1 -- 172.21.15.46:0/332374079 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc280c6190 msgr2=0x7fcc280c3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:23.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.643+0000 7fcc2dccc640 1 --2- 172.21.15.46:0/332374079 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc280c6190 0x7fcc280c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:23.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.643+0000 7fcc2dccc640 1 -- 172.21.15.46:0/332374079 >> v1:172.21.15.46:6789/0 conn(0x7fcc280c6570 legacy=0x7fcc28150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:23.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.643+0000 7fcc2dccc640 1 -- 172.21.15.46:0/332374079 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc280c5490 con 0x7fcc280c7620 2024-01-23T08:55:23.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.647+0000 7fcc2dccc640 1 --2- 172.21.15.46:0/332374079 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc280c7620 0x7fcc281507a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcc20009d90 tx=0x7fcc2001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80bebdaa523320be server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:23.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.651+0000 7fcc1ffff640 1 -- 172.21.15.46:0/332374079 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc200a5950 con 0x7fcc280c7620 2024-01-23T08:55:23.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.651+0000 7fcc1ffff640 1 -- 172.21.15.46:0/332374079 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc200a5ab0 con 0x7fcc280c7620 2024-01-23T08:55:23.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.651+0000 7fcc1ffff640 1 -- 172.21.15.46:0/332374079 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc200a5e40 con 0x7fcc280c7620 2024-01-23T08:55:23.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.651+0000 7fcc2f72f640 1 -- 172.21.15.46:0/332374079 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc280c7620 msgr2=0x7fcc281507a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:23.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.651+0000 7fcc2f72f640 1 --2- 172.21.15.46:0/332374079 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc280c7620 0x7fcc281507a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcc20009d90 tx=0x7fcc2001c890 comp rx=0 tx=0).stop 2024-01-23T08:55:23.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.651+0000 7fcc2f72f640 1 -- 172.21.15.46:0/332374079 shutdown_connections 2024-01-23T08:55:23.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.651+0000 7fcc2f72f640 1 --2- 172.21.15.46:0/332374079 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc280c7620 0x7fcc281507a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:23.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.651+0000 7fcc2f72f640 1 --2- 172.21.15.46:0/332374079 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc280c6190 0x7fcc280c3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:23.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.651+0000 7fcc2f72f640 1 -- 172.21.15.46:0/332374079 >> 172.21.15.46:0/332374079 conn(0x7fcc2806fa20 msgr2=0x7fcc280c8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:23.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.651+0000 7fcc2f72f640 1 -- 172.21.15.46:0/332374079 shutdown_connections 2024-01-23T08:55:23.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.651+0000 7fcc2f72f640 1 -- 172.21.15.46:0/332374079 wait complete. 2024-01-23T08:55:23.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.655+0000 7fcc2f72f640 1 Processor -- start 2024-01-23T08:55:23.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.655+0000 7fcc2f72f640 1 -- start start 2024-01-23T08:55:23.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.655+0000 7fcc2f72f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc280c6190 0x7fcc281547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:23.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.655+0000 7fcc2f72f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc280c6570 0x7fcc28151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:23.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.655+0000 7fcc2f72f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc280c7620 0x7fcc28071d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:23.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.655+0000 7fcc2f72f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc28152e70 con 0x7fcc280c6570 2024-01-23T08:55:23.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.655+0000 7fcc2f72f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc281f3150 con 0x7fcc280c7620 2024-01-23T08:55:23.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.655+0000 7fcc2f72f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc281f56c0 con 0x7fcc280c6190 2024-01-23T08:55:23.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.655+0000 7fcc2ccca640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc280c6570 0x7fcc28151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:23.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.655+0000 7fcc2ccca640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc280c6570 0x7fcc28151fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37452/0 (socket says 172.21.15.46:37452) 2024-01-23T08:55:23.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.655+0000 7fcc2ccca640 1 -- 172.21.15.46:0/1017043783 learned_addr learned my addr 172.21.15.46:0/1017043783 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:23.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.659+0000 7fcc2ccca640 1 -- 172.21.15.46:0/1017043783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc280c6190 msgr2=0x7fcc281547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:23.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.659+0000 7fcc2ccca640 1 --2- 172.21.15.46:0/1017043783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc280c6190 0x7fcc281547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:23.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.659+0000 7fcc2ccca640 1 -- 172.21.15.46:0/1017043783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc280c7620 msgr2=0x7fcc28071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:23.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.659+0000 7fcc2ccca640 1 --2- 172.21.15.46:0/1017043783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc280c7620 0x7fcc28071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:23.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.659+0000 7fcc2ccca640 1 -- 172.21.15.46:0/1017043783 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc20009a70 con 0x7fcc280c6570 2024-01-23T08:55:23.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.659+0000 7fcc2ccca640 1 --2- 172.21.15.46:0/1017043783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc280c6570 0x7fcc28151fb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcc1800c370 tx=0x7fcc1800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:23.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.667+0000 7fcc1dffb640 1 -- 172.21.15.46:0/1017043783 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc18005cf0 con 0x7fcc280c6570 2024-01-23T08:55:23.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.667+0000 7fcc1dffb640 1 -- 172.21.15.46:0/1017043783 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc18005e50 con 0x7fcc280c6570 2024-01-23T08:55:23.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.667+0000 7fcc1dffb640 1 -- 172.21.15.46:0/1017043783 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc180072f0 con 0x7fcc280c6570 2024-01-23T08:55:23.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.667+0000 7fcc2f72f640 1 -- 172.21.15.46:0/1017043783 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc281f5f60 con 0x7fcc280c6570 2024-01-23T08:55:23.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.667+0000 7fcc2f72f640 1 -- 172.21.15.46:0/1017043783 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc28155d50 con 0x7fcc280c6570 2024-01-23T08:55:23.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.667+0000 7fcc2f72f640 1 -- 172.21.15.46:0/1017043783 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc28074340 con 0x7fcc280c6570 2024-01-23T08:55:23.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.687+0000 7fcc1dffb640 1 -- 172.21.15.46:0/1017043783 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fcc18007450 con 0x7fcc280c6570 2024-01-23T08:55:23.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.687+0000 7fcc1dffb640 1 --2- 172.21.15.46:0/1017043783 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fcc0c066550 0x7fcc0c068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:23.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.687+0000 7fcc2d4cb640 1 --2- 172.21.15.46:0/1017043783 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fcc0c066550 0x7fcc0c068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:23.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.691+0000 7fcc2d4cb640 1 --2- 172.21.15.46:0/1017043783 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fcc0c066550 0x7fcc0c068a10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcc24009690 tx=0x7fcc24006c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:23.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.987+0000 7fcc1dffb640 1 -- 172.21.15.46:0/1017043783 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcc18054ee0 con 0x7fcc280c6570 2024-01-23T08:55:23.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:23.987+0000 7fcc1dffb640 1 -- 172.21.15.46:0/1017043783 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fcc18050b20 con 0x7fcc280c6570 2024-01-23T08:55:24.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.199+0000 7fcc2f72f640 1 -- 172.21.15.46:0/1017043783 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7fcc2814a6d0 con 0x7fcc280c6570 2024-01-23T08:55:24.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.703+0000 7fcc1dffb640 1 -- 172.21.15.46:0/1017043783 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v12) v1 ==== 115+0+0 (secure 0 0 0) 0x7fcc180170b0 con 0x7fcc280c6570 2024-01-23T08:55:24.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.707+0000 7fcc2f72f640 1 -- 172.21.15.46:0/1017043783 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fcc0c066550 msgr2=0x7fcc0c068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:24.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.707+0000 7fcc2f72f640 1 --2- 172.21.15.46:0/1017043783 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fcc0c066550 0x7fcc0c068a10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcc24009690 tx=0x7fcc24006c00 comp rx=0 tx=0).stop 2024-01-23T08:55:24.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.707+0000 7fcc2f72f640 1 -- 172.21.15.46:0/1017043783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc280c6570 msgr2=0x7fcc28151fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:24.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.707+0000 7fcc2f72f640 1 --2- 172.21.15.46:0/1017043783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc280c6570 0x7fcc28151fb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcc1800c370 tx=0x7fcc1800c830 comp rx=0 tx=0).stop 2024-01-23T08:55:24.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.707+0000 7fcc2f72f640 1 -- 172.21.15.46:0/1017043783 shutdown_connections 2024-01-23T08:55:24.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.707+0000 7fcc2f72f640 1 --2- 172.21.15.46:0/1017043783 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fcc0c066550 0x7fcc0c068a10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:24.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.707+0000 7fcc2f72f640 1 --2- 172.21.15.46:0/1017043783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc280c7620 0x7fcc28071d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:24.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.707+0000 7fcc2f72f640 1 --2- 172.21.15.46:0/1017043783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc280c6570 0x7fcc28151fb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:24.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.707+0000 7fcc2f72f640 1 --2- 172.21.15.46:0/1017043783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc280c6190 0x7fcc281547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:24.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.707+0000 7fcc2f72f640 1 -- 172.21.15.46:0/1017043783 >> 172.21.15.46:0/1017043783 conn(0x7fcc2806fa20 msgr2=0x7fcc2814f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:24.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.707+0000 7fcc2f72f640 1 -- 172.21.15.46:0/1017043783 shutdown_connections 2024-01-23T08:55:24.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.707+0000 7fcc2f72f640 1 -- 172.21.15.46:0/1017043783 wait complete. 2024-01-23T08:55:24.732 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-23T08:55:24.732 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-23T08:55:24.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.879+0000 7f03f09b1640 1 Processor -- start 2024-01-23T08:55:24.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.879+0000 7f03f09b1640 1 -- start start 2024-01-23T08:55:24.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.883+0000 7f03f09b1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03ec0c0e90 0x7f03ec0c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:24.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.883+0000 7f03f09b1640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f03ec0c8e80 0x7f03ec159870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:24.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.883+0000 7f03f09b1640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03ec156ae0 con 0x7f03ec14d1b0 2024-01-23T08:55:24.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.883+0000 7f03f09b1640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03ec06f0d0 con 0x7f03ec0c8e80 2024-01-23T08:55:24.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.883+0000 7f03f09b1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec156280 con 0x7f03ec0c0e90 2024-01-23T08:55:24.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.883+0000 7f03e9d9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03ec0c0e90 0x7f03ec0c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:24.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.883+0000 7f03e9d9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03ec0c0e90 0x7f03ec0c6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:45006/0 (socket says 172.21.15.46:45006) 2024-01-23T08:55:24.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.883+0000 7f03e9d9b640 1 -- 172.21.15.46:0/2456681477 learned_addr learned my addr 172.21.15.46:0/2456681477 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:24.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.891+0000 7f03e9d9b640 1 -- 172.21.15.46:0/2456681477 >> v2:172.21.15.46:3300/0 conn(0x7f03ec0c8e80 msgr2=0x7f03ec159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:24.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.891+0000 7f03e9d9b640 1 --2- 172.21.15.46:0/2456681477 >> v2:172.21.15.46:3300/0 conn(0x7f03ec0c8e80 0x7f03ec159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:24.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.891+0000 7f03e9d9b640 1 -- 172.21.15.46:0/2456681477 >> v1:172.21.15.175:6789/0 conn(0x7f03ec14d1b0 legacy=0x7f03ec0c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:24.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.891+0000 7f03e9d9b640 1 -- 172.21.15.46:0/2456681477 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ec159db0 con 0x7f03ec0c0e90 2024-01-23T08:55:24.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.895+0000 7f03e9d9b640 1 --2- 172.21.15.46:0/2456681477 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03ec0c0e90 0x7f03ec0c6770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f03e0009870 tx=0x7f03e001c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a049ae9409a4e463 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:24.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.907+0000 7f03e959a640 1 -- 172.21.15.46:0/2456681477 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e00aa620 con 0x7f03ec0c0e90 2024-01-23T08:55:24.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.907+0000 7f03e959a640 1 -- 172.21.15.46:0/2456681477 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e00aa780 con 0x7f03ec0c0e90 2024-01-23T08:55:24.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.907+0000 7f03e959a640 1 -- 172.21.15.46:0/2456681477 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e00aab10 con 0x7f03ec0c0e90 2024-01-23T08:55:24.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.911+0000 7f03f09b1640 1 -- 172.21.15.46:0/2456681477 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03ec0c0e90 msgr2=0x7f03ec0c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:24.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.911+0000 7f03f09b1640 1 --2- 172.21.15.46:0/2456681477 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03ec0c0e90 0x7f03ec0c6770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f03e0009870 tx=0x7f03e001c500 comp rx=0 tx=0).stop 2024-01-23T08:55:24.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.911+0000 7f03f09b1640 1 -- 172.21.15.46:0/2456681477 shutdown_connections 2024-01-23T08:55:24.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.911+0000 7f03f09b1640 1 --2- 172.21.15.46:0/2456681477 >> v2:172.21.15.46:3300/0 conn(0x7f03ec0c8e80 0x7f03ec159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:24.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.911+0000 7f03f09b1640 1 --2- 172.21.15.46:0/2456681477 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03ec0c0e90 0x7f03ec0c6770 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:24.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.911+0000 7f03f09b1640 1 -- 172.21.15.46:0/2456681477 >> 172.21.15.46:0/2456681477 conn(0x7f03ec072450 msgr2=0x7f03ec06fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:24.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.911+0000 7f03f09b1640 1 -- 172.21.15.46:0/2456681477 shutdown_connections 2024-01-23T08:55:24.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.911+0000 7f03f09b1640 1 -- 172.21.15.46:0/2456681477 wait complete. 2024-01-23T08:55:24.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.911+0000 7f03f09b1640 1 Processor -- start 2024-01-23T08:55:24.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.911+0000 7f03f09b1640 1 -- start start 2024-01-23T08:55:24.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.911+0000 7f03f09b1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03ec0c0e90 0x7f03ec13bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:24.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.911+0000 7f03f09b1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03ec0c8e80 0x7f03ec1f6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:24.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.911+0000 7f03f09b1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03ec14d1b0 0x7f03ec1f6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:24.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.911+0000 7f03f09b1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec1f6280 con 0x7f03ec0c8e80 2024-01-23T08:55:24.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.911+0000 7f03f09b1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec157960 con 0x7f03ec0c0e90 2024-01-23T08:55:24.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.911+0000 7f03f09b1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec157ee0 con 0x7f03ec14d1b0 2024-01-23T08:55:24.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.915+0000 7f03ead9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03ec14d1b0 0x7f03ec1f6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:24.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.919+0000 7f03ea59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03ec0c0e90 0x7f03ec13bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:24.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.923+0000 7f03e9d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03ec0c8e80 0x7f03ec1f6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:24.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.923+0000 7f03e9d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03ec0c8e80 0x7f03ec1f6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37476/0 (socket says 172.21.15.46:37476) 2024-01-23T08:55:24.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.923+0000 7f03e9d9b640 1 -- 172.21.15.46:0/3109437071 learned_addr learned my addr 172.21.15.46:0/3109437071 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:24.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.927+0000 7f03e9d9b640 1 -- 172.21.15.46:0/3109437071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03ec14d1b0 msgr2=0x7f03ec1f6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:24.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.927+0000 7f03e9d9b640 1 --2- 172.21.15.46:0/3109437071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03ec14d1b0 0x7f03ec1f6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:24.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.927+0000 7f03e9d9b640 1 -- 172.21.15.46:0/3109437071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03ec0c0e90 msgr2=0x7f03ec13bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:24.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.927+0000 7f03e9d9b640 1 --2- 172.21.15.46:0/3109437071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03ec0c0e90 0x7f03ec13bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:24.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.927+0000 7f03e9d9b640 1 -- 172.21.15.46:0/3109437071 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e00094d0 con 0x7f03ec0c8e80 2024-01-23T08:55:24.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.931+0000 7f03e9d9b640 1 --2- 172.21.15.46:0/3109437071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03ec0c8e80 0x7f03ec1f6710 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f03e00ac040 tx=0x7f03e001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:24.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.931+0000 7f03daffd640 1 -- 172.21.15.46:0/3109437071 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e00b3800 con 0x7f03ec0c8e80 2024-01-23T08:55:24.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.931+0000 7f03f09b1640 1 -- 172.21.15.46:0/3109437071 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03ec157c00 con 0x7f03ec0c8e80 2024-01-23T08:55:24.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.931+0000 7f03f09b1640 1 -- 172.21.15.46:0/3109437071 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03ec1412e0 con 0x7f03ec0c8e80 2024-01-23T08:55:24.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.935+0000 7f03f09b1640 1 -- 172.21.15.46:0/3109437071 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03ec0c97d0 con 0x7f03ec0c8e80 2024-01-23T08:55:24.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:24.935+0000 7f03daffd640 1 -- 172.21.15.46:0/3109437071 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e00aae30 con 0x7f03ec0c8e80 2024-01-23T08:55:25.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.255+0000 7f03daffd640 1 -- 172.21.15.46:0/3109437071 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e00b3b80 con 0x7f03ec0c8e80 2024-01-23T08:55:25.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.259+0000 7f03daffd640 1 -- 172.21.15.46:0/3109437071 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f03e00c6390 con 0x7f03ec0c8e80 2024-01-23T08:55:25.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.259+0000 7f03daffd640 1 --2- 172.21.15.46:0/3109437071 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f03cc066500 0x7f03cc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:25.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.259+0000 7f03ea59c640 1 --2- 172.21.15.46:0/3109437071 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f03cc066500 0x7f03cc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:25.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.263+0000 7f03ea59c640 1 --2- 172.21.15.46:0/3109437071 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f03cc066500 0x7f03cc0689c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f03dc0098e0 tx=0x7f03dc009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:25.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.295+0000 7f03daffd640 1 -- 172.21.15.46:0/3109437071 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f03e00efa20 con 0x7f03ec0c8e80 2024-01-23T08:55:25.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.299+0000 7f03daffd640 1 -- 172.21.15.46:0/3109437071 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f03e00ebd60 con 0x7f03ec0c8e80 2024-01-23T08:55:25.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.515+0000 7f03f09b1640 1 -- 172.21.15.46:0/3109437071 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03ec074340 con 0x7f03ec0c8e80 2024-01-23T08:55:25.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.607+0000 7f03daffd640 1 -- 172.21.15.46:0/3109437071 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+6553 (secure 0 0 0) 0x7f03e00ef380 con 0x7f03ec0c8e80 2024-01-23T08:55:25.607 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:55:25.607 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4208,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/397511399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":397511399},{"type":"v1","addr":"172.21.15.175:6835","nonce":397511399}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1620040020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1620040020},{"type":"v1","addr":"172.21.15.46:6835","nonce":1620040020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/2714415350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2714415350},{"type":"v1","addr":"172.21.15.175:6833","nonce":2714415350}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-23T08:54:42.028655+0000","modified":"2024-01-23T08:55:24.660670+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2],"up":{"mds_0":4242,"mds_1":4239,"mds_2":4234},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4234":{"gid":4234,"name":"f","rank":2,"incarnation":13,"state":"up:creating","state_seq":1,"addr":"172.21.15.175:6837/3103300888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3103300888},{"type":"v1","addr":"172.21.15.175:6837","nonce":3103300888}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4239":{"gid":4239,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6837/338965660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":338965660},{"type":"v1","addr":"172.21.15.46:6837","nonce":338965660}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4242":{"gid":4242,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":9,"addr":"172.21.15.46:6839/1889172114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1889172114},{"type":"v1","addr":"172.21.15.46:6839","nonce":1889172114}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-23T08:55:25.607 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 13 2024-01-23T08:55:25.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.611+0000 7f03f09b1640 1 -- 172.21.15.46:0/3109437071 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f03cc066500 msgr2=0x7f03cc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:25.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.611+0000 7f03f09b1640 1 --2- 172.21.15.46:0/3109437071 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f03cc066500 0x7f03cc0689c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f03dc0098e0 tx=0x7f03dc009060 comp rx=0 tx=0).stop 2024-01-23T08:55:25.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.611+0000 7f03f09b1640 1 -- 172.21.15.46:0/3109437071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03ec0c8e80 msgr2=0x7f03ec1f6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:25.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.611+0000 7f03f09b1640 1 --2- 172.21.15.46:0/3109437071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03ec0c8e80 0x7f03ec1f6710 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f03e00ac040 tx=0x7f03e001ad40 comp rx=0 tx=0).stop 2024-01-23T08:55:25.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.611+0000 7f03f09b1640 1 -- 172.21.15.46:0/3109437071 shutdown_connections 2024-01-23T08:55:25.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.611+0000 7f03f09b1640 1 --2- 172.21.15.46:0/3109437071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03ec14d1b0 0x7f03ec1f6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:25.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.611+0000 7f03f09b1640 1 --2- 172.21.15.46:0/3109437071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f03ec0c8e80 0x7f03ec1f6710 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:25.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.611+0000 7f03f09b1640 1 --2- 172.21.15.46:0/3109437071 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f03cc066500 0x7f03cc0689c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:25.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.611+0000 7f03f09b1640 1 --2- 172.21.15.46:0/3109437071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03ec0c0e90 0x7f03ec13bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:25.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.611+0000 7f03f09b1640 1 -- 172.21.15.46:0/3109437071 >> 172.21.15.46:0/3109437071 conn(0x7f03ec072450 msgr2=0x7f03ec0cadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:25.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.611+0000 7f03f09b1640 1 -- 172.21.15.46:0/3109437071 shutdown_connections 2024-01-23T08:55:25.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.611+0000 7f03f09b1640 1 -- 172.21.15.46:0/3109437071 wait complete. 2024-01-23T08:55:25.635 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-23T08:55:25.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.763+0000 7f063c403640 1 Processor -- start 2024-01-23T08:55:25.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.763+0000 7f063c403640 1 -- start start 2024-01-23T08:55:25.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.763+0000 7f063c403640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f06340cb370 0x7f0634071a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:25.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.763+0000 7f063c403640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0634071f40 con 0x7f06340cb750 2024-01-23T08:55:25.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.763+0000 7f063c403640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06340722a0 con 0x7f06340bffd0 2024-01-23T08:55:25.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.763+0000 7f063c403640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0634072580 con 0x7f06340cb370 2024-01-23T08:55:25.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.763+0000 7f063a9a0640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f06340cb750 0x7f063414ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35224/0 (socket says 172.21.15.46:35224) 2024-01-23T08:55:25.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.763+0000 7f063a9a0640 1 -- 172.21.15.46:0/514446173 learned_addr learned my addr 172.21.15.46:0/514446173 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:25.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.767+0000 7f063919d640 1 -- 172.21.15.46:0/514446173 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3465927077 0 0) 0x7f0634071f40 con 0x7f06340cb750 2024-01-23T08:55:25.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.767+0000 7f063919d640 1 -- 172.21.15.46:0/514446173 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0620003530 con 0x7f06340cb750 2024-01-23T08:55:25.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.771+0000 7f063919d640 1 -- 172.21.15.46:0/514446173 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1973031572 0 0) 0x7f0620003530 con 0x7f06340cb750 2024-01-23T08:55:25.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.771+0000 7f063919d640 1 -- 172.21.15.46:0/514446173 >> v2:172.21.15.175:3300/0 conn(0x7f06340cb370 msgr2=0x7f0634071a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:25.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.771+0000 7f063919d640 1 --2- 172.21.15.46:0/514446173 >> v2:172.21.15.175:3300/0 conn(0x7f06340cb370 0x7f0634071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:25.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.771+0000 7f063919d640 1 -- 172.21.15.46:0/514446173 >> v1:172.21.15.175:6789/0 conn(0x7f06340bffd0 legacy=0x7f0634159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:25.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.771+0000 7f063919d640 1 -- 172.21.15.46:0/514446173 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0634072860 con 0x7f06340cb750 2024-01-23T08:55:25.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.771+0000 7f063919d640 1 -- 172.21.15.46:0/514446173 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466917103 0 0) 0x7f062c001a00 con 0x7f06340cb750 2024-01-23T08:55:25.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.771+0000 7f063919d640 1 -- 172.21.15.46:0/514446173 >> v1:172.21.15.46:6789/0 conn(0x7f06340cb750 legacy=0x7f063414ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:25.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.775+0000 7f063919d640 1 --2- 172.21.15.46:0/514446173 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06200039d0 0x7f0620003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:25.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.775+0000 7f063919d640 1 --2- 172.21.15.46:0/514446173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06200047d0 0x7f0620004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:25.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.775+0000 7f063919d640 1 --2- 172.21.15.46:0/514446173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06200052b0 0x7f062000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:25.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.775+0000 7f063919d640 1 -- 172.21.15.46:0/514446173 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0634072580 con 0x7f06200047d0 2024-01-23T08:55:25.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.775+0000 7f063919d640 1 -- 172.21.15.46:0/514446173 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062000c1f0 con 0x7f06200052b0 2024-01-23T08:55:25.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.775+0000 7f063919d640 1 -- 172.21.15.46:0/514446173 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062000c3b0 con 0x7f06200039d0 2024-01-23T08:55:25.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.779+0000 7f063999e640 1 --2- 172.21.15.46:0/514446173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06200047d0 0x7f0620004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:25.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.787+0000 7f063999e640 1 -- 172.21.15.46:0/514446173 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06200039d0 msgr2=0x7f0620003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:25.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.787+0000 7f063999e640 1 --2- 172.21.15.46:0/514446173 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06200039d0 0x7f0620003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:25.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.787+0000 7f063999e640 1 -- 172.21.15.46:0/514446173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06200052b0 msgr2=0x7f062000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:25.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.787+0000 7f063999e640 1 --2- 172.21.15.46:0/514446173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06200052b0 0x7f062000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:25.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.787+0000 7f063999e640 1 -- 172.21.15.46:0/514446173 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0620003530 con 0x7f06200047d0 2024-01-23T08:55:25.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.787+0000 7f063a9a0640 1 -- 172.21.15.46:0/514446173 reap_dead start 2024-01-23T08:55:25.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.795+0000 7f063999e640 1 --2- 172.21.15.46:0/514446173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06200047d0 0x7f0620004c50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0624007fd0 tx=0x7f062401c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5451c361b69efd6b server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:25.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.799+0000 7f063919d640 1 -- 172.21.15.46:0/514446173 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624005270 con 0x7f06200047d0 2024-01-23T08:55:25.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.799+0000 7f063919d640 1 -- 172.21.15.46:0/514446173 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06240a7070 con 0x7f06200047d0 2024-01-23T08:55:25.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.799+0000 7f063919d640 1 -- 172.21.15.46:0/514446173 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624003860 con 0x7f06200047d0 2024-01-23T08:55:25.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.799+0000 7f063c403640 1 -- 172.21.15.46:0/514446173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06200047d0 msgr2=0x7f0620004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:25.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.799+0000 7f063c403640 1 --2- 172.21.15.46:0/514446173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06200047d0 0x7f0620004c50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0624007fd0 tx=0x7f062401c2a0 comp rx=0 tx=0).stop 2024-01-23T08:55:25.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.799+0000 7f063c403640 1 -- 172.21.15.46:0/514446173 shutdown_connections 2024-01-23T08:55:25.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.799+0000 7f063c403640 1 --2- 172.21.15.46:0/514446173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06200047d0 0x7f0620004c50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:25.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.799+0000 7f063c403640 1 -- 172.21.15.46:0/514446173 >> 172.21.15.46:0/514446173 conn(0x7f063406d590 msgr2=0x7f0634066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:25.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.799+0000 7f063c403640 1 -- 172.21.15.46:0/514446173 shutdown_connections 2024-01-23T08:55:25.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.799+0000 7f063c403640 1 -- 172.21.15.46:0/514446173 wait complete. 2024-01-23T08:55:25.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.799+0000 7f063c403640 1 Processor -- start 2024-01-23T08:55:25.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.799+0000 7f063c403640 1 -- start start 2024-01-23T08:55:25.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.803+0000 7f063c403640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06200047d0 0x7f0634165780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:25.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.803+0000 7f063c403640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0634163c20 0x7f06341f2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:25.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.803+0000 7f063c403640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06340c6860 0x7f0634135520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:25.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.803+0000 7f063c403640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06341f2080 con 0x7f06200047d0 2024-01-23T08:55:25.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.803+0000 7f063c403640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0634165cc0 con 0x7f06340c6860 2024-01-23T08:55:25.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.803+0000 7f063c403640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06340c24b0 con 0x7f0634163c20 2024-01-23T08:55:25.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.803+0000 7f063a9a0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06340c6860 0x7f0634135520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:25.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.803+0000 7f063a19f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06200047d0 0x7f0634165780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:25.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.803+0000 7f063a9a0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06340c6860 0x7f0634135520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:56142/0 (socket says 172.21.15.46:56142) 2024-01-23T08:55:25.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.803+0000 7f063a9a0640 1 -- 172.21.15.46:0/1992288358 learned_addr learned my addr 172.21.15.46:0/1992288358 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:25.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.807+0000 7f063a9a0640 1 -- 172.21.15.46:0/1992288358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0634163c20 msgr2=0x7f06341f2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:25.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.807+0000 7f063a9a0640 1 --2- 172.21.15.46:0/1992288358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0634163c20 0x7f06341f2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:25.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.807+0000 7f063a9a0640 1 -- 172.21.15.46:0/1992288358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06200047d0 msgr2=0x7f0634165780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:25.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.807+0000 7f063a9a0640 1 --2- 172.21.15.46:0/1992288358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06200047d0 0x7f0634165780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:25.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.807+0000 7f063a9a0640 1 -- 172.21.15.46:0/1992288358 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06341f2fa0 con 0x7f06340c6860 2024-01-23T08:55:25.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.811+0000 7f063a9a0640 1 --2- 172.21.15.46:0/1992288358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06340c6860 0x7f0634135520 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f06340c1660 tx=0x7f062c00cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:25.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.823+0000 7f062affd640 1 -- 172.21.15.46:0/1992288358 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c00ce60 con 0x7f06340c6860 2024-01-23T08:55:25.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.823+0000 7f062affd640 1 -- 172.21.15.46:0/1992288358 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c00a610 con 0x7f06340c6860 2024-01-23T08:55:25.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.823+0000 7f062affd640 1 -- 172.21.15.46:0/1992288358 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c00a9c0 con 0x7f06340c6860 2024-01-23T08:55:25.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.823+0000 7f063c403640 1 -- 172.21.15.46:0/1992288358 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f063413dab0 con 0x7f06340c6860 2024-01-23T08:55:25.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.823+0000 7f063c403640 1 -- 172.21.15.46:0/1992288358 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06341f2260 con 0x7f06340c6860 2024-01-23T08:55:25.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:25.823+0000 7f063c403640 1 -- 172.21.15.46:0/1992288358 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063413bf70 con 0x7f06340c6860 2024-01-23T08:55:26.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.111+0000 7f062affd640 1 -- 172.21.15.46:0/1992288358 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f062c00ab20 con 0x7f06340c6860 2024-01-23T08:55:26.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.111+0000 7f062affd640 1 --2- 172.21.15.46:0/1992288358 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f0618066550 0x7f0618068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:26.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.111+0000 7f063a19f640 1 --2- 172.21.15.46:0/1992288358 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f0618066550 0x7f0618068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:26.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.115+0000 7f063a19f640 1 --2- 172.21.15.46:0/1992288358 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f0618066550 0x7f0618068a10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f06340cb0e0 tx=0x7f0630009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:26.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.135+0000 7f062affd640 1 -- 172.21.15.46:0/1992288358 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f062c01a2f0 con 0x7f06340c6860 2024-01-23T08:55:26.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.207+0000 7f062affd640 1 -- 172.21.15.46:0/1992288358 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f062c054800 con 0x7f06340c6860 2024-01-23T08:55:26.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.387+0000 7f063c403640 1 -- 172.21.15.46:0/1992288358 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f063413bf70 con 0x7f06340c6860 2024-01-23T08:55:26.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.519+0000 7f062affd640 1 -- 172.21.15.46:0/1992288358 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f063413bf70 con 0x7f06340c6860 2024-01-23T08:55:26.518 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:55:26.518 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":28,"fsid":"fdbdd393-f422-45ae-a488-2bbb0163e580","created":"2024-01-23T08:53:36.942515+0000","modified":"2024-01-23T08:54:50.465916+0000","last_up_change":"2024-01-23T08:53:57.198113+0000","last_in_change":"2024-01-23T08:53:47.852614+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-23T08:53:59.340853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-23T08:54:38.278770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-23T08:54:40.216521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-23T08:54:47.311079+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f32c3d7d-e32a-42d8-b55f-db874d915a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6818","nonce":2681790976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6821","nonce":2681790976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6825","nonce":2681790976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6823","nonce":2681790976}]},"public_addr":"172.21.15.46:6818/2681790976","cluster_addr":"172.21.15.46:6821/2681790976","heartbeat_back_addr":"172.21.15.46:6825/2681790976","heartbeat_front_addr":"172.21.15.46:6823/2681790976","state":["exists","up"]},{"osd":1,"uuid":"6f3b6bd2-bbea-4d08-84d5-4407363b5eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6803","nonce":3679152623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6805","nonce":3679152623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6809","nonce":3679152623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6807","nonce":3679152623}]},"public_addr":"172.21.15.46:6803/3679152623","cluster_addr":"172.21.15.46:6805/3679152623","heartbeat_back_addr":"172.21.15.46:6809/3679152623","heartbeat_front_addr":"172.21.15.46:6807/3679152623","state":["exists","up"]},{"osd":2,"uuid":"8f110727-31e7-4f69-926b-c87481d4d28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6811","nonce":3869652274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6813","nonce":3869652274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6820","nonce":3869652274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6815","nonce":3869652274}]},"public_addr":"172.21.15.46:6811/3869652274","cluster_addr":"172.21.15.46:6813/3869652274","heartbeat_back_addr":"172.21.15.46:6820/3869652274","heartbeat_front_addr":"172.21.15.46:6815/3869652274","state":["exists","up"]},{"osd":3,"uuid":"3aa7527d-0463-4373-b9c7-e6b507a7987f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6827","nonce":4168860822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6829","nonce":4168860822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6833","nonce":4168860822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6831","nonce":4168860822}]},"public_addr":"172.21.15.46:6827/4168860822","cluster_addr":"172.21.15.46:6829/4168860822","heartbeat_back_addr":"172.21.15.46:6833/4168860822","heartbeat_front_addr":"172.21.15.46:6831/4168860822","state":["exists","up"]},{"osd":4,"uuid":"eb47a1e5-9f26-465f-b188-87c6eed63c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6805","nonce":3115257412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6808","nonce":3115257412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6815","nonce":3115257412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6812","nonce":3115257412}]},"public_addr":"172.21.15.175:6805/3115257412","cluster_addr":"172.21.15.175:6808/3115257412","heartbeat_back_addr":"172.21.15.175:6815/3115257412","heartbeat_front_addr":"172.21.15.175:6812/3115257412","state":["exists","up"]},{"osd":5,"uuid":"34048409-998c-44f3-a29d-dcad7a6c917b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6818","nonce":3146473948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6822","nonce":3146473948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6831","nonce":3146473948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6826","nonce":3146473948}]},"public_addr":"172.21.15.175:6818/3146473948","cluster_addr":"172.21.15.175:6822/3146473948","heartbeat_back_addr":"172.21.15.175:6831/3146473948","heartbeat_front_addr":"172.21.15.175:6826/3146473948","state":["exists","up"]},{"osd":6,"uuid":"f5d45d3f-9af3-44a1-a730-c260ed1654b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6801","nonce":4161180058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6804","nonce":4161180058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6814","nonce":4161180058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6809","nonce":4161180058}]},"public_addr":"172.21.15.175:6801/4161180058","cluster_addr":"172.21.15.175:6804/4161180058","heartbeat_back_addr":"172.21.15.175:6814/4161180058","heartbeat_front_addr":"172.21.15.175:6809/4161180058","state":["exists","up"]},{"osd":7,"uuid":"16d12e53-2ad3-4b5c-a789-22b45056fd9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6819","nonce":2670236415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6823","nonce":2670236415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6830","nonce":2670236415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6827","nonce":2670236415}]},"public_addr":"172.21.15.175:6819/2670236415","cluster_addr":"172.21.15.175:6823/2670236415","heartbeat_back_addr":"172.21.15.175:6830/2670236415","heartbeat_front_addr":"172.21.15.175:6827/2670236415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.847037+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.765547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.716122+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.874628+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.786580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.924885+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.285635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.898130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T08:55:26.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.523+0000 7f063c403640 1 -- 172.21.15.46:0/1992288358 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f0618066550 msgr2=0x7f0618068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:26.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.523+0000 7f063c403640 1 --2- 172.21.15.46:0/1992288358 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f0618066550 0x7f0618068a10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f06340cb0e0 tx=0x7f0630009110 comp rx=0 tx=0).stop 2024-01-23T08:55:26.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.523+0000 7f063c403640 1 -- 172.21.15.46:0/1992288358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06340c6860 msgr2=0x7f0634135520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:26.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.523+0000 7f063c403640 1 --2- 172.21.15.46:0/1992288358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06340c6860 0x7f0634135520 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f06340c1660 tx=0x7f062c00cc10 comp rx=0 tx=0).stop 2024-01-23T08:55:26.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.523+0000 7f063c403640 1 -- 172.21.15.46:0/1992288358 shutdown_connections 2024-01-23T08:55:26.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.523+0000 7f063c403640 1 --2- 172.21.15.46:0/1992288358 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f0618066550 0x7f0618068a10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:26.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.523+0000 7f063c403640 1 --2- 172.21.15.46:0/1992288358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06340c6860 0x7f0634135520 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:26.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.523+0000 7f063c403640 1 --2- 172.21.15.46:0/1992288358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0634163c20 0x7f06341f2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:26.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.523+0000 7f063c403640 1 --2- 172.21.15.46:0/1992288358 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06200047d0 0x7f0634165780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:26.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.523+0000 7f063c403640 1 -- 172.21.15.46:0/1992288358 >> 172.21.15.46:0/1992288358 conn(0x7f063406d590 msgr2=0x7f063413e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:26.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.523+0000 7f063c403640 1 -- 172.21.15.46:0/1992288358 shutdown_connections 2024-01-23T08:55:26.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.523+0000 7f063c403640 1 -- 172.21.15.46:0/1992288358 wait complete. 2024-01-23T08:55:26.545 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-23T08:55:26.545 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-23T08:55:26.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.679+0000 7efe1ff09640 1 Processor -- start 2024-01-23T08:55:26.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.683+0000 7efe1ff09640 1 -- start start 2024-01-23T08:55:26.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.683+0000 7efe1ff09640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efe1814e1b0 0x7efe180c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:26.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.683+0000 7efe1ff09640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe18066860 0x7efe180c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:26.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.683+0000 7efe1ff09640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe1806a7e0 con 0x7efe1806b7c0 2024-01-23T08:55:26.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.683+0000 7efe1ff09640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe1806c0c0 con 0x7efe1814e1b0 2024-01-23T08:55:26.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.683+0000 7efe1ff09640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe180c7940 con 0x7efe18066860 2024-01-23T08:55:26.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.683+0000 7efe1d4a4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe18066860 0x7efe180c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:26.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.683+0000 7efe1d4a4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe18066860 0x7efe180c50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:45054/0 (socket says 172.21.15.46:45054) 2024-01-23T08:55:26.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.683+0000 7efe1d4a4640 1 -- 172.21.15.46:0/2712211569 learned_addr learned my addr 172.21.15.46:0/2712211569 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:26.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.691+0000 7efe1d4a4640 1 -- 172.21.15.46:0/2712211569 >> v2:172.21.15.46:3300/0 conn(0x7efe1814e1b0 msgr2=0x7efe180c4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:26.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.691+0000 7efe1d4a4640 1 --2- 172.21.15.46:0/2712211569 >> v2:172.21.15.46:3300/0 conn(0x7efe1814e1b0 0x7efe180c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:26.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.691+0000 7efe1d4a4640 1 -- 172.21.15.46:0/2712211569 >> v1:172.21.15.46:6789/0 conn(0x7efe1806b7c0 legacy=0x7efe18071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:26.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.691+0000 7efe1d4a4640 1 -- 172.21.15.46:0/2712211569 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe18157ec0 con 0x7efe18066860 2024-01-23T08:55:26.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.695+0000 7efe1d4a4640 1 --2- 172.21.15.46:0/2712211569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe18066860 0x7efe180c50a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efe14009870 tx=0x7efe1401ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49016652d1c51cd4 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:26.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.703+0000 7efe1cca3640 1 -- 172.21.15.46:0/2712211569 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe140a89b0 con 0x7efe18066860 2024-01-23T08:55:26.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.703+0000 7efe1cca3640 1 -- 172.21.15.46:0/2712211569 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe140a8b10 con 0x7efe18066860 2024-01-23T08:55:26.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.703+0000 7efe1cca3640 1 -- 172.21.15.46:0/2712211569 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe140a8ea0 con 0x7efe18066860 2024-01-23T08:55:26.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.703+0000 7efe1ff09640 1 -- 172.21.15.46:0/2712211569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe18066860 msgr2=0x7efe180c50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:26.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.703+0000 7efe1ff09640 1 --2- 172.21.15.46:0/2712211569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe18066860 0x7efe180c50a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efe14009870 tx=0x7efe1401ecf0 comp rx=0 tx=0).stop 2024-01-23T08:55:26.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.703+0000 7efe1ff09640 1 -- 172.21.15.46:0/2712211569 shutdown_connections 2024-01-23T08:55:26.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.703+0000 7efe1ff09640 1 --2- 172.21.15.46:0/2712211569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe18066860 0x7efe180c50a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:26.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.703+0000 7efe1ff09640 1 --2- 172.21.15.46:0/2712211569 >> v2:172.21.15.46:3300/0 conn(0x7efe1814e1b0 0x7efe180c4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:26.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.703+0000 7efe1ff09640 1 -- 172.21.15.46:0/2712211569 >> 172.21.15.46:0/2712211569 conn(0x7efe180cba50 msgr2=0x7efe180c7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:26.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.703+0000 7efe1ff09640 1 -- 172.21.15.46:0/2712211569 shutdown_connections 2024-01-23T08:55:26.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.703+0000 7efe1ff09640 1 -- 172.21.15.46:0/2712211569 wait complete. 2024-01-23T08:55:26.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.703+0000 7efe1ff09640 1 Processor -- start 2024-01-23T08:55:26.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.703+0000 7efe1ff09640 1 -- start start 2024-01-23T08:55:26.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.707+0000 7efe1ff09640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe18066860 0x7efe180ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:26.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.707+0000 7efe1ff09640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe1806b7c0 0x7efe180c3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:26.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.707+0000 7efe1ff09640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe1814e1b0 0x7efe181436a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:26.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.707+0000 7efe1ff09640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe181567f0 con 0x7efe1806b7c0 2024-01-23T08:55:26.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.707+0000 7efe1ff09640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe180c9c60 con 0x7efe18066860 2024-01-23T08:55:26.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.707+0000 7efe1ff09640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe180c3ce0 con 0x7efe1814e1b0 2024-01-23T08:55:26.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.707+0000 7efe1dca5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe18066860 0x7efe180ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:26.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.707+0000 7efe1e4a6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe1814e1b0 0x7efe181436a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:26.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.707+0000 7efe1dca5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe18066860 0x7efe180ca700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:56158/0 (socket says 172.21.15.46:56158) 2024-01-23T08:55:26.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.707+0000 7efe1dca5640 1 -- 172.21.15.46:0/404855702 learned_addr learned my addr 172.21.15.46:0/404855702 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:26.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.711+0000 7efe1d4a4640 1 --2- 172.21.15.46:0/404855702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe1806b7c0 0x7efe180c3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:26.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.715+0000 7efe1dca5640 1 -- 172.21.15.46:0/404855702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe1814e1b0 msgr2=0x7efe181436a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:26.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.715+0000 7efe1dca5640 1 --2- 172.21.15.46:0/404855702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe1814e1b0 0x7efe181436a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:26.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.715+0000 7efe1dca5640 1 -- 172.21.15.46:0/404855702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe1806b7c0 msgr2=0x7efe180c3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:26.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.715+0000 7efe1dca5640 1 --2- 172.21.15.46:0/404855702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe1806b7c0 0x7efe180c3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:26.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.715+0000 7efe1dca5640 1 -- 172.21.15.46:0/404855702 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe140094d0 con 0x7efe18066860 2024-01-23T08:55:26.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.719+0000 7efe1dca5640 1 --2- 172.21.15.46:0/404855702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe18066860 0x7efe180ca700 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efe0800b550 tx=0x7efe0800ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:26.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.727+0000 7efe0e7fc640 1 -- 172.21.15.46:0/404855702 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe08010870 con 0x7efe18066860 2024-01-23T08:55:26.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.727+0000 7efe0e7fc640 1 -- 172.21.15.46:0/404855702 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe080109f0 con 0x7efe18066860 2024-01-23T08:55:26.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.727+0000 7efe0e7fc640 1 -- 172.21.15.46:0/404855702 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe08010da0 con 0x7efe18066860 2024-01-23T08:55:26.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.727+0000 7efe1ff09640 1 -- 172.21.15.46:0/404855702 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe180c3fc0 con 0x7efe18066860 2024-01-23T08:55:26.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.727+0000 7efe1ff09640 1 -- 172.21.15.46:0/404855702 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe180ca1e0 con 0x7efe18066860 2024-01-23T08:55:26.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:26.727+0000 7efe1ff09640 1 -- 172.21.15.46:0/404855702 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe1806af60 con 0x7efe18066860 2024-01-23T08:55:27.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.055+0000 7efe0e7fc640 1 -- 172.21.15.46:0/404855702 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7efe08023480 con 0x7efe18066860 2024-01-23T08:55:27.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.059+0000 7efe0e7fc640 1 --2- 172.21.15.46:0/404855702 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7efdfc066580 0x7efdfc068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:27.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.059+0000 7efe1d4a4640 1 --2- 172.21.15.46:0/404855702 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7efdfc066580 0x7efdfc068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:27.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.059+0000 7efe1d4a4640 1 --2- 172.21.15.46:0/404855702 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7efdfc066580 0x7efdfc068a40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efe140b2000 tx=0x7efe140aa070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:27.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.071+0000 7efe0e7fc640 1 -- 172.21.15.46:0/404855702 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efe08055300 con 0x7efe18066860 2024-01-23T08:55:27.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.127+0000 7efe0e7fc640 1 -- 172.21.15.46:0/404855702 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7efe08051640 con 0x7efe18066860 2024-01-23T08:55:27.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.291+0000 7efe1ff09640 1 -- 172.21.15.46:0/404855702 --> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efe18071900 con 0x7efdfc066580 2024-01-23T08:55:27.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.303+0000 7efe0e7fc640 1 -- 172.21.15.46:0/404855702 <== mgr.4107 v2:172.21.15.46:6800/2324478006 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367848 (secure 0 0 0) 0x7efe140b0440 con 0x7efdfc066580 2024-01-23T08:55:27.307 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:55:27.311 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-01-23T08:55:27.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.307+0000 7efe1ff09640 1 -- 172.21.15.46:0/404855702 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7efdfc066580 msgr2=0x7efdfc068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:27.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.307+0000 7efe1ff09640 1 --2- 172.21.15.46:0/404855702 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7efdfc066580 0x7efdfc068a40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efe140b2000 tx=0x7efe140aa070 comp rx=0 tx=0).stop 2024-01-23T08:55:27.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.307+0000 7efe1ff09640 1 -- 172.21.15.46:0/404855702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe18066860 msgr2=0x7efe180ca700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:27.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.307+0000 7efe1ff09640 1 --2- 172.21.15.46:0/404855702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe18066860 0x7efe180ca700 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efe0800b550 tx=0x7efe0800ba10 comp rx=0 tx=0).stop 2024-01-23T08:55:27.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.307+0000 7efe1ff09640 1 -- 172.21.15.46:0/404855702 shutdown_connections 2024-01-23T08:55:27.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.307+0000 7efe1ff09640 1 --2- 172.21.15.46:0/404855702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe1814e1b0 0x7efe181436a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:27.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.307+0000 7efe1ff09640 1 --2- 172.21.15.46:0/404855702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efe1806b7c0 0x7efe180c3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:27.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.307+0000 7efe1ff09640 1 --2- 172.21.15.46:0/404855702 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7efdfc066580 0x7efdfc068a40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:27.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.307+0000 7efe1ff09640 1 --2- 172.21.15.46:0/404855702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe18066860 0x7efe180ca700 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:27.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.307+0000 7efe1ff09640 1 -- 172.21.15.46:0/404855702 >> 172.21.15.46:0/404855702 conn(0x7efe180cba50 msgr2=0x7efe1814bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:27.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.307+0000 7efe1ff09640 1 -- 172.21.15.46:0/404855702 shutdown_connections 2024-01-23T08:55:27.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.307+0000 7efe1ff09640 1 -- 172.21.15.46:0/404855702 wait complete. 2024-01-23T08:55:27.324 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-01-23T08:55:26.580773+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595769,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":228,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":175,"ondisk_log_size":175,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236344,"kb_used_data":3536,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738376,"statfs":{"total":773094113280,"available":772852097024,"internally_reserved":0,"allocated":3620864,"data_stored":2128310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":762,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004900"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.721599+0000","last_change":"2024-01-23T08:54:40.661700+0000","last_active":"2024-01-23T08:54:49.721599+0000","last_peered":"2024-01-23T08:54:49.721599+0000","last_clean":"2024-01-23T08:54:49.721599+0000","last_became_active":"2024-01-23T08:54:40.660901+0000","last_became_peered":"2024-01-23T08:54:40.660901+0000","last_unstale":"2024-01-23T08:54:49.721599+0000","last_undegraded":"2024-01-23T08:54:49.721599+0000","last_fullsized":"2024-01-23T08:54:49.721599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:59:22.804479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.662103+0000","last_change":"2024-01-23T08:54:42.159130+0000","last_active":"2024-01-23T08:54:49.662103+0000","last_peered":"2024-01-23T08:54:49.662103+0000","last_clean":"2024-01-23T08:54:49.662103+0000","last_became_active":"2024-01-23T08:54:42.158776+0000","last_became_peered":"2024-01-23T08:54:42.158776+0000","last_unstale":"2024-01-23T08:54:49.662103+0000","last_undegraded":"2024-01-23T08:54:49.662103+0000","last_fullsized":"2024-01-23T08:54:49.662103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:06.320845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.833180+0000","last_change":"2024-01-23T08:54:49.752558+0000","last_active":"2024-01-23T08:54:50.833180+0000","last_peered":"2024-01-23T08:54:50.833180+0000","last_clean":"2024-01-23T08:54:50.833180+0000","last_became_active":"2024-01-23T08:54:49.752077+0000","last_became_peered":"2024-01-23T08:54:49.752077+0000","last_unstale":"2024-01-23T08:54:50.833180+0000","last_undegraded":"2024-01-23T08:54:50.833180+0000","last_fullsized":"2024-01-23T08:54:50.833180+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:20:50.653881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.662253+0000","last_change":"2024-01-23T08:54:40.700164+0000","last_active":"2024-01-23T08:54:49.662253+0000","last_peered":"2024-01-23T08:54:49.662253+0000","last_clean":"2024-01-23T08:54:49.662253+0000","last_became_active":"2024-01-23T08:54:40.699449+0000","last_became_peered":"2024-01-23T08:54:40.699449+0000","last_unstale":"2024-01-23T08:54:49.662253+0000","last_undegraded":"2024-01-23T08:54:49.662253+0000","last_fullsized":"2024-01-23T08:54:49.662253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:16:32.814250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.660624+0000","last_change":"2024-01-23T08:54:42.092833+0000","last_active":"2024-01-23T08:54:49.660624+0000","last_peered":"2024-01-23T08:54:49.660624+0000","last_clean":"2024-01-23T08:54:49.660624+0000","last_became_active":"2024-01-23T08:54:42.091950+0000","last_became_peered":"2024-01-23T08:54:42.091950+0000","last_unstale":"2024-01-23T08:54:49.660624+0000","last_undegraded":"2024-01-23T08:54:49.660624+0000","last_fullsized":"2024-01-23T08:54:49.660624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:46.594970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.816521+0000","last_change":"2024-01-23T08:54:49.747131+0000","last_active":"2024-01-23T08:54:50.816521+0000","last_peered":"2024-01-23T08:54:50.816521+0000","last_clean":"2024-01-23T08:54:50.816521+0000","last_became_active":"2024-01-23T08:54:49.746481+0000","last_became_peered":"2024-01-23T08:54:49.746481+0000","last_unstale":"2024-01-23T08:54:50.816521+0000","last_undegraded":"2024-01-23T08:54:50.816521+0000","last_fullsized":"2024-01-23T08:54:50.816521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:45:19.670524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705960+0000","last_change":"2024-01-23T08:54:40.687614+0000","last_active":"2024-01-23T08:54:49.705960+0000","last_peered":"2024-01-23T08:54:49.705960+0000","last_clean":"2024-01-23T08:54:49.705960+0000","last_became_active":"2024-01-23T08:54:40.687234+0000","last_became_peered":"2024-01-23T08:54:40.687234+0000","last_unstale":"2024-01-23T08:54:49.705960+0000","last_undegraded":"2024-01-23T08:54:49.705960+0000","last_fullsized":"2024-01-23T08:54:49.705960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:54:17.627706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.711014+0000","last_change":"2024-01-23T08:54:42.114480+0000","last_active":"2024-01-23T08:54:49.711014+0000","last_peered":"2024-01-23T08:54:49.711014+0000","last_clean":"2024-01-23T08:54:49.711014+0000","last_became_active":"2024-01-23T08:54:42.113946+0000","last_became_peered":"2024-01-23T08:54:42.113946+0000","last_unstale":"2024-01-23T08:54:49.711014+0000","last_undegraded":"2024-01-23T08:54:49.711014+0000","last_fullsized":"2024-01-23T08:54:49.711014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:19:25.718244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.817755+0000","last_change":"2024-01-23T08:54:49.747332+0000","last_active":"2024-01-23T08:54:50.817755+0000","last_peered":"2024-01-23T08:54:50.817755+0000","last_clean":"2024-01-23T08:54:50.817755+0000","last_became_active":"2024-01-23T08:54:49.746474+0000","last_became_peered":"2024-01-23T08:54:49.746474+0000","last_unstale":"2024-01-23T08:54:50.817755+0000","last_undegraded":"2024-01-23T08:54:50.817755+0000","last_fullsized":"2024-01-23T08:54:50.817755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:28:57.975606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.709129+0000","last_change":"2024-01-23T08:54:40.687290+0000","last_active":"2024-01-23T08:54:49.709129+0000","last_peered":"2024-01-23T08:54:49.709129+0000","last_clean":"2024-01-23T08:54:49.709129+0000","last_became_active":"2024-01-23T08:54:40.686903+0000","last_became_peered":"2024-01-23T08:54:40.686903+0000","last_unstale":"2024-01-23T08:54:49.709129+0000","last_undegraded":"2024-01-23T08:54:49.709129+0000","last_fullsized":"2024-01-23T08:54:49.709129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:57:23.064188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.639122+0000","last_change":"2024-01-23T08:54:42.109485+0000","last_active":"2024-01-23T08:54:49.639122+0000","last_peered":"2024-01-23T08:54:49.639122+0000","last_clean":"2024-01-23T08:54:49.639122+0000","last_became_active":"2024-01-23T08:54:42.108182+0000","last_became_peered":"2024-01-23T08:54:42.108182+0000","last_unstale":"2024-01-23T08:54:49.639122+0000","last_undegraded":"2024-01-23T08:54:49.639122+0000","last_fullsized":"2024-01-23T08:54:49.639122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:51:12.417589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.816879+0000","last_change":"2024-01-23T08:54:49.747949+0000","last_active":"2024-01-23T08:54:50.816879+0000","last_peered":"2024-01-23T08:54:50.816879+0000","last_clean":"2024-01-23T08:54:50.816879+0000","last_became_active":"2024-01-23T08:54:49.746880+0000","last_became_peered":"2024-01-23T08:54:49.746880+0000","last_unstale":"2024-01-23T08:54:50.816879+0000","last_undegraded":"2024-01-23T08:54:50.816879+0000","last_fullsized":"2024-01-23T08:54:50.816879+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:54:26.728005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.638029+0000","last_change":"2024-01-23T08:54:42.088786+0000","last_active":"2024-01-23T08:54:49.638029+0000","last_peered":"2024-01-23T08:54:49.638029+0000","last_clean":"2024-01-23T08:54:49.638029+0000","last_became_active":"2024-01-23T08:54:42.088068+0000","last_became_peered":"2024-01-23T08:54:42.088068+0000","last_unstale":"2024-01-23T08:54:49.638029+0000","last_undegraded":"2024-01-23T08:54:49.638029+0000","last_fullsized":"2024-01-23T08:54:49.638029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:38:41.382732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.638575+0000","last_change":"2024-01-23T08:54:40.612044+0000","last_active":"2024-01-23T08:54:49.638575+0000","last_peered":"2024-01-23T08:54:49.638575+0000","last_clean":"2024-01-23T08:54:49.638575+0000","last_became_active":"2024-01-23T08:54:40.611589+0000","last_became_peered":"2024-01-23T08:54:40.611589+0000","last_unstale":"2024-01-23T08:54:49.638575+0000","last_undegraded":"2024-01-23T08:54:49.638575+0000","last_fullsized":"2024-01-23T08:54:49.638575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:36.177844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.311704+0000","last_change":"2024-01-23T08:54:49.716713+0000","last_active":"2024-01-23T08:54:51.311704+0000","last_peered":"2024-01-23T08:54:51.311704+0000","last_clean":"2024-01-23T08:54:51.311704+0000","last_became_active":"2024-01-23T08:54:49.715843+0000","last_became_peered":"2024-01-23T08:54:49.715843+0000","last_unstale":"2024-01-23T08:54:51.311704+0000","last_undegraded":"2024-01-23T08:54:51.311704+0000","last_fullsized":"2024-01-23T08:54:51.311704+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:46:24.157230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.715500+0000","last_change":"2024-01-23T08:54:42.230199+0000","last_active":"2024-01-23T08:54:49.715500+0000","last_peered":"2024-01-23T08:54:49.715500+0000","last_clean":"2024-01-23T08:54:49.715500+0000","last_became_active":"2024-01-23T08:54:42.229547+0000","last_became_peered":"2024-01-23T08:54:42.229547+0000","last_unstale":"2024-01-23T08:54:49.715500+0000","last_undegraded":"2024-01-23T08:54:49.715500+0000","last_fullsized":"2024-01-23T08:54:49.715500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:07:07.781698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.678319+0000","last_change":"2024-01-23T08:54:40.688971+0000","last_active":"2024-01-23T08:54:49.678319+0000","last_peered":"2024-01-23T08:54:49.678319+0000","last_clean":"2024-01-23T08:54:49.678319+0000","last_became_active":"2024-01-23T08:54:40.688230+0000","last_became_peered":"2024-01-23T08:54:40.688230+0000","last_unstale":"2024-01-23T08:54:49.678319+0000","last_undegraded":"2024-01-23T08:54:49.678319+0000","last_fullsized":"2024-01-23T08:54:49.678319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:40:12.245110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.314784+0000","last_change":"2024-01-23T08:54:49.748471+0000","last_active":"2024-01-23T08:54:51.314784+0000","last_peered":"2024-01-23T08:54:51.314784+0000","last_clean":"2024-01-23T08:54:51.314784+0000","last_became_active":"2024-01-23T08:54:49.747958+0000","last_became_peered":"2024-01-23T08:54:49.747958+0000","last_unstale":"2024-01-23T08:54:51.314784+0000","last_undegraded":"2024-01-23T08:54:51.314784+0000","last_fullsized":"2024-01-23T08:54:51.314784+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:46:36.583078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.709746+0000","last_change":"2024-01-23T08:54:42.194148+0000","last_active":"2024-01-23T08:54:49.709746+0000","last_peered":"2024-01-23T08:54:49.709746+0000","last_clean":"2024-01-23T08:54:49.709746+0000","last_became_active":"2024-01-23T08:54:42.193403+0000","last_became_peered":"2024-01-23T08:54:42.193403+0000","last_unstale":"2024-01-23T08:54:49.709746+0000","last_undegraded":"2024-01-23T08:54:49.709746+0000","last_fullsized":"2024-01-23T08:54:49.709746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:38:42.543776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:23.532404+0000","last_change":"2024-01-23T08:54:40.688897+0000","last_active":"2024-01-23T08:55:23.532404+0000","last_peered":"2024-01-23T08:55:23.532404+0000","last_clean":"2024-01-23T08:55:23.532404+0000","last_became_active":"2024-01-23T08:54:40.688122+0000","last_became_peered":"2024-01-23T08:54:40.688122+0000","last_unstale":"2024-01-23T08:55:23.532404+0000","last_undegraded":"2024-01-23T08:55:23.532404+0000","last_fullsized":"2024-01-23T08:55:23.532404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:19:16.760424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.834576+0000","last_change":"2024-01-23T08:54:49.738331+0000","last_active":"2024-01-23T08:54:50.834576+0000","last_peered":"2024-01-23T08:54:50.834576+0000","last_clean":"2024-01-23T08:54:50.834576+0000","last_became_active":"2024-01-23T08:54:49.737442+0000","last_became_peered":"2024-01-23T08:54:49.737442+0000","last_unstale":"2024-01-23T08:54:50.834576+0000","last_undegraded":"2024-01-23T08:54:50.834576+0000","last_fullsized":"2024-01-23T08:54:50.834576+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:59:20.106849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.637930+0000","last_change":"2024-01-23T08:54:42.192681+0000","last_active":"2024-01-23T08:54:49.637930+0000","last_peered":"2024-01-23T08:54:49.637930+0000","last_clean":"2024-01-23T08:54:49.637930+0000","last_became_active":"2024-01-23T08:54:42.192225+0000","last_became_peered":"2024-01-23T08:54:42.192225+0000","last_unstale":"2024-01-23T08:54:49.637930+0000","last_undegraded":"2024-01-23T08:54:49.637930+0000","last_fullsized":"2024-01-23T08:54:49.637930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:20:26.263299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.699945+0000","last_change":"2024-01-23T08:54:40.686987+0000","last_active":"2024-01-23T08:54:49.699945+0000","last_peered":"2024-01-23T08:54:49.699945+0000","last_clean":"2024-01-23T08:54:49.699945+0000","last_became_active":"2024-01-23T08:54:40.686654+0000","last_became_peered":"2024-01-23T08:54:40.686654+0000","last_unstale":"2024-01-23T08:54:49.699945+0000","last_undegraded":"2024-01-23T08:54:49.699945+0000","last_fullsized":"2024-01-23T08:54:49.699945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:43:26.442461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.818343+0000","last_change":"2024-01-23T08:54:49.736471+0000","last_active":"2024-01-23T08:54:50.818343+0000","last_peered":"2024-01-23T08:54:50.818343+0000","last_clean":"2024-01-23T08:54:50.818343+0000","last_became_active":"2024-01-23T08:54:49.735971+0000","last_became_peered":"2024-01-23T08:54:49.735971+0000","last_unstale":"2024-01-23T08:54:50.818343+0000","last_undegraded":"2024-01-23T08:54:50.818343+0000","last_fullsized":"2024-01-23T08:54:50.818343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:18:10.354308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.710027+0000","last_change":"2024-01-23T08:54:42.195854+0000","last_active":"2024-01-23T08:54:49.710027+0000","last_peered":"2024-01-23T08:54:49.710027+0000","last_clean":"2024-01-23T08:54:49.710027+0000","last_became_active":"2024-01-23T08:54:42.195052+0000","last_became_peered":"2024-01-23T08:54:42.195052+0000","last_unstale":"2024-01-23T08:54:49.710027+0000","last_undegraded":"2024-01-23T08:54:49.710027+0000","last_fullsized":"2024-01-23T08:54:49.710027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:54:18.859903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.640728+0000","last_change":"2024-01-23T08:54:40.694194+0000","last_active":"2024-01-23T08:54:49.640728+0000","last_peered":"2024-01-23T08:54:49.640728+0000","last_clean":"2024-01-23T08:54:49.640728+0000","last_became_active":"2024-01-23T08:54:40.693610+0000","last_became_peered":"2024-01-23T08:54:40.693610+0000","last_unstale":"2024-01-23T08:54:49.640728+0000","last_undegraded":"2024-01-23T08:54:49.640728+0000","last_fullsized":"2024-01-23T08:54:49.640728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:47:30.746915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.817667+0000","last_change":"2024-01-23T08:54:49.747205+0000","last_active":"2024-01-23T08:54:50.817667+0000","last_peered":"2024-01-23T08:54:50.817667+0000","last_clean":"2024-01-23T08:54:50.817667+0000","last_became_active":"2024-01-23T08:54:49.746792+0000","last_became_peered":"2024-01-23T08:54:49.746792+0000","last_unstale":"2024-01-23T08:54:50.817667+0000","last_undegraded":"2024-01-23T08:54:50.817667+0000","last_fullsized":"2024-01-23T08:54:50.817667+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:58:42.245045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.708442+0000","last_change":"2024-01-23T08:54:42.233783+0000","last_active":"2024-01-23T08:54:49.708442+0000","last_peered":"2024-01-23T08:54:49.708442+0000","last_clean":"2024-01-23T08:54:49.708442+0000","last_became_active":"2024-01-23T08:54:42.233018+0000","last_became_peered":"2024-01-23T08:54:42.233018+0000","last_unstale":"2024-01-23T08:54:49.708442+0000","last_undegraded":"2024-01-23T08:54:49.708442+0000","last_fullsized":"2024-01-23T08:54:49.708442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:04:58.998914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:06.380549+0000","last_change":"2024-01-23T08:54:40.690385+0000","last_active":"2024-01-23T08:55:06.380549+0000","last_peered":"2024-01-23T08:55:06.380549+0000","last_clean":"2024-01-23T08:55:06.380549+0000","last_became_active":"2024-01-23T08:54:40.689528+0000","last_became_peered":"2024-01-23T08:54:40.689528+0000","last_unstale":"2024-01-23T08:55:06.380549+0000","last_undegraded":"2024-01-23T08:55:06.380549+0000","last_fullsized":"2024-01-23T08:55:06.380549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:59:11.006550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.314560+0000","last_change":"2024-01-23T08:54:49.731870+0000","last_active":"2024-01-23T08:54:51.314560+0000","last_peered":"2024-01-23T08:54:51.314560+0000","last_clean":"2024-01-23T08:54:51.314560+0000","last_became_active":"2024-01-23T08:54:49.731414+0000","last_became_peered":"2024-01-23T08:54:49.731414+0000","last_unstale":"2024-01-23T08:54:51.314560+0000","last_undegraded":"2024-01-23T08:54:51.314560+0000","last_fullsized":"2024-01-23T08:54:51.314560+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:30.315625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.679440+0000","last_change":"2024-01-23T08:54:42.227885+0000","last_active":"2024-01-23T08:54:49.679440+0000","last_peered":"2024-01-23T08:54:49.679440+0000","last_clean":"2024-01-23T08:54:49.679440+0000","last_became_active":"2024-01-23T08:54:42.227188+0000","last_became_peered":"2024-01-23T08:54:42.227188+0000","last_unstale":"2024-01-23T08:54:49.679440+0000","last_undegraded":"2024-01-23T08:54:49.679440+0000","last_fullsized":"2024-01-23T08:54:49.679440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:02:13.790208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.640066+0000","last_change":"2024-01-23T08:54:40.658365+0000","last_active":"2024-01-23T08:54:49.640066+0000","last_peered":"2024-01-23T08:54:49.640066+0000","last_clean":"2024-01-23T08:54:49.640066+0000","last_became_active":"2024-01-23T08:54:40.657616+0000","last_became_peered":"2024-01-23T08:54:40.657616+0000","last_unstale":"2024-01-23T08:54:49.640066+0000","last_undegraded":"2024-01-23T08:54:49.640066+0000","last_fullsized":"2024-01-23T08:54:49.640066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:23:50.053046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.315400+0000","last_change":"2024-01-23T08:54:49.739474+0000","last_active":"2024-01-23T08:54:51.315400+0000","last_peered":"2024-01-23T08:54:51.315400+0000","last_clean":"2024-01-23T08:54:51.315400+0000","last_became_active":"2024-01-23T08:54:49.738579+0000","last_became_peered":"2024-01-23T08:54:49.738579+0000","last_unstale":"2024-01-23T08:54:51.315400+0000","last_undegraded":"2024-01-23T08:54:51.315400+0000","last_fullsized":"2024-01-23T08:54:51.315400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:23:32.238072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.702527+0000","last_change":"2024-01-23T08:54:42.228302+0000","last_active":"2024-01-23T08:54:49.702527+0000","last_peered":"2024-01-23T08:54:49.702527+0000","last_clean":"2024-01-23T08:54:49.702527+0000","last_became_active":"2024-01-23T08:54:42.227558+0000","last_became_peered":"2024-01-23T08:54:42.227558+0000","last_unstale":"2024-01-23T08:54:49.702527+0000","last_undegraded":"2024-01-23T08:54:49.702527+0000","last_fullsized":"2024-01-23T08:54:49.702527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:19:17.992621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.660203+0000","last_change":"2024-01-23T08:54:40.697453+0000","last_active":"2024-01-23T08:54:49.660203+0000","last_peered":"2024-01-23T08:54:49.660203+0000","last_clean":"2024-01-23T08:54:49.660203+0000","last_became_active":"2024-01-23T08:54:40.696688+0000","last_became_peered":"2024-01-23T08:54:40.696688+0000","last_unstale":"2024-01-23T08:54:49.660203+0000","last_undegraded":"2024-01-23T08:54:49.660203+0000","last_fullsized":"2024-01-23T08:54:49.660203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:59:22.804479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.314513+0000","last_change":"2024-01-23T08:54:49.726678+0000","last_active":"2024-01-23T08:54:51.314513+0000","last_peered":"2024-01-23T08:54:51.314513+0000","last_clean":"2024-01-23T08:54:51.314513+0000","last_became_active":"2024-01-23T08:54:49.725830+0000","last_became_peered":"2024-01-23T08:54:49.725830+0000","last_unstale":"2024-01-23T08:54:51.314513+0000","last_undegraded":"2024-01-23T08:54:51.314513+0000","last_fullsized":"2024-01-23T08:54:51.314513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:12:34.009779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705119+0000","last_change":"2024-01-23T08:54:42.149751+0000","last_active":"2024-01-23T08:54:49.705119+0000","last_peered":"2024-01-23T08:54:49.705119+0000","last_clean":"2024-01-23T08:54:49.705119+0000","last_became_active":"2024-01-23T08:54:42.149019+0000","last_became_peered":"2024-01-23T08:54:42.149019+0000","last_unstale":"2024-01-23T08:54:49.705119+0000","last_undegraded":"2024-01-23T08:54:49.705119+0000","last_fullsized":"2024-01-23T08:54:49.705119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:38:36.083606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.638399+0000","last_change":"2024-01-23T08:54:40.680243+0000","last_active":"2024-01-23T08:54:49.638399+0000","last_peered":"2024-01-23T08:54:49.638399+0000","last_clean":"2024-01-23T08:54:49.638399+0000","last_became_active":"2024-01-23T08:54:40.679839+0000","last_became_peered":"2024-01-23T08:54:40.679839+0000","last_unstale":"2024-01-23T08:54:49.638399+0000","last_undegraded":"2024-01-23T08:54:49.638399+0000","last_fullsized":"2024-01-23T08:54:49.638399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:38:34.851409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.317036+0000","last_change":"2024-01-23T08:54:49.727785+0000","last_active":"2024-01-23T08:54:51.317036+0000","last_peered":"2024-01-23T08:54:51.317036+0000","last_clean":"2024-01-23T08:54:51.317036+0000","last_became_active":"2024-01-23T08:54:49.726855+0000","last_became_peered":"2024-01-23T08:54:49.726855+0000","last_unstale":"2024-01-23T08:54:51.317036+0000","last_undegraded":"2024-01-23T08:54:51.317036+0000","last_fullsized":"2024-01-23T08:54:51.317036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:13:39.452120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.659533+0000","last_change":"2024-01-23T08:54:42.108793+0000","last_active":"2024-01-23T08:54:49.659533+0000","last_peered":"2024-01-23T08:54:49.659533+0000","last_clean":"2024-01-23T08:54:49.659533+0000","last_became_active":"2024-01-23T08:54:42.108346+0000","last_became_peered":"2024-01-23T08:54:42.108346+0000","last_unstale":"2024-01-23T08:54:49.659533+0000","last_undegraded":"2024-01-23T08:54:49.659533+0000","last_fullsized":"2024-01-23T08:54:49.659533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:18:02.486206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.833462+0000","last_change":"2024-01-23T08:54:40.708494+0000","last_active":"2024-01-23T08:54:50.833462+0000","last_peered":"2024-01-23T08:54:50.833462+0000","last_clean":"2024-01-23T08:54:50.833462+0000","last_became_active":"2024-01-23T08:54:40.707841+0000","last_became_peered":"2024-01-23T08:54:40.707841+0000","last_unstale":"2024-01-23T08:54:50.833462+0000","last_undegraded":"2024-01-23T08:54:50.833462+0000","last_fullsized":"2024-01-23T08:54:50.833462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:53:17.764440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.319565+0000","last_change":"2024-01-23T08:54:49.738198+0000","last_active":"2024-01-23T08:54:51.319565+0000","last_peered":"2024-01-23T08:54:51.319565+0000","last_clean":"2024-01-23T08:54:51.319565+0000","last_became_active":"2024-01-23T08:54:49.737677+0000","last_became_peered":"2024-01-23T08:54:49.737677+0000","last_unstale":"2024-01-23T08:54:51.319565+0000","last_undegraded":"2024-01-23T08:54:51.319565+0000","last_fullsized":"2024-01-23T08:54:51.319565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:57:26.436916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.676533+0000","last_change":"2024-01-23T08:54:42.228222+0000","last_active":"2024-01-23T08:54:49.676533+0000","last_peered":"2024-01-23T08:54:49.676533+0000","last_clean":"2024-01-23T08:54:49.676533+0000","last_became_active":"2024-01-23T08:54:42.227335+0000","last_became_peered":"2024-01-23T08:54:42.227335+0000","last_unstale":"2024-01-23T08:54:49.676533+0000","last_undegraded":"2024-01-23T08:54:49.676533+0000","last_fullsized":"2024-01-23T08:54:49.676533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:29:51.842390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.638097+0000","last_change":"2024-01-23T08:54:40.679852+0000","last_active":"2024-01-23T08:54:49.638097+0000","last_peered":"2024-01-23T08:54:49.638097+0000","last_clean":"2024-01-23T08:54:49.638097+0000","last_became_active":"2024-01-23T08:54:40.679467+0000","last_became_peered":"2024-01-23T08:54:40.679467+0000","last_unstale":"2024-01-23T08:54:49.638097+0000","last_undegraded":"2024-01-23T08:54:49.638097+0000","last_fullsized":"2024-01-23T08:54:49.638097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:17.915137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.316103+0000","last_change":"2024-01-23T08:54:49.730538+0000","last_active":"2024-01-23T08:54:51.316103+0000","last_peered":"2024-01-23T08:54:51.316103+0000","last_clean":"2024-01-23T08:54:51.316103+0000","last_became_active":"2024-01-23T08:54:49.729861+0000","last_became_peered":"2024-01-23T08:54:49.729861+0000","last_unstale":"2024-01-23T08:54:51.316103+0000","last_undegraded":"2024-01-23T08:54:51.316103+0000","last_fullsized":"2024-01-23T08:54:51.316103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:46:36.583078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.709127+0000","last_change":"2024-01-23T08:54:42.196505+0000","last_active":"2024-01-23T08:54:49.709127+0000","last_peered":"2024-01-23T08:54:49.709127+0000","last_clean":"2024-01-23T08:54:49.709127+0000","last_became_active":"2024-01-23T08:54:42.195555+0000","last_became_peered":"2024-01-23T08:54:42.195555+0000","last_unstale":"2024-01-23T08:54:49.709127+0000","last_undegraded":"2024-01-23T08:54:49.709127+0000","last_fullsized":"2024-01-23T08:54:49.709127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:57:24.296384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.638705+0000","last_change":"2024-01-23T08:54:40.612594+0000","last_active":"2024-01-23T08:54:49.638705+0000","last_peered":"2024-01-23T08:54:49.638705+0000","last_clean":"2024-01-23T08:54:49.638705+0000","last_became_active":"2024-01-23T08:54:40.611932+0000","last_became_peered":"2024-01-23T08:54:40.611932+0000","last_unstale":"2024-01-23T08:54:49.638705+0000","last_undegraded":"2024-01-23T08:54:49.638705+0000","last_fullsized":"2024-01-23T08:54:49.638705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:05.088648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.709873+0000","last_change":"2024-01-23T08:54:01.491195+0000","last_active":"2024-01-23T08:54:49.709873+0000","last_peered":"2024-01-23T08:54:49.709873+0000","last_clean":"2024-01-23T08:54:49.709873+0000","last_became_active":"2024-01-23T08:54:01.490869+0000","last_became_peered":"2024-01-23T08:54:01.490869+0000","last_unstale":"2024-01-23T08:54:49.709873+0000","last_undegraded":"2024-01-23T08:54:49.709873+0000","last_fullsized":"2024-01-23T08:54:49.709873+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:53:59.492955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:53:59.492955+0000","last_clean_scrub_stamp":"2024-01-23T08:53:59.492955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:18:58.446726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.312760+0000","last_change":"2024-01-23T08:54:49.716297+0000","last_active":"2024-01-23T08:54:51.312760+0000","last_peered":"2024-01-23T08:54:51.312760+0000","last_clean":"2024-01-23T08:54:51.312760+0000","last_became_active":"2024-01-23T08:54:49.715231+0000","last_became_peered":"2024-01-23T08:54:49.715231+0000","last_unstale":"2024-01-23T08:54:51.312760+0000","last_undegraded":"2024-01-23T08:54:51.312760+0000","last_fullsized":"2024-01-23T08:54:51.312760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:17:59.837409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.639265+0000","last_change":"2024-01-23T08:54:42.089174+0000","last_active":"2024-01-23T08:54:49.639265+0000","last_peered":"2024-01-23T08:54:49.639265+0000","last_clean":"2024-01-23T08:54:49.639265+0000","last_became_active":"2024-01-23T08:54:42.088303+0000","last_became_peered":"2024-01-23T08:54:42.088303+0000","last_unstale":"2024-01-23T08:54:49.639265+0000","last_undegraded":"2024-01-23T08:54:49.639265+0000","last_fullsized":"2024-01-23T08:54:49.639265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:06:49.326117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.679747+0000","last_change":"2024-01-23T08:54:40.690720+0000","last_active":"2024-01-23T08:54:49.679747+0000","last_peered":"2024-01-23T08:54:49.679747+0000","last_clean":"2024-01-23T08:54:49.679747+0000","last_became_active":"2024-01-23T08:54:40.689895+0000","last_became_peered":"2024-01-23T08:54:40.689895+0000","last_unstale":"2024-01-23T08:54:49.679747+0000","last_undegraded":"2024-01-23T08:54:49.679747+0000","last_fullsized":"2024-01-23T08:54:49.679747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:33:12.542607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.817001+0000","last_change":"2024-01-23T08:54:49.736539+0000","last_active":"2024-01-23T08:54:50.817001+0000","last_peered":"2024-01-23T08:54:50.817001+0000","last_clean":"2024-01-23T08:54:50.817001+0000","last_became_active":"2024-01-23T08:54:49.735777+0000","last_became_peered":"2024-01-23T08:54:49.735777+0000","last_unstale":"2024-01-23T08:54:50.817001+0000","last_undegraded":"2024-01-23T08:54:50.817001+0000","last_fullsized":"2024-01-23T08:54:50.817001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:05:06.867017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.709023+0000","last_change":"2024-01-23T08:54:42.107066+0000","last_active":"2024-01-23T08:54:49.709023+0000","last_peered":"2024-01-23T08:54:49.709023+0000","last_clean":"2024-01-23T08:54:49.709023+0000","last_became_active":"2024-01-23T08:54:42.106757+0000","last_became_peered":"2024-01-23T08:54:42.106757+0000","last_unstale":"2024-01-23T08:54:49.709023+0000","last_undegraded":"2024-01-23T08:54:49.709023+0000","last_fullsized":"2024-01-23T08:54:49.709023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:47:31.979111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.662059+0000","last_change":"2024-01-23T08:54:40.687942+0000","last_active":"2024-01-23T08:54:49.662059+0000","last_peered":"2024-01-23T08:54:49.662059+0000","last_clean":"2024-01-23T08:54:49.662059+0000","last_became_active":"2024-01-23T08:54:40.686860+0000","last_became_peered":"2024-01-23T08:54:40.686860+0000","last_unstale":"2024-01-23T08:54:49.662059+0000","last_undegraded":"2024-01-23T08:54:49.662059+0000","last_fullsized":"2024-01-23T08:54:49.662059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:04:57.766717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.315714+0000","last_change":"2024-01-23T08:54:49.727416+0000","last_active":"2024-01-23T08:54:51.315714+0000","last_peered":"2024-01-23T08:54:51.315714+0000","last_clean":"2024-01-23T08:54:51.315714+0000","last_became_active":"2024-01-23T08:54:49.721494+0000","last_became_peered":"2024-01-23T08:54:49.721494+0000","last_unstale":"2024-01-23T08:54:51.315714+0000","last_undegraded":"2024-01-23T08:54:51.315714+0000","last_fullsized":"2024-01-23T08:54:51.315714+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:52:20.767279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.706168+0000","last_change":"2024-01-23T08:54:42.117785+0000","last_active":"2024-01-23T08:54:49.706168+0000","last_peered":"2024-01-23T08:54:49.706168+0000","last_clean":"2024-01-23T08:54:49.706168+0000","last_became_active":"2024-01-23T08:54:42.117317+0000","last_became_peered":"2024-01-23T08:54:42.117317+0000","last_unstale":"2024-01-23T08:54:49.706168+0000","last_undegraded":"2024-01-23T08:54:49.706168+0000","last_fullsized":"2024-01-23T08:54:49.706168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:48:28.943781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.713901+0000","last_change":"2024-01-23T08:54:40.682656+0000","last_active":"2024-01-23T08:54:49.713901+0000","last_peered":"2024-01-23T08:54:49.713901+0000","last_clean":"2024-01-23T08:54:49.713901+0000","last_became_active":"2024-01-23T08:54:40.681954+0000","last_became_peered":"2024-01-23T08:54:40.681954+0000","last_unstale":"2024-01-23T08:54:49.713901+0000","last_undegraded":"2024-01-23T08:54:49.713901+0000","last_fullsized":"2024-01-23T08:54:49.713901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:20:41.553582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.311198+0000","last_change":"2024-01-23T08:54:49.716316+0000","last_active":"2024-01-23T08:54:51.311198+0000","last_peered":"2024-01-23T08:54:51.311198+0000","last_clean":"2024-01-23T08:54:51.311198+0000","last_became_active":"2024-01-23T08:54:49.715917+0000","last_became_peered":"2024-01-23T08:54:49.715917+0000","last_unstale":"2024-01-23T08:54:51.311198+0000","last_undegraded":"2024-01-23T08:54:51.311198+0000","last_fullsized":"2024-01-23T08:54:51.311198+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:56:01.803823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.708070+0000","last_change":"2024-01-23T08:54:42.158814+0000","last_active":"2024-01-23T08:54:49.708070+0000","last_peered":"2024-01-23T08:54:49.708070+0000","last_clean":"2024-01-23T08:54:49.708070+0000","last_became_active":"2024-01-23T08:54:42.155411+0000","last_became_peered":"2024-01-23T08:54:42.155411+0000","last_unstale":"2024-01-23T08:54:49.708070+0000","last_undegraded":"2024-01-23T08:54:49.708070+0000","last_fullsized":"2024-01-23T08:54:49.708070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:28:02.074838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.706344+0000","last_change":"2024-01-23T08:54:40.696522+0000","last_active":"2024-01-23T08:54:49.706344+0000","last_peered":"2024-01-23T08:54:49.706344+0000","last_clean":"2024-01-23T08:54:49.706344+0000","last_became_active":"2024-01-23T08:54:40.696128+0000","last_became_peered":"2024-01-23T08:54:40.696128+0000","last_unstale":"2024-01-23T08:54:49.706344+0000","last_undegraded":"2024-01-23T08:54:49.706344+0000","last_fullsized":"2024-01-23T08:54:49.706344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:18:01.254009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.850403+0000","last_change":"2024-01-23T08:54:49.724660+0000","last_active":"2024-01-23T08:54:50.850403+0000","last_peered":"2024-01-23T08:54:50.850403+0000","last_clean":"2024-01-23T08:54:50.850403+0000","last_became_active":"2024-01-23T08:54:49.723038+0000","last_became_peered":"2024-01-23T08:54:49.723038+0000","last_unstale":"2024-01-23T08:54:50.850403+0000","last_undegraded":"2024-01-23T08:54:50.850403+0000","last_fullsized":"2024-01-23T08:54:50.850403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:20:50.653881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.637799+0000","last_change":"2024-01-23T08:54:42.149978+0000","last_active":"2024-01-23T08:54:49.637799+0000","last_peered":"2024-01-23T08:54:49.637799+0000","last_clean":"2024-01-23T08:54:49.637799+0000","last_became_active":"2024-01-23T08:54:42.149180+0000","last_became_peered":"2024-01-23T08:54:42.149180+0000","last_unstale":"2024-01-23T08:54:49.637799+0000","last_undegraded":"2024-01-23T08:54:49.637799+0000","last_fullsized":"2024-01-23T08:54:49.637799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:52:12.899176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'10","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:23.530742+0000","last_change":"2024-01-23T08:54:40.699997+0000","last_active":"2024-01-23T08:55:23.530742+0000","last_peered":"2024-01-23T08:55:23.530742+0000","last_clean":"2024-01-23T08:55:23.530742+0000","last_became_active":"2024-01-23T08:54:40.699246+0000","last_became_peered":"2024-01-23T08:54:40.699246+0000","last_unstale":"2024-01-23T08:55:23.530742+0000","last_undegraded":"2024-01-23T08:55:23.530742+0000","last_fullsized":"2024-01-23T08:55:23.530742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:19:24.486048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.317431+0000","last_change":"2024-01-23T08:54:49.729218+0000","last_active":"2024-01-23T08:54:51.317431+0000","last_peered":"2024-01-23T08:54:51.317431+0000","last_clean":"2024-01-23T08:54:51.317431+0000","last_became_active":"2024-01-23T08:54:49.728448+0000","last_became_peered":"2024-01-23T08:54:49.728448+0000","last_unstale":"2024-01-23T08:54:51.317431+0000","last_undegraded":"2024-01-23T08:54:51.317431+0000","last_fullsized":"2024-01-23T08:54:51.317431+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:56:52.671943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.709676+0000","last_change":"2024-01-23T08:54:42.087980+0000","last_active":"2024-01-23T08:54:49.709676+0000","last_peered":"2024-01-23T08:54:49.709676+0000","last_clean":"2024-01-23T08:54:49.709676+0000","last_became_active":"2024-01-23T08:54:42.087328+0000","last_became_peered":"2024-01-23T08:54:42.087328+0000","last_unstale":"2024-01-23T08:54:49.709676+0000","last_undegraded":"2024-01-23T08:54:49.709676+0000","last_fullsized":"2024-01-23T08:54:49.709676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:07:07.781698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.700020+0000","last_change":"2024-01-23T08:54:40.693906+0000","last_active":"2024-01-23T08:54:49.700020+0000","last_peered":"2024-01-23T08:54:49.700020+0000","last_clean":"2024-01-23T08:54:49.700020+0000","last_became_active":"2024-01-23T08:54:40.693530+0000","last_became_peered":"2024-01-23T08:54:40.693530+0000","last_unstale":"2024-01-23T08:54:49.700020+0000","last_undegraded":"2024-01-23T08:54:49.700020+0000","last_fullsized":"2024-01-23T08:54:49.700020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:59:11.006550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.317201+0000","last_change":"2024-01-23T08:54:49.730687+0000","last_active":"2024-01-23T08:54:51.317201+0000","last_peered":"2024-01-23T08:54:51.317201+0000","last_clean":"2024-01-23T08:54:51.317201+0000","last_became_active":"2024-01-23T08:54:49.729689+0000","last_became_peered":"2024-01-23T08:54:49.729689+0000","last_unstale":"2024-01-23T08:54:51.317201+0000","last_undegraded":"2024-01-23T08:54:51.317201+0000","last_fullsized":"2024-01-23T08:54:51.317201+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:54:47.041161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.638496+0000","last_change":"2024-01-23T08:54:42.108919+0000","last_active":"2024-01-23T08:54:49.638496+0000","last_peered":"2024-01-23T08:54:49.638496+0000","last_clean":"2024-01-23T08:54:49.638496+0000","last_became_active":"2024-01-23T08:54:42.108253+0000","last_became_peered":"2024-01-23T08:54:42.108253+0000","last_unstale":"2024-01-23T08:54:49.638496+0000","last_undegraded":"2024-01-23T08:54:49.638496+0000","last_fullsized":"2024-01-23T08:54:49.638496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:46:28.714976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.638279+0000","last_change":"2024-01-23T08:54:40.696080+0000","last_active":"2024-01-23T08:54:49.638279+0000","last_peered":"2024-01-23T08:54:49.638279+0000","last_clean":"2024-01-23T08:54:49.638279+0000","last_became_active":"2024-01-23T08:54:40.695699+0000","last_became_peered":"2024-01-23T08:54:40.695699+0000","last_unstale":"2024-01-23T08:54:49.638279+0000","last_undegraded":"2024-01-23T08:54:49.638279+0000","last_fullsized":"2024-01-23T08:54:49.638279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:21.215326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.316997+0000","last_change":"2024-01-23T08:54:49.740480+0000","last_active":"2024-01-23T08:54:51.316997+0000","last_peered":"2024-01-23T08:54:51.316997+0000","last_clean":"2024-01-23T08:54:51.316997+0000","last_became_active":"2024-01-23T08:54:49.739524+0000","last_became_peered":"2024-01-23T08:54:49.739524+0000","last_unstale":"2024-01-23T08:54:51.316997+0000","last_undegraded":"2024-01-23T08:54:51.316997+0000","last_fullsized":"2024-01-23T08:54:51.316997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:45:25.447987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.677949+0000","last_change":"2024-01-23T08:54:42.230659+0000","last_active":"2024-01-23T08:54:49.677949+0000","last_peered":"2024-01-23T08:54:49.677949+0000","last_clean":"2024-01-23T08:54:49.677949+0000","last_became_active":"2024-01-23T08:54:42.229952+0000","last_became_peered":"2024-01-23T08:54:42.229952+0000","last_unstale":"2024-01-23T08:54:49.677949+0000","last_undegraded":"2024-01-23T08:54:49.677949+0000","last_fullsized":"2024-01-23T08:54:49.677949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:41:53.265527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:23.534428+0000","last_change":"2024-01-23T08:54:40.698779+0000","last_active":"2024-01-23T08:55:23.534428+0000","last_peered":"2024-01-23T08:55:23.534428+0000","last_clean":"2024-01-23T08:55:23.534428+0000","last_became_active":"2024-01-23T08:54:40.698059+0000","last_became_peered":"2024-01-23T08:54:40.698059+0000","last_unstale":"2024-01-23T08:55:23.534428+0000","last_undegraded":"2024-01-23T08:55:23.534428+0000","last_fullsized":"2024-01-23T08:55:23.534428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:24:40.655839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.313021+0000","last_change":"2024-01-23T08:54:49.708388+0000","last_active":"2024-01-23T08:54:51.313021+0000","last_peered":"2024-01-23T08:54:51.313021+0000","last_clean":"2024-01-23T08:54:51.313021+0000","last_became_active":"2024-01-23T08:54:49.707837+0000","last_became_peered":"2024-01-23T08:54:49.707837+0000","last_unstale":"2024-01-23T08:54:51.313021+0000","last_undegraded":"2024-01-23T08:54:51.313021+0000","last_fullsized":"2024-01-23T08:54:51.313021+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:49:25.509880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705781+0000","last_change":"2024-01-23T08:54:42.229836+0000","last_active":"2024-01-23T08:54:49.705781+0000","last_peered":"2024-01-23T08:54:49.705781+0000","last_clean":"2024-01-23T08:54:49.705781+0000","last_became_active":"2024-01-23T08:54:42.229252+0000","last_became_peered":"2024-01-23T08:54:42.229252+0000","last_unstale":"2024-01-23T08:54:49.705781+0000","last_undegraded":"2024-01-23T08:54:49.705781+0000","last_fullsized":"2024-01-23T08:54:49.705781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:23:51.285243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'11","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:01.657369+0000","last_change":"2024-01-23T08:54:40.658490+0000","last_active":"2024-01-23T08:55:01.657369+0000","last_peered":"2024-01-23T08:55:01.657369+0000","last_clean":"2024-01-23T08:55:01.657369+0000","last_became_active":"2024-01-23T08:54:40.657711+0000","last_became_peered":"2024-01-23T08:54:40.657711+0000","last_unstale":"2024-01-23T08:55:01.657369+0000","last_undegraded":"2024-01-23T08:55:01.657369+0000","last_fullsized":"2024-01-23T08:55:01.657369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:37:29.479181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.313979+0000","last_change":"2024-01-23T08:54:49.737210+0000","last_active":"2024-01-23T08:54:51.313979+0000","last_peered":"2024-01-23T08:54:51.313979+0000","last_clean":"2024-01-23T08:54:51.313979+0000","last_became_active":"2024-01-23T08:54:49.735023+0000","last_became_peered":"2024-01-23T08:54:49.735023+0000","last_unstale":"2024-01-23T08:54:51.313979+0000","last_undegraded":"2024-01-23T08:54:51.313979+0000","last_fullsized":"2024-01-23T08:54:51.313979+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:27.015436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.638868+0000","last_change":"2024-01-23T08:54:42.154453+0000","last_active":"2024-01-23T08:54:49.638868+0000","last_peered":"2024-01-23T08:54:49.638868+0000","last_clean":"2024-01-23T08:54:49.638868+0000","last_became_active":"2024-01-23T08:54:42.153735+0000","last_became_peered":"2024-01-23T08:54:42.153735+0000","last_unstale":"2024-01-23T08:54:49.638868+0000","last_undegraded":"2024-01-23T08:54:49.638868+0000","last_fullsized":"2024-01-23T08:54:49.638868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:54:39.173058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.834471+0000","last_change":"2024-01-23T08:54:40.702888+0000","last_active":"2024-01-23T08:54:50.834471+0000","last_peered":"2024-01-23T08:54:50.834471+0000","last_clean":"2024-01-23T08:54:50.834471+0000","last_became_active":"2024-01-23T08:54:40.701827+0000","last_became_peered":"2024-01-23T08:54:40.701827+0000","last_unstale":"2024-01-23T08:54:50.834471+0000","last_undegraded":"2024-01-23T08:54:50.834471+0000","last_fullsized":"2024-01-23T08:54:50.834471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:18:17.748052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.817591+0000","last_change":"2024-01-23T08:54:49.736262+0000","last_active":"2024-01-23T08:54:50.817591+0000","last_peered":"2024-01-23T08:54:50.817591+0000","last_clean":"2024-01-23T08:54:50.817591+0000","last_became_active":"2024-01-23T08:54:49.735765+0000","last_became_peered":"2024-01-23T08:54:49.735765+0000","last_unstale":"2024-01-23T08:54:50.817591+0000","last_undegraded":"2024-01-23T08:54:50.817591+0000","last_fullsized":"2024-01-23T08:54:50.817591+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:29:59.191326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.660727+0000","last_change":"2024-01-23T08:54:42.071292+0000","last_active":"2024-01-23T08:54:49.660727+0000","last_peered":"2024-01-23T08:54:49.660727+0000","last_clean":"2024-01-23T08:54:49.660727+0000","last_became_active":"2024-01-23T08:54:42.070703+0000","last_became_peered":"2024-01-23T08:54:42.070703+0000","last_unstale":"2024-01-23T08:54:49.660727+0000","last_undegraded":"2024-01-23T08:54:49.660727+0000","last_fullsized":"2024-01-23T08:54:49.660727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:37.410041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705569+0000","last_change":"2024-01-23T08:54:40.687946+0000","last_active":"2024-01-23T08:54:49.705569+0000","last_peered":"2024-01-23T08:54:49.705569+0000","last_clean":"2024-01-23T08:54:49.705569+0000","last_became_active":"2024-01-23T08:54:40.687656+0000","last_became_peered":"2024-01-23T08:54:40.687656+0000","last_unstale":"2024-01-23T08:54:49.705569+0000","last_undegraded":"2024-01-23T08:54:49.705569+0000","last_fullsized":"2024-01-23T08:54:49.705569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:29:50.091026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.833039+0000","last_change":"2024-01-23T08:54:49.729434+0000","last_active":"2024-01-23T08:54:50.833039+0000","last_peered":"2024-01-23T08:54:50.833039+0000","last_clean":"2024-01-23T08:54:50.833039+0000","last_became_active":"2024-01-23T08:54:49.728191+0000","last_became_peered":"2024-01-23T08:54:49.728191+0000","last_unstale":"2024-01-23T08:54:50.833039+0000","last_undegraded":"2024-01-23T08:54:50.833039+0000","last_fullsized":"2024-01-23T08:54:50.833039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:30:27.390400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.707973+0000","last_change":"2024-01-23T08:54:42.155857+0000","last_active":"2024-01-23T08:54:49.707973+0000","last_peered":"2024-01-23T08:54:49.707973+0000","last_clean":"2024-01-23T08:54:49.707973+0000","last_became_active":"2024-01-23T08:54:42.153539+0000","last_became_peered":"2024-01-23T08:54:42.153539+0000","last_unstale":"2024-01-23T08:54:49.707973+0000","last_undegraded":"2024-01-23T08:54:49.707973+0000","last_fullsized":"2024-01-23T08:54:49.707973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:27:34.618270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:23.616435+0000","last_change":"2024-01-23T08:54:40.683174+0000","last_active":"2024-01-23T08:55:23.616435+0000","last_peered":"2024-01-23T08:55:23.616435+0000","last_clean":"2024-01-23T08:55:23.616435+0000","last_became_active":"2024-01-23T08:54:40.682765+0000","last_became_peered":"2024-01-23T08:54:40.682765+0000","last_unstale":"2024-01-23T08:55:23.616435+0000","last_undegraded":"2024-01-23T08:55:23.616435+0000","last_fullsized":"2024-01-23T08:55:23.616435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:13:10.191082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.313951+0000","last_change":"2024-01-23T08:54:49.728962+0000","last_active":"2024-01-23T08:54:51.313951+0000","last_peered":"2024-01-23T08:54:51.313951+0000","last_clean":"2024-01-23T08:54:51.313951+0000","last_became_active":"2024-01-23T08:54:49.724121+0000","last_became_peered":"2024-01-23T08:54:49.724121+0000","last_unstale":"2024-01-23T08:54:51.313951+0000","last_undegraded":"2024-01-23T08:54:51.313951+0000","last_fullsized":"2024-01-23T08:54:51.313951+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:14.188947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.315305+0000","last_change":"2024-01-23T08:54:49.735678+0000","last_active":"2024-01-23T08:54:51.315305+0000","last_peered":"2024-01-23T08:54:51.315305+0000","last_clean":"2024-01-23T08:54:51.315305+0000","last_became_active":"2024-01-23T08:54:49.732632+0000","last_became_peered":"2024-01-23T08:54:49.732632+0000","last_unstale":"2024-01-23T08:54:51.315305+0000","last_undegraded":"2024-01-23T08:54:51.315305+0000","last_fullsized":"2024-01-23T08:54:51.315305+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:54.463072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.707967+0000","last_change":"2024-01-23T08:54:42.196434+0000","last_active":"2024-01-23T08:54:49.707967+0000","last_peered":"2024-01-23T08:54:49.707967+0000","last_clean":"2024-01-23T08:54:49.707967+0000","last_became_active":"2024-01-23T08:54:42.195570+0000","last_became_peered":"2024-01-23T08:54:42.195570+0000","last_unstale":"2024-01-23T08:54:49.707967+0000","last_undegraded":"2024-01-23T08:54:49.707967+0000","last_fullsized":"2024-01-23T08:54:49.707967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:04:44.856358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.637969+0000","last_change":"2024-01-23T08:54:40.678920+0000","last_active":"2024-01-23T08:54:49.637969+0000","last_peered":"2024-01-23T08:54:49.637969+0000","last_clean":"2024-01-23T08:54:49.637969+0000","last_became_active":"2024-01-23T08:54:40.678527+0000","last_became_peered":"2024-01-23T08:54:40.678527+0000","last_unstale":"2024-01-23T08:54:49.637969+0000","last_undegraded":"2024-01-23T08:54:49.637969+0000","last_fullsized":"2024-01-23T08:54:49.637969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:48:02.807942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.313485+0000","last_change":"2024-01-23T08:54:49.719401+0000","last_active":"2024-01-23T08:54:51.313485+0000","last_peered":"2024-01-23T08:54:51.313485+0000","last_clean":"2024-01-23T08:54:51.313485+0000","last_became_active":"2024-01-23T08:54:49.717116+0000","last_became_peered":"2024-01-23T08:54:49.717116+0000","last_unstale":"2024-01-23T08:54:51.313485+0000","last_undegraded":"2024-01-23T08:54:51.313485+0000","last_fullsized":"2024-01-23T08:54:51.313485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:58:50.143993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.659808+0000","last_change":"2024-01-23T08:54:42.235843+0000","last_active":"2024-01-23T08:54:49.659808+0000","last_peered":"2024-01-23T08:54:49.659808+0000","last_clean":"2024-01-23T08:54:49.659808+0000","last_became_active":"2024-01-23T08:54:42.235116+0000","last_became_peered":"2024-01-23T08:54:42.235116+0000","last_unstale":"2024-01-23T08:54:49.659808+0000","last_undegraded":"2024-01-23T08:54:49.659808+0000","last_fullsized":"2024-01-23T08:54:49.659808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:43:27.674658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.676769+0000","last_change":"2024-01-23T08:54:40.690150+0000","last_active":"2024-01-23T08:54:49.676769+0000","last_peered":"2024-01-23T08:54:49.676769+0000","last_clean":"2024-01-23T08:54:49.676769+0000","last_became_active":"2024-01-23T08:54:40.689433+0000","last_became_peered":"2024-01-23T08:54:40.689433+0000","last_unstale":"2024-01-23T08:54:49.676769+0000","last_undegraded":"2024-01-23T08:54:49.676769+0000","last_fullsized":"2024-01-23T08:54:49.676769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:35:11.315349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.638150+0000","last_change":"2024-01-23T08:54:40.686731+0000","last_active":"2024-01-23T08:54:49.638150+0000","last_peered":"2024-01-23T08:54:49.638150+0000","last_clean":"2024-01-23T08:54:49.638150+0000","last_became_active":"2024-01-23T08:54:40.686371+0000","last_became_peered":"2024-01-23T08:54:40.686371+0000","last_unstale":"2024-01-23T08:54:49.638150+0000","last_undegraded":"2024-01-23T08:54:49.638150+0000","last_fullsized":"2024-01-23T08:54:49.638150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:45.362773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.707184+0000","last_change":"2024-01-23T08:54:42.200428+0000","last_active":"2024-01-23T08:54:49.707184+0000","last_peered":"2024-01-23T08:54:49.707184+0000","last_clean":"2024-01-23T08:54:49.707184+0000","last_became_active":"2024-01-23T08:54:42.198648+0000","last_became_peered":"2024-01-23T08:54:42.198648+0000","last_unstale":"2024-01-23T08:54:49.707184+0000","last_undegraded":"2024-01-23T08:54:49.707184+0000","last_fullsized":"2024-01-23T08:54:49.707184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:45:11.802421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.314977+0000","last_change":"2024-01-23T08:54:49.742269+0000","last_active":"2024-01-23T08:54:51.314977+0000","last_peered":"2024-01-23T08:54:51.314977+0000","last_clean":"2024-01-23T08:54:51.314977+0000","last_became_active":"2024-01-23T08:54:49.741692+0000","last_became_peered":"2024-01-23T08:54:49.741692+0000","last_unstale":"2024-01-23T08:54:51.314977+0000","last_undegraded":"2024-01-23T08:54:51.314977+0000","last_fullsized":"2024-01-23T08:54:51.314977+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:45.278144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.660400+0000","last_change":"2024-01-23T08:54:40.687352+0000","last_active":"2024-01-23T08:54:49.660400+0000","last_peered":"2024-01-23T08:54:49.660400+0000","last_clean":"2024-01-23T08:54:49.660400+0000","last_became_active":"2024-01-23T08:54:40.686125+0000","last_became_peered":"2024-01-23T08:54:40.686125+0000","last_unstale":"2024-01-23T08:54:49.660400+0000","last_undegraded":"2024-01-23T08:54:49.660400+0000","last_fullsized":"2024-01-23T08:54:49.660400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:38:41.311580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.710758+0000","last_change":"2024-01-23T08:54:42.090249+0000","last_active":"2024-01-23T08:54:49.710758+0000","last_peered":"2024-01-23T08:54:49.710758+0000","last_clean":"2024-01-23T08:54:49.710758+0000","last_became_active":"2024-01-23T08:54:42.089826+0000","last_became_peered":"2024-01-23T08:54:42.089826+0000","last_unstale":"2024-01-23T08:54:49.710758+0000","last_undegraded":"2024-01-23T08:54:49.710758+0000","last_fullsized":"2024-01-23T08:54:49.710758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:07:39.007667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.834012+0000","last_change":"2024-01-23T08:54:49.737089+0000","last_active":"2024-01-23T08:54:50.834012+0000","last_peered":"2024-01-23T08:54:50.834012+0000","last_clean":"2024-01-23T08:54:50.834012+0000","last_became_active":"2024-01-23T08:54:49.736197+0000","last_became_peered":"2024-01-23T08:54:49.736197+0000","last_unstale":"2024-01-23T08:54:50.834012+0000","last_undegraded":"2024-01-23T08:54:50.834012+0000","last_fullsized":"2024-01-23T08:54:50.834012+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:27:36.690726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.703007+0000","last_change":"2024-01-23T08:54:42.228128+0000","last_active":"2024-01-23T08:54:49.703007+0000","last_peered":"2024-01-23T08:54:49.703007+0000","last_clean":"2024-01-23T08:54:49.703007+0000","last_became_active":"2024-01-23T08:54:42.227421+0000","last_became_peered":"2024-01-23T08:54:42.227421+0000","last_unstale":"2024-01-23T08:54:49.703007+0000","last_undegraded":"2024-01-23T08:54:49.703007+0000","last_fullsized":"2024-01-23T08:54:49.703007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:47:09.171802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.713503+0000","last_change":"2024-01-23T08:54:42.112162+0000","last_active":"2024-01-23T08:54:49.713503+0000","last_peered":"2024-01-23T08:54:49.713503+0000","last_clean":"2024-01-23T08:54:49.713503+0000","last_became_active":"2024-01-23T08:54:42.111635+0000","last_became_peered":"2024-01-23T08:54:42.111635+0000","last_unstale":"2024-01-23T08:54:49.713503+0000","last_undegraded":"2024-01-23T08:54:49.713503+0000","last_fullsized":"2024-01-23T08:54:49.713503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:13:11.423278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.637930+0000","last_change":"2024-01-23T08:54:42.069982+0000","last_active":"2024-01-23T08:54:49.637930+0000","last_peered":"2024-01-23T08:54:49.637930+0000","last_clean":"2024-01-23T08:54:49.637930+0000","last_became_active":"2024-01-23T08:54:42.069262+0000","last_became_peered":"2024-01-23T08:54:42.069262+0000","last_unstale":"2024-01-23T08:54:49.637930+0000","last_undegraded":"2024-01-23T08:54:49.637930+0000","last_fullsized":"2024-01-23T08:54:49.637930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:56:44.803841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.660259+0000","last_change":"2024-01-23T08:54:42.108709+0000","last_active":"2024-01-23T08:54:49.660259+0000","last_peered":"2024-01-23T08:54:49.660259+0000","last_clean":"2024-01-23T08:54:49.660259+0000","last_became_active":"2024-01-23T08:54:42.107985+0000","last_became_peered":"2024-01-23T08:54:42.107985+0000","last_unstale":"2024-01-23T08:54:49.660259+0000","last_undegraded":"2024-01-23T08:54:49.660259+0000","last_fullsized":"2024-01-23T08:54:49.660259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:27:28.770059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.679217+0000","last_change":"2024-01-23T08:54:42.229100+0000","last_active":"2024-01-23T08:54:49.679217+0000","last_peered":"2024-01-23T08:54:49.679217+0000","last_clean":"2024-01-23T08:54:49.679217+0000","last_became_active":"2024-01-23T08:54:42.227918+0000","last_became_peered":"2024-01-23T08:54:42.227918+0000","last_unstale":"2024-01-23T08:54:49.679217+0000","last_undegraded":"2024-01-23T08:54:49.679217+0000","last_fullsized":"2024-01-23T08:54:49.679217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:54:47.705445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.677129+0000","last_change":"2024-01-23T08:54:42.231357+0000","last_active":"2024-01-23T08:54:49.677129+0000","last_peered":"2024-01-23T08:54:49.677129+0000","last_clean":"2024-01-23T08:54:49.677129+0000","last_became_active":"2024-01-23T08:54:42.230615+0000","last_became_peered":"2024-01-23T08:54:42.230615+0000","last_unstale":"2024-01-23T08:54:49.677129+0000","last_undegraded":"2024-01-23T08:54:49.677129+0000","last_fullsized":"2024-01-23T08:54:49.677129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:12:12.757498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.707876+0000","last_change":"2024-01-23T08:54:42.158739+0000","last_active":"2024-01-23T08:54:49.707876+0000","last_peered":"2024-01-23T08:54:49.707876+0000","last_clean":"2024-01-23T08:54:49.707876+0000","last_became_active":"2024-01-23T08:54:42.157106+0000","last_became_peered":"2024-01-23T08:54:42.157106+0000","last_unstale":"2024-01-23T08:54:49.707876+0000","last_undegraded":"2024-01-23T08:54:49.707876+0000","last_fullsized":"2024-01-23T08:54:49.707876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:32:37.961458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.660441+0000","last_change":"2024-01-23T08:54:42.092942+0000","last_active":"2024-01-23T08:54:49.660441+0000","last_peered":"2024-01-23T08:54:49.660441+0000","last_clean":"2024-01-23T08:54:49.660441+0000","last_became_active":"2024-01-23T08:54:42.092149+0000","last_became_peered":"2024-01-23T08:54:42.092149+0000","last_unstale":"2024-01-23T08:54:49.660441+0000","last_undegraded":"2024-01-23T08:54:49.660441+0000","last_fullsized":"2024-01-23T08:54:49.660441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:19.147334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.637829+0000","last_change":"2024-01-23T08:54:42.069948+0000","last_active":"2024-01-23T08:54:49.637829+0000","last_peered":"2024-01-23T08:54:49.637829+0000","last_clean":"2024-01-23T08:54:49.637829+0000","last_became_active":"2024-01-23T08:54:42.069305+0000","last_became_peered":"2024-01-23T08:54:42.069305+0000","last_unstale":"2024-01-23T08:54:49.637829+0000","last_undegraded":"2024-01-23T08:54:49.637829+0000","last_fullsized":"2024-01-23T08:54:49.637829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:21:50.684517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.659901+0000","last_change":"2024-01-23T08:54:42.158120+0000","last_active":"2024-01-23T08:54:49.659901+0000","last_peered":"2024-01-23T08:54:49.659901+0000","last_clean":"2024-01-23T08:54:49.659901+0000","last_became_active":"2024-01-23T08:54:42.157647+0000","last_became_peered":"2024-01-23T08:54:42.157647+0000","last_unstale":"2024-01-23T08:54:49.659901+0000","last_undegraded":"2024-01-23T08:54:49.659901+0000","last_fullsized":"2024-01-23T08:54:49.659901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:28:50.107504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.710525+0000","last_change":"2024-01-23T08:54:42.119253+0000","last_active":"2024-01-23T08:54:49.710525+0000","last_peered":"2024-01-23T08:54:49.710525+0000","last_clean":"2024-01-23T08:54:49.710525+0000","last_became_active":"2024-01-23T08:54:42.118528+0000","last_became_peered":"2024-01-23T08:54:42.118528+0000","last_unstale":"2024-01-23T08:54:49.710525+0000","last_undegraded":"2024-01-23T08:54:49.710525+0000","last_fullsized":"2024-01-23T08:54:49.710525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:47:09.171802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.706925+0000","last_change":"2024-01-23T08:54:42.197561+0000","last_active":"2024-01-23T08:54:49.706925+0000","last_peered":"2024-01-23T08:54:49.706925+0000","last_clean":"2024-01-23T08:54:49.706925+0000","last_became_active":"2024-01-23T08:54:42.196809+0000","last_became_peered":"2024-01-23T08:54:42.196809+0000","last_unstale":"2024-01-23T08:54:49.706925+0000","last_undegraded":"2024-01-23T08:54:49.706925+0000","last_fullsized":"2024-01-23T08:54:49.706925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:16:34.046447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.708919+0000","last_change":"2024-01-23T08:54:42.112093+0000","last_active":"2024-01-23T08:54:49.708919+0000","last_peered":"2024-01-23T08:54:49.708919+0000","last_clean":"2024-01-23T08:54:49.708919+0000","last_became_active":"2024-01-23T08:54:42.111207+0000","last_became_peered":"2024-01-23T08:54:42.111207+0000","last_unstale":"2024-01-23T08:54:49.708919+0000","last_undegraded":"2024-01-23T08:54:49.708919+0000","last_fullsized":"2024-01-23T08:54:49.708919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:37.410041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.639633+0000","last_change":"2024-01-23T08:54:42.195803+0000","last_active":"2024-01-23T08:54:49.639633+0000","last_peered":"2024-01-23T08:54:49.639633+0000","last_clean":"2024-01-23T08:54:49.639633+0000","last_became_active":"2024-01-23T08:54:42.194562+0000","last_became_peered":"2024-01-23T08:54:42.194562+0000","last_unstale":"2024-01-23T08:54:49.639633+0000","last_undegraded":"2024-01-23T08:54:49.639633+0000","last_fullsized":"2024-01-23T08:54:49.639633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:53:56.379892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.716004+0000","last_change":"2024-01-23T08:54:42.161219+0000","last_active":"2024-01-23T08:54:49.716004+0000","last_peered":"2024-01-23T08:54:49.716004+0000","last_clean":"2024-01-23T08:54:49.716004+0000","last_became_active":"2024-01-23T08:54:42.160570+0000","last_became_peered":"2024-01-23T08:54:42.160570+0000","last_unstale":"2024-01-23T08:54:49.716004+0000","last_undegraded":"2024-01-23T08:54:49.716004+0000","last_fullsized":"2024-01-23T08:54:49.716004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:47:09.171802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.640590+0000","last_change":"2024-01-23T08:54:42.115468+0000","last_active":"2024-01-23T08:54:49.640590+0000","last_peered":"2024-01-23T08:54:49.640590+0000","last_clean":"2024-01-23T08:54:49.640590+0000","last_became_active":"2024-01-23T08:54:42.114759+0000","last_became_peered":"2024-01-23T08:54:42.114759+0000","last_unstale":"2024-01-23T08:54:49.640590+0000","last_undegraded":"2024-01-23T08:54:49.640590+0000","last_fullsized":"2024-01-23T08:54:49.640590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:00:35.095097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.637665+0000","last_change":"2024-01-23T08:54:42.150054+0000","last_active":"2024-01-23T08:54:49.637665+0000","last_peered":"2024-01-23T08:54:49.637665+0000","last_clean":"2024-01-23T08:54:49.637665+0000","last_became_active":"2024-01-23T08:54:42.149278+0000","last_became_peered":"2024-01-23T08:54:42.149278+0000","last_unstale":"2024-01-23T08:54:49.637665+0000","last_undegraded":"2024-01-23T08:54:49.637665+0000","last_fullsized":"2024-01-23T08:54:49.637665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:16:33.710981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.659573+0000","last_change":"2024-01-23T08:54:42.110442+0000","last_active":"2024-01-23T08:54:49.659573+0000","last_peered":"2024-01-23T08:54:49.659573+0000","last_clean":"2024-01-23T08:54:49.659573+0000","last_became_active":"2024-01-23T08:54:42.109743+0000","last_became_peered":"2024-01-23T08:54:42.109743+0000","last_unstale":"2024-01-23T08:54:49.659573+0000","last_undegraded":"2024-01-23T08:54:49.659573+0000","last_fullsized":"2024-01-23T08:54:49.659573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:58:34.376942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.677729+0000","last_change":"2024-01-23T08:54:42.228264+0000","last_active":"2024-01-23T08:54:49.677729+0000","last_peered":"2024-01-23T08:54:49.677729+0000","last_clean":"2024-01-23T08:54:49.677729+0000","last_became_active":"2024-01-23T08:54:42.227537+0000","last_became_peered":"2024-01-23T08:54:42.227537+0000","last_unstale":"2024-01-23T08:54:49.677729+0000","last_undegraded":"2024-01-23T08:54:49.677729+0000","last_fullsized":"2024-01-23T08:54:49.677729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:54:25.960679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.677826+0000","last_change":"2024-01-23T08:54:42.225968+0000","last_active":"2024-01-23T08:54:49.677826+0000","last_peered":"2024-01-23T08:54:49.677826+0000","last_clean":"2024-01-23T08:54:49.677826+0000","last_became_active":"2024-01-23T08:54:42.224541+0000","last_became_peered":"2024-01-23T08:54:42.224541+0000","last_unstale":"2024-01-23T08:54:49.677826+0000","last_undegraded":"2024-01-23T08:54:49.677826+0000","last_fullsized":"2024-01-23T08:54:49.677826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:04:03.310087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.708825+0000","last_change":"2024-01-23T08:54:42.111363+0000","last_active":"2024-01-23T08:54:49.708825+0000","last_peered":"2024-01-23T08:54:49.708825+0000","last_clean":"2024-01-23T08:54:49.708825+0000","last_became_active":"2024-01-23T08:54:42.111043+0000","last_became_peered":"2024-01-23T08:54:42.111043+0000","last_unstale":"2024-01-23T08:54:49.708825+0000","last_undegraded":"2024-01-23T08:54:49.708825+0000","last_fullsized":"2024-01-23T08:54:49.708825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:22.447523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705684+0000","last_change":"2024-01-23T08:54:42.116234+0000","last_active":"2024-01-23T08:54:49.705684+0000","last_peered":"2024-01-23T08:54:49.705684+0000","last_clean":"2024-01-23T08:54:49.705684+0000","last_became_active":"2024-01-23T08:54:42.115911+0000","last_became_peered":"2024-01-23T08:54:42.115911+0000","last_unstale":"2024-01-23T08:54:49.705684+0000","last_undegraded":"2024-01-23T08:54:49.705684+0000","last_fullsized":"2024-01-23T08:54:49.705684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:06.320845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705399+0000","last_change":"2024-01-23T08:54:42.158134+0000","last_active":"2024-01-23T08:54:49.705399+0000","last_peered":"2024-01-23T08:54:49.705399+0000","last_clean":"2024-01-23T08:54:49.705399+0000","last_became_active":"2024-01-23T08:54:42.157331+0000","last_became_peered":"2024-01-23T08:54:42.157331+0000","last_unstale":"2024-01-23T08:54:49.705399+0000","last_undegraded":"2024-01-23T08:54:49.705399+0000","last_fullsized":"2024-01-23T08:54:49.705399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:46.594970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.715272+0000","last_change":"2024-01-23T08:54:42.092495+0000","last_active":"2024-01-23T08:54:49.715272+0000","last_peered":"2024-01-23T08:54:49.715272+0000","last_clean":"2024-01-23T08:54:49.715272+0000","last_became_active":"2024-01-23T08:54:42.091726+0000","last_became_peered":"2024-01-23T08:54:42.091726+0000","last_unstale":"2024-01-23T08:54:49.715272+0000","last_undegraded":"2024-01-23T08:54:49.715272+0000","last_fullsized":"2024-01-23T08:54:49.715272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:19:17.992621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.659528+0000","last_change":"2024-01-23T08:54:42.120617+0000","last_active":"2024-01-23T08:54:49.659528+0000","last_peered":"2024-01-23T08:54:49.659528+0000","last_clean":"2024-01-23T08:54:49.659528+0000","last_became_active":"2024-01-23T08:54:42.119847+0000","last_became_peered":"2024-01-23T08:54:42.119847+0000","last_unstale":"2024-01-23T08:54:49.659528+0000","last_undegraded":"2024-01-23T08:54:49.659528+0000","last_fullsized":"2024-01-23T08:54:49.659528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:29:51.323223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.699912+0000","last_change":"2024-01-23T08:54:42.197133+0000","last_active":"2024-01-23T08:54:49.699912+0000","last_peered":"2024-01-23T08:54:49.699912+0000","last_clean":"2024-01-23T08:54:49.699912+0000","last_became_active":"2024-01-23T08:54:42.195743+0000","last_became_peered":"2024-01-23T08:54:42.195743+0000","last_unstale":"2024-01-23T08:54:49.699912+0000","last_undegraded":"2024-01-23T08:54:49.699912+0000","last_fullsized":"2024-01-23T08:54:49.699912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:48:04.040139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705359+0000","last_change":"2024-01-23T08:54:42.195979+0000","last_active":"2024-01-23T08:54:49.705359+0000","last_peered":"2024-01-23T08:54:49.705359+0000","last_clean":"2024-01-23T08:54:49.705359+0000","last_became_active":"2024-01-23T08:54:42.194846+0000","last_became_peered":"2024-01-23T08:54:42.194846+0000","last_unstale":"2024-01-23T08:54:49.705359+0000","last_undegraded":"2024-01-23T08:54:49.705359+0000","last_fullsized":"2024-01-23T08:54:49.705359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:07:39.007667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705207+0000","last_change":"2024-01-23T08:54:42.118056+0000","last_active":"2024-01-23T08:54:49.705207+0000","last_peered":"2024-01-23T08:54:49.705207+0000","last_clean":"2024-01-23T08:54:49.705207+0000","last_became_active":"2024-01-23T08:54:42.117735+0000","last_became_peered":"2024-01-23T08:54:42.117735+0000","last_unstale":"2024-01-23T08:54:49.705207+0000","last_undegraded":"2024-01-23T08:54:49.705207+0000","last_fullsized":"2024-01-23T08:54:49.705207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:19.147334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.707758+0000","last_change":"2024-01-23T08:54:42.195159+0000","last_active":"2024-01-23T08:54:49.707758+0000","last_peered":"2024-01-23T08:54:49.707758+0000","last_clean":"2024-01-23T08:54:49.707758+0000","last_became_active":"2024-01-23T08:54:42.194331+0000","last_became_peered":"2024-01-23T08:54:42.194331+0000","last_unstale":"2024-01-23T08:54:49.707758+0000","last_undegraded":"2024-01-23T08:54:49.707758+0000","last_fullsized":"2024-01-23T08:54:49.707758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:19:25.718244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.662214+0000","last_change":"2024-01-23T08:54:42.197096+0000","last_active":"2024-01-23T08:54:49.662214+0000","last_peered":"2024-01-23T08:54:49.662214+0000","last_clean":"2024-01-23T08:54:49.662214+0000","last_became_active":"2024-01-23T08:54:42.196391+0000","last_became_peered":"2024-01-23T08:54:42.196391+0000","last_unstale":"2024-01-23T08:54:49.662214+0000","last_undegraded":"2024-01-23T08:54:49.662214+0000","last_fullsized":"2024-01-23T08:54:49.662214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:22.447523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.661112+0000","last_change":"2024-01-23T08:54:42.231430+0000","last_active":"2024-01-23T08:54:49.661112+0000","last_peered":"2024-01-23T08:54:49.661112+0000","last_clean":"2024-01-23T08:54:49.661112+0000","last_became_active":"2024-01-23T08:54:42.229220+0000","last_became_peered":"2024-01-23T08:54:42.229220+0000","last_unstale":"2024-01-23T08:54:49.661112+0000","last_undegraded":"2024-01-23T08:54:49.661112+0000","last_fullsized":"2024-01-23T08:54:49.661112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:48:04.040139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705952+0000","last_change":"2024-01-23T08:54:42.118613+0000","last_active":"2024-01-23T08:54:49.705952+0000","last_peered":"2024-01-23T08:54:49.705952+0000","last_clean":"2024-01-23T08:54:49.705952+0000","last_became_active":"2024-01-23T08:54:42.118233+0000","last_became_peered":"2024-01-23T08:54:42.118233+0000","last_unstale":"2024-01-23T08:54:49.705952+0000","last_undegraded":"2024-01-23T08:54:49.705952+0000","last_fullsized":"2024-01-23T08:54:49.705952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:16:33.710981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5401,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":58,"ondisk_log_size":58,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":117327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.0549999999999999}]},{"osd":1,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.1739999999999999},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.67700000000000005}]},{"osd":2,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.1060000000000001}]},{"osd":3,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.76300000000000001}]},{"osd":4,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.2530000000000001,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":1.1379999999999999}]},{"osd":5,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.2430000000000001}]},{"osd":6,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":1.325},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":1.212}]}]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":897024,"data_stored":707663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":1.3220000000000001}]},{"osd":1,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.097},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":1.1499999999999999}]},{"osd":2,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.194}]},{"osd":3,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.254},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.224}]},{"osd":4,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.0529999999999999}]},{"osd":6,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.296}]},{"osd":7,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":1.417},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":1.014}]}]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":122388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.738,"5min":2.738,"15min":2.738},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.83799999999999997}]},{"osd":1,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.4529999999999998,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":1.097}]},{"osd":2,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":2.524,"5min":2.524,"15min":2.524},"last":1.0029999999999999}]},{"osd":3,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.58099999999999996},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.96999999999999997}]},{"osd":5,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.3690000000000002,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.034}]},{"osd":6,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.069},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.6030000000000002,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.66800000000000004}]},{"osd":7,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":1.119}]}]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":307200,"data_stored":121044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.046},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.59399999999999997}]},{"osd":1,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.54300000000000004}]},{"osd":3,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.90700000000000003}]},{"osd":4,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":1.085},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.63100000000000001}]},{"osd":5,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.996}]},{"osd":6,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.86199999999999999}]},{"osd":7,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.94799999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":892928,"data_stored":707641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.751},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.67100000000000004}]},{"osd":2,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":1.0600000000000001}]},{"osd":3,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":1.232},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.84999999999999998}]},{"osd":4,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":1.319}]},{"osd":5,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.002},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.135}]},{"osd":6,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":1.109},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.1870000000000001}]},{"osd":7,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.1619999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509460,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":303104,"data_stored":117259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.39100000000000001}]},{"osd":2,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.435}]},{"osd":3,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.54000000000000004}]},{"osd":4,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.2270000000000001}]},{"osd":5,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":1.03}]},{"osd":6,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.93100000000000005}]},{"osd":7,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.3959999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":299008,"data_stored":117785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.438},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.34699999999999998}]},{"osd":1,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.60399999999999998}]},{"osd":2,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.55400000000000005}]},{"osd":4,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.753}]},{"osd":5,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.0549999999999999}]},{"osd":6,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.81399999999999995}]},{"osd":7,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.80100000000000005}]}]},{"osd":6,"up_from":14,"seq":60129542164,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":117203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.88},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.56699999999999995}]},{"osd":1,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.03}]},{"osd":2,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.65900000000000003}]},{"osd":3,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.625}]},{"osd":4,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":1.071},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.92500000000000004}]},{"osd":5,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.1120000000000001}]},{"osd":7,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.71099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-23T08:55:27.335 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-23T08:55:27.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.491+0000 7fe96bf83640 1 Processor -- start 2024-01-23T08:55:27.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.491+0000 7fe96bf83640 1 -- start start 2024-01-23T08:55:27.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.491+0000 7fe96bf83640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe9640cc560 0x7fe96415cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:27.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.491+0000 7fe96bf83640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe964159740 con 0x7fe9640cc120 2024-01-23T08:55:27.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.491+0000 7fe96bf83640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe964153d40 con 0x7fe964153960 2024-01-23T08:55:27.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.491+0000 7fe96bf83640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9641599e0 con 0x7fe9640cc560 2024-01-23T08:55:27.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.491+0000 7fe96951e640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe9640cc120 0x7fe9640c3de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35236/0 (socket says 172.21.15.46:35236) 2024-01-23T08:55:27.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.491+0000 7fe96951e640 1 -- 172.21.15.46:0/598564711 learned_addr learned my addr 172.21.15.46:0/598564711 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:27.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.491+0000 7fe96a520640 1 --2- 172.21.15.46:0/598564711 >> v2:172.21.15.175:3300/0 conn(0x7fe9640cc560 0x7fe96415cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:27.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.495+0000 7fe968d1d640 1 -- 172.21.15.46:0/598564711 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2448460015 0 0) 0x7fe964159740 con 0x7fe9640cc120 2024-01-23T08:55:27.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.495+0000 7fe968d1d640 1 -- 172.21.15.46:0/598564711 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe950003530 con 0x7fe9640cc120 2024-01-23T08:55:27.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.499+0000 7fe968d1d640 1 -- 172.21.15.46:0/598564711 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3496728924 0 0) 0x7fe950003530 con 0x7fe9640cc120 2024-01-23T08:55:27.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.499+0000 7fe968d1d640 1 -- 172.21.15.46:0/598564711 >> v2:172.21.15.175:3300/0 conn(0x7fe9640cc560 msgr2=0x7fe96415cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:27.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.499+0000 7fe968d1d640 1 --2- 172.21.15.46:0/598564711 >> v2:172.21.15.175:3300/0 conn(0x7fe9640cc560 0x7fe96415cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:27.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.499+0000 7fe968d1d640 1 -- 172.21.15.46:0/598564711 >> v1:172.21.15.175:6789/0 conn(0x7fe964153960 legacy=0x7fe9640c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:27.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.499+0000 7fe968d1d640 1 -- 172.21.15.46:0/598564711 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe964159cc0 con 0x7fe9640cc120 2024-01-23T08:55:27.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.499+0000 7fe968d1d640 1 -- 172.21.15.46:0/598564711 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466917103 0 0) 0x7fe960001680 con 0x7fe9640cc120 2024-01-23T08:55:27.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.499+0000 7fe968d1d640 1 -- 172.21.15.46:0/598564711 >> v1:172.21.15.46:6789/0 conn(0x7fe9640cc120 legacy=0x7fe9640c3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:27.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.499+0000 7fe968d1d640 1 --2- 172.21.15.46:0/598564711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9500039d0 0x7fe950003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:27.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.499+0000 7fe968d1d640 1 --2- 172.21.15.46:0/598564711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9500047d0 0x7fe950004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:27.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.499+0000 7fe968d1d640 1 --2- 172.21.15.46:0/598564711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe950005190 0x7fe95000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:27.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.499+0000 7fe968d1d640 1 -- 172.21.15.46:0/598564711 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9641599e0 con 0x7fe9500039d0 2024-01-23T08:55:27.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.499+0000 7fe968d1d640 1 -- 172.21.15.46:0/598564711 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95000c070 con 0x7fe9500047d0 2024-01-23T08:55:27.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.499+0000 7fe968d1d640 1 -- 172.21.15.46:0/598564711 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95000c230 con 0x7fe950005190 2024-01-23T08:55:27.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.503+0000 7fe96a520640 1 --2- 172.21.15.46:0/598564711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe950005190 0x7fe95000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:27.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.503+0000 7fe969d1f640 1 --2- 172.21.15.46:0/598564711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9500039d0 0x7fe950003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:27.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.507+0000 7fe969d1f640 1 -- 172.21.15.46:0/598564711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe950005190 msgr2=0x7fe95000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:27.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.507+0000 7fe969d1f640 1 --2- 172.21.15.46:0/598564711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe950005190 0x7fe95000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:27.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.507+0000 7fe969d1f640 1 -- 172.21.15.46:0/598564711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9500047d0 msgr2=0x7fe950004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:27.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.507+0000 7fe969d1f640 1 --2- 172.21.15.46:0/598564711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9500047d0 0x7fe950004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:27.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.507+0000 7fe969d1f640 1 -- 172.21.15.46:0/598564711 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe950003530 con 0x7fe9500039d0 2024-01-23T08:55:27.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.507+0000 7fe96a520640 1 -- 172.21.15.46:0/598564711 reap_dead start 2024-01-23T08:55:27.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.511+0000 7fe969d1f640 1 --2- 172.21.15.46:0/598564711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9500039d0 0x7fe950003df0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe954001780 tx=0x7fe95401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c8eb26706b7656 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:27.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.515+0000 7fe968d1d640 1 -- 172.21.15.46:0/598564711 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9540052d0 con 0x7fe9500039d0 2024-01-23T08:55:27.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.515+0000 7fe968d1d640 1 -- 172.21.15.46:0/598564711 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9540a7050 con 0x7fe9500039d0 2024-01-23T08:55:27.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.515+0000 7fe968d1d640 1 -- 172.21.15.46:0/598564711 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe954003840 con 0x7fe9500039d0 2024-01-23T08:55:27.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.519+0000 7fe96bf83640 1 -- 172.21.15.46:0/598564711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9500039d0 msgr2=0x7fe950003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:27.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.519+0000 7fe96bf83640 1 --2- 172.21.15.46:0/598564711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9500039d0 0x7fe950003df0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe954001780 tx=0x7fe95401c400 comp rx=0 tx=0).stop 2024-01-23T08:55:27.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.519+0000 7fe96bf83640 1 -- 172.21.15.46:0/598564711 shutdown_connections 2024-01-23T08:55:27.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.519+0000 7fe96bf83640 1 --2- 172.21.15.46:0/598564711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9500039d0 0x7fe950003df0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:27.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.519+0000 7fe96bf83640 1 -- 172.21.15.46:0/598564711 >> 172.21.15.46:0/598564711 conn(0x7fe96408afa0 msgr2=0x7fe96408b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:27.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.519+0000 7fe96bf83640 1 -- 172.21.15.46:0/598564711 shutdown_connections 2024-01-23T08:55:27.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.519+0000 7fe96bf83640 1 -- 172.21.15.46:0/598564711 wait complete. 2024-01-23T08:55:27.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.519+0000 7fe96bf83640 1 Processor -- start 2024-01-23T08:55:27.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.519+0000 7fe96bf83640 1 -- start start 2024-01-23T08:55:27.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.519+0000 7fe96bf83640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9500039d0 0x7fe96415c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:27.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.519+0000 7fe96bf83640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9640c6240 0x7fe9641526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:27.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.519+0000 7fe96bf83640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe964156620 0x7fe964156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:27.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.519+0000 7fe96bf83640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe964157010 con 0x7fe964156620 2024-01-23T08:55:27.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.519+0000 7fe96bf83640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe964152fe0 con 0x7fe9500039d0 2024-01-23T08:55:27.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.519+0000 7fe96bf83640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9641f2510 con 0x7fe9640c6240 2024-01-23T08:55:27.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.519+0000 7fe96a520640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe964156620 0x7fe964156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:27.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.519+0000 7fe96a520640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe964156620 0x7fe964156ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37522/0 (socket says 172.21.15.46:37522) 2024-01-23T08:55:27.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.519+0000 7fe96a520640 1 -- 172.21.15.46:0/634109053 learned_addr learned my addr 172.21.15.46:0/634109053 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:27.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.523+0000 7fe96951e640 1 --2- 172.21.15.46:0/634109053 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9640c6240 0x7fe9641526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:27.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.523+0000 7fe969d1f640 1 --2- 172.21.15.46:0/634109053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9500039d0 0x7fe96415c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:27.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.523+0000 7fe96a520640 1 -- 172.21.15.46:0/634109053 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9640c6240 msgr2=0x7fe9641526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:27.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.523+0000 7fe96a520640 1 --2- 172.21.15.46:0/634109053 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9640c6240 0x7fe9641526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:27.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.523+0000 7fe96a520640 1 -- 172.21.15.46:0/634109053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9500039d0 msgr2=0x7fe96415c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:27.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.523+0000 7fe96a520640 1 --2- 172.21.15.46:0/634109053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9500039d0 0x7fe96415c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:27.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.523+0000 7fe96a520640 1 -- 172.21.15.46:0/634109053 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9641f27f0 con 0x7fe964156620 2024-01-23T08:55:27.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.527+0000 7fe96a520640 1 --2- 172.21.15.46:0/634109053 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe964156620 0x7fe964156ad0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe9640cfa50 tx=0x7fe95c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:27.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.531+0000 7fe95a7fc640 1 -- 172.21.15.46:0/634109053 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c00e040 con 0x7fe964156620 2024-01-23T08:55:27.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.531+0000 7fe95a7fc640 1 -- 172.21.15.46:0/634109053 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95c00f040 con 0x7fe964156620 2024-01-23T08:55:27.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.531+0000 7fe96bf83640 1 -- 172.21.15.46:0/634109053 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9641f2ad0 con 0x7fe964156620 2024-01-23T08:55:27.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.531+0000 7fe95a7fc640 1 -- 172.21.15.46:0/634109053 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c015430 con 0x7fe964156620 2024-01-23T08:55:27.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.531+0000 7fe96bf83640 1 -- 172.21.15.46:0/634109053 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9641f3090 con 0x7fe964156620 2024-01-23T08:55:27.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.535+0000 7fe96bf83640 1 -- 172.21.15.46:0/634109053 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe964074340 con 0x7fe964156620 2024-01-23T08:55:27.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.563+0000 7fe95a7fc640 1 -- 172.21.15.46:0/634109053 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe95c015590 con 0x7fe964156620 2024-01-23T08:55:27.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.563+0000 7fe95a7fc640 1 --2- 172.21.15.46:0/634109053 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fe948066580 0x7fe948068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:27.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.563+0000 7fe969d1f640 1 --2- 172.21.15.46:0/634109053 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fe948066580 0x7fe948068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:27.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.567+0000 7fe969d1f640 1 --2- 172.21.15.46:0/634109053 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fe948066580 0x7fe948068a40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe954004000 tx=0x7fe9540011a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:27.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.859+0000 7fe95a7fc640 1 -- 172.21.15.46:0/634109053 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe95c056840 con 0x7fe964156620 2024-01-23T08:55:27.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:27.859+0000 7fe95a7fc640 1 -- 172.21.15.46:0/634109053 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe95c052480 con 0x7fe964156620 2024-01-23T08:55:28.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.027+0000 7fe96bf83640 1 -- 172.21.15.46:0/634109053 --> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe9640c9950 con 0x7fe948066580 2024-01-23T08:55:28.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.055+0000 7fe95a7fc640 1 -- 172.21.15.46:0/634109053 <== mgr.4107 v2:172.21.15.46:6800/2324478006 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367848 (secure 0 0 0) 0x7fe9640c9950 con 0x7fe948066580 2024-01-23T08:55:28.055 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:55:28.059 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-01-23T08:55:28.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.063+0000 7fe96bf83640 1 -- 172.21.15.46:0/634109053 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fe948066580 msgr2=0x7fe948068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:28.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.063+0000 7fe96bf83640 1 --2- 172.21.15.46:0/634109053 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fe948066580 0x7fe948068a40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe954004000 tx=0x7fe9540011a0 comp rx=0 tx=0).stop 2024-01-23T08:55:28.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.063+0000 7fe96bf83640 1 -- 172.21.15.46:0/634109053 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe964156620 msgr2=0x7fe964156ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:28.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.063+0000 7fe96bf83640 1 --2- 172.21.15.46:0/634109053 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe964156620 0x7fe964156ad0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe9640cfa50 tx=0x7fe95c00f580 comp rx=0 tx=0).stop 2024-01-23T08:55:28.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.063+0000 7fe96bf83640 1 -- 172.21.15.46:0/634109053 shutdown_connections 2024-01-23T08:55:28.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.063+0000 7fe96bf83640 1 --2- 172.21.15.46:0/634109053 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe964156620 0x7fe964156ad0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:28.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.063+0000 7fe96bf83640 1 --2- 172.21.15.46:0/634109053 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9640c6240 0x7fe9641526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:28.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.063+0000 7fe96bf83640 1 --2- 172.21.15.46:0/634109053 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fe948066580 0x7fe948068a40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:28.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.063+0000 7fe96bf83640 1 --2- 172.21.15.46:0/634109053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9500039d0 0x7fe96415c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:28.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.063+0000 7fe96bf83640 1 -- 172.21.15.46:0/634109053 >> 172.21.15.46:0/634109053 conn(0x7fe96408afa0 msgr2=0x7fe9640b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:28.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.063+0000 7fe96bf83640 1 -- 172.21.15.46:0/634109053 shutdown_connections 2024-01-23T08:55:28.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.063+0000 7fe96bf83640 1 -- 172.21.15.46:0/634109053 wait complete. 2024-01-23T08:55:28.079 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-01-23T08:55:26.580773+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595769,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":228,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":175,"ondisk_log_size":175,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236344,"kb_used_data":3536,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738376,"statfs":{"total":773094113280,"available":772852097024,"internally_reserved":0,"allocated":3620864,"data_stored":2128310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":762,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004900"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.721599+0000","last_change":"2024-01-23T08:54:40.661700+0000","last_active":"2024-01-23T08:54:49.721599+0000","last_peered":"2024-01-23T08:54:49.721599+0000","last_clean":"2024-01-23T08:54:49.721599+0000","last_became_active":"2024-01-23T08:54:40.660901+0000","last_became_peered":"2024-01-23T08:54:40.660901+0000","last_unstale":"2024-01-23T08:54:49.721599+0000","last_undegraded":"2024-01-23T08:54:49.721599+0000","last_fullsized":"2024-01-23T08:54:49.721599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:59:22.804479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.662103+0000","last_change":"2024-01-23T08:54:42.159130+0000","last_active":"2024-01-23T08:54:49.662103+0000","last_peered":"2024-01-23T08:54:49.662103+0000","last_clean":"2024-01-23T08:54:49.662103+0000","last_became_active":"2024-01-23T08:54:42.158776+0000","last_became_peered":"2024-01-23T08:54:42.158776+0000","last_unstale":"2024-01-23T08:54:49.662103+0000","last_undegraded":"2024-01-23T08:54:49.662103+0000","last_fullsized":"2024-01-23T08:54:49.662103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:06.320845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.833180+0000","last_change":"2024-01-23T08:54:49.752558+0000","last_active":"2024-01-23T08:54:50.833180+0000","last_peered":"2024-01-23T08:54:50.833180+0000","last_clean":"2024-01-23T08:54:50.833180+0000","last_became_active":"2024-01-23T08:54:49.752077+0000","last_became_peered":"2024-01-23T08:54:49.752077+0000","last_unstale":"2024-01-23T08:54:50.833180+0000","last_undegraded":"2024-01-23T08:54:50.833180+0000","last_fullsized":"2024-01-23T08:54:50.833180+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:20:50.653881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.662253+0000","last_change":"2024-01-23T08:54:40.700164+0000","last_active":"2024-01-23T08:54:49.662253+0000","last_peered":"2024-01-23T08:54:49.662253+0000","last_clean":"2024-01-23T08:54:49.662253+0000","last_became_active":"2024-01-23T08:54:40.699449+0000","last_became_peered":"2024-01-23T08:54:40.699449+0000","last_unstale":"2024-01-23T08:54:49.662253+0000","last_undegraded":"2024-01-23T08:54:49.662253+0000","last_fullsized":"2024-01-23T08:54:49.662253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:16:32.814250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.660624+0000","last_change":"2024-01-23T08:54:42.092833+0000","last_active":"2024-01-23T08:54:49.660624+0000","last_peered":"2024-01-23T08:54:49.660624+0000","last_clean":"2024-01-23T08:54:49.660624+0000","last_became_active":"2024-01-23T08:54:42.091950+0000","last_became_peered":"2024-01-23T08:54:42.091950+0000","last_unstale":"2024-01-23T08:54:49.660624+0000","last_undegraded":"2024-01-23T08:54:49.660624+0000","last_fullsized":"2024-01-23T08:54:49.660624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:46.594970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.816521+0000","last_change":"2024-01-23T08:54:49.747131+0000","last_active":"2024-01-23T08:54:50.816521+0000","last_peered":"2024-01-23T08:54:50.816521+0000","last_clean":"2024-01-23T08:54:50.816521+0000","last_became_active":"2024-01-23T08:54:49.746481+0000","last_became_peered":"2024-01-23T08:54:49.746481+0000","last_unstale":"2024-01-23T08:54:50.816521+0000","last_undegraded":"2024-01-23T08:54:50.816521+0000","last_fullsized":"2024-01-23T08:54:50.816521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:45:19.670524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705960+0000","last_change":"2024-01-23T08:54:40.687614+0000","last_active":"2024-01-23T08:54:49.705960+0000","last_peered":"2024-01-23T08:54:49.705960+0000","last_clean":"2024-01-23T08:54:49.705960+0000","last_became_active":"2024-01-23T08:54:40.687234+0000","last_became_peered":"2024-01-23T08:54:40.687234+0000","last_unstale":"2024-01-23T08:54:49.705960+0000","last_undegraded":"2024-01-23T08:54:49.705960+0000","last_fullsized":"2024-01-23T08:54:49.705960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:54:17.627706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.711014+0000","last_change":"2024-01-23T08:54:42.114480+0000","last_active":"2024-01-23T08:54:49.711014+0000","last_peered":"2024-01-23T08:54:49.711014+0000","last_clean":"2024-01-23T08:54:49.711014+0000","last_became_active":"2024-01-23T08:54:42.113946+0000","last_became_peered":"2024-01-23T08:54:42.113946+0000","last_unstale":"2024-01-23T08:54:49.711014+0000","last_undegraded":"2024-01-23T08:54:49.711014+0000","last_fullsized":"2024-01-23T08:54:49.711014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:19:25.718244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.817755+0000","last_change":"2024-01-23T08:54:49.747332+0000","last_active":"2024-01-23T08:54:50.817755+0000","last_peered":"2024-01-23T08:54:50.817755+0000","last_clean":"2024-01-23T08:54:50.817755+0000","last_became_active":"2024-01-23T08:54:49.746474+0000","last_became_peered":"2024-01-23T08:54:49.746474+0000","last_unstale":"2024-01-23T08:54:50.817755+0000","last_undegraded":"2024-01-23T08:54:50.817755+0000","last_fullsized":"2024-01-23T08:54:50.817755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:28:57.975606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.709129+0000","last_change":"2024-01-23T08:54:40.687290+0000","last_active":"2024-01-23T08:54:49.709129+0000","last_peered":"2024-01-23T08:54:49.709129+0000","last_clean":"2024-01-23T08:54:49.709129+0000","last_became_active":"2024-01-23T08:54:40.686903+0000","last_became_peered":"2024-01-23T08:54:40.686903+0000","last_unstale":"2024-01-23T08:54:49.709129+0000","last_undegraded":"2024-01-23T08:54:49.709129+0000","last_fullsized":"2024-01-23T08:54:49.709129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:57:23.064188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.639122+0000","last_change":"2024-01-23T08:54:42.109485+0000","last_active":"2024-01-23T08:54:49.639122+0000","last_peered":"2024-01-23T08:54:49.639122+0000","last_clean":"2024-01-23T08:54:49.639122+0000","last_became_active":"2024-01-23T08:54:42.108182+0000","last_became_peered":"2024-01-23T08:54:42.108182+0000","last_unstale":"2024-01-23T08:54:49.639122+0000","last_undegraded":"2024-01-23T08:54:49.639122+0000","last_fullsized":"2024-01-23T08:54:49.639122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:51:12.417589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.816879+0000","last_change":"2024-01-23T08:54:49.747949+0000","last_active":"2024-01-23T08:54:50.816879+0000","last_peered":"2024-01-23T08:54:50.816879+0000","last_clean":"2024-01-23T08:54:50.816879+0000","last_became_active":"2024-01-23T08:54:49.746880+0000","last_became_peered":"2024-01-23T08:54:49.746880+0000","last_unstale":"2024-01-23T08:54:50.816879+0000","last_undegraded":"2024-01-23T08:54:50.816879+0000","last_fullsized":"2024-01-23T08:54:50.816879+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:54:26.728005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.638029+0000","last_change":"2024-01-23T08:54:42.088786+0000","last_active":"2024-01-23T08:54:49.638029+0000","last_peered":"2024-01-23T08:54:49.638029+0000","last_clean":"2024-01-23T08:54:49.638029+0000","last_became_active":"2024-01-23T08:54:42.088068+0000","last_became_peered":"2024-01-23T08:54:42.088068+0000","last_unstale":"2024-01-23T08:54:49.638029+0000","last_undegraded":"2024-01-23T08:54:49.638029+0000","last_fullsized":"2024-01-23T08:54:49.638029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:38:41.382732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.638575+0000","last_change":"2024-01-23T08:54:40.612044+0000","last_active":"2024-01-23T08:54:49.638575+0000","last_peered":"2024-01-23T08:54:49.638575+0000","last_clean":"2024-01-23T08:54:49.638575+0000","last_became_active":"2024-01-23T08:54:40.611589+0000","last_became_peered":"2024-01-23T08:54:40.611589+0000","last_unstale":"2024-01-23T08:54:49.638575+0000","last_undegraded":"2024-01-23T08:54:49.638575+0000","last_fullsized":"2024-01-23T08:54:49.638575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:36.177844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.311704+0000","last_change":"2024-01-23T08:54:49.716713+0000","last_active":"2024-01-23T08:54:51.311704+0000","last_peered":"2024-01-23T08:54:51.311704+0000","last_clean":"2024-01-23T08:54:51.311704+0000","last_became_active":"2024-01-23T08:54:49.715843+0000","last_became_peered":"2024-01-23T08:54:49.715843+0000","last_unstale":"2024-01-23T08:54:51.311704+0000","last_undegraded":"2024-01-23T08:54:51.311704+0000","last_fullsized":"2024-01-23T08:54:51.311704+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:46:24.157230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.715500+0000","last_change":"2024-01-23T08:54:42.230199+0000","last_active":"2024-01-23T08:54:49.715500+0000","last_peered":"2024-01-23T08:54:49.715500+0000","last_clean":"2024-01-23T08:54:49.715500+0000","last_became_active":"2024-01-23T08:54:42.229547+0000","last_became_peered":"2024-01-23T08:54:42.229547+0000","last_unstale":"2024-01-23T08:54:49.715500+0000","last_undegraded":"2024-01-23T08:54:49.715500+0000","last_fullsized":"2024-01-23T08:54:49.715500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:07:07.781698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.678319+0000","last_change":"2024-01-23T08:54:40.688971+0000","last_active":"2024-01-23T08:54:49.678319+0000","last_peered":"2024-01-23T08:54:49.678319+0000","last_clean":"2024-01-23T08:54:49.678319+0000","last_became_active":"2024-01-23T08:54:40.688230+0000","last_became_peered":"2024-01-23T08:54:40.688230+0000","last_unstale":"2024-01-23T08:54:49.678319+0000","last_undegraded":"2024-01-23T08:54:49.678319+0000","last_fullsized":"2024-01-23T08:54:49.678319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:40:12.245110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.314784+0000","last_change":"2024-01-23T08:54:49.748471+0000","last_active":"2024-01-23T08:54:51.314784+0000","last_peered":"2024-01-23T08:54:51.314784+0000","last_clean":"2024-01-23T08:54:51.314784+0000","last_became_active":"2024-01-23T08:54:49.747958+0000","last_became_peered":"2024-01-23T08:54:49.747958+0000","last_unstale":"2024-01-23T08:54:51.314784+0000","last_undegraded":"2024-01-23T08:54:51.314784+0000","last_fullsized":"2024-01-23T08:54:51.314784+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:46:36.583078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.709746+0000","last_change":"2024-01-23T08:54:42.194148+0000","last_active":"2024-01-23T08:54:49.709746+0000","last_peered":"2024-01-23T08:54:49.709746+0000","last_clean":"2024-01-23T08:54:49.709746+0000","last_became_active":"2024-01-23T08:54:42.193403+0000","last_became_peered":"2024-01-23T08:54:42.193403+0000","last_unstale":"2024-01-23T08:54:49.709746+0000","last_undegraded":"2024-01-23T08:54:49.709746+0000","last_fullsized":"2024-01-23T08:54:49.709746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:38:42.543776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:23.532404+0000","last_change":"2024-01-23T08:54:40.688897+0000","last_active":"2024-01-23T08:55:23.532404+0000","last_peered":"2024-01-23T08:55:23.532404+0000","last_clean":"2024-01-23T08:55:23.532404+0000","last_became_active":"2024-01-23T08:54:40.688122+0000","last_became_peered":"2024-01-23T08:54:40.688122+0000","last_unstale":"2024-01-23T08:55:23.532404+0000","last_undegraded":"2024-01-23T08:55:23.532404+0000","last_fullsized":"2024-01-23T08:55:23.532404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:19:16.760424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.834576+0000","last_change":"2024-01-23T08:54:49.738331+0000","last_active":"2024-01-23T08:54:50.834576+0000","last_peered":"2024-01-23T08:54:50.834576+0000","last_clean":"2024-01-23T08:54:50.834576+0000","last_became_active":"2024-01-23T08:54:49.737442+0000","last_became_peered":"2024-01-23T08:54:49.737442+0000","last_unstale":"2024-01-23T08:54:50.834576+0000","last_undegraded":"2024-01-23T08:54:50.834576+0000","last_fullsized":"2024-01-23T08:54:50.834576+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:59:20.106849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.637930+0000","last_change":"2024-01-23T08:54:42.192681+0000","last_active":"2024-01-23T08:54:49.637930+0000","last_peered":"2024-01-23T08:54:49.637930+0000","last_clean":"2024-01-23T08:54:49.637930+0000","last_became_active":"2024-01-23T08:54:42.192225+0000","last_became_peered":"2024-01-23T08:54:42.192225+0000","last_unstale":"2024-01-23T08:54:49.637930+0000","last_undegraded":"2024-01-23T08:54:49.637930+0000","last_fullsized":"2024-01-23T08:54:49.637930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:20:26.263299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.699945+0000","last_change":"2024-01-23T08:54:40.686987+0000","last_active":"2024-01-23T08:54:49.699945+0000","last_peered":"2024-01-23T08:54:49.699945+0000","last_clean":"2024-01-23T08:54:49.699945+0000","last_became_active":"2024-01-23T08:54:40.686654+0000","last_became_peered":"2024-01-23T08:54:40.686654+0000","last_unstale":"2024-01-23T08:54:49.699945+0000","last_undegraded":"2024-01-23T08:54:49.699945+0000","last_fullsized":"2024-01-23T08:54:49.699945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:43:26.442461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.818343+0000","last_change":"2024-01-23T08:54:49.736471+0000","last_active":"2024-01-23T08:54:50.818343+0000","last_peered":"2024-01-23T08:54:50.818343+0000","last_clean":"2024-01-23T08:54:50.818343+0000","last_became_active":"2024-01-23T08:54:49.735971+0000","last_became_peered":"2024-01-23T08:54:49.735971+0000","last_unstale":"2024-01-23T08:54:50.818343+0000","last_undegraded":"2024-01-23T08:54:50.818343+0000","last_fullsized":"2024-01-23T08:54:50.818343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:18:10.354308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.710027+0000","last_change":"2024-01-23T08:54:42.195854+0000","last_active":"2024-01-23T08:54:49.710027+0000","last_peered":"2024-01-23T08:54:49.710027+0000","last_clean":"2024-01-23T08:54:49.710027+0000","last_became_active":"2024-01-23T08:54:42.195052+0000","last_became_peered":"2024-01-23T08:54:42.195052+0000","last_unstale":"2024-01-23T08:54:49.710027+0000","last_undegraded":"2024-01-23T08:54:49.710027+0000","last_fullsized":"2024-01-23T08:54:49.710027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:54:18.859903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.640728+0000","last_change":"2024-01-23T08:54:40.694194+0000","last_active":"2024-01-23T08:54:49.640728+0000","last_peered":"2024-01-23T08:54:49.640728+0000","last_clean":"2024-01-23T08:54:49.640728+0000","last_became_active":"2024-01-23T08:54:40.693610+0000","last_became_peered":"2024-01-23T08:54:40.693610+0000","last_unstale":"2024-01-23T08:54:49.640728+0000","last_undegraded":"2024-01-23T08:54:49.640728+0000","last_fullsized":"2024-01-23T08:54:49.640728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:47:30.746915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.817667+0000","last_change":"2024-01-23T08:54:49.747205+0000","last_active":"2024-01-23T08:54:50.817667+0000","last_peered":"2024-01-23T08:54:50.817667+0000","last_clean":"2024-01-23T08:54:50.817667+0000","last_became_active":"2024-01-23T08:54:49.746792+0000","last_became_peered":"2024-01-23T08:54:49.746792+0000","last_unstale":"2024-01-23T08:54:50.817667+0000","last_undegraded":"2024-01-23T08:54:50.817667+0000","last_fullsized":"2024-01-23T08:54:50.817667+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:58:42.245045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.708442+0000","last_change":"2024-01-23T08:54:42.233783+0000","last_active":"2024-01-23T08:54:49.708442+0000","last_peered":"2024-01-23T08:54:49.708442+0000","last_clean":"2024-01-23T08:54:49.708442+0000","last_became_active":"2024-01-23T08:54:42.233018+0000","last_became_peered":"2024-01-23T08:54:42.233018+0000","last_unstale":"2024-01-23T08:54:49.708442+0000","last_undegraded":"2024-01-23T08:54:49.708442+0000","last_fullsized":"2024-01-23T08:54:49.708442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:04:58.998914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:06.380549+0000","last_change":"2024-01-23T08:54:40.690385+0000","last_active":"2024-01-23T08:55:06.380549+0000","last_peered":"2024-01-23T08:55:06.380549+0000","last_clean":"2024-01-23T08:55:06.380549+0000","last_became_active":"2024-01-23T08:54:40.689528+0000","last_became_peered":"2024-01-23T08:54:40.689528+0000","last_unstale":"2024-01-23T08:55:06.380549+0000","last_undegraded":"2024-01-23T08:55:06.380549+0000","last_fullsized":"2024-01-23T08:55:06.380549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:59:11.006550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.314560+0000","last_change":"2024-01-23T08:54:49.731870+0000","last_active":"2024-01-23T08:54:51.314560+0000","last_peered":"2024-01-23T08:54:51.314560+0000","last_clean":"2024-01-23T08:54:51.314560+0000","last_became_active":"2024-01-23T08:54:49.731414+0000","last_became_peered":"2024-01-23T08:54:49.731414+0000","last_unstale":"2024-01-23T08:54:51.314560+0000","last_undegraded":"2024-01-23T08:54:51.314560+0000","last_fullsized":"2024-01-23T08:54:51.314560+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:30.315625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.679440+0000","last_change":"2024-01-23T08:54:42.227885+0000","last_active":"2024-01-23T08:54:49.679440+0000","last_peered":"2024-01-23T08:54:49.679440+0000","last_clean":"2024-01-23T08:54:49.679440+0000","last_became_active":"2024-01-23T08:54:42.227188+0000","last_became_peered":"2024-01-23T08:54:42.227188+0000","last_unstale":"2024-01-23T08:54:49.679440+0000","last_undegraded":"2024-01-23T08:54:49.679440+0000","last_fullsized":"2024-01-23T08:54:49.679440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:02:13.790208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.640066+0000","last_change":"2024-01-23T08:54:40.658365+0000","last_active":"2024-01-23T08:54:49.640066+0000","last_peered":"2024-01-23T08:54:49.640066+0000","last_clean":"2024-01-23T08:54:49.640066+0000","last_became_active":"2024-01-23T08:54:40.657616+0000","last_became_peered":"2024-01-23T08:54:40.657616+0000","last_unstale":"2024-01-23T08:54:49.640066+0000","last_undegraded":"2024-01-23T08:54:49.640066+0000","last_fullsized":"2024-01-23T08:54:49.640066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:23:50.053046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.315400+0000","last_change":"2024-01-23T08:54:49.739474+0000","last_active":"2024-01-23T08:54:51.315400+0000","last_peered":"2024-01-23T08:54:51.315400+0000","last_clean":"2024-01-23T08:54:51.315400+0000","last_became_active":"2024-01-23T08:54:49.738579+0000","last_became_peered":"2024-01-23T08:54:49.738579+0000","last_unstale":"2024-01-23T08:54:51.315400+0000","last_undegraded":"2024-01-23T08:54:51.315400+0000","last_fullsized":"2024-01-23T08:54:51.315400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:23:32.238072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.702527+0000","last_change":"2024-01-23T08:54:42.228302+0000","last_active":"2024-01-23T08:54:49.702527+0000","last_peered":"2024-01-23T08:54:49.702527+0000","last_clean":"2024-01-23T08:54:49.702527+0000","last_became_active":"2024-01-23T08:54:42.227558+0000","last_became_peered":"2024-01-23T08:54:42.227558+0000","last_unstale":"2024-01-23T08:54:49.702527+0000","last_undegraded":"2024-01-23T08:54:49.702527+0000","last_fullsized":"2024-01-23T08:54:49.702527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:19:17.992621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.660203+0000","last_change":"2024-01-23T08:54:40.697453+0000","last_active":"2024-01-23T08:54:49.660203+0000","last_peered":"2024-01-23T08:54:49.660203+0000","last_clean":"2024-01-23T08:54:49.660203+0000","last_became_active":"2024-01-23T08:54:40.696688+0000","last_became_peered":"2024-01-23T08:54:40.696688+0000","last_unstale":"2024-01-23T08:54:49.660203+0000","last_undegraded":"2024-01-23T08:54:49.660203+0000","last_fullsized":"2024-01-23T08:54:49.660203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:59:22.804479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.314513+0000","last_change":"2024-01-23T08:54:49.726678+0000","last_active":"2024-01-23T08:54:51.314513+0000","last_peered":"2024-01-23T08:54:51.314513+0000","last_clean":"2024-01-23T08:54:51.314513+0000","last_became_active":"2024-01-23T08:54:49.725830+0000","last_became_peered":"2024-01-23T08:54:49.725830+0000","last_unstale":"2024-01-23T08:54:51.314513+0000","last_undegraded":"2024-01-23T08:54:51.314513+0000","last_fullsized":"2024-01-23T08:54:51.314513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:12:34.009779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705119+0000","last_change":"2024-01-23T08:54:42.149751+0000","last_active":"2024-01-23T08:54:49.705119+0000","last_peered":"2024-01-23T08:54:49.705119+0000","last_clean":"2024-01-23T08:54:49.705119+0000","last_became_active":"2024-01-23T08:54:42.149019+0000","last_became_peered":"2024-01-23T08:54:42.149019+0000","last_unstale":"2024-01-23T08:54:49.705119+0000","last_undegraded":"2024-01-23T08:54:49.705119+0000","last_fullsized":"2024-01-23T08:54:49.705119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:38:36.083606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.638399+0000","last_change":"2024-01-23T08:54:40.680243+0000","last_active":"2024-01-23T08:54:49.638399+0000","last_peered":"2024-01-23T08:54:49.638399+0000","last_clean":"2024-01-23T08:54:49.638399+0000","last_became_active":"2024-01-23T08:54:40.679839+0000","last_became_peered":"2024-01-23T08:54:40.679839+0000","last_unstale":"2024-01-23T08:54:49.638399+0000","last_undegraded":"2024-01-23T08:54:49.638399+0000","last_fullsized":"2024-01-23T08:54:49.638399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:38:34.851409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.317036+0000","last_change":"2024-01-23T08:54:49.727785+0000","last_active":"2024-01-23T08:54:51.317036+0000","last_peered":"2024-01-23T08:54:51.317036+0000","last_clean":"2024-01-23T08:54:51.317036+0000","last_became_active":"2024-01-23T08:54:49.726855+0000","last_became_peered":"2024-01-23T08:54:49.726855+0000","last_unstale":"2024-01-23T08:54:51.317036+0000","last_undegraded":"2024-01-23T08:54:51.317036+0000","last_fullsized":"2024-01-23T08:54:51.317036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:13:39.452120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.659533+0000","last_change":"2024-01-23T08:54:42.108793+0000","last_active":"2024-01-23T08:54:49.659533+0000","last_peered":"2024-01-23T08:54:49.659533+0000","last_clean":"2024-01-23T08:54:49.659533+0000","last_became_active":"2024-01-23T08:54:42.108346+0000","last_became_peered":"2024-01-23T08:54:42.108346+0000","last_unstale":"2024-01-23T08:54:49.659533+0000","last_undegraded":"2024-01-23T08:54:49.659533+0000","last_fullsized":"2024-01-23T08:54:49.659533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:18:02.486206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.833462+0000","last_change":"2024-01-23T08:54:40.708494+0000","last_active":"2024-01-23T08:54:50.833462+0000","last_peered":"2024-01-23T08:54:50.833462+0000","last_clean":"2024-01-23T08:54:50.833462+0000","last_became_active":"2024-01-23T08:54:40.707841+0000","last_became_peered":"2024-01-23T08:54:40.707841+0000","last_unstale":"2024-01-23T08:54:50.833462+0000","last_undegraded":"2024-01-23T08:54:50.833462+0000","last_fullsized":"2024-01-23T08:54:50.833462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:53:17.764440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.319565+0000","last_change":"2024-01-23T08:54:49.738198+0000","last_active":"2024-01-23T08:54:51.319565+0000","last_peered":"2024-01-23T08:54:51.319565+0000","last_clean":"2024-01-23T08:54:51.319565+0000","last_became_active":"2024-01-23T08:54:49.737677+0000","last_became_peered":"2024-01-23T08:54:49.737677+0000","last_unstale":"2024-01-23T08:54:51.319565+0000","last_undegraded":"2024-01-23T08:54:51.319565+0000","last_fullsized":"2024-01-23T08:54:51.319565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:57:26.436916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.676533+0000","last_change":"2024-01-23T08:54:42.228222+0000","last_active":"2024-01-23T08:54:49.676533+0000","last_peered":"2024-01-23T08:54:49.676533+0000","last_clean":"2024-01-23T08:54:49.676533+0000","last_became_active":"2024-01-23T08:54:42.227335+0000","last_became_peered":"2024-01-23T08:54:42.227335+0000","last_unstale":"2024-01-23T08:54:49.676533+0000","last_undegraded":"2024-01-23T08:54:49.676533+0000","last_fullsized":"2024-01-23T08:54:49.676533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:29:51.842390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.638097+0000","last_change":"2024-01-23T08:54:40.679852+0000","last_active":"2024-01-23T08:54:49.638097+0000","last_peered":"2024-01-23T08:54:49.638097+0000","last_clean":"2024-01-23T08:54:49.638097+0000","last_became_active":"2024-01-23T08:54:40.679467+0000","last_became_peered":"2024-01-23T08:54:40.679467+0000","last_unstale":"2024-01-23T08:54:49.638097+0000","last_undegraded":"2024-01-23T08:54:49.638097+0000","last_fullsized":"2024-01-23T08:54:49.638097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:17.915137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.316103+0000","last_change":"2024-01-23T08:54:49.730538+0000","last_active":"2024-01-23T08:54:51.316103+0000","last_peered":"2024-01-23T08:54:51.316103+0000","last_clean":"2024-01-23T08:54:51.316103+0000","last_became_active":"2024-01-23T08:54:49.729861+0000","last_became_peered":"2024-01-23T08:54:49.729861+0000","last_unstale":"2024-01-23T08:54:51.316103+0000","last_undegraded":"2024-01-23T08:54:51.316103+0000","last_fullsized":"2024-01-23T08:54:51.316103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:46:36.583078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.709127+0000","last_change":"2024-01-23T08:54:42.196505+0000","last_active":"2024-01-23T08:54:49.709127+0000","last_peered":"2024-01-23T08:54:49.709127+0000","last_clean":"2024-01-23T08:54:49.709127+0000","last_became_active":"2024-01-23T08:54:42.195555+0000","last_became_peered":"2024-01-23T08:54:42.195555+0000","last_unstale":"2024-01-23T08:54:49.709127+0000","last_undegraded":"2024-01-23T08:54:49.709127+0000","last_fullsized":"2024-01-23T08:54:49.709127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:57:24.296384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.638705+0000","last_change":"2024-01-23T08:54:40.612594+0000","last_active":"2024-01-23T08:54:49.638705+0000","last_peered":"2024-01-23T08:54:49.638705+0000","last_clean":"2024-01-23T08:54:49.638705+0000","last_became_active":"2024-01-23T08:54:40.611932+0000","last_became_peered":"2024-01-23T08:54:40.611932+0000","last_unstale":"2024-01-23T08:54:49.638705+0000","last_undegraded":"2024-01-23T08:54:49.638705+0000","last_fullsized":"2024-01-23T08:54:49.638705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:05.088648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.709873+0000","last_change":"2024-01-23T08:54:01.491195+0000","last_active":"2024-01-23T08:54:49.709873+0000","last_peered":"2024-01-23T08:54:49.709873+0000","last_clean":"2024-01-23T08:54:49.709873+0000","last_became_active":"2024-01-23T08:54:01.490869+0000","last_became_peered":"2024-01-23T08:54:01.490869+0000","last_unstale":"2024-01-23T08:54:49.709873+0000","last_undegraded":"2024-01-23T08:54:49.709873+0000","last_fullsized":"2024-01-23T08:54:49.709873+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:53:59.492955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:53:59.492955+0000","last_clean_scrub_stamp":"2024-01-23T08:53:59.492955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:18:58.446726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.312760+0000","last_change":"2024-01-23T08:54:49.716297+0000","last_active":"2024-01-23T08:54:51.312760+0000","last_peered":"2024-01-23T08:54:51.312760+0000","last_clean":"2024-01-23T08:54:51.312760+0000","last_became_active":"2024-01-23T08:54:49.715231+0000","last_became_peered":"2024-01-23T08:54:49.715231+0000","last_unstale":"2024-01-23T08:54:51.312760+0000","last_undegraded":"2024-01-23T08:54:51.312760+0000","last_fullsized":"2024-01-23T08:54:51.312760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:17:59.837409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.639265+0000","last_change":"2024-01-23T08:54:42.089174+0000","last_active":"2024-01-23T08:54:49.639265+0000","last_peered":"2024-01-23T08:54:49.639265+0000","last_clean":"2024-01-23T08:54:49.639265+0000","last_became_active":"2024-01-23T08:54:42.088303+0000","last_became_peered":"2024-01-23T08:54:42.088303+0000","last_unstale":"2024-01-23T08:54:49.639265+0000","last_undegraded":"2024-01-23T08:54:49.639265+0000","last_fullsized":"2024-01-23T08:54:49.639265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:06:49.326117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.679747+0000","last_change":"2024-01-23T08:54:40.690720+0000","last_active":"2024-01-23T08:54:49.679747+0000","last_peered":"2024-01-23T08:54:49.679747+0000","last_clean":"2024-01-23T08:54:49.679747+0000","last_became_active":"2024-01-23T08:54:40.689895+0000","last_became_peered":"2024-01-23T08:54:40.689895+0000","last_unstale":"2024-01-23T08:54:49.679747+0000","last_undegraded":"2024-01-23T08:54:49.679747+0000","last_fullsized":"2024-01-23T08:54:49.679747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:33:12.542607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.817001+0000","last_change":"2024-01-23T08:54:49.736539+0000","last_active":"2024-01-23T08:54:50.817001+0000","last_peered":"2024-01-23T08:54:50.817001+0000","last_clean":"2024-01-23T08:54:50.817001+0000","last_became_active":"2024-01-23T08:54:49.735777+0000","last_became_peered":"2024-01-23T08:54:49.735777+0000","last_unstale":"2024-01-23T08:54:50.817001+0000","last_undegraded":"2024-01-23T08:54:50.817001+0000","last_fullsized":"2024-01-23T08:54:50.817001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:05:06.867017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.709023+0000","last_change":"2024-01-23T08:54:42.107066+0000","last_active":"2024-01-23T08:54:49.709023+0000","last_peered":"2024-01-23T08:54:49.709023+0000","last_clean":"2024-01-23T08:54:49.709023+0000","last_became_active":"2024-01-23T08:54:42.106757+0000","last_became_peered":"2024-01-23T08:54:42.106757+0000","last_unstale":"2024-01-23T08:54:49.709023+0000","last_undegraded":"2024-01-23T08:54:49.709023+0000","last_fullsized":"2024-01-23T08:54:49.709023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:47:31.979111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.662059+0000","last_change":"2024-01-23T08:54:40.687942+0000","last_active":"2024-01-23T08:54:49.662059+0000","last_peered":"2024-01-23T08:54:49.662059+0000","last_clean":"2024-01-23T08:54:49.662059+0000","last_became_active":"2024-01-23T08:54:40.686860+0000","last_became_peered":"2024-01-23T08:54:40.686860+0000","last_unstale":"2024-01-23T08:54:49.662059+0000","last_undegraded":"2024-01-23T08:54:49.662059+0000","last_fullsized":"2024-01-23T08:54:49.662059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:04:57.766717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.315714+0000","last_change":"2024-01-23T08:54:49.727416+0000","last_active":"2024-01-23T08:54:51.315714+0000","last_peered":"2024-01-23T08:54:51.315714+0000","last_clean":"2024-01-23T08:54:51.315714+0000","last_became_active":"2024-01-23T08:54:49.721494+0000","last_became_peered":"2024-01-23T08:54:49.721494+0000","last_unstale":"2024-01-23T08:54:51.315714+0000","last_undegraded":"2024-01-23T08:54:51.315714+0000","last_fullsized":"2024-01-23T08:54:51.315714+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:52:20.767279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.706168+0000","last_change":"2024-01-23T08:54:42.117785+0000","last_active":"2024-01-23T08:54:49.706168+0000","last_peered":"2024-01-23T08:54:49.706168+0000","last_clean":"2024-01-23T08:54:49.706168+0000","last_became_active":"2024-01-23T08:54:42.117317+0000","last_became_peered":"2024-01-23T08:54:42.117317+0000","last_unstale":"2024-01-23T08:54:49.706168+0000","last_undegraded":"2024-01-23T08:54:49.706168+0000","last_fullsized":"2024-01-23T08:54:49.706168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:48:28.943781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.713901+0000","last_change":"2024-01-23T08:54:40.682656+0000","last_active":"2024-01-23T08:54:49.713901+0000","last_peered":"2024-01-23T08:54:49.713901+0000","last_clean":"2024-01-23T08:54:49.713901+0000","last_became_active":"2024-01-23T08:54:40.681954+0000","last_became_peered":"2024-01-23T08:54:40.681954+0000","last_unstale":"2024-01-23T08:54:49.713901+0000","last_undegraded":"2024-01-23T08:54:49.713901+0000","last_fullsized":"2024-01-23T08:54:49.713901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:20:41.553582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.311198+0000","last_change":"2024-01-23T08:54:49.716316+0000","last_active":"2024-01-23T08:54:51.311198+0000","last_peered":"2024-01-23T08:54:51.311198+0000","last_clean":"2024-01-23T08:54:51.311198+0000","last_became_active":"2024-01-23T08:54:49.715917+0000","last_became_peered":"2024-01-23T08:54:49.715917+0000","last_unstale":"2024-01-23T08:54:51.311198+0000","last_undegraded":"2024-01-23T08:54:51.311198+0000","last_fullsized":"2024-01-23T08:54:51.311198+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:56:01.803823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.708070+0000","last_change":"2024-01-23T08:54:42.158814+0000","last_active":"2024-01-23T08:54:49.708070+0000","last_peered":"2024-01-23T08:54:49.708070+0000","last_clean":"2024-01-23T08:54:49.708070+0000","last_became_active":"2024-01-23T08:54:42.155411+0000","last_became_peered":"2024-01-23T08:54:42.155411+0000","last_unstale":"2024-01-23T08:54:49.708070+0000","last_undegraded":"2024-01-23T08:54:49.708070+0000","last_fullsized":"2024-01-23T08:54:49.708070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:28:02.074838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.706344+0000","last_change":"2024-01-23T08:54:40.696522+0000","last_active":"2024-01-23T08:54:49.706344+0000","last_peered":"2024-01-23T08:54:49.706344+0000","last_clean":"2024-01-23T08:54:49.706344+0000","last_became_active":"2024-01-23T08:54:40.696128+0000","last_became_peered":"2024-01-23T08:54:40.696128+0000","last_unstale":"2024-01-23T08:54:49.706344+0000","last_undegraded":"2024-01-23T08:54:49.706344+0000","last_fullsized":"2024-01-23T08:54:49.706344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:18:01.254009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.850403+0000","last_change":"2024-01-23T08:54:49.724660+0000","last_active":"2024-01-23T08:54:50.850403+0000","last_peered":"2024-01-23T08:54:50.850403+0000","last_clean":"2024-01-23T08:54:50.850403+0000","last_became_active":"2024-01-23T08:54:49.723038+0000","last_became_peered":"2024-01-23T08:54:49.723038+0000","last_unstale":"2024-01-23T08:54:50.850403+0000","last_undegraded":"2024-01-23T08:54:50.850403+0000","last_fullsized":"2024-01-23T08:54:50.850403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:20:50.653881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.637799+0000","last_change":"2024-01-23T08:54:42.149978+0000","last_active":"2024-01-23T08:54:49.637799+0000","last_peered":"2024-01-23T08:54:49.637799+0000","last_clean":"2024-01-23T08:54:49.637799+0000","last_became_active":"2024-01-23T08:54:42.149180+0000","last_became_peered":"2024-01-23T08:54:42.149180+0000","last_unstale":"2024-01-23T08:54:49.637799+0000","last_undegraded":"2024-01-23T08:54:49.637799+0000","last_fullsized":"2024-01-23T08:54:49.637799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:52:12.899176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'10","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:23.530742+0000","last_change":"2024-01-23T08:54:40.699997+0000","last_active":"2024-01-23T08:55:23.530742+0000","last_peered":"2024-01-23T08:55:23.530742+0000","last_clean":"2024-01-23T08:55:23.530742+0000","last_became_active":"2024-01-23T08:54:40.699246+0000","last_became_peered":"2024-01-23T08:54:40.699246+0000","last_unstale":"2024-01-23T08:55:23.530742+0000","last_undegraded":"2024-01-23T08:55:23.530742+0000","last_fullsized":"2024-01-23T08:55:23.530742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:19:24.486048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.317431+0000","last_change":"2024-01-23T08:54:49.729218+0000","last_active":"2024-01-23T08:54:51.317431+0000","last_peered":"2024-01-23T08:54:51.317431+0000","last_clean":"2024-01-23T08:54:51.317431+0000","last_became_active":"2024-01-23T08:54:49.728448+0000","last_became_peered":"2024-01-23T08:54:49.728448+0000","last_unstale":"2024-01-23T08:54:51.317431+0000","last_undegraded":"2024-01-23T08:54:51.317431+0000","last_fullsized":"2024-01-23T08:54:51.317431+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:56:52.671943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.709676+0000","last_change":"2024-01-23T08:54:42.087980+0000","last_active":"2024-01-23T08:54:49.709676+0000","last_peered":"2024-01-23T08:54:49.709676+0000","last_clean":"2024-01-23T08:54:49.709676+0000","last_became_active":"2024-01-23T08:54:42.087328+0000","last_became_peered":"2024-01-23T08:54:42.087328+0000","last_unstale":"2024-01-23T08:54:49.709676+0000","last_undegraded":"2024-01-23T08:54:49.709676+0000","last_fullsized":"2024-01-23T08:54:49.709676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:07:07.781698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.700020+0000","last_change":"2024-01-23T08:54:40.693906+0000","last_active":"2024-01-23T08:54:49.700020+0000","last_peered":"2024-01-23T08:54:49.700020+0000","last_clean":"2024-01-23T08:54:49.700020+0000","last_became_active":"2024-01-23T08:54:40.693530+0000","last_became_peered":"2024-01-23T08:54:40.693530+0000","last_unstale":"2024-01-23T08:54:49.700020+0000","last_undegraded":"2024-01-23T08:54:49.700020+0000","last_fullsized":"2024-01-23T08:54:49.700020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:59:11.006550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.317201+0000","last_change":"2024-01-23T08:54:49.730687+0000","last_active":"2024-01-23T08:54:51.317201+0000","last_peered":"2024-01-23T08:54:51.317201+0000","last_clean":"2024-01-23T08:54:51.317201+0000","last_became_active":"2024-01-23T08:54:49.729689+0000","last_became_peered":"2024-01-23T08:54:49.729689+0000","last_unstale":"2024-01-23T08:54:51.317201+0000","last_undegraded":"2024-01-23T08:54:51.317201+0000","last_fullsized":"2024-01-23T08:54:51.317201+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:54:47.041161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.638496+0000","last_change":"2024-01-23T08:54:42.108919+0000","last_active":"2024-01-23T08:54:49.638496+0000","last_peered":"2024-01-23T08:54:49.638496+0000","last_clean":"2024-01-23T08:54:49.638496+0000","last_became_active":"2024-01-23T08:54:42.108253+0000","last_became_peered":"2024-01-23T08:54:42.108253+0000","last_unstale":"2024-01-23T08:54:49.638496+0000","last_undegraded":"2024-01-23T08:54:49.638496+0000","last_fullsized":"2024-01-23T08:54:49.638496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:46:28.714976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.638279+0000","last_change":"2024-01-23T08:54:40.696080+0000","last_active":"2024-01-23T08:54:49.638279+0000","last_peered":"2024-01-23T08:54:49.638279+0000","last_clean":"2024-01-23T08:54:49.638279+0000","last_became_active":"2024-01-23T08:54:40.695699+0000","last_became_peered":"2024-01-23T08:54:40.695699+0000","last_unstale":"2024-01-23T08:54:49.638279+0000","last_undegraded":"2024-01-23T08:54:49.638279+0000","last_fullsized":"2024-01-23T08:54:49.638279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:21.215326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.316997+0000","last_change":"2024-01-23T08:54:49.740480+0000","last_active":"2024-01-23T08:54:51.316997+0000","last_peered":"2024-01-23T08:54:51.316997+0000","last_clean":"2024-01-23T08:54:51.316997+0000","last_became_active":"2024-01-23T08:54:49.739524+0000","last_became_peered":"2024-01-23T08:54:49.739524+0000","last_unstale":"2024-01-23T08:54:51.316997+0000","last_undegraded":"2024-01-23T08:54:51.316997+0000","last_fullsized":"2024-01-23T08:54:51.316997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:45:25.447987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.677949+0000","last_change":"2024-01-23T08:54:42.230659+0000","last_active":"2024-01-23T08:54:49.677949+0000","last_peered":"2024-01-23T08:54:49.677949+0000","last_clean":"2024-01-23T08:54:49.677949+0000","last_became_active":"2024-01-23T08:54:42.229952+0000","last_became_peered":"2024-01-23T08:54:42.229952+0000","last_unstale":"2024-01-23T08:54:49.677949+0000","last_undegraded":"2024-01-23T08:54:49.677949+0000","last_fullsized":"2024-01-23T08:54:49.677949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:41:53.265527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:23.534428+0000","last_change":"2024-01-23T08:54:40.698779+0000","last_active":"2024-01-23T08:55:23.534428+0000","last_peered":"2024-01-23T08:55:23.534428+0000","last_clean":"2024-01-23T08:55:23.534428+0000","last_became_active":"2024-01-23T08:54:40.698059+0000","last_became_peered":"2024-01-23T08:54:40.698059+0000","last_unstale":"2024-01-23T08:55:23.534428+0000","last_undegraded":"2024-01-23T08:55:23.534428+0000","last_fullsized":"2024-01-23T08:55:23.534428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:24:40.655839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.313021+0000","last_change":"2024-01-23T08:54:49.708388+0000","last_active":"2024-01-23T08:54:51.313021+0000","last_peered":"2024-01-23T08:54:51.313021+0000","last_clean":"2024-01-23T08:54:51.313021+0000","last_became_active":"2024-01-23T08:54:49.707837+0000","last_became_peered":"2024-01-23T08:54:49.707837+0000","last_unstale":"2024-01-23T08:54:51.313021+0000","last_undegraded":"2024-01-23T08:54:51.313021+0000","last_fullsized":"2024-01-23T08:54:51.313021+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:49:25.509880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705781+0000","last_change":"2024-01-23T08:54:42.229836+0000","last_active":"2024-01-23T08:54:49.705781+0000","last_peered":"2024-01-23T08:54:49.705781+0000","last_clean":"2024-01-23T08:54:49.705781+0000","last_became_active":"2024-01-23T08:54:42.229252+0000","last_became_peered":"2024-01-23T08:54:42.229252+0000","last_unstale":"2024-01-23T08:54:49.705781+0000","last_undegraded":"2024-01-23T08:54:49.705781+0000","last_fullsized":"2024-01-23T08:54:49.705781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:23:51.285243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'11","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:01.657369+0000","last_change":"2024-01-23T08:54:40.658490+0000","last_active":"2024-01-23T08:55:01.657369+0000","last_peered":"2024-01-23T08:55:01.657369+0000","last_clean":"2024-01-23T08:55:01.657369+0000","last_became_active":"2024-01-23T08:54:40.657711+0000","last_became_peered":"2024-01-23T08:54:40.657711+0000","last_unstale":"2024-01-23T08:55:01.657369+0000","last_undegraded":"2024-01-23T08:55:01.657369+0000","last_fullsized":"2024-01-23T08:55:01.657369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:37:29.479181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.313979+0000","last_change":"2024-01-23T08:54:49.737210+0000","last_active":"2024-01-23T08:54:51.313979+0000","last_peered":"2024-01-23T08:54:51.313979+0000","last_clean":"2024-01-23T08:54:51.313979+0000","last_became_active":"2024-01-23T08:54:49.735023+0000","last_became_peered":"2024-01-23T08:54:49.735023+0000","last_unstale":"2024-01-23T08:54:51.313979+0000","last_undegraded":"2024-01-23T08:54:51.313979+0000","last_fullsized":"2024-01-23T08:54:51.313979+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:27.015436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.638868+0000","last_change":"2024-01-23T08:54:42.154453+0000","last_active":"2024-01-23T08:54:49.638868+0000","last_peered":"2024-01-23T08:54:49.638868+0000","last_clean":"2024-01-23T08:54:49.638868+0000","last_became_active":"2024-01-23T08:54:42.153735+0000","last_became_peered":"2024-01-23T08:54:42.153735+0000","last_unstale":"2024-01-23T08:54:49.638868+0000","last_undegraded":"2024-01-23T08:54:49.638868+0000","last_fullsized":"2024-01-23T08:54:49.638868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:54:39.173058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.834471+0000","last_change":"2024-01-23T08:54:40.702888+0000","last_active":"2024-01-23T08:54:50.834471+0000","last_peered":"2024-01-23T08:54:50.834471+0000","last_clean":"2024-01-23T08:54:50.834471+0000","last_became_active":"2024-01-23T08:54:40.701827+0000","last_became_peered":"2024-01-23T08:54:40.701827+0000","last_unstale":"2024-01-23T08:54:50.834471+0000","last_undegraded":"2024-01-23T08:54:50.834471+0000","last_fullsized":"2024-01-23T08:54:50.834471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:18:17.748052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.817591+0000","last_change":"2024-01-23T08:54:49.736262+0000","last_active":"2024-01-23T08:54:50.817591+0000","last_peered":"2024-01-23T08:54:50.817591+0000","last_clean":"2024-01-23T08:54:50.817591+0000","last_became_active":"2024-01-23T08:54:49.735765+0000","last_became_peered":"2024-01-23T08:54:49.735765+0000","last_unstale":"2024-01-23T08:54:50.817591+0000","last_undegraded":"2024-01-23T08:54:50.817591+0000","last_fullsized":"2024-01-23T08:54:50.817591+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:29:59.191326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.660727+0000","last_change":"2024-01-23T08:54:42.071292+0000","last_active":"2024-01-23T08:54:49.660727+0000","last_peered":"2024-01-23T08:54:49.660727+0000","last_clean":"2024-01-23T08:54:49.660727+0000","last_became_active":"2024-01-23T08:54:42.070703+0000","last_became_peered":"2024-01-23T08:54:42.070703+0000","last_unstale":"2024-01-23T08:54:49.660727+0000","last_undegraded":"2024-01-23T08:54:49.660727+0000","last_fullsized":"2024-01-23T08:54:49.660727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:37.410041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705569+0000","last_change":"2024-01-23T08:54:40.687946+0000","last_active":"2024-01-23T08:54:49.705569+0000","last_peered":"2024-01-23T08:54:49.705569+0000","last_clean":"2024-01-23T08:54:49.705569+0000","last_became_active":"2024-01-23T08:54:40.687656+0000","last_became_peered":"2024-01-23T08:54:40.687656+0000","last_unstale":"2024-01-23T08:54:49.705569+0000","last_undegraded":"2024-01-23T08:54:49.705569+0000","last_fullsized":"2024-01-23T08:54:49.705569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:29:50.091026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.833039+0000","last_change":"2024-01-23T08:54:49.729434+0000","last_active":"2024-01-23T08:54:50.833039+0000","last_peered":"2024-01-23T08:54:50.833039+0000","last_clean":"2024-01-23T08:54:50.833039+0000","last_became_active":"2024-01-23T08:54:49.728191+0000","last_became_peered":"2024-01-23T08:54:49.728191+0000","last_unstale":"2024-01-23T08:54:50.833039+0000","last_undegraded":"2024-01-23T08:54:50.833039+0000","last_fullsized":"2024-01-23T08:54:50.833039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:30:27.390400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.707973+0000","last_change":"2024-01-23T08:54:42.155857+0000","last_active":"2024-01-23T08:54:49.707973+0000","last_peered":"2024-01-23T08:54:49.707973+0000","last_clean":"2024-01-23T08:54:49.707973+0000","last_became_active":"2024-01-23T08:54:42.153539+0000","last_became_peered":"2024-01-23T08:54:42.153539+0000","last_unstale":"2024-01-23T08:54:49.707973+0000","last_undegraded":"2024-01-23T08:54:49.707973+0000","last_fullsized":"2024-01-23T08:54:49.707973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:27:34.618270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:23.616435+0000","last_change":"2024-01-23T08:54:40.683174+0000","last_active":"2024-01-23T08:55:23.616435+0000","last_peered":"2024-01-23T08:55:23.616435+0000","last_clean":"2024-01-23T08:55:23.616435+0000","last_became_active":"2024-01-23T08:54:40.682765+0000","last_became_peered":"2024-01-23T08:54:40.682765+0000","last_unstale":"2024-01-23T08:55:23.616435+0000","last_undegraded":"2024-01-23T08:55:23.616435+0000","last_fullsized":"2024-01-23T08:55:23.616435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:13:10.191082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.313951+0000","last_change":"2024-01-23T08:54:49.728962+0000","last_active":"2024-01-23T08:54:51.313951+0000","last_peered":"2024-01-23T08:54:51.313951+0000","last_clean":"2024-01-23T08:54:51.313951+0000","last_became_active":"2024-01-23T08:54:49.724121+0000","last_became_peered":"2024-01-23T08:54:49.724121+0000","last_unstale":"2024-01-23T08:54:51.313951+0000","last_undegraded":"2024-01-23T08:54:51.313951+0000","last_fullsized":"2024-01-23T08:54:51.313951+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:14.188947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.315305+0000","last_change":"2024-01-23T08:54:49.735678+0000","last_active":"2024-01-23T08:54:51.315305+0000","last_peered":"2024-01-23T08:54:51.315305+0000","last_clean":"2024-01-23T08:54:51.315305+0000","last_became_active":"2024-01-23T08:54:49.732632+0000","last_became_peered":"2024-01-23T08:54:49.732632+0000","last_unstale":"2024-01-23T08:54:51.315305+0000","last_undegraded":"2024-01-23T08:54:51.315305+0000","last_fullsized":"2024-01-23T08:54:51.315305+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:54.463072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.707967+0000","last_change":"2024-01-23T08:54:42.196434+0000","last_active":"2024-01-23T08:54:49.707967+0000","last_peered":"2024-01-23T08:54:49.707967+0000","last_clean":"2024-01-23T08:54:49.707967+0000","last_became_active":"2024-01-23T08:54:42.195570+0000","last_became_peered":"2024-01-23T08:54:42.195570+0000","last_unstale":"2024-01-23T08:54:49.707967+0000","last_undegraded":"2024-01-23T08:54:49.707967+0000","last_fullsized":"2024-01-23T08:54:49.707967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:04:44.856358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.637969+0000","last_change":"2024-01-23T08:54:40.678920+0000","last_active":"2024-01-23T08:54:49.637969+0000","last_peered":"2024-01-23T08:54:49.637969+0000","last_clean":"2024-01-23T08:54:49.637969+0000","last_became_active":"2024-01-23T08:54:40.678527+0000","last_became_peered":"2024-01-23T08:54:40.678527+0000","last_unstale":"2024-01-23T08:54:49.637969+0000","last_undegraded":"2024-01-23T08:54:49.637969+0000","last_fullsized":"2024-01-23T08:54:49.637969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:48:02.807942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.313485+0000","last_change":"2024-01-23T08:54:49.719401+0000","last_active":"2024-01-23T08:54:51.313485+0000","last_peered":"2024-01-23T08:54:51.313485+0000","last_clean":"2024-01-23T08:54:51.313485+0000","last_became_active":"2024-01-23T08:54:49.717116+0000","last_became_peered":"2024-01-23T08:54:49.717116+0000","last_unstale":"2024-01-23T08:54:51.313485+0000","last_undegraded":"2024-01-23T08:54:51.313485+0000","last_fullsized":"2024-01-23T08:54:51.313485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:58:50.143993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.659808+0000","last_change":"2024-01-23T08:54:42.235843+0000","last_active":"2024-01-23T08:54:49.659808+0000","last_peered":"2024-01-23T08:54:49.659808+0000","last_clean":"2024-01-23T08:54:49.659808+0000","last_became_active":"2024-01-23T08:54:42.235116+0000","last_became_peered":"2024-01-23T08:54:42.235116+0000","last_unstale":"2024-01-23T08:54:49.659808+0000","last_undegraded":"2024-01-23T08:54:49.659808+0000","last_fullsized":"2024-01-23T08:54:49.659808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:43:27.674658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.676769+0000","last_change":"2024-01-23T08:54:40.690150+0000","last_active":"2024-01-23T08:54:49.676769+0000","last_peered":"2024-01-23T08:54:49.676769+0000","last_clean":"2024-01-23T08:54:49.676769+0000","last_became_active":"2024-01-23T08:54:40.689433+0000","last_became_peered":"2024-01-23T08:54:40.689433+0000","last_unstale":"2024-01-23T08:54:49.676769+0000","last_undegraded":"2024-01-23T08:54:49.676769+0000","last_fullsized":"2024-01-23T08:54:49.676769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:35:11.315349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.638150+0000","last_change":"2024-01-23T08:54:40.686731+0000","last_active":"2024-01-23T08:54:49.638150+0000","last_peered":"2024-01-23T08:54:49.638150+0000","last_clean":"2024-01-23T08:54:49.638150+0000","last_became_active":"2024-01-23T08:54:40.686371+0000","last_became_peered":"2024-01-23T08:54:40.686371+0000","last_unstale":"2024-01-23T08:54:49.638150+0000","last_undegraded":"2024-01-23T08:54:49.638150+0000","last_fullsized":"2024-01-23T08:54:49.638150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:45.362773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.707184+0000","last_change":"2024-01-23T08:54:42.200428+0000","last_active":"2024-01-23T08:54:49.707184+0000","last_peered":"2024-01-23T08:54:49.707184+0000","last_clean":"2024-01-23T08:54:49.707184+0000","last_became_active":"2024-01-23T08:54:42.198648+0000","last_became_peered":"2024-01-23T08:54:42.198648+0000","last_unstale":"2024-01-23T08:54:49.707184+0000","last_undegraded":"2024-01-23T08:54:49.707184+0000","last_fullsized":"2024-01-23T08:54:49.707184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:45:11.802421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.314977+0000","last_change":"2024-01-23T08:54:49.742269+0000","last_active":"2024-01-23T08:54:51.314977+0000","last_peered":"2024-01-23T08:54:51.314977+0000","last_clean":"2024-01-23T08:54:51.314977+0000","last_became_active":"2024-01-23T08:54:49.741692+0000","last_became_peered":"2024-01-23T08:54:49.741692+0000","last_unstale":"2024-01-23T08:54:51.314977+0000","last_undegraded":"2024-01-23T08:54:51.314977+0000","last_fullsized":"2024-01-23T08:54:51.314977+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:45.278144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.660400+0000","last_change":"2024-01-23T08:54:40.687352+0000","last_active":"2024-01-23T08:54:49.660400+0000","last_peered":"2024-01-23T08:54:49.660400+0000","last_clean":"2024-01-23T08:54:49.660400+0000","last_became_active":"2024-01-23T08:54:40.686125+0000","last_became_peered":"2024-01-23T08:54:40.686125+0000","last_unstale":"2024-01-23T08:54:49.660400+0000","last_undegraded":"2024-01-23T08:54:49.660400+0000","last_fullsized":"2024-01-23T08:54:49.660400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:38:41.311580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.710758+0000","last_change":"2024-01-23T08:54:42.090249+0000","last_active":"2024-01-23T08:54:49.710758+0000","last_peered":"2024-01-23T08:54:49.710758+0000","last_clean":"2024-01-23T08:54:49.710758+0000","last_became_active":"2024-01-23T08:54:42.089826+0000","last_became_peered":"2024-01-23T08:54:42.089826+0000","last_unstale":"2024-01-23T08:54:49.710758+0000","last_undegraded":"2024-01-23T08:54:49.710758+0000","last_fullsized":"2024-01-23T08:54:49.710758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:07:39.007667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.834012+0000","last_change":"2024-01-23T08:54:49.737089+0000","last_active":"2024-01-23T08:54:50.834012+0000","last_peered":"2024-01-23T08:54:50.834012+0000","last_clean":"2024-01-23T08:54:50.834012+0000","last_became_active":"2024-01-23T08:54:49.736197+0000","last_became_peered":"2024-01-23T08:54:49.736197+0000","last_unstale":"2024-01-23T08:54:50.834012+0000","last_undegraded":"2024-01-23T08:54:50.834012+0000","last_fullsized":"2024-01-23T08:54:50.834012+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:27:36.690726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.703007+0000","last_change":"2024-01-23T08:54:42.228128+0000","last_active":"2024-01-23T08:54:49.703007+0000","last_peered":"2024-01-23T08:54:49.703007+0000","last_clean":"2024-01-23T08:54:49.703007+0000","last_became_active":"2024-01-23T08:54:42.227421+0000","last_became_peered":"2024-01-23T08:54:42.227421+0000","last_unstale":"2024-01-23T08:54:49.703007+0000","last_undegraded":"2024-01-23T08:54:49.703007+0000","last_fullsized":"2024-01-23T08:54:49.703007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:47:09.171802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.713503+0000","last_change":"2024-01-23T08:54:42.112162+0000","last_active":"2024-01-23T08:54:49.713503+0000","last_peered":"2024-01-23T08:54:49.713503+0000","last_clean":"2024-01-23T08:54:49.713503+0000","last_became_active":"2024-01-23T08:54:42.111635+0000","last_became_peered":"2024-01-23T08:54:42.111635+0000","last_unstale":"2024-01-23T08:54:49.713503+0000","last_undegraded":"2024-01-23T08:54:49.713503+0000","last_fullsized":"2024-01-23T08:54:49.713503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:13:11.423278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.637930+0000","last_change":"2024-01-23T08:54:42.069982+0000","last_active":"2024-01-23T08:54:49.637930+0000","last_peered":"2024-01-23T08:54:49.637930+0000","last_clean":"2024-01-23T08:54:49.637930+0000","last_became_active":"2024-01-23T08:54:42.069262+0000","last_became_peered":"2024-01-23T08:54:42.069262+0000","last_unstale":"2024-01-23T08:54:49.637930+0000","last_undegraded":"2024-01-23T08:54:49.637930+0000","last_fullsized":"2024-01-23T08:54:49.637930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:56:44.803841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.660259+0000","last_change":"2024-01-23T08:54:42.108709+0000","last_active":"2024-01-23T08:54:49.660259+0000","last_peered":"2024-01-23T08:54:49.660259+0000","last_clean":"2024-01-23T08:54:49.660259+0000","last_became_active":"2024-01-23T08:54:42.107985+0000","last_became_peered":"2024-01-23T08:54:42.107985+0000","last_unstale":"2024-01-23T08:54:49.660259+0000","last_undegraded":"2024-01-23T08:54:49.660259+0000","last_fullsized":"2024-01-23T08:54:49.660259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:27:28.770059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.679217+0000","last_change":"2024-01-23T08:54:42.229100+0000","last_active":"2024-01-23T08:54:49.679217+0000","last_peered":"2024-01-23T08:54:49.679217+0000","last_clean":"2024-01-23T08:54:49.679217+0000","last_became_active":"2024-01-23T08:54:42.227918+0000","last_became_peered":"2024-01-23T08:54:42.227918+0000","last_unstale":"2024-01-23T08:54:49.679217+0000","last_undegraded":"2024-01-23T08:54:49.679217+0000","last_fullsized":"2024-01-23T08:54:49.679217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:54:47.705445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.677129+0000","last_change":"2024-01-23T08:54:42.231357+0000","last_active":"2024-01-23T08:54:49.677129+0000","last_peered":"2024-01-23T08:54:49.677129+0000","last_clean":"2024-01-23T08:54:49.677129+0000","last_became_active":"2024-01-23T08:54:42.230615+0000","last_became_peered":"2024-01-23T08:54:42.230615+0000","last_unstale":"2024-01-23T08:54:49.677129+0000","last_undegraded":"2024-01-23T08:54:49.677129+0000","last_fullsized":"2024-01-23T08:54:49.677129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:12:12.757498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.707876+0000","last_change":"2024-01-23T08:54:42.158739+0000","last_active":"2024-01-23T08:54:49.707876+0000","last_peered":"2024-01-23T08:54:49.707876+0000","last_clean":"2024-01-23T08:54:49.707876+0000","last_became_active":"2024-01-23T08:54:42.157106+0000","last_became_peered":"2024-01-23T08:54:42.157106+0000","last_unstale":"2024-01-23T08:54:49.707876+0000","last_undegraded":"2024-01-23T08:54:49.707876+0000","last_fullsized":"2024-01-23T08:54:49.707876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:32:37.961458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.660441+0000","last_change":"2024-01-23T08:54:42.092942+0000","last_active":"2024-01-23T08:54:49.660441+0000","last_peered":"2024-01-23T08:54:49.660441+0000","last_clean":"2024-01-23T08:54:49.660441+0000","last_became_active":"2024-01-23T08:54:42.092149+0000","last_became_peered":"2024-01-23T08:54:42.092149+0000","last_unstale":"2024-01-23T08:54:49.660441+0000","last_undegraded":"2024-01-23T08:54:49.660441+0000","last_fullsized":"2024-01-23T08:54:49.660441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:19.147334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.637829+0000","last_change":"2024-01-23T08:54:42.069948+0000","last_active":"2024-01-23T08:54:49.637829+0000","last_peered":"2024-01-23T08:54:49.637829+0000","last_clean":"2024-01-23T08:54:49.637829+0000","last_became_active":"2024-01-23T08:54:42.069305+0000","last_became_peered":"2024-01-23T08:54:42.069305+0000","last_unstale":"2024-01-23T08:54:49.637829+0000","last_undegraded":"2024-01-23T08:54:49.637829+0000","last_fullsized":"2024-01-23T08:54:49.637829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:21:50.684517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.659901+0000","last_change":"2024-01-23T08:54:42.158120+0000","last_active":"2024-01-23T08:54:49.659901+0000","last_peered":"2024-01-23T08:54:49.659901+0000","last_clean":"2024-01-23T08:54:49.659901+0000","last_became_active":"2024-01-23T08:54:42.157647+0000","last_became_peered":"2024-01-23T08:54:42.157647+0000","last_unstale":"2024-01-23T08:54:49.659901+0000","last_undegraded":"2024-01-23T08:54:49.659901+0000","last_fullsized":"2024-01-23T08:54:49.659901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:28:50.107504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.710525+0000","last_change":"2024-01-23T08:54:42.119253+0000","last_active":"2024-01-23T08:54:49.710525+0000","last_peered":"2024-01-23T08:54:49.710525+0000","last_clean":"2024-01-23T08:54:49.710525+0000","last_became_active":"2024-01-23T08:54:42.118528+0000","last_became_peered":"2024-01-23T08:54:42.118528+0000","last_unstale":"2024-01-23T08:54:49.710525+0000","last_undegraded":"2024-01-23T08:54:49.710525+0000","last_fullsized":"2024-01-23T08:54:49.710525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:47:09.171802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.706925+0000","last_change":"2024-01-23T08:54:42.197561+0000","last_active":"2024-01-23T08:54:49.706925+0000","last_peered":"2024-01-23T08:54:49.706925+0000","last_clean":"2024-01-23T08:54:49.706925+0000","last_became_active":"2024-01-23T08:54:42.196809+0000","last_became_peered":"2024-01-23T08:54:42.196809+0000","last_unstale":"2024-01-23T08:54:49.706925+0000","last_undegraded":"2024-01-23T08:54:49.706925+0000","last_fullsized":"2024-01-23T08:54:49.706925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:16:34.046447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.708919+0000","last_change":"2024-01-23T08:54:42.112093+0000","last_active":"2024-01-23T08:54:49.708919+0000","last_peered":"2024-01-23T08:54:49.708919+0000","last_clean":"2024-01-23T08:54:49.708919+0000","last_became_active":"2024-01-23T08:54:42.111207+0000","last_became_peered":"2024-01-23T08:54:42.111207+0000","last_unstale":"2024-01-23T08:54:49.708919+0000","last_undegraded":"2024-01-23T08:54:49.708919+0000","last_fullsized":"2024-01-23T08:54:49.708919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:37.410041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.639633+0000","last_change":"2024-01-23T08:54:42.195803+0000","last_active":"2024-01-23T08:54:49.639633+0000","last_peered":"2024-01-23T08:54:49.639633+0000","last_clean":"2024-01-23T08:54:49.639633+0000","last_became_active":"2024-01-23T08:54:42.194562+0000","last_became_peered":"2024-01-23T08:54:42.194562+0000","last_unstale":"2024-01-23T08:54:49.639633+0000","last_undegraded":"2024-01-23T08:54:49.639633+0000","last_fullsized":"2024-01-23T08:54:49.639633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:53:56.379892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.716004+0000","last_change":"2024-01-23T08:54:42.161219+0000","last_active":"2024-01-23T08:54:49.716004+0000","last_peered":"2024-01-23T08:54:49.716004+0000","last_clean":"2024-01-23T08:54:49.716004+0000","last_became_active":"2024-01-23T08:54:42.160570+0000","last_became_peered":"2024-01-23T08:54:42.160570+0000","last_unstale":"2024-01-23T08:54:49.716004+0000","last_undegraded":"2024-01-23T08:54:49.716004+0000","last_fullsized":"2024-01-23T08:54:49.716004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:47:09.171802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.640590+0000","last_change":"2024-01-23T08:54:42.115468+0000","last_active":"2024-01-23T08:54:49.640590+0000","last_peered":"2024-01-23T08:54:49.640590+0000","last_clean":"2024-01-23T08:54:49.640590+0000","last_became_active":"2024-01-23T08:54:42.114759+0000","last_became_peered":"2024-01-23T08:54:42.114759+0000","last_unstale":"2024-01-23T08:54:49.640590+0000","last_undegraded":"2024-01-23T08:54:49.640590+0000","last_fullsized":"2024-01-23T08:54:49.640590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:00:35.095097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.637665+0000","last_change":"2024-01-23T08:54:42.150054+0000","last_active":"2024-01-23T08:54:49.637665+0000","last_peered":"2024-01-23T08:54:49.637665+0000","last_clean":"2024-01-23T08:54:49.637665+0000","last_became_active":"2024-01-23T08:54:42.149278+0000","last_became_peered":"2024-01-23T08:54:42.149278+0000","last_unstale":"2024-01-23T08:54:49.637665+0000","last_undegraded":"2024-01-23T08:54:49.637665+0000","last_fullsized":"2024-01-23T08:54:49.637665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:16:33.710981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.659573+0000","last_change":"2024-01-23T08:54:42.110442+0000","last_active":"2024-01-23T08:54:49.659573+0000","last_peered":"2024-01-23T08:54:49.659573+0000","last_clean":"2024-01-23T08:54:49.659573+0000","last_became_active":"2024-01-23T08:54:42.109743+0000","last_became_peered":"2024-01-23T08:54:42.109743+0000","last_unstale":"2024-01-23T08:54:49.659573+0000","last_undegraded":"2024-01-23T08:54:49.659573+0000","last_fullsized":"2024-01-23T08:54:49.659573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:58:34.376942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.677729+0000","last_change":"2024-01-23T08:54:42.228264+0000","last_active":"2024-01-23T08:54:49.677729+0000","last_peered":"2024-01-23T08:54:49.677729+0000","last_clean":"2024-01-23T08:54:49.677729+0000","last_became_active":"2024-01-23T08:54:42.227537+0000","last_became_peered":"2024-01-23T08:54:42.227537+0000","last_unstale":"2024-01-23T08:54:49.677729+0000","last_undegraded":"2024-01-23T08:54:49.677729+0000","last_fullsized":"2024-01-23T08:54:49.677729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:54:25.960679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.677826+0000","last_change":"2024-01-23T08:54:42.225968+0000","last_active":"2024-01-23T08:54:49.677826+0000","last_peered":"2024-01-23T08:54:49.677826+0000","last_clean":"2024-01-23T08:54:49.677826+0000","last_became_active":"2024-01-23T08:54:42.224541+0000","last_became_peered":"2024-01-23T08:54:42.224541+0000","last_unstale":"2024-01-23T08:54:49.677826+0000","last_undegraded":"2024-01-23T08:54:49.677826+0000","last_fullsized":"2024-01-23T08:54:49.677826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:04:03.310087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.708825+0000","last_change":"2024-01-23T08:54:42.111363+0000","last_active":"2024-01-23T08:54:49.708825+0000","last_peered":"2024-01-23T08:54:49.708825+0000","last_clean":"2024-01-23T08:54:49.708825+0000","last_became_active":"2024-01-23T08:54:42.111043+0000","last_became_peered":"2024-01-23T08:54:42.111043+0000","last_unstale":"2024-01-23T08:54:49.708825+0000","last_undegraded":"2024-01-23T08:54:49.708825+0000","last_fullsized":"2024-01-23T08:54:49.708825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:22.447523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705684+0000","last_change":"2024-01-23T08:54:42.116234+0000","last_active":"2024-01-23T08:54:49.705684+0000","last_peered":"2024-01-23T08:54:49.705684+0000","last_clean":"2024-01-23T08:54:49.705684+0000","last_became_active":"2024-01-23T08:54:42.115911+0000","last_became_peered":"2024-01-23T08:54:42.115911+0000","last_unstale":"2024-01-23T08:54:49.705684+0000","last_undegraded":"2024-01-23T08:54:49.705684+0000","last_fullsized":"2024-01-23T08:54:49.705684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:06.320845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705399+0000","last_change":"2024-01-23T08:54:42.158134+0000","last_active":"2024-01-23T08:54:49.705399+0000","last_peered":"2024-01-23T08:54:49.705399+0000","last_clean":"2024-01-23T08:54:49.705399+0000","last_became_active":"2024-01-23T08:54:42.157331+0000","last_became_peered":"2024-01-23T08:54:42.157331+0000","last_unstale":"2024-01-23T08:54:49.705399+0000","last_undegraded":"2024-01-23T08:54:49.705399+0000","last_fullsized":"2024-01-23T08:54:49.705399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:46.594970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.715272+0000","last_change":"2024-01-23T08:54:42.092495+0000","last_active":"2024-01-23T08:54:49.715272+0000","last_peered":"2024-01-23T08:54:49.715272+0000","last_clean":"2024-01-23T08:54:49.715272+0000","last_became_active":"2024-01-23T08:54:42.091726+0000","last_became_peered":"2024-01-23T08:54:42.091726+0000","last_unstale":"2024-01-23T08:54:49.715272+0000","last_undegraded":"2024-01-23T08:54:49.715272+0000","last_fullsized":"2024-01-23T08:54:49.715272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:19:17.992621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.659528+0000","last_change":"2024-01-23T08:54:42.120617+0000","last_active":"2024-01-23T08:54:49.659528+0000","last_peered":"2024-01-23T08:54:49.659528+0000","last_clean":"2024-01-23T08:54:49.659528+0000","last_became_active":"2024-01-23T08:54:42.119847+0000","last_became_peered":"2024-01-23T08:54:42.119847+0000","last_unstale":"2024-01-23T08:54:49.659528+0000","last_undegraded":"2024-01-23T08:54:49.659528+0000","last_fullsized":"2024-01-23T08:54:49.659528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:29:51.323223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.699912+0000","last_change":"2024-01-23T08:54:42.197133+0000","last_active":"2024-01-23T08:54:49.699912+0000","last_peered":"2024-01-23T08:54:49.699912+0000","last_clean":"2024-01-23T08:54:49.699912+0000","last_became_active":"2024-01-23T08:54:42.195743+0000","last_became_peered":"2024-01-23T08:54:42.195743+0000","last_unstale":"2024-01-23T08:54:49.699912+0000","last_undegraded":"2024-01-23T08:54:49.699912+0000","last_fullsized":"2024-01-23T08:54:49.699912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:48:04.040139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705359+0000","last_change":"2024-01-23T08:54:42.195979+0000","last_active":"2024-01-23T08:54:49.705359+0000","last_peered":"2024-01-23T08:54:49.705359+0000","last_clean":"2024-01-23T08:54:49.705359+0000","last_became_active":"2024-01-23T08:54:42.194846+0000","last_became_peered":"2024-01-23T08:54:42.194846+0000","last_unstale":"2024-01-23T08:54:49.705359+0000","last_undegraded":"2024-01-23T08:54:49.705359+0000","last_fullsized":"2024-01-23T08:54:49.705359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:07:39.007667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705207+0000","last_change":"2024-01-23T08:54:42.118056+0000","last_active":"2024-01-23T08:54:49.705207+0000","last_peered":"2024-01-23T08:54:49.705207+0000","last_clean":"2024-01-23T08:54:49.705207+0000","last_became_active":"2024-01-23T08:54:42.117735+0000","last_became_peered":"2024-01-23T08:54:42.117735+0000","last_unstale":"2024-01-23T08:54:49.705207+0000","last_undegraded":"2024-01-23T08:54:49.705207+0000","last_fullsized":"2024-01-23T08:54:49.705207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:19.147334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.707758+0000","last_change":"2024-01-23T08:54:42.195159+0000","last_active":"2024-01-23T08:54:49.707758+0000","last_peered":"2024-01-23T08:54:49.707758+0000","last_clean":"2024-01-23T08:54:49.707758+0000","last_became_active":"2024-01-23T08:54:42.194331+0000","last_became_peered":"2024-01-23T08:54:42.194331+0000","last_unstale":"2024-01-23T08:54:49.707758+0000","last_undegraded":"2024-01-23T08:54:49.707758+0000","last_fullsized":"2024-01-23T08:54:49.707758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:19:25.718244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.662214+0000","last_change":"2024-01-23T08:54:42.197096+0000","last_active":"2024-01-23T08:54:49.662214+0000","last_peered":"2024-01-23T08:54:49.662214+0000","last_clean":"2024-01-23T08:54:49.662214+0000","last_became_active":"2024-01-23T08:54:42.196391+0000","last_became_peered":"2024-01-23T08:54:42.196391+0000","last_unstale":"2024-01-23T08:54:49.662214+0000","last_undegraded":"2024-01-23T08:54:49.662214+0000","last_fullsized":"2024-01-23T08:54:49.662214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:22.447523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.661112+0000","last_change":"2024-01-23T08:54:42.231430+0000","last_active":"2024-01-23T08:54:49.661112+0000","last_peered":"2024-01-23T08:54:49.661112+0000","last_clean":"2024-01-23T08:54:49.661112+0000","last_became_active":"2024-01-23T08:54:42.229220+0000","last_became_peered":"2024-01-23T08:54:42.229220+0000","last_unstale":"2024-01-23T08:54:49.661112+0000","last_undegraded":"2024-01-23T08:54:49.661112+0000","last_fullsized":"2024-01-23T08:54:49.661112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:48:04.040139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705952+0000","last_change":"2024-01-23T08:54:42.118613+0000","last_active":"2024-01-23T08:54:49.705952+0000","last_peered":"2024-01-23T08:54:49.705952+0000","last_clean":"2024-01-23T08:54:49.705952+0000","last_became_active":"2024-01-23T08:54:42.118233+0000","last_became_peered":"2024-01-23T08:54:42.118233+0000","last_unstale":"2024-01-23T08:54:49.705952+0000","last_undegraded":"2024-01-23T08:54:49.705952+0000","last_fullsized":"2024-01-23T08:54:49.705952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:16:33.710981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5401,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":58,"ondisk_log_size":58,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":117327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.0549999999999999}]},{"osd":1,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.1739999999999999},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.67700000000000005}]},{"osd":2,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.1060000000000001}]},{"osd":3,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.76300000000000001}]},{"osd":4,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.2530000000000001,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":1.1379999999999999}]},{"osd":5,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.2430000000000001}]},{"osd":6,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":1.325},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":1.212}]}]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":897024,"data_stored":707663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":1.3220000000000001}]},{"osd":1,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.097},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":1.1499999999999999}]},{"osd":2,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.194}]},{"osd":3,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.254},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.224}]},{"osd":4,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.0529999999999999}]},{"osd":6,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.296}]},{"osd":7,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":1.417},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":1.014}]}]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":122388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.738,"5min":2.738,"15min":2.738},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.83799999999999997}]},{"osd":1,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.4529999999999998,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":1.097}]},{"osd":2,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":2.524,"5min":2.524,"15min":2.524},"last":1.0029999999999999}]},{"osd":3,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.58099999999999996},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.96999999999999997}]},{"osd":5,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.3690000000000002,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.034}]},{"osd":6,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.069},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.6030000000000002,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.66800000000000004}]},{"osd":7,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":1.119}]}]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":307200,"data_stored":121044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.046},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.59399999999999997}]},{"osd":1,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.54300000000000004}]},{"osd":3,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.90700000000000003}]},{"osd":4,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":1.085},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.63100000000000001}]},{"osd":5,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.996}]},{"osd":6,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.86199999999999999}]},{"osd":7,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.94799999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":892928,"data_stored":707641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.751},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.67100000000000004}]},{"osd":2,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":1.0600000000000001}]},{"osd":3,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":1.232},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.84999999999999998}]},{"osd":4,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":1.319}]},{"osd":5,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.002},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.135}]},{"osd":6,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":1.109},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.1870000000000001}]},{"osd":7,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.1619999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509460,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":303104,"data_stored":117259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.39100000000000001}]},{"osd":2,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.435}]},{"osd":3,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.54000000000000004}]},{"osd":4,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.2270000000000001}]},{"osd":5,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":1.03}]},{"osd":6,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.93100000000000005}]},{"osd":7,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.3959999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":299008,"data_stored":117785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.438},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.34699999999999998}]},{"osd":1,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.60399999999999998}]},{"osd":2,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.55400000000000005}]},{"osd":4,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.753}]},{"osd":5,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.0549999999999999}]},{"osd":6,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.81399999999999995}]},{"osd":7,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.80100000000000005}]}]},{"osd":6,"up_from":14,"seq":60129542164,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":117203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.88},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.56699999999999995}]},{"osd":1,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.03}]},{"osd":2,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.65900000000000003}]},{"osd":3,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.625}]},{"osd":4,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":1.071},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.92500000000000004}]},{"osd":5,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.1120000000000001}]},{"osd":7,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.71099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-23T08:55:28.085 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-23T08:55:28.085 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-01-23T08:55:28.085 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-01-23T08:55:28.085 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-01-23T08:55:28.086 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-01-23T08:55:28.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.267+0000 7f9eb30c2640 1 Processor -- start 2024-01-23T08:55:28.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.267+0000 7f9eb30c2640 1 -- start start 2024-01-23T08:55:28.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.267+0000 7f9eb30c2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eac1539c0 0x7f9eac0cae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:28.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.267+0000 7f9eb30c2640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9eac15d5c0 0x7f9eac0ca700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:28.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.267+0000 7f9eb30c2640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eac0cc800 con 0x7f9eac0ca300 2024-01-23T08:55:28.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.267+0000 7f9eb30c2640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eac0cac40 con 0x7f9eac15d5c0 2024-01-23T08:55:28.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.267+0000 7f9eb30c2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0c45b0 con 0x7f9eac1539c0 2024-01-23T08:55:28.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.279+0000 7f9eb0e5e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eac1539c0 0x7f9eac0cae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:28.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.283+0000 7f9eb0e5e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eac1539c0 0x7f9eac0cae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:45082/0 (socket says 172.21.15.46:45082) 2024-01-23T08:55:28.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.283+0000 7f9eb0e5e640 1 -- 172.21.15.46:0/355540663 learned_addr learned my addr 172.21.15.46:0/355540663 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:28.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.287+0000 7f9eb165f640 1 --2- 172.21.15.46:0/355540663 >> v2:172.21.15.175:3300/0 conn(0x7f9eac15d5c0 0x7f9eac0ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:28.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.287+0000 7f9eb0e5e640 1 -- 172.21.15.46:0/355540663 >> v2:172.21.15.175:3300/0 conn(0x7f9eac15d5c0 msgr2=0x7f9eac0ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:28.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.287+0000 7f9eb0e5e640 1 --2- 172.21.15.46:0/355540663 >> v2:172.21.15.175:3300/0 conn(0x7f9eac15d5c0 0x7f9eac0ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:28.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.287+0000 7f9eb0e5e640 1 -- 172.21.15.46:0/355540663 >> v1:172.21.15.175:6789/0 conn(0x7f9eac0ca300 legacy=0x7f9eac15ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:28.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.287+0000 7f9eb0e5e640 1 -- 172.21.15.46:0/355540663 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac0c4890 con 0x7f9eac1539c0 2024-01-23T08:55:28.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.299+0000 7f9eb0e5e640 1 --2- 172.21.15.46:0/355540663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eac1539c0 0x7f9eac0cae40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009870 tx=0x7f9ea801c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a01799a85a7613f7 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:28.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.307+0000 7f9ea37fe640 1 -- 172.21.15.46:0/355540663 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea80ac410 con 0x7f9eac1539c0 2024-01-23T08:55:28.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.307+0000 7f9ea37fe640 1 -- 172.21.15.46:0/355540663 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea80ac570 con 0x7f9eac1539c0 2024-01-23T08:55:28.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.307+0000 7f9ea37fe640 1 -- 172.21.15.46:0/355540663 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea80ac900 con 0x7f9eac1539c0 2024-01-23T08:55:28.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.307+0000 7f9eb30c2640 1 -- 172.21.15.46:0/355540663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eac1539c0 msgr2=0x7f9eac0cae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:28.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.307+0000 7f9eb30c2640 1 --2- 172.21.15.46:0/355540663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eac1539c0 0x7f9eac0cae40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009870 tx=0x7f9ea801c500 comp rx=0 tx=0).stop 2024-01-23T08:55:28.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.311+0000 7f9eb30c2640 1 -- 172.21.15.46:0/355540663 shutdown_connections 2024-01-23T08:55:28.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.311+0000 7f9eb30c2640 1 --2- 172.21.15.46:0/355540663 >> v2:172.21.15.175:3300/0 conn(0x7f9eac15d5c0 0x7f9eac0ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:28.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.311+0000 7f9eb30c2640 1 --2- 172.21.15.46:0/355540663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eac1539c0 0x7f9eac0cae40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:28.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.311+0000 7f9eb30c2640 1 -- 172.21.15.46:0/355540663 >> 172.21.15.46:0/355540663 conn(0x7f9eac08afa0 msgr2=0x7f9eac08b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:28.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.311+0000 7f9eb30c2640 1 -- 172.21.15.46:0/355540663 shutdown_connections 2024-01-23T08:55:28.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.311+0000 7f9eb30c2640 1 -- 172.21.15.46:0/355540663 wait complete. 2024-01-23T08:55:28.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.311+0000 7f9eb30c2640 1 Processor -- start 2024-01-23T08:55:28.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.311+0000 7f9eb30c2640 1 -- start start 2024-01-23T08:55:28.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.315+0000 7f9eb30c2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eac0ca300 0x7f9eac149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:28.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.315+0000 7f9eb30c2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9eac1539c0 0x7f9eac14a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:28.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.315+0000 7f9eb30c2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9eac15d5c0 0x7f9eac14f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:28.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.315+0000 7f9eb30c2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac163fc0 con 0x7f9eac1539c0 2024-01-23T08:55:28.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.315+0000 7f9eb30c2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac14e3e0 con 0x7f9eac15d5c0 2024-01-23T08:55:28.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.315+0000 7f9eb30c2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac157080 con 0x7f9eac0ca300 2024-01-23T08:55:28.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.315+0000 7f9ea3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9eac1539c0 0x7f9eac14a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:28.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.315+0000 7f9ea3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9eac1539c0 0x7f9eac14a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37536/0 (socket says 172.21.15.46:37536) 2024-01-23T08:55:28.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.315+0000 7f9ea3fff640 1 -- 172.21.15.46:0/3572333708 learned_addr learned my addr 172.21.15.46:0/3572333708 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:28.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.315+0000 7f9eb0e5e640 1 --2- 172.21.15.46:0/3572333708 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eac0ca300 0x7f9eac149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:28.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.315+0000 7f9eb165f640 1 --2- 172.21.15.46:0/3572333708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9eac15d5c0 0x7f9eac14f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:28.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.319+0000 7f9ea3fff640 1 -- 172.21.15.46:0/3572333708 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eac0ca300 msgr2=0x7f9eac149cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:28.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.319+0000 7f9ea3fff640 1 --2- 172.21.15.46:0/3572333708 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eac0ca300 0x7f9eac149cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:28.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.319+0000 7f9ea3fff640 1 -- 172.21.15.46:0/3572333708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9eac15d5c0 msgr2=0x7f9eac14f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:28.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.319+0000 7f9ea3fff640 1 --2- 172.21.15.46:0/3572333708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9eac15d5c0 0x7f9eac14f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:28.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.319+0000 7f9ea3fff640 1 -- 172.21.15.46:0/3572333708 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea80094d0 con 0x7f9eac1539c0 2024-01-23T08:55:28.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.323+0000 7f9ea3fff640 1 --2- 172.21.15.46:0/3572333708 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9eac1539c0 0x7f9eac14a230 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c00b410 tx=0x7f9e9c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:28.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.331+0000 7f9ea17fa640 1 -- 172.21.15.46:0/3572333708 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c011830 con 0x7f9eac1539c0 2024-01-23T08:55:28.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.331+0000 7f9ea17fa640 1 -- 172.21.15.46:0/3572333708 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9c011990 con 0x7f9eac1539c0 2024-01-23T08:55:28.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.331+0000 7f9ea17fa640 1 -- 172.21.15.46:0/3572333708 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c011d40 con 0x7f9eac1539c0 2024-01-23T08:55:28.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.331+0000 7f9eb30c2640 1 -- 172.21.15.46:0/3572333708 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eac156da0 con 0x7f9eac1539c0 2024-01-23T08:55:28.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.331+0000 7f9eb30c2640 1 -- 172.21.15.46:0/3572333708 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eac14dd90 con 0x7f9eac1539c0 2024-01-23T08:55:28.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.331+0000 7f9eb30c2640 1 -- 172.21.15.46:0/3572333708 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eac074340 con 0x7f9eac1539c0 2024-01-23T08:55:28.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.787+0000 7f9ea17fa640 1 -- 172.21.15.46:0/3572333708 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f9e9c01a400 con 0x7f9eac1539c0 2024-01-23T08:55:28.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.791+0000 7f9ea17fa640 1 --2- 172.21.15.46:0/3572333708 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9e98066550 0x7f9e98068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:28.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.791+0000 7f9eb0e5e640 1 --2- 172.21.15.46:0/3572333708 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9e98066550 0x7f9e98068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:28.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.791+0000 7f9eb0e5e640 1 --2- 172.21.15.46:0/3572333708 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9e98066550 0x7f9e98068a10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9ea80ae000 tx=0x7f9ea8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:28.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.823+0000 7f9ea17fa640 1 -- 172.21.15.46:0/3572333708 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9e9c0554d0 con 0x7f9eac1539c0 2024-01-23T08:55:28.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:28.823+0000 7f9ea17fa640 1 -- 172.21.15.46:0/3572333708 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f9e9c051810 con 0x7f9eac1539c0 2024-01-23T08:55:29.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.079+0000 7f9eb30c2640 1 -- 172.21.15.46:0/3572333708 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f9eac157250 con 0x7f9eac1539c0 2024-01-23T08:55:29.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.315+0000 7f9ea17fa640 1 -- 172.21.15.46:0/3572333708 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164169 (secure 0 0 0) 0x7f9e9c015020 con 0x7f9eac1539c0 2024-01-23T08:55:29.317 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:55:29.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.319+0000 7f9eb30c2640 1 -- 172.21.15.46:0/3572333708 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9e98066550 msgr2=0x7f9e98068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:29.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.319+0000 7f9eb30c2640 1 --2- 172.21.15.46:0/3572333708 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9e98066550 0x7f9e98068a10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9ea80ae000 tx=0x7f9ea8008040 comp rx=0 tx=0).stop 2024-01-23T08:55:29.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.323+0000 7f9eb30c2640 1 -- 172.21.15.46:0/3572333708 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9eac1539c0 msgr2=0x7f9eac14a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:29.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.323+0000 7f9eb30c2640 1 --2- 172.21.15.46:0/3572333708 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9eac1539c0 0x7f9eac14a230 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c00b410 tx=0x7f9e9c00b8d0 comp rx=0 tx=0).stop 2024-01-23T08:55:29.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.323+0000 7f9eb30c2640 1 -- 172.21.15.46:0/3572333708 shutdown_connections 2024-01-23T08:55:29.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.323+0000 7f9eb30c2640 1 --2- 172.21.15.46:0/3572333708 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9e98066550 0x7f9e98068a10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:29.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.323+0000 7f9eb30c2640 1 --2- 172.21.15.46:0/3572333708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9eac15d5c0 0x7f9eac14f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:29.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.323+0000 7f9eb30c2640 1 --2- 172.21.15.46:0/3572333708 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9eac1539c0 0x7f9eac14a230 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:29.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.323+0000 7f9eb30c2640 1 --2- 172.21.15.46:0/3572333708 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eac0ca300 0x7f9eac149cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:29.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.323+0000 7f9eb30c2640 1 -- 172.21.15.46:0/3572333708 >> 172.21.15.46:0/3572333708 conn(0x7f9eac08afa0 msgr2=0x7f9eac152be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:29.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.323+0000 7f9eb30c2640 1 -- 172.21.15.46:0/3572333708 shutdown_connections 2024-01-23T08:55:29.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.323+0000 7f9eb30c2640 1 -- 172.21.15.46:0/3572333708 wait complete. 2024-01-23T08:55:29.344 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":5,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2324478006},{"type":"v1","addr":"172.21.15.46:6801","nonce":2324478006}]},"active_addr":"172.21.15.46:6801/2324478006","active_change":"2024-01-23T08:53:44.011986+0000","active_mgr_features":4540701272860131327,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":4193324955}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":2992268375}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":3842793962}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":1351608926}]}]} 2024-01-23T08:55:29.350 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-01-23T08:55:29.350 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-01-23T08:55:29.350 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-23T08:55:29.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.479+0000 7fd4118ef640 1 Processor -- start 2024-01-23T08:55:29.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.479+0000 7fd4118ef640 1 -- start start 2024-01-23T08:55:29.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.483+0000 7fd4118ef640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd40c0c91a0 0x7fd40c0ca200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:29.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.483+0000 7fd4118ef640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40c15a950 con 0x7fd40c070b30 2024-01-23T08:55:29.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.483+0000 7fd4118ef640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40c1581a0 con 0x7fd40c151650 2024-01-23T08:55:29.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.483+0000 7fd4118ef640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40c15aba0 con 0x7fd40c0c91a0 2024-01-23T08:55:29.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.483+0000 7fd40b7fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd40c070b30 0x7fd40c161ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35250/0 (socket says 172.21.15.46:35250) 2024-01-23T08:55:29.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.483+0000 7fd40b7fe640 1 -- 172.21.15.46:0/2174562343 learned_addr learned my addr 172.21.15.46:0/2174562343 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:29.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.487+0000 7fd40a7fc640 1 -- 172.21.15.46:0/2174562343 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2042571463 0 0) 0x7fd40c15a950 con 0x7fd40c070b30 2024-01-23T08:55:29.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.487+0000 7fd40a7fc640 1 -- 172.21.15.46:0/2174562343 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3f8003530 con 0x7fd40c070b30 2024-01-23T08:55:29.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.491+0000 7fd4027fc640 1 --2- 172.21.15.46:0/2174562343 >> v2:172.21.15.175:3300/0 conn(0x7fd40c0c91a0 0x7fd40c0ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:29.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.495+0000 7fd40a7fc640 1 -- 172.21.15.46:0/2174562343 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2100344493 0 0) 0x7fd3f8003530 con 0x7fd40c070b30 2024-01-23T08:55:29.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.495+0000 7fd40a7fc640 1 -- 172.21.15.46:0/2174562343 >> v2:172.21.15.175:3300/0 conn(0x7fd40c0c91a0 msgr2=0x7fd40c0ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:29.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.495+0000 7fd40a7fc640 1 --2- 172.21.15.46:0/2174562343 >> v2:172.21.15.175:3300/0 conn(0x7fd40c0c91a0 0x7fd40c0ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:29.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.495+0000 7fd40a7fc640 1 -- 172.21.15.46:0/2174562343 >> v1:172.21.15.175:6789/0 conn(0x7fd40c151650 legacy=0x7fd40c0c1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:29.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.495+0000 7fd40a7fc640 1 -- 172.21.15.46:0/2174562343 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40c15ae80 con 0x7fd40c070b30 2024-01-23T08:55:29.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.495+0000 7fd40a7fc640 1 -- 172.21.15.46:0/2174562343 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466917103 0 0) 0x7fd404001a00 con 0x7fd40c070b30 2024-01-23T08:55:29.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.495+0000 7fd40a7fc640 1 -- 172.21.15.46:0/2174562343 >> v1:172.21.15.46:6789/0 conn(0x7fd40c070b30 legacy=0x7fd40c161ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:29.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.495+0000 7fd40a7fc640 1 --2- 172.21.15.46:0/2174562343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3f80039d0 0x7fd3f8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:29.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.495+0000 7fd40a7fc640 1 --2- 172.21.15.46:0/2174562343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3f80047d0 0x7fd3f8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:29.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.495+0000 7fd40a7fc640 1 --2- 172.21.15.46:0/2174562343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3f80052b0 0x7fd3f800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:29.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.495+0000 7fd40a7fc640 1 -- 172.21.15.46:0/2174562343 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c15aba0 con 0x7fd3f80047d0 2024-01-23T08:55:29.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.495+0000 7fd40a7fc640 1 -- 172.21.15.46:0/2174562343 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f800c1b0 con 0x7fd3f80052b0 2024-01-23T08:55:29.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.495+0000 7fd40a7fc640 1 -- 172.21.15.46:0/2174562343 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f800c370 con 0x7fd3f80039d0 2024-01-23T08:55:29.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.495+0000 7fd40affd640 1 --2- 172.21.15.46:0/2174562343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3f80039d0 0x7fd3f8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:29.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.495+0000 7fd4027fc640 1 --2- 172.21.15.46:0/2174562343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3f80047d0 0x7fd3f8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:29.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.499+0000 7fd40affd640 1 -- 172.21.15.46:0/2174562343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3f80052b0 msgr2=0x7fd3f800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:29.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.499+0000 7fd40affd640 1 --2- 172.21.15.46:0/2174562343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3f80052b0 0x7fd3f800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:29.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.499+0000 7fd40affd640 1 -- 172.21.15.46:0/2174562343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3f80047d0 msgr2=0x7fd3f8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:29.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.499+0000 7fd40affd640 1 --2- 172.21.15.46:0/2174562343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3f80047d0 0x7fd3f8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:29.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.499+0000 7fd40affd640 1 -- 172.21.15.46:0/2174562343 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f8003530 con 0x7fd3f80039d0 2024-01-23T08:55:29.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.499+0000 7fd40b7fe640 1 -- 172.21.15.46:0/2174562343 reap_dead start 2024-01-23T08:55:29.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.503+0000 7fd40affd640 1 --2- 172.21.15.46:0/2174562343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3f80039d0 0x7fd3f8003dd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc007fd0 tx=0x7fd3fc01c280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c097e36665484386 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:29.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.507+0000 7fd40a7fc640 1 -- 172.21.15.46:0/2174562343 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc005270 con 0x7fd3f80039d0 2024-01-23T08:55:29.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.511+0000 7fd40a7fc640 1 -- 172.21.15.46:0/2174562343 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3fc0a7070 con 0x7fd3f80039d0 2024-01-23T08:55:29.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.511+0000 7fd40a7fc640 1 -- 172.21.15.46:0/2174562343 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc003620 con 0x7fd3f80039d0 2024-01-23T08:55:29.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.511+0000 7fd4118ef640 1 -- 172.21.15.46:0/2174562343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3f80039d0 msgr2=0x7fd3f8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:29.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.511+0000 7fd4118ef640 1 --2- 172.21.15.46:0/2174562343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3f80039d0 0x7fd3f8003dd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc007fd0 tx=0x7fd3fc01c280 comp rx=0 tx=0).stop 2024-01-23T08:55:29.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.511+0000 7fd4118ef640 1 -- 172.21.15.46:0/2174562343 shutdown_connections 2024-01-23T08:55:29.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.511+0000 7fd4118ef640 1 --2- 172.21.15.46:0/2174562343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3f80039d0 0x7fd3f8003dd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:29.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.511+0000 7fd4118ef640 1 -- 172.21.15.46:0/2174562343 >> 172.21.15.46:0/2174562343 conn(0x7fd40c066b40 msgr2=0x7fd40c06eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:29.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.511+0000 7fd4118ef640 1 -- 172.21.15.46:0/2174562343 shutdown_connections 2024-01-23T08:55:29.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.511+0000 7fd4118ef640 1 -- 172.21.15.46:0/2174562343 wait complete. 2024-01-23T08:55:29.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.515+0000 7fd4118ef640 1 Processor -- start 2024-01-23T08:55:29.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.515+0000 7fd4118ef640 1 -- start start 2024-01-23T08:55:29.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.515+0000 7fd4118ef640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3f80039d0 0x7fd40c1f5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:29.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.515+0000 7fd4118ef640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd40c1488a0 0x7fd40c0cd010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:29.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.515+0000 7fd4118ef640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd40c1e7040 0x7fd40c147620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:29.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.515+0000 7fd4118ef640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c0cd550 con 0x7fd40c1488a0 2024-01-23T08:55:29.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.515+0000 7fd4118ef640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c1f2410 con 0x7fd40c1e7040 2024-01-23T08:55:29.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.515+0000 7fd4118ef640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c1f26f0 con 0x7fd3f80039d0 2024-01-23T08:55:29.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.515+0000 7fd40b7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd40c1e7040 0x7fd40c147620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:29.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.515+0000 7fd40affd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3f80039d0 0x7fd40c1f5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:29.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.515+0000 7fd40b7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd40c1e7040 0x7fd40c147620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:56230/0 (socket says 172.21.15.46:56230) 2024-01-23T08:55:29.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.515+0000 7fd40b7fe640 1 -- 172.21.15.46:0/1855512928 learned_addr learned my addr 172.21.15.46:0/1855512928 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:29.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.523+0000 7fd40affd640 1 -- 172.21.15.46:0/1855512928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd40c1e7040 msgr2=0x7fd40c147620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:29.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.523+0000 7fd40affd640 1 --2- 172.21.15.46:0/1855512928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd40c1e7040 0x7fd40c147620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:29.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.523+0000 7fd40affd640 1 -- 172.21.15.46:0/1855512928 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd40c1488a0 msgr2=0x7fd40c0cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:29.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.523+0000 7fd40affd640 1 --2- 172.21.15.46:0/1855512928 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd40c1488a0 0x7fd40c0cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:29.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.523+0000 7fd40affd640 1 -- 172.21.15.46:0/1855512928 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40c1f29d0 con 0x7fd3f80039d0 2024-01-23T08:55:29.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.523+0000 7fd40affd640 1 --2- 172.21.15.46:0/1855512928 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3f80039d0 0x7fd40c1f5ff0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009000 tx=0x7fd3f8005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:29.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.531+0000 7fd408ff9640 1 -- 172.21.15.46:0/1855512928 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc0b1070 con 0x7fd3f80039d0 2024-01-23T08:55:29.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.531+0000 7fd408ff9640 1 -- 172.21.15.46:0/1855512928 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3fc005070 con 0x7fd3f80039d0 2024-01-23T08:55:29.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.531+0000 7fd4118ef640 1 -- 172.21.15.46:0/1855512928 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd40c1f2cb0 con 0x7fd3f80039d0 2024-01-23T08:55:29.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.531+0000 7fd408ff9640 1 -- 172.21.15.46:0/1855512928 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc005420 con 0x7fd3f80039d0 2024-01-23T08:55:29.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.531+0000 7fd4118ef640 1 -- 172.21.15.46:0/1855512928 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd40c1f20e0 con 0x7fd3f80039d0 2024-01-23T08:55:29.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.531+0000 7fd4118ef640 1 -- 172.21.15.46:0/1855512928 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd40c147340 con 0x7fd3f80039d0 2024-01-23T08:55:29.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.579+0000 7fd408ff9640 1 -- 172.21.15.46:0/1855512928 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd3fc0a9020 con 0x7fd3f80039d0 2024-01-23T08:55:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.579+0000 7fd408ff9640 1 --2- 172.21.15.46:0/1855512928 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd3ec066580 0x7fd3ec068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:29.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.579+0000 7fd4027fc640 1 --2- 172.21.15.46:0/1855512928 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd3ec066580 0x7fd3ec068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:29.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.579+0000 7fd4027fc640 1 --2- 172.21.15.46:0/1855512928 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd3ec066580 0x7fd3ec068a40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4006e90 tx=0x7fd3f4006e00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:29.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.707+0000 7fd408ff9640 1 -- 172.21.15.46:0/1855512928 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd3fc0ee370 con 0x7fd3f80039d0 2024-01-23T08:55:29.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:29.967+0000 7fd408ff9640 1 -- 172.21.15.46:0/1855512928 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd3fc0ea6b0 con 0x7fd3f80039d0 2024-01-23T08:55:30.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.151+0000 7fd4118ef640 1 -- 172.21.15.46:0/1855512928 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd40c147340 con 0x7fd3f80039d0 2024-01-23T08:55:30.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.219+0000 7fd408ff9640 1 -- 172.21.15.46:0/1855512928 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18363 (secure 0 0 0) 0x7fd40c147340 con 0x7fd3f80039d0 2024-01-23T08:55:30.217 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:55:30.217 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":28,"fsid":"fdbdd393-f422-45ae-a488-2bbb0163e580","created":"2024-01-23T08:53:36.942515+0000","modified":"2024-01-23T08:54:50.465916+0000","last_up_change":"2024-01-23T08:53:57.198113+0000","last_in_change":"2024-01-23T08:53:47.852614+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-23T08:53:59.340853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-23T08:54:38.278770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-23T08:54:40.216521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-23T08:54:47.311079+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f32c3d7d-e32a-42d8-b55f-db874d915a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6818","nonce":2681790976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6821","nonce":2681790976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6825","nonce":2681790976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6823","nonce":2681790976}]},"public_addr":"172.21.15.46:6818/2681790976","cluster_addr":"172.21.15.46:6821/2681790976","heartbeat_back_addr":"172.21.15.46:6825/2681790976","heartbeat_front_addr":"172.21.15.46:6823/2681790976","state":["exists","up"]},{"osd":1,"uuid":"6f3b6bd2-bbea-4d08-84d5-4407363b5eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6803","nonce":3679152623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6805","nonce":3679152623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6809","nonce":3679152623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6807","nonce":3679152623}]},"public_addr":"172.21.15.46:6803/3679152623","cluster_addr":"172.21.15.46:6805/3679152623","heartbeat_back_addr":"172.21.15.46:6809/3679152623","heartbeat_front_addr":"172.21.15.46:6807/3679152623","state":["exists","up"]},{"osd":2,"uuid":"8f110727-31e7-4f69-926b-c87481d4d28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6811","nonce":3869652274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6813","nonce":3869652274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6820","nonce":3869652274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6815","nonce":3869652274}]},"public_addr":"172.21.15.46:6811/3869652274","cluster_addr":"172.21.15.46:6813/3869652274","heartbeat_back_addr":"172.21.15.46:6820/3869652274","heartbeat_front_addr":"172.21.15.46:6815/3869652274","state":["exists","up"]},{"osd":3,"uuid":"3aa7527d-0463-4373-b9c7-e6b507a7987f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6827","nonce":4168860822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6829","nonce":4168860822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6833","nonce":4168860822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6831","nonce":4168860822}]},"public_addr":"172.21.15.46:6827/4168860822","cluster_addr":"172.21.15.46:6829/4168860822","heartbeat_back_addr":"172.21.15.46:6833/4168860822","heartbeat_front_addr":"172.21.15.46:6831/4168860822","state":["exists","up"]},{"osd":4,"uuid":"eb47a1e5-9f26-465f-b188-87c6eed63c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6805","nonce":3115257412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6808","nonce":3115257412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6815","nonce":3115257412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6812","nonce":3115257412}]},"public_addr":"172.21.15.175:6805/3115257412","cluster_addr":"172.21.15.175:6808/3115257412","heartbeat_back_addr":"172.21.15.175:6815/3115257412","heartbeat_front_addr":"172.21.15.175:6812/3115257412","state":["exists","up"]},{"osd":5,"uuid":"34048409-998c-44f3-a29d-dcad7a6c917b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6818","nonce":3146473948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6822","nonce":3146473948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6831","nonce":3146473948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6826","nonce":3146473948}]},"public_addr":"172.21.15.175:6818/3146473948","cluster_addr":"172.21.15.175:6822/3146473948","heartbeat_back_addr":"172.21.15.175:6831/3146473948","heartbeat_front_addr":"172.21.15.175:6826/3146473948","state":["exists","up"]},{"osd":6,"uuid":"f5d45d3f-9af3-44a1-a730-c260ed1654b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6801","nonce":4161180058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6804","nonce":4161180058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6814","nonce":4161180058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6809","nonce":4161180058}]},"public_addr":"172.21.15.175:6801/4161180058","cluster_addr":"172.21.15.175:6804/4161180058","heartbeat_back_addr":"172.21.15.175:6814/4161180058","heartbeat_front_addr":"172.21.15.175:6809/4161180058","state":["exists","up"]},{"osd":7,"uuid":"16d12e53-2ad3-4b5c-a789-22b45056fd9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6819","nonce":2670236415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6823","nonce":2670236415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6830","nonce":2670236415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6827","nonce":2670236415}]},"public_addr":"172.21.15.175:6819/2670236415","cluster_addr":"172.21.15.175:6823/2670236415","heartbeat_back_addr":"172.21.15.175:6830/2670236415","heartbeat_front_addr":"172.21.15.175:6827/2670236415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.847037+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.765547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.716122+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.874628+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.786580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.924885+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.285635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.898130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T08:55:30.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.223+0000 7fd4118ef640 1 -- 172.21.15.46:0/1855512928 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd3ec066580 msgr2=0x7fd3ec068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:30.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.223+0000 7fd4118ef640 1 --2- 172.21.15.46:0/1855512928 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd3ec066580 0x7fd3ec068a40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4006e90 tx=0x7fd3f4006e00 comp rx=0 tx=0).stop 2024-01-23T08:55:30.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.223+0000 7fd4118ef640 1 -- 172.21.15.46:0/1855512928 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3f80039d0 msgr2=0x7fd40c1f5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:30.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.223+0000 7fd4118ef640 1 --2- 172.21.15.46:0/1855512928 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3f80039d0 0x7fd40c1f5ff0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009000 tx=0x7fd3f8005800 comp rx=0 tx=0).stop 2024-01-23T08:55:30.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.223+0000 7fd4118ef640 1 -- 172.21.15.46:0/1855512928 shutdown_connections 2024-01-23T08:55:30.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.223+0000 7fd4118ef640 1 --2- 172.21.15.46:0/1855512928 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd3ec066580 0x7fd3ec068a40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:30.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.223+0000 7fd4118ef640 1 --2- 172.21.15.46:0/1855512928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd40c1e7040 0x7fd40c147620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:30.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.223+0000 7fd4118ef640 1 --2- 172.21.15.46:0/1855512928 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd40c1488a0 0x7fd40c0cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:30.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.223+0000 7fd4118ef640 1 --2- 172.21.15.46:0/1855512928 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3f80039d0 0x7fd40c1f5ff0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:30.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.223+0000 7fd4118ef640 1 -- 172.21.15.46:0/1855512928 >> 172.21.15.46:0/1855512928 conn(0x7fd40c066b40 msgr2=0x7fd40c0c7950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:30.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.223+0000 7fd4118ef640 1 -- 172.21.15.46:0/1855512928 shutdown_connections 2024-01-23T08:55:30.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.223+0000 7fd4118ef640 1 -- 172.21.15.46:0/1855512928 wait complete. 2024-01-23T08:55:30.244 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-01-23T08:55:30.244 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-23T08:55:30.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.375+0000 7f40ad93c640 1 Processor -- start 2024-01-23T08:55:30.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.375+0000 7f40ad93c640 1 -- start start 2024-01-23T08:55:30.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.375+0000 7f40ad93c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f40a81501d0 0x7f40a80c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:30.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.375+0000 7f40ad93c640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a80c6700 con 0x7f40a80c87f0 2024-01-23T08:55:30.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.375+0000 7f40ad93c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a8156510 con 0x7f40a80c8c40 2024-01-23T08:55:30.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.375+0000 7f40ad93c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a80c4730 con 0x7f40a81501d0 2024-01-23T08:55:30.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.375+0000 7f40a6ffd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f40a81501d0 0x7f40a80c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:30.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.379+0000 7f40a6ffd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f40a81501d0 0x7f40a80c5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:56236/0 (socket says 172.21.15.46:56236) 2024-01-23T08:55:30.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.379+0000 7f40a6ffd640 1 -- 172.21.15.46:0/193463222 learned_addr learned my addr 172.21.15.46:0/193463222 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:30.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.383+0000 7f40a5ffb640 1 -- 172.21.15.46:0/193463222 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560254694 0 0) 0x7f40a80c6700 con 0x7f40a80c87f0 2024-01-23T08:55:30.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.383+0000 7f40a5ffb640 1 -- 172.21.15.46:0/193463222 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4090003530 con 0x7f40a80c87f0 2024-01-23T08:55:30.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.383+0000 7f40a6ffd640 1 -- 172.21.15.46:0/193463222 >> v1:172.21.15.175:6789/0 conn(0x7f40a80c8c40 legacy=0x7f40a80c2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:30.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.383+0000 7f40a6ffd640 1 -- 172.21.15.46:0/193463222 >> v1:172.21.15.46:6789/0 conn(0x7f40a80c87f0 legacy=0x7f40a80c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:30.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.383+0000 7f40a6ffd640 1 -- 172.21.15.46:0/193463222 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a81567f0 con 0x7f40a81501d0 2024-01-23T08:55:30.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.391+0000 7f40a6ffd640 1 --2- 172.21.15.46:0/193463222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40a81501d0 0x7f40a80c5e50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f409800bb10 tx=0x7f4098021400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10fa22d0e81f567b server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:30.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.407+0000 7f40a5ffb640 1 -- 172.21.15.46:0/193463222 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40980b1600 con 0x7f40a81501d0 2024-01-23T08:55:30.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.407+0000 7f40a5ffb640 1 -- 172.21.15.46:0/193463222 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40980ad050 con 0x7f40a81501d0 2024-01-23T08:55:30.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.407+0000 7f40a5ffb640 1 -- 172.21.15.46:0/193463222 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40980b1980 con 0x7f40a81501d0 2024-01-23T08:55:30.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.407+0000 7f40ad93c640 1 -- 172.21.15.46:0/193463222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40a81501d0 msgr2=0x7f40a80c5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:30.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.407+0000 7f40ad93c640 1 --2- 172.21.15.46:0/193463222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40a81501d0 0x7f40a80c5e50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f409800bb10 tx=0x7f4098021400 comp rx=0 tx=0).stop 2024-01-23T08:55:30.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.407+0000 7f40ad93c640 1 -- 172.21.15.46:0/193463222 shutdown_connections 2024-01-23T08:55:30.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.407+0000 7f40ad93c640 1 --2- 172.21.15.46:0/193463222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40a81501d0 0x7f40a80c5e50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:30.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.407+0000 7f40ad93c640 1 -- 172.21.15.46:0/193463222 >> 172.21.15.46:0/193463222 conn(0x7f40a80cba50 msgr2=0x7f40a80c7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:30.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.407+0000 7f40ad93c640 1 -- 172.21.15.46:0/193463222 shutdown_connections 2024-01-23T08:55:30.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.407+0000 7f40ad93c640 1 -- 172.21.15.46:0/193463222 wait complete. 2024-01-23T08:55:30.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.407+0000 7f40ad93c640 1 Processor -- start 2024-01-23T08:55:30.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.407+0000 7f40ad93c640 1 -- start start 2024-01-23T08:55:30.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.407+0000 7f40ad93c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40a80c87f0 0x7f40a81ef4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:30.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.407+0000 7f40ad93c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40a80c8c40 0x7f40a814ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:30.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.407+0000 7f40ad93c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40a81501d0 0x7f40a81eff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:30.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.407+0000 7f40ad93c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a8156090 con 0x7f40a80c8c40 2024-01-23T08:55:30.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.407+0000 7f40ad93c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a81efa00 con 0x7f40a80c87f0 2024-01-23T08:55:30.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.407+0000 7f40ad93c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a81574b0 con 0x7f40a81501d0 2024-01-23T08:55:30.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.407+0000 7f40a67fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40a80c8c40 0x7f40a814ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:30.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.411+0000 7f40a67fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40a80c8c40 0x7f40a814ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37560/0 (socket says 172.21.15.46:37560) 2024-01-23T08:55:30.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.411+0000 7f40a67fc640 1 -- 172.21.15.46:0/3465447479 learned_addr learned my addr 172.21.15.46:0/3465447479 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:30.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.411+0000 7f40a77fe640 1 --2- 172.21.15.46:0/3465447479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40a81501d0 0x7f40a81eff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:30.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.411+0000 7f40a6ffd640 1 --2- 172.21.15.46:0/3465447479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40a80c87f0 0x7f40a81ef4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:30.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.415+0000 7f40a67fc640 1 -- 172.21.15.46:0/3465447479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40a81501d0 msgr2=0x7f40a81eff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:30.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.415+0000 7f40a67fc640 1 --2- 172.21.15.46:0/3465447479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40a81501d0 0x7f40a81eff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:30.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.415+0000 7f40a67fc640 1 -- 172.21.15.46:0/3465447479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40a80c87f0 msgr2=0x7f40a81ef4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:30.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.415+0000 7f40a67fc640 1 --2- 172.21.15.46:0/3465447479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40a80c87f0 0x7f40a81ef4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:30.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.415+0000 7f40a67fc640 1 -- 172.21.15.46:0/3465447479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409800b770 con 0x7f40a80c8c40 2024-01-23T08:55:30.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.415+0000 7f40a67fc640 1 --2- 172.21.15.46:0/3465447479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40a80c8c40 0x7f40a814ee00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f409c00c500 tx=0x7f409c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:30.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.423+0000 7f408ffff640 1 -- 172.21.15.46:0/3465447479 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c0052d0 con 0x7f40a80c8c40 2024-01-23T08:55:30.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.423+0000 7f408ffff640 1 -- 172.21.15.46:0/3465447479 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409c005450 con 0x7f40a80c8c40 2024-01-23T08:55:30.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.423+0000 7f408ffff640 1 -- 172.21.15.46:0/3465447479 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c012870 con 0x7f40a80c8c40 2024-01-23T08:55:30.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.423+0000 7f40ad93c640 1 -- 172.21.15.46:0/3465447479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a8157790 con 0x7f40a80c8c40 2024-01-23T08:55:30.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.423+0000 7f40ad93c640 1 -- 172.21.15.46:0/3465447479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a81f2310 con 0x7f40a80c8c40 2024-01-23T08:55:30.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.423+0000 7f40ad93c640 1 -- 172.21.15.46:0/3465447479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a8074340 con 0x7f40a80c8c40 2024-01-23T08:55:30.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.863+0000 7f408ffff640 1 -- 172.21.15.46:0/3465447479 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f409c0129d0 con 0x7f40a80c8c40 2024-01-23T08:55:30.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.867+0000 7f408ffff640 1 --2- 172.21.15.46:0/3465447479 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4094066580 0x7f4094068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:30.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.867+0000 7f40a6ffd640 1 --2- 172.21.15.46:0/3465447479 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4094066580 0x7f4094068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:30.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.867+0000 7f40a6ffd640 1 --2- 172.21.15.46:0/3465447479 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4094066580 0x7f4094068a40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f40980b3000 tx=0x7f4098008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:30.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.907+0000 7f408ffff640 1 -- 172.21.15.46:0/3465447479 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f409c055b00 con 0x7f40a80c8c40 2024-01-23T08:55:30.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:30.911+0000 7f408ffff640 1 -- 172.21.15.46:0/3465447479 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f409c051740 con 0x7f40a80c8c40 2024-01-23T08:55:31.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.115+0000 7f40ad93c640 1 -- 172.21.15.46:0/3465447479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40a814f9e0 con 0x7f40a80c8c40 2024-01-23T08:55:31.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.191+0000 7f408ffff640 1 -- 172.21.15.46:0/3465447479 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f409c054d60 con 0x7f40a80c8c40 2024-01-23T08:55:31.188 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:55:31.189 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":28,"fsid":"fdbdd393-f422-45ae-a488-2bbb0163e580","created":"2024-01-23T08:53:36.942515+0000","modified":"2024-01-23T08:54:50.465916+0000","last_up_change":"2024-01-23T08:53:57.198113+0000","last_in_change":"2024-01-23T08:53:47.852614+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-23T08:53:59.340853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-23T08:54:38.278770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-23T08:54:40.216521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-23T08:54:47.311079+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f32c3d7d-e32a-42d8-b55f-db874d915a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6818","nonce":2681790976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6821","nonce":2681790976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6825","nonce":2681790976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6823","nonce":2681790976}]},"public_addr":"172.21.15.46:6818/2681790976","cluster_addr":"172.21.15.46:6821/2681790976","heartbeat_back_addr":"172.21.15.46:6825/2681790976","heartbeat_front_addr":"172.21.15.46:6823/2681790976","state":["exists","up"]},{"osd":1,"uuid":"6f3b6bd2-bbea-4d08-84d5-4407363b5eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6803","nonce":3679152623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6805","nonce":3679152623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6809","nonce":3679152623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6807","nonce":3679152623}]},"public_addr":"172.21.15.46:6803/3679152623","cluster_addr":"172.21.15.46:6805/3679152623","heartbeat_back_addr":"172.21.15.46:6809/3679152623","heartbeat_front_addr":"172.21.15.46:6807/3679152623","state":["exists","up"]},{"osd":2,"uuid":"8f110727-31e7-4f69-926b-c87481d4d28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6811","nonce":3869652274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6813","nonce":3869652274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6820","nonce":3869652274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6815","nonce":3869652274}]},"public_addr":"172.21.15.46:6811/3869652274","cluster_addr":"172.21.15.46:6813/3869652274","heartbeat_back_addr":"172.21.15.46:6820/3869652274","heartbeat_front_addr":"172.21.15.46:6815/3869652274","state":["exists","up"]},{"osd":3,"uuid":"3aa7527d-0463-4373-b9c7-e6b507a7987f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6827","nonce":4168860822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6829","nonce":4168860822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6833","nonce":4168860822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6831","nonce":4168860822}]},"public_addr":"172.21.15.46:6827/4168860822","cluster_addr":"172.21.15.46:6829/4168860822","heartbeat_back_addr":"172.21.15.46:6833/4168860822","heartbeat_front_addr":"172.21.15.46:6831/4168860822","state":["exists","up"]},{"osd":4,"uuid":"eb47a1e5-9f26-465f-b188-87c6eed63c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6805","nonce":3115257412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6808","nonce":3115257412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6815","nonce":3115257412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6812","nonce":3115257412}]},"public_addr":"172.21.15.175:6805/3115257412","cluster_addr":"172.21.15.175:6808/3115257412","heartbeat_back_addr":"172.21.15.175:6815/3115257412","heartbeat_front_addr":"172.21.15.175:6812/3115257412","state":["exists","up"]},{"osd":5,"uuid":"34048409-998c-44f3-a29d-dcad7a6c917b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6818","nonce":3146473948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6822","nonce":3146473948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6831","nonce":3146473948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6826","nonce":3146473948}]},"public_addr":"172.21.15.175:6818/3146473948","cluster_addr":"172.21.15.175:6822/3146473948","heartbeat_back_addr":"172.21.15.175:6831/3146473948","heartbeat_front_addr":"172.21.15.175:6826/3146473948","state":["exists","up"]},{"osd":6,"uuid":"f5d45d3f-9af3-44a1-a730-c260ed1654b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6801","nonce":4161180058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6804","nonce":4161180058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6814","nonce":4161180058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6809","nonce":4161180058}]},"public_addr":"172.21.15.175:6801/4161180058","cluster_addr":"172.21.15.175:6804/4161180058","heartbeat_back_addr":"172.21.15.175:6814/4161180058","heartbeat_front_addr":"172.21.15.175:6809/4161180058","state":["exists","up"]},{"osd":7,"uuid":"16d12e53-2ad3-4b5c-a789-22b45056fd9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6819","nonce":2670236415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6823","nonce":2670236415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6830","nonce":2670236415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6827","nonce":2670236415}]},"public_addr":"172.21.15.175:6819/2670236415","cluster_addr":"172.21.15.175:6823/2670236415","heartbeat_back_addr":"172.21.15.175:6830/2670236415","heartbeat_front_addr":"172.21.15.175:6827/2670236415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.847037+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.765547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.716122+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.874628+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.786580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.924885+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.285635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.898130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T08:55:31.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.191+0000 7f40ad93c640 1 -- 172.21.15.46:0/3465447479 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4094066580 msgr2=0x7f4094068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.195+0000 7f40ad93c640 1 --2- 172.21.15.46:0/3465447479 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4094066580 0x7f4094068a40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f40980b3000 tx=0x7f4098008040 comp rx=0 tx=0).stop 2024-01-23T08:55:31.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.195+0000 7f40ad93c640 1 -- 172.21.15.46:0/3465447479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40a80c8c40 msgr2=0x7f40a814ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.195+0000 7f40ad93c640 1 --2- 172.21.15.46:0/3465447479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40a80c8c40 0x7f40a814ee00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f409c00c500 tx=0x7f409c00c9c0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.195+0000 7f40ad93c640 1 -- 172.21.15.46:0/3465447479 shutdown_connections 2024-01-23T08:55:31.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.195+0000 7f40ad93c640 1 --2- 172.21.15.46:0/3465447479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40a81501d0 0x7f40a81eff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.195+0000 7f40ad93c640 1 --2- 172.21.15.46:0/3465447479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40a80c8c40 0x7f40a814ee00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.195+0000 7f40ad93c640 1 --2- 172.21.15.46:0/3465447479 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4094066580 0x7f4094068a40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.195+0000 7f40ad93c640 1 --2- 172.21.15.46:0/3465447479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40a80c87f0 0x7f40a81ef4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.195+0000 7f40ad93c640 1 -- 172.21.15.46:0/3465447479 >> 172.21.15.46:0/3465447479 conn(0x7f40a80cba50 msgr2=0x7f40a80c33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:31.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.195+0000 7f40ad93c640 1 -- 172.21.15.46:0/3465447479 shutdown_connections 2024-01-23T08:55:31.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.195+0000 7f40ad93c640 1 -- 172.21.15.46:0/3465447479 wait complete. 2024-01-23T08:55:31.211 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-01-23T08:55:31.212 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-01-23T08:55:31.212 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-01-23T08:55:31.213 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-01-23T08:55:31.213 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-01-23T08:55:31.213 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-01-23T08:55:31.214 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-01-23T08:55:31.214 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-01-23T08:55:31.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.419+0000 7fc4898cf640 1 Processor -- start 2024-01-23T08:55:31.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.419+0000 7fc4898cf640 1 -- start start 2024-01-23T08:55:31.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.419+0000 7f4d1df2b640 1 Processor -- start 2024-01-23T08:55:31.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.419+0000 7f4d1df2b640 1 -- start start 2024-01-23T08:55:31.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.419+0000 7fc4898cf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4840c6ee0 0x7fc48415d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.419+0000 7fc4898cf640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc484160f00 con 0x7fc484157e40 2024-01-23T08:55:31.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.419+0000 7fc4898cf640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4840c60d0 con 0x7fc484157a60 2024-01-23T08:55:31.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.419+0000 7fc4898cf640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc484161580 con 0x7fc4840c6ee0 2024-01-23T08:55:31.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.419+0000 7fbb991d3640 1 Processor -- start 2024-01-23T08:55:31.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.419+0000 7fbb991d3640 1 -- start start 2024-01-23T08:55:31.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.419+0000 7f4d1df2b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4d181503c0 0x7f4d180c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.419+0000 7fc4827fc640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc484157e40 0x7fc4840c7650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35264/0 (socket says 172.21.15.46:35264) 2024-01-23T08:55:31.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.419+0000 7fc4827fc640 1 -- 172.21.15.46:0/2863125093 learned_addr learned my addr 172.21.15.46:0/2863125093 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:31.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.419+0000 7f4d1df2b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4d180c7cd0 0x7f4d180c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.419+0000 7f4d1df2b640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d18156760 con 0x7f4d18072760 2024-01-23T08:55:31.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.419+0000 7f4d1df2b640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d18157300 con 0x7f4d180c7cd0 2024-01-23T08:55:31.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.419+0000 7f4d1df2b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d181507a0 con 0x7f4d181503c0 2024-01-23T08:55:31.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.419+0000 7f8688900640 1 Processor -- start 2024-01-23T08:55:31.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.419+0000 7fc4837fe640 1 --2- 172.21.15.46:0/2863125093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4840c6ee0 0x7fc48415d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.419+0000 7fbb991d3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb94156bc0 0x7fbb940c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.419+0000 7fbb991d3640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbb940c1770 0x7fbb940c8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.419+0000 7fbb991d3640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb9406de40 con 0x7fbb940b01a0 2024-01-23T08:55:31.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.419+0000 7fbb991d3640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb94072130 con 0x7fbb940c1770 2024-01-23T08:55:31.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.419+0000 7fbb991d3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb940bff60 con 0x7fbb94156bc0 2024-01-23T08:55:31.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.419+0000 7f8688900640 1 -- start start 2024-01-23T08:55:31.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.423+0000 7f8688900640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f868406f090 0x7f86840ca220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.423+0000 7f8688900640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8684072ae0 0x7f86840c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.423+0000 7f8688900640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86840ca8d0 con 0x7f8684072680 2024-01-23T08:55:31.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.423+0000 7f8688900640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8684156510 con 0x7f8684072ae0 2024-01-23T08:55:31.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.423+0000 7f8688900640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8684155900 con 0x7f868406f090 2024-01-23T08:55:31.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.423+0000 7f50a2636640 1 Processor -- start 2024-01-23T08:55:31.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.423+0000 7f50a2636640 1 -- start start 2024-01-23T08:55:31.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.423+0000 7fb5f1ea1640 1 Processor -- start 2024-01-23T08:55:31.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.423+0000 7fb5f1ea1640 1 -- start start 2024-01-23T08:55:31.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.423+0000 7fb5f1ea1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5ec0c69b0 0x7fb5ec0c0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.423+0000 7f50a2636640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f509c150500 0x7f509c0c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.423+0000 7f50a2636640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f509c0c2e00 0x7f509c156250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.423+0000 7fb5f1ea1640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5ec0c16b0 con 0x7fb5ec156f30 2024-01-23T08:55:31.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.423+0000 7fb5f1ea1640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5ec0c1970 con 0x7fb5ec0c6d90 2024-01-23T08:55:31.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.423+0000 7fb5f1ea1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec0c9540 con 0x7fb5ec0c69b0 2024-01-23T08:55:31.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.423+0000 7f50a2636640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f509c156790 con 0x7f509c06e460 2024-01-23T08:55:31.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.423+0000 7f50a2636640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f509c156a20 con 0x7f509c150500 2024-01-23T08:55:31.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.423+0000 7f50a2636640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509c156d00 con 0x7f509c0c2e00 2024-01-23T08:55:31.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.427+0000 7fb8ee578640 1 Processor -- start 2024-01-23T08:55:31.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.427+0000 7fb8ee578640 1 -- start start 2024-01-23T08:55:31.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.427+0000 7fb8ee578640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb8e00d54b0 0x7fb8e00dbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.427+0000 7fb8ee578640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb8e0045ce0 0x7fb8e0006b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.427+0000 7fb8ee578640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e00475b0 0x7fb8e004b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.427+0000 7fb8ee578640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e00dc140 con 0x7fb8e0045ce0 2024-01-23T08:55:31.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.427+0000 7fb8ee578640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e0047120 con 0x7fb8e00d54b0 2024-01-23T08:55:31.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.427+0000 7fb8ee578640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e00d5890 con 0x7fb8e00475b0 2024-01-23T08:55:31.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.427+0000 7fc4837fe640 1 -- 172.21.15.46:0/2863125093 >> v1:172.21.15.175:6789/0 conn(0x7fc484157a60 legacy=0x7fc4840c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:31.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.427+0000 7fc4837fe640 1 -- 172.21.15.46:0/2863125093 >> v1:172.21.15.46:6789/0 conn(0x7fc484157e40 legacy=0x7fc4840c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.427+0000 7fc4837fe640 1 -- 172.21.15.46:0/2863125093 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4840c1620 con 0x7fc4840c6ee0 2024-01-23T08:55:31.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.431+0000 7fbb92d9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb94156bc0 0x7fbb940c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.431+0000 7fbb92d9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb94156bc0 0x7fbb940c7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:45146/0 (socket says 172.21.15.46:45146) 2024-01-23T08:55:31.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.431+0000 7fbb92d9d640 1 -- 172.21.15.46:0/2165408919 learned_addr learned my addr 172.21.15.46:0/2165408919 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:31.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.431+0000 7f4d17fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4d180c7cd0 0x7f4d180c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.431+0000 7f4d17fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4d180c7cd0 0x7f4d180c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37574/0 (socket says 172.21.15.46:37574) 2024-01-23T08:55:31.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.431+0000 7f4d17fff640 1 -- 172.21.15.46:0/3673664445 learned_addr learned my addr 172.21.15.46:0/3673664445 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:31.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.439+0000 7fbb92d9d640 1 -- 172.21.15.46:0/2165408919 >> v2:172.21.15.46:3300/0 conn(0x7fbb940c1770 msgr2=0x7fbb940c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:31.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.439+0000 7fbb92d9d640 1 --2- 172.21.15.46:0/2165408919 >> v2:172.21.15.46:3300/0 conn(0x7fbb940c1770 0x7fbb940c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.439+0000 7fbb92d9d640 1 -- 172.21.15.46:0/2165408919 >> v1:172.21.15.46:6789/0 conn(0x7fbb940b01a0 legacy=0x7fbb9415cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:31.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.439+0000 7fbb92d9d640 1 -- 172.21.15.46:0/2165408919 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9406e0e0 con 0x7fbb94156bc0 2024-01-23T08:55:31.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.439+0000 7f4d17fff640 1 -- 172.21.15.46:0/3673664445 >> v2:172.21.15.175:3300/0 conn(0x7f4d181503c0 msgr2=0x7f4d180c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:31.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.439+0000 7f4d17fff640 1 --2- 172.21.15.46:0/3673664445 >> v2:172.21.15.175:3300/0 conn(0x7f4d181503c0 0x7f4d180c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.439+0000 7f4d17fff640 1 -- 172.21.15.46:0/3673664445 >> v1:172.21.15.46:6789/0 conn(0x7f4d18072760 legacy=0x7f4d18156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:31.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.439+0000 7f4d17fff640 1 -- 172.21.15.46:0/3673664445 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d18071a10 con 0x7f4d180c7cd0 2024-01-23T08:55:31.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.439+0000 7fc4837fe640 1 --2- 172.21.15.46:0/2863125093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4840c6ee0 0x7fc48415d910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc4780097f0 tx=0x7fc47801ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6d31ff902670569 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.447+0000 7fbb92d9d640 1 --2- 172.21.15.46:0/2165408919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb94156bc0 0x7fbb940c7cd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbb88009870 tx=0x7fbb8801c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a228bfe239fad0da server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.447+0000 7f8683fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8684072ae0 0x7f86840c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.451+0000 7f8683fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8684072ae0 0x7f86840c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37590/0 (socket says 172.21.15.46:37590) 2024-01-23T08:55:31.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.451+0000 7f8683fff640 1 -- 172.21.15.46:0/3157322480 learned_addr learned my addr 172.21.15.46:0/3157322480 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:31.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.455+0000 7f4d17fff640 1 --2- 172.21.15.46:0/3673664445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d180c7cd0 0x7f4d180c8100 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4d18071690 tx=0x7f4d0801ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55ca8cb97290f8b8 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.459+0000 7f8683fff640 1 -- 172.21.15.46:0/3157322480 >> v2:172.21.15.175:3300/0 conn(0x7f868406f090 msgr2=0x7f86840ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:31.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.459+0000 7f8683fff640 1 --2- 172.21.15.46:0/3157322480 >> v2:172.21.15.175:3300/0 conn(0x7f868406f090 0x7f86840ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.459+0000 7f8683fff640 1 -- 172.21.15.46:0/3157322480 >> v1:172.21.15.46:6789/0 conn(0x7f8684072680 legacy=0x7f868414f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:31.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.459+0000 7f8683fff640 1 -- 172.21.15.46:0/3157322480 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8684155be0 con 0x7f8684072ae0 2024-01-23T08:55:31.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.463+0000 7f509b7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f509c0c2e00 0x7f509c156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.463+0000 7f509bfff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f509c150500 0x7f509c0c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.463+0000 7fbb91d9b640 1 -- 172.21.15.46:0/2165408919 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb880aa5f0 con 0x7fbb94156bc0 2024-01-23T08:55:31.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.463+0000 7fbb91d9b640 1 -- 172.21.15.46:0/2165408919 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb880aa750 con 0x7fbb94156bc0 2024-01-23T08:55:31.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.463+0000 7fbb91d9b640 1 -- 172.21.15.46:0/2165408919 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb880aaae0 con 0x7fbb94156bc0 2024-01-23T08:55:31.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.463+0000 7f509bfff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f509c150500 0x7f509c0c5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37598/0 (socket says 172.21.15.46:37598) 2024-01-23T08:55:31.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.463+0000 7f509bfff640 1 -- 172.21.15.46:0/4226141083 learned_addr learned my addr 172.21.15.46:0/4226141083 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:31.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.463+0000 7fbb991d3640 1 -- 172.21.15.46:0/2165408919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb94156bc0 msgr2=0x7fbb940c7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.463+0000 7fbb991d3640 1 --2- 172.21.15.46:0/2165408919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb94156bc0 0x7fbb940c7cd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbb88009870 tx=0x7fbb8801c4d0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.463+0000 7fbb991d3640 1 -- 172.21.15.46:0/2165408919 shutdown_connections 2024-01-23T08:55:31.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.463+0000 7fbb991d3640 1 --2- 172.21.15.46:0/2165408919 >> v2:172.21.15.46:3300/0 conn(0x7fbb940c1770 0x7fbb940c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.463+0000 7fbb991d3640 1 --2- 172.21.15.46:0/2165408919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb94156bc0 0x7fbb940c7cd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.463+0000 7fbb991d3640 1 -- 172.21.15.46:0/2165408919 >> 172.21.15.46:0/2165408919 conn(0x7fbb9406aa60 msgr2=0x7fbb9406ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:31.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.463+0000 7fbb991d3640 1 -- 172.21.15.46:0/2165408919 shutdown_connections 2024-01-23T08:55:31.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.463+0000 7fbb991d3640 1 -- 172.21.15.46:0/2165408919 wait complete. 2024-01-23T08:55:31.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fc481ffb640 1 -- 172.21.15.46:0/2863125093 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4780a8970 con 0x7fc4840c6ee0 2024-01-23T08:55:31.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fc481ffb640 1 -- 172.21.15.46:0/2863125093 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4780a8ad0 con 0x7fc4840c6ee0 2024-01-23T08:55:31.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fc481ffb640 1 -- 172.21.15.46:0/2863125093 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4780a8e60 con 0x7fc4840c6ee0 2024-01-23T08:55:31.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fb8edd77640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e00475b0 0x7fb8e004b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fc4898cf640 1 -- 172.21.15.46:0/2863125093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4840c6ee0 msgr2=0x7fc48415d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fc4898cf640 1 --2- 172.21.15.46:0/2863125093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4840c6ee0 0x7fc48415d910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc4780097f0 tx=0x7fc47801ec70 comp rx=0 tx=0).stop 2024-01-23T08:55:31.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fbb991d3640 1 Processor -- start 2024-01-23T08:55:31.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fb5ebfff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb5ec156f30 0x7fb5ec159880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35298/0 (socket says 172.21.15.46:35298) 2024-01-23T08:55:31.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fb5f0e9f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5ec0c69b0 0x7fb5ec0c0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fb5ebfff640 1 -- 172.21.15.46:0/839069824 learned_addr learned my addr 172.21.15.46:0/839069824 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:31.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fc4898cf640 1 -- 172.21.15.46:0/2863125093 shutdown_connections 2024-01-23T08:55:31.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fc4898cf640 1 --2- 172.21.15.46:0/2863125093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4840c6ee0 0x7fc48415d910 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fc4898cf640 1 -- 172.21.15.46:0/2863125093 >> 172.21.15.46:0/2863125093 conn(0x7fc48406d290 msgr2=0x7fc48406e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:31.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fbb991d3640 1 -- start start 2024-01-23T08:55:31.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fc4898cf640 1 -- 172.21.15.46:0/2863125093 shutdown_connections 2024-01-23T08:55:31.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fc4898cf640 1 -- 172.21.15.46:0/2863125093 wait complete. 2024-01-23T08:55:31.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fbb991d3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb940b01a0 0x7fbb9414d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fb8edd77640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e00475b0 0x7fb8e004b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:45178/0 (socket says 172.21.15.46:45178) 2024-01-23T08:55:31.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fb8edd77640 1 -- 172.21.15.46:0/644720914 learned_addr learned my addr 172.21.15.46:0/644720914 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:31.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fc4898cf640 1 Processor -- start 2024-01-23T08:55:31.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fbb991d3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb940c1770 0x7fbb9414ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fc4898cf640 1 -- start start 2024-01-23T08:55:31.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fbb991d3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb94156bc0 0x7fbb9414ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fbb991d3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb94151170 con 0x7fbb94156bc0 2024-01-23T08:55:31.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fbb991d3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9414de10 con 0x7fbb940c1770 2024-01-23T08:55:31.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fbb991d3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb941f3290 con 0x7fbb940b01a0 2024-01-23T08:55:31.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fc4898cf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4840c6ee0 0x7fc4841f4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fc4898cf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc484157a60 0x7fc4841f4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fc4898cf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc484157e40 0x7fc4840ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fc4898cf640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4840c7e60 con 0x7fc484157a60 2024-01-23T08:55:31.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fc4898cf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4841f3e90 con 0x7fc484157e40 2024-01-23T08:55:31.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.467+0000 7fc4898cf640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4840c98b0 con 0x7fc4840c6ee0 2024-01-23T08:55:31.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.471+0000 7f509bfff640 1 -- 172.21.15.46:0/4226141083 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f509c0c2e00 msgr2=0x7f509c156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:31.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.471+0000 7f509bfff640 1 --2- 172.21.15.46:0/4226141083 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f509c0c2e00 0x7f509c156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.471+0000 7f509bfff640 1 -- 172.21.15.46:0/4226141083 >> v1:172.21.15.46:6789/0 conn(0x7f509c06e460 legacy=0x7f509c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:31.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.471+0000 7f509bfff640 1 -- 172.21.15.46:0/4226141083 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509c156fe0 con 0x7f509c150500 2024-01-23T08:55:31.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.471+0000 7fb5f0e9f640 1 -- 172.21.15.46:0/839069824 >> v1:172.21.15.175:6789/0 conn(0x7fb5ec0c6d90 legacy=0x7fb5ec0c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:31.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.471+0000 7fb5f0e9f640 1 -- 172.21.15.46:0/839069824 >> v1:172.21.15.46:6789/0 conn(0x7fb5ec156f30 legacy=0x7fb5ec159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.471+0000 7fb5f0e9f640 1 -- 172.21.15.46:0/839069824 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ec156450 con 0x7fb5ec0c69b0 2024-01-23T08:55:31.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.471+0000 7fb8ecd75640 1 --2- 172.21.15.46:0/644720914 >> v2:172.21.15.46:3300/0 conn(0x7fb8e0045ce0 0x7fb8e0006b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.475+0000 7f8683fff640 1 --2- 172.21.15.46:0/3157322480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8684072ae0 0x7f86840c94c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f868406b2a0 tx=0x7f867c01f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc243a962c9a873 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.475+0000 7fb8edd77640 1 -- 172.21.15.46:0/644720914 >> v2:172.21.15.175:3300/0 conn(0x7fb8e00d54b0 msgr2=0x7fb8e00dbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:31.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.475+0000 7fb8edd77640 1 --2- 172.21.15.46:0/644720914 >> v2:172.21.15.175:3300/0 conn(0x7fb8e00d54b0 0x7fb8e00dbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.475+0000 7fb8edd77640 1 -- 172.21.15.46:0/644720914 >> v2:172.21.15.46:3300/0 conn(0x7fb8e0045ce0 msgr2=0x7fb8e0006b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:31.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.475+0000 7fb8edd77640 1 --2- 172.21.15.46:0/644720914 >> v2:172.21.15.46:3300/0 conn(0x7fb8e0045ce0 0x7fb8e0006b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.475+0000 7fb8edd77640 1 -- 172.21.15.46:0/644720914 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e0046230 con 0x7fb8e00475b0 2024-01-23T08:55:31.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.479+0000 7f509bfff640 1 --2- 172.21.15.46:0/4226141083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f509c150500 0x7f509c0c5f20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5090009870 tx=0x7f509001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf83009c8531a815 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.479+0000 7f8e31b9e640 1 Processor -- start 2024-01-23T08:55:31.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.479+0000 7f8e31b9e640 1 -- start start 2024-01-23T08:55:31.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.483+0000 7f8e31b9e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e2c153800 0x7f8e2c1596c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.483+0000 7f8e31b9e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8e2c06fc50 0x7f8e2c0700e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.483+0000 7f8e31b9e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e2c159d50 con 0x7f8e2c0cc3e0 2024-01-23T08:55:31.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.483+0000 7f8e31b9e640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2c159ff0 con 0x7f8e2c06fc50 2024-01-23T08:55:31.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.483+0000 7f8e31b9e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c15a2b0 con 0x7f8e2c153800 2024-01-23T08:55:31.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.487+0000 7fb5f0e9f640 1 --2- 172.21.15.46:0/839069824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5ec0c69b0 0x7fb5ec0c0e90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb5e00097f0 tx=0x7fb5e001ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11d33f88c093cc8a server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.487+0000 7f8e2bfff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8e2c06fc50 0x7f8e2c0700e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.491+0000 7fbb9359e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb94156bc0 0x7fbb9414ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.491+0000 7fbb9359e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb94156bc0 0x7fbb9414ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37618/0 (socket says 172.21.15.46:37618) 2024-01-23T08:55:31.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.491+0000 7fbb9359e640 1 -- 172.21.15.46:0/396340423 learned_addr learned my addr 172.21.15.46:0/396340423 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:31.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.491+0000 7f8e2bfff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8e2c06fc50 0x7f8e2c0700e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37638/0 (socket says 172.21.15.46:37638) 2024-01-23T08:55:31.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.491+0000 7f8e2bfff640 1 -- 172.21.15.46:0/3841854561 learned_addr learned my addr 172.21.15.46:0/3841854561 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:31.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.495+0000 7fbb92d9d640 1 --2- 172.21.15.46:0/396340423 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb940b01a0 0x7fbb9414d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.495+0000 7fbb9359e640 1 -- 172.21.15.46:0/396340423 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb940b01a0 msgr2=0x7fbb9414d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.495+0000 7fbb9359e640 1 --2- 172.21.15.46:0/396340423 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb940b01a0 0x7fbb9414d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.495+0000 7fbb9359e640 1 -- 172.21.15.46:0/396340423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb940c1770 msgr2=0x7fbb9414ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.495+0000 7fbb9359e640 1 --2- 172.21.15.46:0/396340423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb940c1770 0x7fbb9414ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.495+0000 7fbb9359e640 1 -- 172.21.15.46:0/396340423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb880094d0 con 0x7fbb94156bc0 2024-01-23T08:55:31.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.499+0000 7f4d167fc640 1 -- 172.21.15.46:0/3673664445 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d080a89b0 con 0x7f4d180c7cd0 2024-01-23T08:55:31.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.499+0000 7f4d167fc640 1 -- 172.21.15.46:0/3673664445 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d080a8b10 con 0x7f4d180c7cd0 2024-01-23T08:55:31.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.499+0000 7f4d167fc640 1 -- 172.21.15.46:0/3673664445 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d080a8ea0 con 0x7f4d180c7cd0 2024-01-23T08:55:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.499+0000 7f4d1df2b640 1 -- 172.21.15.46:0/3673664445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d180c7cd0 msgr2=0x7f4d180c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.499+0000 7f4d1df2b640 1 --2- 172.21.15.46:0/3673664445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d180c7cd0 0x7f4d180c8100 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4d18071690 tx=0x7f4d0801ecb0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.499+0000 7f4d1df2b640 1 -- 172.21.15.46:0/3673664445 shutdown_connections 2024-01-23T08:55:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.499+0000 7f4d1df2b640 1 --2- 172.21.15.46:0/3673664445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d180c7cd0 0x7f4d180c8100 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.499+0000 7f4d1df2b640 1 --2- 172.21.15.46:0/3673664445 >> v2:172.21.15.175:3300/0 conn(0x7f4d181503c0 0x7f4d180c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.499+0000 7f4d1df2b640 1 -- 172.21.15.46:0/3673664445 >> 172.21.15.46:0/3673664445 conn(0x7f4d1806aa60 msgr2=0x7f4d1806ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.499+0000 7f4d1df2b640 1 -- 172.21.15.46:0/3673664445 shutdown_connections 2024-01-23T08:55:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.499+0000 7f4d1df2b640 1 -- 172.21.15.46:0/3673664445 wait complete. 2024-01-23T08:55:31.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.499+0000 7fc482ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4840c6ee0 0x7fc4841f4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.499+0000 7f4d1df2b640 1 Processor -- start 2024-01-23T08:55:31.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.499+0000 7f4d1df2b640 1 -- start start 2024-01-23T08:55:31.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.499+0000 7fc482ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4840c6ee0 0x7fc4841f4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:45190/0 (socket says 172.21.15.46:45190) 2024-01-23T08:55:31.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.499+0000 7fc482ffd640 1 -- 172.21.15.46:0/3078846068 learned_addr learned my addr 172.21.15.46:0/3078846068 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:31.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f4d1df2b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d18072760 0x7f4d181522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f4d1df2b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d180c7cd0 0x7f4d18152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f4d1df2b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d181503c0 0x7f4d18147840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f4d1df2b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d18151eb0 con 0x7f4d18072760 2024-01-23T08:55:31.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f4d1df2b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d18147580 con 0x7f4d180c7cd0 2024-01-23T08:55:31.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f4d1df2b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d18151550 con 0x7f4d181503c0 2024-01-23T08:55:31.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f509affd640 1 -- 172.21.15.46:0/4226141083 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50900a89b0 con 0x7f509c150500 2024-01-23T08:55:31.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f509affd640 1 -- 172.21.15.46:0/4226141083 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50900a8b10 con 0x7f509c150500 2024-01-23T08:55:31.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f509affd640 1 -- 172.21.15.46:0/4226141083 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50900a8ea0 con 0x7f509c150500 2024-01-23T08:55:31.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f8e2b7fe640 1 --2- 172.21.15.46:0/3841854561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e2c153800 0x7f8e2c1596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f50a2636640 1 -- 172.21.15.46:0/4226141083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f509c150500 msgr2=0x7f509c0c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f50a2636640 1 --2- 172.21.15.46:0/4226141083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f509c150500 0x7f509c0c5f20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5090009870 tx=0x7f509001ecf0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f50a2636640 1 -- 172.21.15.46:0/4226141083 shutdown_connections 2024-01-23T08:55:31.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f50a2636640 1 --2- 172.21.15.46:0/4226141083 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f509c0c2e00 0x7f509c156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f50a2636640 1 --2- 172.21.15.46:0/4226141083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f509c150500 0x7f509c0c5f20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f50a2636640 1 -- 172.21.15.46:0/4226141083 >> 172.21.15.46:0/4226141083 conn(0x7f509c06b770 msgr2=0x7f509c06bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:31.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f50a2636640 1 -- 172.21.15.46:0/4226141083 shutdown_connections 2024-01-23T08:55:31.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f50a2636640 1 -- 172.21.15.46:0/4226141083 wait complete. 2024-01-23T08:55:31.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f8e2bfff640 1 -- 172.21.15.46:0/3841854561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e2c153800 msgr2=0x7f8e2c1596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:31.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f8e2bfff640 1 --2- 172.21.15.46:0/3841854561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e2c153800 0x7f8e2c1596c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f8e2bfff640 1 -- 172.21.15.46:0/3841854561 >> v1:172.21.15.175:6789/0 conn(0x7f8e2c0cc3e0 legacy=0x7f8e2c15d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:31.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f8e2bfff640 1 -- 172.21.15.46:0/3841854561 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2c15cd50 con 0x7f8e2c06fc50 2024-01-23T08:55:31.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f50a2636640 1 Processor -- start 2024-01-23T08:55:31.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f50a2636640 1 -- start start 2024-01-23T08:55:31.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f50a2636640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f509c06e460 0x7f509c1efe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f50a2636640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f509c0c2e00 0x7f509c155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f50a2636640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f509c150500 0x7f509c1f2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f50a2636640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509c1ef980 con 0x7f509c06e460 2024-01-23T08:55:31.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f50a2636640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509c1e5b50 con 0x7f509c0c2e00 2024-01-23T08:55:31.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.503+0000 7f50a2636640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509c1ef650 con 0x7f509c150500 2024-01-23T08:55:31.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.507+0000 7fbb9359e640 1 --2- 172.21.15.46:0/396340423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb94156bc0 0x7fbb9414ed00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400c440 tx=0x7fbb8400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.507+0000 7f86827fc640 1 -- 172.21.15.46:0/3157322480 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c0af400 con 0x7f8684072ae0 2024-01-23T08:55:31.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.507+0000 7f86827fc640 1 -- 172.21.15.46:0/3157322480 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867c0ab050 con 0x7f8684072ae0 2024-01-23T08:55:31.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.507+0000 7f86827fc640 1 -- 172.21.15.46:0/3157322480 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c0af780 con 0x7f8684072ae0 2024-01-23T08:55:31.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.511+0000 7f8688900640 1 -- 172.21.15.46:0/3157322480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8684072ae0 msgr2=0x7f86840c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.511+0000 7f8688900640 1 --2- 172.21.15.46:0/3157322480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8684072ae0 0x7f86840c94c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f868406b2a0 tx=0x7f867c01f180 comp rx=0 tx=0).stop 2024-01-23T08:55:31.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.511+0000 7f8688900640 1 -- 172.21.15.46:0/3157322480 shutdown_connections 2024-01-23T08:55:31.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.511+0000 7f8688900640 1 --2- 172.21.15.46:0/3157322480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8684072ae0 0x7f86840c94c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.511+0000 7f8688900640 1 --2- 172.21.15.46:0/3157322480 >> v2:172.21.15.175:3300/0 conn(0x7f868406f090 0x7f86840ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.511+0000 7f8688900640 1 -- 172.21.15.46:0/3157322480 >> 172.21.15.46:0/3157322480 conn(0x7f868406d490 msgr2=0x7f868406e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:31.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.511+0000 7f8688900640 1 -- 172.21.15.46:0/3157322480 shutdown_connections 2024-01-23T08:55:31.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.511+0000 7f8688900640 1 -- 172.21.15.46:0/3157322480 wait complete. 2024-01-23T08:55:31.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.511+0000 7fc482ffd640 1 -- 172.21.15.46:0/3078846068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc484157e40 msgr2=0x7fc4840ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.511+0000 7fc482ffd640 1 --2- 172.21.15.46:0/3078846068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc484157e40 0x7fc4840ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.511+0000 7fc482ffd640 1 -- 172.21.15.46:0/3078846068 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc484157a60 msgr2=0x7fc4841f4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.511+0000 7fc4827fc640 1 --2- 172.21.15.46:0/3078846068 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc484157a60 0x7fc4841f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.511+0000 7fc482ffd640 1 --2- 172.21.15.46:0/3078846068 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc484157a60 0x7fc4841f4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.511+0000 7fc482ffd640 1 -- 172.21.15.46:0/3078846068 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc478009420 con 0x7fc4840c6ee0 2024-01-23T08:55:31.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.511+0000 7f8688900640 1 Processor -- start 2024-01-23T08:55:31.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.511+0000 7f8688900640 1 -- start start 2024-01-23T08:55:31.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.511+0000 7f8688900640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f868406f090 0x7f868413ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.511+0000 7f8688900640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8684072680 0x7f868413fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.511+0000 7f8688900640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8684072ae0 0x7f868413d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.511+0000 7f8688900640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868413f7c0 con 0x7f868406f090 2024-01-23T08:55:31.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.511+0000 7f8688900640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8684140aa0 con 0x7f8684072680 2024-01-23T08:55:31.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.511+0000 7f8688900640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868413ebf0 con 0x7f8684072ae0 2024-01-23T08:55:31.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.511+0000 7f8e2bfff640 1 --2- 172.21.15.46:0/3841854561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e2c06fc50 0x7f8e2c0700e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8e24009e50 tx=0x7f8e2401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba2421524b98fb8 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.515+0000 7fc482ffd640 1 --2- 172.21.15.46:0/3078846068 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4840c6ee0 0x7fc4841f4c60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc47400c490 tx=0x7fc474001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.519+0000 7fb8edd77640 1 --2- 172.21.15.46:0/644720914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e00475b0 0x7fb8e004b930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8073640 tx=0x7fb8e8098200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=564b6d5b8ac4ce10 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.519+0000 7f8682ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8684072680 0x7f868413fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.519+0000 7f8e2a7fc640 1 -- 172.21.15.46:0/3841854561 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e240a55c0 con 0x7f8e2c06fc50 2024-01-23T08:55:31.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.519+0000 7f4d177fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d18072760 0x7f4d181522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.519+0000 7f8682ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8684072680 0x7f868413fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:56320/0 (socket says 172.21.15.46:56320) 2024-01-23T08:55:31.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.519+0000 7f8682ffd640 1 -- 172.21.15.46:0/944767224 learned_addr learned my addr 172.21.15.46:0/944767224 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:31.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.519+0000 7f4d177fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d18072760 0x7f4d181522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37644/0 (socket says 172.21.15.46:37644) 2024-01-23T08:55:31.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.519+0000 7f4d177fe640 1 -- 172.21.15.46:0/3341098754 learned_addr learned my addr 172.21.15.46:0/3341098754 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:31.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.523+0000 7f4d17fff640 1 --2- 172.21.15.46:0/3341098754 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d181503c0 0x7f4d18147840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.523+0000 7fbb7b7fe640 1 -- 172.21.15.46:0/396340423 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb84003600 con 0x7fbb94156bc0 2024-01-23T08:55:31.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.523+0000 7fbb7b7fe640 1 -- 172.21.15.46:0/396340423 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb84003780 con 0x7fbb94156bc0 2024-01-23T08:55:31.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.523+0000 7fbb7b7fe640 1 -- 172.21.15.46:0/396340423 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb84003b30 con 0x7fbb94156bc0 2024-01-23T08:55:31.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.523+0000 7fbb991d3640 1 -- 172.21.15.46:0/396340423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb9414e030 con 0x7fbb94156bc0 2024-01-23T08:55:31.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.523+0000 7fbb991d3640 1 -- 172.21.15.46:0/396340423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb941f2960 con 0x7fbb94156bc0 2024-01-23T08:55:31.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.523+0000 7fbb991d3640 1 -- 172.21.15.46:0/396340423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbb94070f40 con 0x7fbb94156bc0 2024-01-23T08:55:31.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.523+0000 7f509bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f509c06e460 0x7f509c1efe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.523+0000 7f4d16ffd640 1 --2- 172.21.15.46:0/3341098754 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d180c7cd0 0x7f4d18152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.527+0000 7f509bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f509c06e460 0x7f509c1efe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37650/0 (socket says 172.21.15.46:37650) 2024-01-23T08:55:31.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.527+0000 7f509bfff640 1 -- 172.21.15.46:0/3424415637 learned_addr learned my addr 172.21.15.46:0/3424415637 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:31.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.531+0000 7fc46bfff640 1 -- 172.21.15.46:0/3078846068 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc474003600 con 0x7fc4840c6ee0 2024-01-23T08:55:31.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.531+0000 7fc46bfff640 1 -- 172.21.15.46:0/3078846068 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc474003780 con 0x7fc4840c6ee0 2024-01-23T08:55:31.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.531+0000 7fc4898cf640 1 -- 172.21.15.46:0/3078846068 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4840c9b90 con 0x7fc4840c6ee0 2024-01-23T08:55:31.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.531+0000 7fc4898cf640 1 -- 172.21.15.46:0/3078846068 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4841f3b20 con 0x7fc4840c6ee0 2024-01-23T08:55:31.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.531+0000 7fc46bfff640 1 -- 172.21.15.46:0/3078846068 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc474003b70 con 0x7fc4840c6ee0 2024-01-23T08:55:31.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.531+0000 7f8682ffd640 1 -- 172.21.15.46:0/944767224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8684072ae0 msgr2=0x7f868413d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.531+0000 7f8682ffd640 1 --2- 172.21.15.46:0/944767224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8684072ae0 0x7f868413d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.531+0000 7f8682ffd640 1 -- 172.21.15.46:0/944767224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f868406f090 msgr2=0x7f868413ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.531+0000 7f8682ffd640 1 --2- 172.21.15.46:0/944767224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f868406f090 0x7f868413ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.531+0000 7f8682ffd640 1 -- 172.21.15.46:0/944767224 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c009b30 con 0x7f8684072680 2024-01-23T08:55:31.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.531+0000 7fc4898cf640 1 -- 172.21.15.46:0/3078846068 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc464001040 con 0x7fc4840c6ee0 2024-01-23T08:55:31.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.531+0000 7f509b7fe640 1 --2- 172.21.15.46:0/3424415637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f509c0c2e00 0x7f509c155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.531+0000 7f509bfff640 1 -- 172.21.15.46:0/3424415637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f509c150500 msgr2=0x7f509c1f2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.531+0000 7f509bfff640 1 --2- 172.21.15.46:0/3424415637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f509c150500 0x7f509c1f2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.531+0000 7f509bfff640 1 -- 172.21.15.46:0/3424415637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f509c0c2e00 msgr2=0x7f509c155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.531+0000 7f509bfff640 1 --2- 172.21.15.46:0/3424415637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f509c0c2e00 0x7f509c155e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.531+0000 7f509bfff640 1 -- 172.21.15.46:0/3424415637 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50900094d0 con 0x7f509c06e460 2024-01-23T08:55:31.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.535+0000 7f4d177fe640 1 -- 172.21.15.46:0/3341098754 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d181503c0 msgr2=0x7f4d18147840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.535+0000 7f4d177fe640 1 --2- 172.21.15.46:0/3341098754 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d181503c0 0x7f4d18147840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.535+0000 7f4d177fe640 1 -- 172.21.15.46:0/3341098754 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d180c7cd0 msgr2=0x7f4d18152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.535+0000 7f4d177fe640 1 --2- 172.21.15.46:0/3341098754 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d180c7cd0 0x7f4d18152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.535+0000 7f4d177fe640 1 -- 172.21.15.46:0/3341098754 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d080094d0 con 0x7f4d18072760 2024-01-23T08:55:31.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.543+0000 7fb8dffff640 1 -- 172.21.15.46:0/644720914 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8128440 con 0x7fb8e00475b0 2024-01-23T08:55:31.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.543+0000 7fb8dffff640 1 -- 172.21.15.46:0/644720914 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e81285e0 con 0x7fb8e00475b0 2024-01-23T08:55:31.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.543+0000 7fb8dffff640 1 -- 172.21.15.46:0/644720914 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8128a10 con 0x7fb8e00475b0 2024-01-23T08:55:31.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.543+0000 7fb8ee578640 1 -- 172.21.15.46:0/644720914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e00475b0 msgr2=0x7fb8e004b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.543+0000 7fb8ee578640 1 --2- 172.21.15.46:0/644720914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e00475b0 0x7fb8e004b930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8073640 tx=0x7fb8e8098200 comp rx=0 tx=0).stop 2024-01-23T08:55:31.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.543+0000 7fb8ee578640 1 -- 172.21.15.46:0/644720914 shutdown_connections 2024-01-23T08:55:31.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.543+0000 7fb8ee578640 1 --2- 172.21.15.46:0/644720914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e00475b0 0x7fb8e004b930 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.543+0000 7fb8ee578640 1 --2- 172.21.15.46:0/644720914 >> v2:172.21.15.46:3300/0 conn(0x7fb8e0045ce0 0x7fb8e0006b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.543+0000 7fb8ee578640 1 --2- 172.21.15.46:0/644720914 >> v2:172.21.15.175:3300/0 conn(0x7fb8e00d54b0 0x7fb8e00dbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.543+0000 7fb8ee578640 1 -- 172.21.15.46:0/644720914 >> 172.21.15.46:0/644720914 conn(0x7fb8e0050a20 msgr2=0x7fb8e0050e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:31.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.543+0000 7fb8ee578640 1 -- 172.21.15.46:0/644720914 shutdown_connections 2024-01-23T08:55:31.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.543+0000 7fb8ee578640 1 -- 172.21.15.46:0/644720914 wait complete. 2024-01-23T08:55:31.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.543+0000 7fb8ee578640 1 Processor -- start 2024-01-23T08:55:31.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.543+0000 7fb8ee578640 1 -- start start 2024-01-23T08:55:31.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.547+0000 7f8682ffd640 1 --2- 172.21.15.46:0/944767224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8684072680 0x7f868413fc50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f867800c490 tx=0x7f8678001e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.547+0000 7fb8ee578640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e0045ce0 0x7fb8e0050030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.547+0000 7fb8ee578640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e00475b0 0x7fb8e00c2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.547+0000 7fb8ee578640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8e00d54b0 0x7fb8e0177570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.547+0000 7fb8ee578640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e0035440 con 0x7fb8e00d54b0 2024-01-23T08:55:31.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.547+0000 7fb8ee578640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e0035690 con 0x7fb8e00475b0 2024-01-23T08:55:31.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.547+0000 7fb8ee578640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e00dc3e0 con 0x7fb8e0045ce0 2024-01-23T08:55:31.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.547+0000 7fb5eb7fe640 1 -- 172.21.15.46:0/839069824 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e00a8970 con 0x7fb5ec0c69b0 2024-01-23T08:55:31.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.547+0000 7fb5eb7fe640 1 -- 172.21.15.46:0/839069824 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e00a8ad0 con 0x7fb5ec0c69b0 2024-01-23T08:55:31.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.547+0000 7fb5eb7fe640 1 -- 172.21.15.46:0/839069824 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e00a8e60 con 0x7fb5ec0c69b0 2024-01-23T08:55:31.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.547+0000 7fb5f1ea1640 1 -- 172.21.15.46:0/839069824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5ec0c69b0 msgr2=0x7fb5ec0c0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.547+0000 7fb5f1ea1640 1 --2- 172.21.15.46:0/839069824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5ec0c69b0 0x7fb5ec0c0e90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb5e00097f0 tx=0x7fb5e001ec90 comp rx=0 tx=0).stop 2024-01-23T08:55:31.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.547+0000 7fb5f1ea1640 1 -- 172.21.15.46:0/839069824 shutdown_connections 2024-01-23T08:55:31.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.547+0000 7fb5f1ea1640 1 --2- 172.21.15.46:0/839069824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5ec0c69b0 0x7fb5ec0c0e90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.547+0000 7fb5f1ea1640 1 -- 172.21.15.46:0/839069824 >> 172.21.15.46:0/839069824 conn(0x7fb5ec066b70 msgr2=0x7fb5ec06fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:31.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.547+0000 7fb5f1ea1640 1 -- 172.21.15.46:0/839069824 shutdown_connections 2024-01-23T08:55:31.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.547+0000 7fb5f1ea1640 1 -- 172.21.15.46:0/839069824 wait complete. 2024-01-23T08:55:31.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.547+0000 7fb5f1ea1640 1 Processor -- start 2024-01-23T08:55:31.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.547+0000 7fb5f1ea1640 1 -- start start 2024-01-23T08:55:31.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.547+0000 7fb5f1ea1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5ec0c69b0 0x7fb5ec1e1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.547+0000 7fb5f1ea1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5ec0c6d90 0x7fb5ec151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.547+0000 7fb5f1ea1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5ec156f30 0x7fb5ec1ef6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.547+0000 7fb5f1ea1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec151d10 con 0x7fb5ec0c69b0 2024-01-23T08:55:31.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.547+0000 7fb5f1ea1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec1ef2a0 con 0x7fb5ec0c6d90 2024-01-23T08:55:31.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.547+0000 7fb5f1ea1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec153210 con 0x7fb5ec156f30 2024-01-23T08:55:31.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.551+0000 7fb8ecd75640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e00475b0 0x7fb8e00c2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.551+0000 7f866bfff640 1 -- 172.21.15.46:0/944767224 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8678003600 con 0x7f8684072680 2024-01-23T08:55:31.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.551+0000 7f866bfff640 1 -- 172.21.15.46:0/944767224 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8678003780 con 0x7f8684072680 2024-01-23T08:55:31.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.551+0000 7f866bfff640 1 -- 172.21.15.46:0/944767224 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8678003b70 con 0x7f8684072680 2024-01-23T08:55:31.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.551+0000 7f8688900640 1 -- 172.21.15.46:0/944767224 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8684138960 con 0x7f8684072680 2024-01-23T08:55:31.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.551+0000 7f8688900640 1 -- 172.21.15.46:0/944767224 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868413f170 con 0x7f8684072680 2024-01-23T08:55:31.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.551+0000 7fb8ecd75640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e00475b0 0x7fb8e00c2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:56326/0 (socket says 172.21.15.46:56326) 2024-01-23T08:55:31.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.551+0000 7fb8ecd75640 1 -- 172.21.15.46:0/2991850866 learned_addr learned my addr 172.21.15.46:0/2991850866 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:31.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.551+0000 7f8688900640 1 -- 172.21.15.46:0/944767224 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f86840c6600 con 0x7f8684072680 2024-01-23T08:55:31.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.555+0000 7fb8ecd75640 1 -- 172.21.15.46:0/2991850866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e0045ce0 msgr2=0x7fb8e0050030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.555+0000 7fb8ecd75640 1 --2- 172.21.15.46:0/2991850866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e0045ce0 0x7fb8e0050030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.555+0000 7fb8ecd75640 1 -- 172.21.15.46:0/2991850866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8e00d54b0 msgr2=0x7fb8e0177570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.555+0000 7fb8ecd75640 1 --2- 172.21.15.46:0/2991850866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8e00d54b0 0x7fb8e0177570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.555+0000 7fb8ecd75640 1 -- 172.21.15.46:0/2991850866 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e00dc6c0 con 0x7fb8e00475b0 2024-01-23T08:55:31.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.555+0000 7fb5ebfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5ec0c6d90 0x7fb5ec151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.567+0000 7fb5ebfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5ec0c6d90 0x7fb5ec151330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:56330/0 (socket says 172.21.15.46:56330) 2024-01-23T08:55:31.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.567+0000 7fb5ebfff640 1 -- 172.21.15.46:0/2044500008 learned_addr learned my addr 172.21.15.46:0/2044500008 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:31.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.575+0000 7fb5ebfff640 1 -- 172.21.15.46:0/2044500008 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5ec156f30 msgr2=0x7fb5ec1ef6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.575+0000 7fb5ebfff640 1 --2- 172.21.15.46:0/2044500008 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5ec156f30 0x7fb5ec1ef6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.575+0000 7fb5ebfff640 1 -- 172.21.15.46:0/2044500008 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5ec0c69b0 msgr2=0x7fb5ec1e1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.575+0000 7fb5ebfff640 1 --2- 172.21.15.46:0/2044500008 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5ec0c69b0 0x7fb5ec1e1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.575+0000 7fb5ebfff640 1 -- 172.21.15.46:0/2044500008 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e0009420 con 0x7fb5ec0c6d90 2024-01-23T08:55:31.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.579+0000 7fc46bfff640 1 -- 172.21.15.46:0/3078846068 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fc474003cd0 con 0x7fc4840c6ee0 2024-01-23T08:55:31.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.579+0000 7fc46bfff640 1 --2- 172.21.15.46:0/3078846068 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fc470066580 0x7fc470068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.579+0000 7fc4827fc640 1 --2- 172.21.15.46:0/3078846068 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fc470066580 0x7fc470068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.579+0000 7fc4827fc640 1 --2- 172.21.15.46:0/3078846068 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fc470066580 0x7fc470068a40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc484160df0 tx=0x7fc47c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.583+0000 7fc46bfff640 1 -- 172.21.15.46:0/3078846068 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc474055190 con 0x7fc4840c6ee0 2024-01-23T08:55:31.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.583+0000 7fc46bfff640 1 --2- 172.21.15.46:0/3078846068 >> [v2:172.21.15.46:6802/3679152623,v1:172.21.15.46:6803/3679152623] conn(0x7fc47006fac0 0x7fc470071f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.583+0000 7fc46bfff640 1 -- 172.21.15.46:0/3078846068 --> [v2:172.21.15.46:6802/3679152623,v1:172.21.15.46:6803/3679152623] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc4700725d0 con 0x7fc47006fac0 2024-01-23T08:55:31.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.583+0000 7fc4837fe640 1 --2- 172.21.15.46:0/3078846068 >> [v2:172.21.15.46:6802/3679152623,v1:172.21.15.46:6803/3679152623] conn(0x7fc47006fac0 0x7fc470071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.583+0000 7fc4837fe640 1 --2- 172.21.15.46:0/3078846068 >> [v2:172.21.15.46:6802/3679152623,v1:172.21.15.46:6803/3679152623] conn(0x7fc47006fac0 0x7fc470071f00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.583+0000 7fc46bfff640 1 -- 172.21.15.46:0/3078846068 <== osd.1 v2:172.21.15.46:6802/3679152623 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc4700725d0 con 0x7fc47006fac0 2024-01-23T08:55:31.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.591+0000 7f866bfff640 1 -- 172.21.15.46:0/944767224 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f8678003cd0 con 0x7f8684072680 2024-01-23T08:55:31.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.591+0000 7f866bfff640 1 --2- 172.21.15.46:0/944767224 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8670066550 0x7f8670068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.591+0000 7f86837fe640 1 --2- 172.21.15.46:0/944767224 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8670066550 0x7f8670068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.591+0000 7f86837fe640 1 --2- 172.21.15.46:0/944767224 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8670066550 0x7f8670068a10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8674009690 tx=0x7f8674006c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.595+0000 7f866bfff640 1 -- 172.21.15.46:0/944767224 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f86780552c0 con 0x7f8684072680 2024-01-23T08:55:31.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.595+0000 7f866bfff640 1 --2- 172.21.15.46:0/944767224 >> [v2:172.21.15.46:6810/3869652274,v1:172.21.15.46:6811/3869652274] conn(0x7f867006fa90 0x7f8670071ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.595+0000 7f866bfff640 1 -- 172.21.15.46:0/944767224 --> [v2:172.21.15.46:6810/3869652274,v1:172.21.15.46:6811/3869652274] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f86700725a0 con 0x7f867006fa90 2024-01-23T08:55:31.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.595+0000 7f8683fff640 1 --2- 172.21.15.46:0/944767224 >> [v2:172.21.15.46:6810/3869652274,v1:172.21.15.46:6811/3869652274] conn(0x7f867006fa90 0x7f8670071ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.595+0000 7f8683fff640 1 --2- 172.21.15.46:0/944767224 >> [v2:172.21.15.46:6810/3869652274,v1:172.21.15.46:6811/3869652274] conn(0x7f867006fa90 0x7f8670071ed0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.595+0000 7fb5ebfff640 1 --2- 172.21.15.46:0/2044500008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5ec0c6d90 0x7fb5ec151330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb5d800c400 tx=0x7fb5d800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.595+0000 7f866bfff640 1 -- 172.21.15.46:0/944767224 <== osd.2 v2:172.21.15.46:6810/3869652274 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f86700725a0 con 0x7f867006fa90 2024-01-23T08:55:31.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.595+0000 7fb8ecd75640 1 --2- 172.21.15.46:0/2991850866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e00475b0 0x7fb8e00c2ff0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb8d800d800 tx=0x7fb8d800dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.599+0000 7f509bfff640 1 --2- 172.21.15.46:0/3424415637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f509c06e460 0x7f509c1efe10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f509001c920 tx=0x7f509001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.599+0000 7fc4898cf640 1 -- 172.21.15.46:0/3078846068 --> [v2:172.21.15.46:6802/3679152623,v1:172.21.15.46:6803/3679152623] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc464002d40 con 0x7fc47006fac0 2024-01-23T08:55:31.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.599+0000 7fc46bfff640 1 -- 172.21.15.46:0/3078846068 <== osd.1 v2:172.21.15.46:6802/3679152623 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc464002d40 con 0x7fc47006fac0 2024-01-23T08:55:31.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.599+0000 7fc4898cf640 1 -- 172.21.15.46:0/3078846068 >> [v2:172.21.15.46:6802/3679152623,v1:172.21.15.46:6803/3679152623] conn(0x7fc47006fac0 msgr2=0x7fc470071f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.599+0000 7fc4898cf640 1 --2- 172.21.15.46:0/3078846068 >> [v2:172.21.15.46:6802/3679152623,v1:172.21.15.46:6803/3679152623] conn(0x7fc47006fac0 0x7fc470071f00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.599+0000 7fc4898cf640 1 -- 172.21.15.46:0/3078846068 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fc470066580 msgr2=0x7fc470068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.599+0000 7fc4898cf640 1 --2- 172.21.15.46:0/3078846068 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fc470066580 0x7fc470068a40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc484160df0 tx=0x7fc47c009040 comp rx=0 tx=0).stop 2024-01-23T08:55:31.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.599+0000 7fc4898cf640 1 -- 172.21.15.46:0/3078846068 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4840c6ee0 msgr2=0x7fc4841f4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.599+0000 7fc4898cf640 1 --2- 172.21.15.46:0/3078846068 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4840c6ee0 0x7fc4841f4c60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc47400c490 tx=0x7fc474001e80 comp rx=0 tx=0).stop 2024-01-23T08:55:31.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.599+0000 7fc4837fe640 1 -- 172.21.15.46:0/3078846068 reap_dead start 2024-01-23T08:55:31.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.599+0000 7fc4898cf640 1 -- 172.21.15.46:0/3078846068 shutdown_connections 2024-01-23T08:55:31.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.599+0000 7fc4898cf640 1 -- 172.21.15.46:0/3078846068 >> 172.21.15.46:0/3078846068 conn(0x7fc48406d290 msgr2=0x7fc48415bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:31.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.599+0000 7fc4898cf640 1 -- 172.21.15.46:0/3078846068 shutdown_connections 2024-01-23T08:55:31.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.599+0000 7fc4898cf640 1 -- 172.21.15.46:0/3078846068 wait complete. 2024-01-23T08:55:31.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.599+0000 7f8e2a7fc640 1 -- 172.21.15.46:0/3841854561 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e240a5720 con 0x7f8e2c06fc50 2024-01-23T08:55:31.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.599+0000 7f8e2a7fc640 1 -- 172.21.15.46:0/3841854561 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e240a5ab0 con 0x7f8e2c06fc50 2024-01-23T08:55:31.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.603+0000 7f8e31b9e640 1 -- 172.21.15.46:0/3841854561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e2c06fc50 msgr2=0x7f8e2c0700e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.603+0000 7f8e31b9e640 1 --2- 172.21.15.46:0/3841854561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e2c06fc50 0x7f8e2c0700e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8e24009e50 tx=0x7f8e2401c940 comp rx=0 tx=0).stop 2024-01-23T08:55:31.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.603+0000 7f8e31b9e640 1 -- 172.21.15.46:0/3841854561 shutdown_connections 2024-01-23T08:55:31.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.603+0000 7f8e31b9e640 1 --2- 172.21.15.46:0/3841854561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e2c06fc50 0x7f8e2c0700e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.603+0000 7f8e31b9e640 1 --2- 172.21.15.46:0/3841854561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e2c153800 0x7f8e2c1596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.603+0000 7f8e31b9e640 1 -- 172.21.15.46:0/3841854561 >> 172.21.15.46:0/3841854561 conn(0x7f8e2c072890 msgr2=0x7f8e2c06e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:31.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.603+0000 7f8e31b9e640 1 -- 172.21.15.46:0/3841854561 shutdown_connections 2024-01-23T08:55:31.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.603+0000 7f8e31b9e640 1 -- 172.21.15.46:0/3841854561 wait complete. 2024-01-23T08:55:31.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.603+0000 7f8e31b9e640 1 Processor -- start 2024-01-23T08:55:31.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.603+0000 7f8e31b9e640 1 -- start start 2024-01-23T08:55:31.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.603+0000 7fb5e97fa640 1 -- 172.21.15.46:0/2044500008 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8005cf0 con 0x7fb5ec0c6d90 2024-01-23T08:55:31.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.603+0000 7fb5e97fa640 1 -- 172.21.15.46:0/2044500008 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d8005e50 con 0x7fb5ec0c6d90 2024-01-23T08:55:31.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.603+0000 7fb5f1ea1640 1 -- 172.21.15.46:0/2044500008 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ec1534f0 con 0x7fb5ec0c6d90 2024-01-23T08:55:31.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.603+0000 7fb5e97fa640 1 -- 172.21.15.46:0/2044500008 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d80072d0 con 0x7fb5ec0c6d90 2024-01-23T08:55:31.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.603+0000 7fb5f1ea1640 1 -- 172.21.15.46:0/2044500008 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ec153ab0 con 0x7fb5ec0c6d90 2024-01-23T08:55:31.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.603+0000 7fb5f1ea1640 1 -- 172.21.15.46:0/2044500008 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb5ec0c59a0 con 0x7fb5ec0c6d90 2024-01-23T08:55:31.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.603+0000 7f8e31b9e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e2c06fc50 0x7f8e2c0c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.603+0000 7f8e31b9e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e2c0cc3e0 0x7f8e2c0c3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.603+0000 7f8e31b9e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e2c153800 0x7f8e2c0c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.603+0000 7f8e31b9e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c158470 con 0x7f8e2c0cc3e0 2024-01-23T08:55:31.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.603+0000 7f8e31b9e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c156820 con 0x7f8e2c153800 2024-01-23T08:55:31.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.603+0000 7f8e31b9e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c157530 con 0x7f8e2c06fc50 2024-01-23T08:55:31.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.603+0000 7f8e2b7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e2c06fc50 0x7f8e2c0c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.607+0000 7f8e2b7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e2c06fc50 0x7f8e2c0c7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:45252/0 (socket says 172.21.15.46:45252) 2024-01-23T08:55:31.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.607+0000 7f8e2b7fe640 1 -- 172.21.15.46:0/1840889569 learned_addr learned my addr 172.21.15.46:0/1840889569 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:31.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.607+0000 7fb8ddffb640 1 -- 172.21.15.46:0/2991850866 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d800b640 con 0x7fb8e00475b0 2024-01-23T08:55:31.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.607+0000 7fb8ddffb640 1 -- 172.21.15.46:0/2991850866 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d800b7a0 con 0x7fb8e00475b0 2024-01-23T08:55:31.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.607+0000 7fb8ddffb640 1 -- 172.21.15.46:0/2991850866 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d800bb10 con 0x7fb8e00475b0 2024-01-23T08:55:31.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.607+0000 7fb8ee578640 1 -- 172.21.15.46:0/2991850866 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e00dc9a0 con 0x7fb8e00475b0 2024-01-23T08:55:31.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.607+0000 7fb8ee578640 1 -- 172.21.15.46:0/2991850866 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e00c3530 con 0x7fb8e00475b0 2024-01-23T08:55:31.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.607+0000 7fb8ee578640 1 -- 172.21.15.46:0/2991850866 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb8e0046db0 con 0x7fb8e00475b0 2024-01-23T08:55:31.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.611+0000 7f8e2b7fe640 1 -- 172.21.15.46:0/1840889569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e2c153800 msgr2=0x7f8e2c0c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.611+0000 7f8e2b7fe640 1 --2- 172.21.15.46:0/1840889569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e2c153800 0x7f8e2c0c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.611+0000 7f8e2b7fe640 1 -- 172.21.15.46:0/1840889569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e2c0cc3e0 msgr2=0x7f8e2c0c3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.611+0000 7f8e2b7fe640 1 --2- 172.21.15.46:0/1840889569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e2c0cc3e0 0x7f8e2c0c3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.611+0000 7f8e2b7fe640 1 -- 172.21.15.46:0/1840889569 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e24009b30 con 0x7f8e2c06fc50 2024-01-23T08:55:31.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.611+0000 7f8e2b7fe640 1 --2- 172.21.15.46:0/1840889569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e2c06fc50 0x7f8e2c0c7a50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00c820 tx=0x7f8e1c00cce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.615+0000 7f8688900640 1 -- 172.21.15.46:0/944767224 --> [v2:172.21.15.46:6810/3869652274,v1:172.21.15.46:6811/3869652274] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f86841561a0 con 0x7f867006fa90 2024-01-23T08:55:31.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.615+0000 7f866bfff640 1 -- 172.21.15.46:0/944767224 <== osd.2 v2:172.21.15.46:6810/3869652274 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f867c009270 con 0x7f867006fa90 2024-01-23T08:55:31.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.615+0000 7f8688900640 1 -- 172.21.15.46:0/944767224 >> [v2:172.21.15.46:6810/3869652274,v1:172.21.15.46:6811/3869652274] conn(0x7f867006fa90 msgr2=0x7f8670071ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.615+0000 7f8688900640 1 --2- 172.21.15.46:0/944767224 >> [v2:172.21.15.46:6810/3869652274,v1:172.21.15.46:6811/3869652274] conn(0x7f867006fa90 0x7f8670071ed0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.615+0000 7f8688900640 1 -- 172.21.15.46:0/944767224 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8670066550 msgr2=0x7f8670068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.615+0000 7f8688900640 1 --2- 172.21.15.46:0/944767224 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8670066550 0x7f8670068a10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8674009690 tx=0x7f8674006c00 comp rx=0 tx=0).stop 2024-01-23T08:55:31.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.615+0000 7f8688900640 1 -- 172.21.15.46:0/944767224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8684072680 msgr2=0x7f868413fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.615+0000 7f8688900640 1 --2- 172.21.15.46:0/944767224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8684072680 0x7f868413fc50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f867800c490 tx=0x7f8678001e80 comp rx=0 tx=0).stop 2024-01-23T08:55:31.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.615+0000 7f8683fff640 1 -- 172.21.15.46:0/944767224 reap_dead start 2024-01-23T08:55:31.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.615+0000 7f8688900640 1 -- 172.21.15.46:0/944767224 shutdown_connections 2024-01-23T08:55:31.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.615+0000 7f8688900640 1 -- 172.21.15.46:0/944767224 >> 172.21.15.46:0/944767224 conn(0x7f868406d490 msgr2=0x7f86840c6ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:31.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.615+0000 7f8688900640 1 -- 172.21.15.46:0/944767224 shutdown_connections 2024-01-23T08:55:31.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.615+0000 7f8688900640 1 -- 172.21.15.46:0/944767224 wait complete. 2024-01-23T08:55:31.617 INFO:teuthology.orchestra.run.smithi046.stdout:64424509462 2024-01-23T08:55:31.617 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-23T08:55:31.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.627+0000 7f4d177fe640 1 --2- 172.21.15.46:0/3341098754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d18072760 0x7f4d181522d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4d1000ba50 tx=0x7f4d1000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.631+0000 7f5098ff9640 1 -- 172.21.15.46:0/3424415637 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50900b1df0 con 0x7f509c06e460 2024-01-23T08:55:31.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.631+0000 7f5098ff9640 1 -- 172.21.15.46:0/3424415637 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50900bb470 con 0x7f509c06e460 2024-01-23T08:55:31.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.631+0000 7f5098ff9640 1 -- 172.21.15.46:0/3424415637 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50900bb7e0 con 0x7f509c06e460 2024-01-23T08:55:31.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.631+0000 7f50a2636640 1 -- 172.21.15.46:0/3424415637 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f509c1e52b0 con 0x7f509c06e460 2024-01-23T08:55:31.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.631+0000 7f50a2636640 1 -- 172.21.15.46:0/3424415637 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f509c1e5870 con 0x7f509c06e460 2024-01-23T08:55:31.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.631+0000 7f50a2636640 1 -- 172.21.15.46:0/3424415637 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f509c1508e0 con 0x7f509c06e460 2024-01-23T08:55:31.632 INFO:teuthology.orchestra.run.smithi046.stdout:64424509463 2024-01-23T08:55:31.632 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-23T08:55:31.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.647+0000 7fb5e97fa640 1 -- 172.21.15.46:0/2044500008 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb5d8007430 con 0x7fb5ec0c6d90 2024-01-23T08:55:31.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.647+0000 7fb5e97fa640 1 --2- 172.21.15.46:0/2044500008 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fb5d0066550 0x7fb5d0068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.647+0000 7fbb7b7fe640 1 -- 172.21.15.46:0/396340423 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fbb84003c90 con 0x7fbb94156bc0 2024-01-23T08:55:31.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.647+0000 7fb5f0e9f640 1 --2- 172.21.15.46:0/2044500008 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fb5d0066550 0x7fb5d0068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.647+0000 7fbb7b7fe640 1 --2- 172.21.15.46:0/396340423 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fbb80066500 0x7fbb800689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.647+0000 7fbb92d9d640 1 --2- 172.21.15.46:0/396340423 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fbb80066500 0x7fbb800689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.647+0000 7fb5f0e9f640 1 --2- 172.21.15.46:0/2044500008 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fb5d0066550 0x7fb5d0068a10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb5e00b2000 tx=0x7fb5e0004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.647+0000 7fbb92d9d640 1 --2- 172.21.15.46:0/396340423 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fbb80066500 0x7fbb800689c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbb880ae000 tx=0x7fbb880a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.655+0000 7f4cfffff640 1 -- 172.21.15.46:0/3341098754 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1000cb80 con 0x7f4d18072760 2024-01-23T08:55:31.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.655+0000 7f4cfffff640 1 -- 172.21.15.46:0/3341098754 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1000cd00 con 0x7f4d18072760 2024-01-23T08:55:31.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.655+0000 7f4d1df2b640 1 -- 172.21.15.46:0/3341098754 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d1814b7a0 con 0x7f4d18072760 2024-01-23T08:55:31.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.655+0000 7f4cfffff640 1 -- 172.21.15.46:0/3341098754 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d10014680 con 0x7f4d18072760 2024-01-23T08:55:31.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.655+0000 7f4d1df2b640 1 -- 172.21.15.46:0/3341098754 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d18151ad0 con 0x7f4d18072760 2024-01-23T08:55:31.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.655+0000 7f4d1df2b640 1 -- 172.21.15.46:0/3341098754 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4d180722b0 con 0x7f4d18072760 2024-01-23T08:55:31.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.659+0000 7fbb7b7fe640 1 -- 172.21.15.46:0/396340423 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbb840549b0 con 0x7fbb94156bc0 2024-01-23T08:55:31.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.659+0000 7fbb7b7fe640 1 --2- 172.21.15.46:0/396340423 >> [v2:172.21.15.46:6826/4168860822,v1:172.21.15.46:6827/4168860822] conn(0x7fbb8006fa40 0x7fbb80071e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.659+0000 7fbb7b7fe640 1 -- 172.21.15.46:0/396340423 --> [v2:172.21.15.46:6826/4168860822,v1:172.21.15.46:6827/4168860822] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbb80072550 con 0x7fbb8006fa40 2024-01-23T08:55:31.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.659+0000 7fbb7b7fe640 1 -- 172.21.15.46:0/396340423 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb840010d0 con 0x7fbb94156bc0 2024-01-23T08:55:31.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.659+0000 7fbb9259c640 1 --2- 172.21.15.46:0/396340423 >> [v2:172.21.15.46:6826/4168860822,v1:172.21.15.46:6827/4168860822] conn(0x7fbb8006fa40 0x7fbb80071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.659+0000 7fbb9259c640 1 --2- 172.21.15.46:0/396340423 >> [v2:172.21.15.46:6826/4168860822,v1:172.21.15.46:6827/4168860822] conn(0x7fbb8006fa40 0x7fbb80071e80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.659+0000 7fb8ddffb640 1 -- 172.21.15.46:0/2991850866 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb8d800bc70 con 0x7fb8e00475b0 2024-01-23T08:55:31.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.659+0000 7fbb7b7fe640 1 -- 172.21.15.46:0/396340423 <== osd.3 v2:172.21.15.46:6826/4168860822 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fbb80072550 con 0x7fbb8006fa40 2024-01-23T08:55:31.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.659+0000 7fb8ddffb640 1 --2- 172.21.15.46:0/2991850866 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fb8cc066550 0x7fb8cc068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.659+0000 7fb8ed576640 1 --2- 172.21.15.46:0/2991850866 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fb8cc066550 0x7fb8cc068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.659+0000 7fb8ed576640 1 --2- 172.21.15.46:0/2991850866 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fb8cc066550 0x7fb8cc068a10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4009690 tx=0x7fb8e4006c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.667+0000 7fb8ddffb640 1 -- 172.21.15.46:0/2991850866 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb8d8056380 con 0x7fb8e00475b0 2024-01-23T08:55:31.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.667+0000 7fb8ddffb640 1 --2- 172.21.15.46:0/2991850866 >> [v2:172.21.15.175:6800/4161180058,v1:172.21.15.175:6801/4161180058] conn(0x7fb8cc06fa90 0x7fb8cc071ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.667+0000 7fb8ddffb640 1 -- 172.21.15.46:0/2991850866 --> [v2:172.21.15.175:6800/4161180058,v1:172.21.15.175:6801/4161180058] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb8cc0725a0 con 0x7fb8cc06fa90 2024-01-23T08:55:31.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.667+0000 7fb8edd77640 1 --2- 172.21.15.46:0/2991850866 >> [v2:172.21.15.175:6800/4161180058,v1:172.21.15.175:6801/4161180058] conn(0x7fb8cc06fa90 0x7fb8cc071ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.667+0000 7fb8edd77640 1 --2- 172.21.15.46:0/2991850866 >> [v2:172.21.15.175:6800/4161180058,v1:172.21.15.175:6801/4161180058] conn(0x7fb8cc06fa90 0x7fb8cc071ed0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.667+0000 7fb8ddffb640 1 -- 172.21.15.46:0/2991850866 <== osd.6 v2:172.21.15.175:6800/4161180058 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb8cc0725a0 con 0x7fb8cc06fa90 2024-01-23T08:55:31.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.671+0000 7fb5e97fa640 1 -- 172.21.15.46:0/2044500008 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb5d8054eb0 con 0x7fb5ec0c6d90 2024-01-23T08:55:31.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.671+0000 7fb5e97fa640 1 --2- 172.21.15.46:0/2044500008 >> [v2:172.21.15.175:6816/3146473948,v1:172.21.15.175:6818/3146473948] conn(0x7fb5d006fa90 0x7fb5d0071ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.671+0000 7fb5e97fa640 1 -- 172.21.15.46:0/2044500008 --> [v2:172.21.15.175:6816/3146473948,v1:172.21.15.175:6818/3146473948] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb5d00725a0 con 0x7fb5d006fa90 2024-01-23T08:55:31.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.671+0000 7fb5f16a0640 1 --2- 172.21.15.46:0/2044500008 >> [v2:172.21.15.175:6816/3146473948,v1:172.21.15.175:6818/3146473948] conn(0x7fb5d006fa90 0x7fb5d0071ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.675+0000 7fb5f16a0640 1 --2- 172.21.15.46:0/2044500008 >> [v2:172.21.15.175:6816/3146473948,v1:172.21.15.175:6818/3146473948] conn(0x7fb5d006fa90 0x7fb5d0071ed0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.675+0000 7fb5e97fa640 1 -- 172.21.15.46:0/2044500008 <== osd.5 v2:172.21.15.175:6816/3146473948 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb5d00725a0 con 0x7fb5d006fa90 2024-01-23T08:55:31.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.679+0000 7fbb991d3640 1 -- 172.21.15.46:0/396340423 --> [v2:172.21.15.46:6826/4168860822,v1:172.21.15.46:6827/4168860822] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbb94156fa0 con 0x7fbb8006fa40 2024-01-23T08:55:31.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.679+0000 7fbb7b7fe640 1 -- 172.21.15.46:0/396340423 <== osd.3 v2:172.21.15.46:6826/4168860822 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbb8c00a7a0 con 0x7fbb8006fa40 2024-01-23T08:55:31.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.683+0000 7fbb991d3640 1 -- 172.21.15.46:0/396340423 >> [v2:172.21.15.46:6826/4168860822,v1:172.21.15.46:6827/4168860822] conn(0x7fbb8006fa40 msgr2=0x7fbb80071e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.683+0000 7fbb991d3640 1 --2- 172.21.15.46:0/396340423 >> [v2:172.21.15.46:6826/4168860822,v1:172.21.15.46:6827/4168860822] conn(0x7fbb8006fa40 0x7fbb80071e80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.683+0000 7fbb991d3640 1 -- 172.21.15.46:0/396340423 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fbb80066500 msgr2=0x7fbb800689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.683+0000 7fbb991d3640 1 --2- 172.21.15.46:0/396340423 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fbb80066500 0x7fbb800689c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbb880ae000 tx=0x7fbb880a7000 comp rx=0 tx=0).stop 2024-01-23T08:55:31.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.683+0000 7fbb991d3640 1 -- 172.21.15.46:0/396340423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb94156bc0 msgr2=0x7fbb9414ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.683+0000 7fbb991d3640 1 --2- 172.21.15.46:0/396340423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb94156bc0 0x7fbb9414ed00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400c440 tx=0x7fbb8400c900 comp rx=0 tx=0).stop 2024-01-23T08:55:31.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.683+0000 7fbb9359e640 1 -- 172.21.15.46:0/396340423 reap_dead start 2024-01-23T08:55:31.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.683+0000 7fbb991d3640 1 -- 172.21.15.46:0/396340423 shutdown_connections 2024-01-23T08:55:31.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.683+0000 7fbb991d3640 1 -- 172.21.15.46:0/396340423 >> 172.21.15.46:0/396340423 conn(0x7fbb9406aa60 msgr2=0x7fbb94153350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:31.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.683+0000 7fbb991d3640 1 -- 172.21.15.46:0/396340423 shutdown_connections 2024-01-23T08:55:31.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.683+0000 7fbb991d3640 1 -- 172.21.15.46:0/396340423 wait complete. 2024-01-23T08:55:31.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.683+0000 7f4cfffff640 1 -- 172.21.15.46:0/3341098754 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f4d1001d3b0 con 0x7f4d18072760 2024-01-23T08:55:31.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.683+0000 7f4cfffff640 1 --2- 172.21.15.46:0/3341098754 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4d04066500 0x7f4d040689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.683+0000 7f4d16ffd640 1 --2- 172.21.15.46:0/3341098754 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4d04066500 0x7f4d040689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.683+0000 7f4d16ffd640 1 --2- 172.21.15.46:0/3341098754 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4d04066500 0x7f4d040689c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4d180ca720 tx=0x7f4d0c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.691+0000 7f4cfffff640 1 -- 172.21.15.46:0/3341098754 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4d10055500 con 0x7f4d18072760 2024-01-23T08:55:31.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.691+0000 7f4cfffff640 1 --2- 172.21.15.46:0/3341098754 >> [v2:172.21.15.175:6817/2670236415,v1:172.21.15.175:6819/2670236415] conn(0x7f4d0406fa40 0x7f4d04071e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.691+0000 7f4cfffff640 1 -- 172.21.15.46:0/3341098754 --> [v2:172.21.15.175:6817/2670236415,v1:172.21.15.175:6819/2670236415] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d04072550 con 0x7f4d0406fa40 2024-01-23T08:55:31.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.691+0000 7f4cfffff640 1 -- 172.21.15.46:0/3341098754 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d10009950 con 0x7f4d18072760 2024-01-23T08:55:31.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.695+0000 7fb8ee578640 1 -- 172.21.15.46:0/2991850866 --> [v2:172.21.15.175:6800/4161180058,v1:172.21.15.175:6801/4161180058] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb8e004cea0 con 0x7fb8cc06fa90 2024-01-23T08:55:31.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.695+0000 7f4d17fff640 1 --2- 172.21.15.46:0/3341098754 >> [v2:172.21.15.175:6817/2670236415,v1:172.21.15.175:6819/2670236415] conn(0x7f4d0406fa40 0x7f4d04071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.695+0000 7f4d17fff640 1 --2- 172.21.15.46:0/3341098754 >> [v2:172.21.15.175:6817/2670236415,v1:172.21.15.175:6819/2670236415] conn(0x7f4d0406fa40 0x7f4d04071e80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.695+0000 7fb8ddffb640 1 -- 172.21.15.46:0/2991850866 <== osd.6 v2:172.21.15.175:6800/4161180058 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb8e8072040 con 0x7fb8cc06fa90 2024-01-23T08:55:31.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.695+0000 7fb8ee578640 1 -- 172.21.15.46:0/2991850866 >> [v2:172.21.15.175:6800/4161180058,v1:172.21.15.175:6801/4161180058] conn(0x7fb8cc06fa90 msgr2=0x7fb8cc071ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.695+0000 7fb8ee578640 1 --2- 172.21.15.46:0/2991850866 >> [v2:172.21.15.175:6800/4161180058,v1:172.21.15.175:6801/4161180058] conn(0x7fb8cc06fa90 0x7fb8cc071ed0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.695+0000 7fb8ee578640 1 -- 172.21.15.46:0/2991850866 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fb8cc066550 msgr2=0x7fb8cc068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.695+0000 7fb8ee578640 1 --2- 172.21.15.46:0/2991850866 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fb8cc066550 0x7fb8cc068a10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4009690 tx=0x7fb8e4006c00 comp rx=0 tx=0).stop 2024-01-23T08:55:31.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.695+0000 7fb8ee578640 1 -- 172.21.15.46:0/2991850866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e00475b0 msgr2=0x7fb8e00c2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.695+0000 7fb8ee578640 1 --2- 172.21.15.46:0/2991850866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e00475b0 0x7fb8e00c2ff0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb8d800d800 tx=0x7fb8d800dcc0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.695+0000 7fb8edd77640 1 -- 172.21.15.46:0/2991850866 reap_dead start 2024-01-23T08:55:31.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.695+0000 7f4cfffff640 1 -- 172.21.15.46:0/3341098754 <== osd.7 v2:172.21.15.175:6817/2670236415 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4d04072550 con 0x7f4d0406fa40 2024-01-23T08:55:31.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.695+0000 7fb8ee578640 1 -- 172.21.15.46:0/2991850866 shutdown_connections 2024-01-23T08:55:31.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.695+0000 7fb8ee578640 1 -- 172.21.15.46:0/2991850866 >> 172.21.15.46:0/2991850866 conn(0x7fb8e0050a20 msgr2=0x7fb8e00d4710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:31.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.699+0000 7fb8ee578640 1 -- 172.21.15.46:0/2991850866 shutdown_connections 2024-01-23T08:55:31.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.699+0000 7f8e13fff640 1 -- 172.21.15.46:0/1840889569 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c004220 con 0x7f8e2c06fc50 2024-01-23T08:55:31.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.699+0000 7f8e13fff640 1 -- 172.21.15.46:0/1840889569 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1c0043a0 con 0x7f8e2c06fc50 2024-01-23T08:55:31.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.699+0000 7f8e31b9e640 1 -- 172.21.15.46:0/1840889569 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e2c1577f0 con 0x7f8e2c06fc50 2024-01-23T08:55:31.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.699+0000 7f8e13fff640 1 -- 172.21.15.46:0/1840889569 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c004510 con 0x7f8e2c06fc50 2024-01-23T08:55:31.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.699+0000 7f8e31b9e640 1 -- 172.21.15.46:0/1840889569 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2c157db0 con 0x7f8e2c06fc50 2024-01-23T08:55:31.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.699+0000 7f8e31b9e640 1 -- 172.21.15.46:0/1840889569 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8e2c153be0 con 0x7f8e2c06fc50 2024-01-23T08:55:31.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.703+0000 7fb8ee578640 1 -- 172.21.15.46:0/2991850866 wait complete. 2024-01-23T08:55:31.707 INFO:teuthology.orchestra.run.smithi046.stdout:64424509464 2024-01-23T08:55:31.708 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-23T08:55:31.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.711+0000 7fb5f1ea1640 1 -- 172.21.15.46:0/2044500008 --> [v2:172.21.15.175:6816/3146473948,v1:172.21.15.175:6818/3146473948] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb5ec0c59a0 con 0x7fb5d006fa90 2024-01-23T08:55:31.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.711+0000 7fb5e97fa640 1 -- 172.21.15.46:0/2044500008 <== osd.5 v2:172.21.15.175:6816/3146473948 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb5ec0c59a0 con 0x7fb5d006fa90 2024-01-23T08:55:31.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.711+0000 7fb5f1ea1640 1 -- 172.21.15.46:0/2044500008 >> [v2:172.21.15.175:6816/3146473948,v1:172.21.15.175:6818/3146473948] conn(0x7fb5d006fa90 msgr2=0x7fb5d0071ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.711+0000 7fb5f1ea1640 1 --2- 172.21.15.46:0/2044500008 >> [v2:172.21.15.175:6816/3146473948,v1:172.21.15.175:6818/3146473948] conn(0x7fb5d006fa90 0x7fb5d0071ed0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.711+0000 7fb5f1ea1640 1 -- 172.21.15.46:0/2044500008 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fb5d0066550 msgr2=0x7fb5d0068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.711+0000 7fb5f1ea1640 1 --2- 172.21.15.46:0/2044500008 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fb5d0066550 0x7fb5d0068a10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb5e00b2000 tx=0x7fb5e0004740 comp rx=0 tx=0).stop 2024-01-23T08:55:31.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.711+0000 7fb5f1ea1640 1 -- 172.21.15.46:0/2044500008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5ec0c6d90 msgr2=0x7fb5ec151330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.711+0000 7fb5f1ea1640 1 --2- 172.21.15.46:0/2044500008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5ec0c6d90 0x7fb5ec151330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb5d800c400 tx=0x7fb5d800c8c0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.711+0000 7fb5f16a0640 1 -- 172.21.15.46:0/2044500008 reap_dead start 2024-01-23T08:55:31.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.711+0000 7fb5f1ea1640 1 -- 172.21.15.46:0/2044500008 shutdown_connections 2024-01-23T08:55:31.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.711+0000 7fb5f1ea1640 1 -- 172.21.15.46:0/2044500008 >> 172.21.15.46:0/2044500008 conn(0x7fb5ec066b70 msgr2=0x7fb5ec06ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:31.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.711+0000 7fb5f1ea1640 1 -- 172.21.15.46:0/2044500008 shutdown_connections 2024-01-23T08:55:31.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.711+0000 7fb5f1ea1640 1 -- 172.21.15.46:0/2044500008 wait complete. 2024-01-23T08:55:31.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.719+0000 7f8e13fff640 1 -- 172.21.15.46:0/1840889569 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f8e1c007a70 con 0x7f8e2c06fc50 2024-01-23T08:55:31.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.723+0000 7f8e13fff640 1 --2- 172.21.15.46:0/1840889569 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8e18066550 0x7f8e18068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.723+0000 7f8e2affd640 1 --2- 172.21.15.46:0/1840889569 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8e18066550 0x7f8e18068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.723+0000 7f8e2affd640 1 --2- 172.21.15.46:0/1840889569 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8e18066550 0x7f8e18068a10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c0ca650 tx=0x7f8e20006bb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.723+0000 7f8e13fff640 1 -- 172.21.15.46:0/1840889569 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8e1c0558f0 con 0x7f8e2c06fc50 2024-01-23T08:55:31.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.723+0000 7f8e13fff640 1 --2- 172.21.15.46:0/1840889569 >> [v2:172.21.15.175:6803/3115257412,v1:172.21.15.175:6805/3115257412] conn(0x7f8e1806fa90 0x7f8e18071ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.723+0000 7f8e13fff640 1 -- 172.21.15.46:0/1840889569 --> [v2:172.21.15.175:6803/3115257412,v1:172.21.15.175:6805/3115257412] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8e180725a0 con 0x7f8e1806fa90 2024-01-23T08:55:31.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.723+0000 7f8e2bfff640 1 --2- 172.21.15.46:0/1840889569 >> [v2:172.21.15.175:6803/3115257412,v1:172.21.15.175:6805/3115257412] conn(0x7f8e1806fa90 0x7f8e18071ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.727+0000 7f8e2bfff640 1 --2- 172.21.15.46:0/1840889569 >> [v2:172.21.15.175:6803/3115257412,v1:172.21.15.175:6805/3115257412] conn(0x7f8e1806fa90 0x7f8e18071ed0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.727+0000 7f4d1df2b640 1 -- 172.21.15.46:0/3341098754 --> [v2:172.21.15.175:6817/2670236415,v1:172.21.15.175:6819/2670236415] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4d18071fd0 con 0x7f4d0406fa40 2024-01-23T08:55:31.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.727+0000 7f8e13fff640 1 -- 172.21.15.46:0/1840889569 <== osd.4 v2:172.21.15.175:6803/3115257412 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f8e180725a0 con 0x7f8e1806fa90 2024-01-23T08:55:31.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.727+0000 7f4cfffff640 1 -- 172.21.15.46:0/3341098754 <== osd.7 v2:172.21.15.175:6817/2670236415 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4d080b0440 con 0x7f4d0406fa40 2024-01-23T08:55:31.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.727+0000 7f4d1df2b640 1 -- 172.21.15.46:0/3341098754 >> [v2:172.21.15.175:6817/2670236415,v1:172.21.15.175:6819/2670236415] conn(0x7f4d0406fa40 msgr2=0x7f4d04071e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.727+0000 7f4d1df2b640 1 --2- 172.21.15.46:0/3341098754 >> [v2:172.21.15.175:6817/2670236415,v1:172.21.15.175:6819/2670236415] conn(0x7f4d0406fa40 0x7f4d04071e80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.727+0000 7f4d1df2b640 1 -- 172.21.15.46:0/3341098754 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4d04066500 msgr2=0x7f4d040689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.727+0000 7f4d1df2b640 1 --2- 172.21.15.46:0/3341098754 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4d04066500 0x7f4d040689c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4d180ca720 tx=0x7f4d0c009040 comp rx=0 tx=0).stop 2024-01-23T08:55:31.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.727+0000 7f4d1df2b640 1 -- 172.21.15.46:0/3341098754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d18072760 msgr2=0x7f4d181522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.727+0000 7f4d1df2b640 1 --2- 172.21.15.46:0/3341098754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d18072760 0x7f4d181522d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4d1000ba50 tx=0x7f4d1000bf10 comp rx=0 tx=0).stop 2024-01-23T08:55:31.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.727+0000 7f4d17fff640 1 -- 172.21.15.46:0/3341098754 reap_dead start 2024-01-23T08:55:31.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.731+0000 7f4d1df2b640 1 -- 172.21.15.46:0/3341098754 shutdown_connections 2024-01-23T08:55:31.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.731+0000 7f4d1df2b640 1 -- 172.21.15.46:0/3341098754 >> 172.21.15.46:0/3341098754 conn(0x7f4d1806aa60 msgr2=0x7f4d18156bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:31.728 INFO:teuthology.orchestra.run.smithi046.stdout:60129542167 2024-01-23T08:55:31.728 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-23T08:55:31.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.731+0000 7f4d1df2b640 1 -- 172.21.15.46:0/3341098754 shutdown_connections 2024-01-23T08:55:31.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.731+0000 7f4d1df2b640 1 -- 172.21.15.46:0/3341098754 wait complete. 2024-01-23T08:55:31.739 INFO:teuthology.orchestra.run.smithi046.stdout:64424509462 2024-01-23T08:55:31.739 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-23T08:55:31.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.747+0000 7f5098ff9640 1 -- 172.21.15.46:0/3424415637 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f50900b7070 con 0x7f509c06e460 2024-01-23T08:55:31.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.747+0000 7f5098ff9640 1 --2- 172.21.15.46:0/3424415637 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5088066550 0x7f5088068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.747+0000 7f509b7fe640 1 --2- 172.21.15.46:0/3424415637 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5088066550 0x7f5088068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.747+0000 7f509b7fe640 1 --2- 172.21.15.46:0/3424415637 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5088066550 0x7f5088068a10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f509c0cb720 tx=0x7f508c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.751+0000 7f8e31b9e640 1 -- 172.21.15.46:0/1840889569 --> [v2:172.21.15.175:6803/3115257412,v1:172.21.15.175:6805/3115257412] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8e2c1585b0 con 0x7f8e1806fa90 2024-01-23T08:55:31.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.751+0000 7f8e13fff640 1 -- 172.21.15.46:0/1840889569 <== osd.4 v2:172.21.15.175:6803/3115257412 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8e2c1585b0 con 0x7f8e1806fa90 2024-01-23T08:55:31.751 INFO:teuthology.orchestra.run.smithi046.stdout:64424509463 2024-01-23T08:55:31.752 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-23T08:55:31.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.755+0000 7f5098ff9640 1 -- 172.21.15.46:0/3424415637 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f50900f3a00 con 0x7f509c06e460 2024-01-23T08:55:31.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.755+0000 7f5098ff9640 1 --2- 172.21.15.46:0/3424415637 >> [v2:172.21.15.46:6816/2681790976,v1:172.21.15.46:6818/2681790976] conn(0x7f508806fa90 0x7f5088071ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.755+0000 7f5098ff9640 1 -- 172.21.15.46:0/3424415637 --> [v2:172.21.15.46:6816/2681790976,v1:172.21.15.46:6818/2681790976] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f50880725a0 con 0x7f508806fa90 2024-01-23T08:55:31.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.755+0000 7f5098ff9640 1 -- 172.21.15.46:0/3424415637 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50900efd40 con 0x7f509c06e460 2024-01-23T08:55:31.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.755+0000 7f50a0bd3640 1 --2- 172.21.15.46:0/3424415637 >> [v2:172.21.15.46:6816/2681790976,v1:172.21.15.46:6818/2681790976] conn(0x7f508806fa90 0x7f5088071ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.755+0000 7f50a0bd3640 1 --2- 172.21.15.46:0/3424415637 >> [v2:172.21.15.46:6816/2681790976,v1:172.21.15.46:6818/2681790976] conn(0x7f508806fa90 0x7f5088071ed0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.759+0000 7f8e11ffb640 1 -- 172.21.15.46:0/1840889569 >> [v2:172.21.15.175:6803/3115257412,v1:172.21.15.175:6805/3115257412] conn(0x7f8e1806fa90 msgr2=0x7f8e18071ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.759+0000 7f8e11ffb640 1 --2- 172.21.15.46:0/1840889569 >> [v2:172.21.15.175:6803/3115257412,v1:172.21.15.175:6805/3115257412] conn(0x7f8e1806fa90 0x7f8e18071ed0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.759+0000 7f5098ff9640 1 -- 172.21.15.46:0/3424415637 <== osd.0 v2:172.21.15.46:6816/2681790976 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f50880725a0 con 0x7f508806fa90 2024-01-23T08:55:31.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.759+0000 7f8e11ffb640 1 -- 172.21.15.46:0/1840889569 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8e18066550 msgr2=0x7f8e18068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.759+0000 7f8e11ffb640 1 --2- 172.21.15.46:0/1840889569 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8e18066550 0x7f8e18068a10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c0ca650 tx=0x7f8e20006bb0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.759+0000 7f8e11ffb640 1 -- 172.21.15.46:0/1840889569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e2c06fc50 msgr2=0x7f8e2c0c7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.759+0000 7f8e11ffb640 1 --2- 172.21.15.46:0/1840889569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e2c06fc50 0x7f8e2c0c7a50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00c820 tx=0x7f8e1c00cce0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.759+0000 7f8e2bfff640 1 -- 172.21.15.46:0/1840889569 reap_dead start 2024-01-23T08:55:31.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.759+0000 7f8e11ffb640 1 -- 172.21.15.46:0/1840889569 shutdown_connections 2024-01-23T08:55:31.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.759+0000 7f8e11ffb640 1 -- 172.21.15.46:0/1840889569 >> 172.21.15.46:0/1840889569 conn(0x7f8e2c072890 msgr2=0x7f8e2c1509d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:31.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.759+0000 7f8e11ffb640 1 -- 172.21.15.46:0/1840889569 shutdown_connections 2024-01-23T08:55:31.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.759+0000 7f8e11ffb640 1 -- 172.21.15.46:0/1840889569 wait complete. 2024-01-23T08:55:31.787 INFO:teuthology.orchestra.run.smithi046.stdout:64424509461 2024-01-23T08:55:31.787 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-23T08:55:31.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.807+0000 7f50a2636640 1 -- 172.21.15.46:0/3424415637 --> [v2:172.21.15.46:6816/2681790976,v1:172.21.15.46:6818/2681790976] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f509c159cc0 con 0x7f508806fa90 2024-01-23T08:55:31.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.807+0000 7f5098ff9640 1 -- 172.21.15.46:0/3424415637 <== osd.0 v2:172.21.15.46:6816/2681790976 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5094006b20 con 0x7f508806fa90 2024-01-23T08:55:31.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.815+0000 7f50827fc640 1 -- 172.21.15.46:0/3424415637 >> [v2:172.21.15.46:6816/2681790976,v1:172.21.15.46:6818/2681790976] conn(0x7f508806fa90 msgr2=0x7f5088071ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.815+0000 7f50827fc640 1 --2- 172.21.15.46:0/3424415637 >> [v2:172.21.15.46:6816/2681790976,v1:172.21.15.46:6818/2681790976] conn(0x7f508806fa90 0x7f5088071ed0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.815+0000 7f50827fc640 1 -- 172.21.15.46:0/3424415637 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5088066550 msgr2=0x7f5088068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.815+0000 7f50827fc640 1 --2- 172.21.15.46:0/3424415637 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5088066550 0x7f5088068a10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f509c0cb720 tx=0x7f508c008040 comp rx=0 tx=0).stop 2024-01-23T08:55:31.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.815+0000 7f50827fc640 1 -- 172.21.15.46:0/3424415637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f509c06e460 msgr2=0x7f509c1efe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.815+0000 7f50827fc640 1 --2- 172.21.15.46:0/3424415637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f509c06e460 0x7f509c1efe10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f509001c920 tx=0x7f509001ba90 comp rx=0 tx=0).stop 2024-01-23T08:55:31.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.815+0000 7f50a0bd3640 1 -- 172.21.15.46:0/3424415637 reap_dead start 2024-01-23T08:55:31.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.815+0000 7f50827fc640 1 -- 172.21.15.46:0/3424415637 shutdown_connections 2024-01-23T08:55:31.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.815+0000 7f50827fc640 1 -- 172.21.15.46:0/3424415637 >> 172.21.15.46:0/3424415637 conn(0x7f509c06b770 msgr2=0x7f509c0c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:31.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.815+0000 7f50827fc640 1 -- 172.21.15.46:0/3424415637 shutdown_connections 2024-01-23T08:55:31.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.815+0000 7f50827fc640 1 -- 172.21.15.46:0/3424415637 wait complete. 2024-01-23T08:55:31.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.827+0000 7fa8d3c76640 1 Processor -- start 2024-01-23T08:55:31.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.827+0000 7fa8d3c76640 1 -- start start 2024-01-23T08:55:31.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.827+0000 7fa8d3c76640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa8cc0c7890 0x7fa8cc0c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.827+0000 7fa8d3c76640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8cc0c0ac0 0x7fa8cc0c0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.827+0000 7fa8d3c76640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8cc14fe40 con 0x7fa8cc0c1930 2024-01-23T08:55:31.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.827+0000 7fa8d3c76640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8cc0c5d10 con 0x7fa8cc0c7890 2024-01-23T08:55:31.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.827+0000 7fa8d3c76640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc071310 con 0x7fa8cc0c0ac0 2024-01-23T08:55:31.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.843+0000 7f02a09dc640 1 Processor -- start 2024-01-23T08:55:31.842 INFO:teuthology.orchestra.run.smithi046.stdout:64424509462 2024-01-23T08:55:31.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.843+0000 7fa8d1a12640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa8cc0c7890 0x7fa8cc0c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.843+0000 7fa8d1211640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa8cc0c1930 0x7fa8cc14f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35306/0 (socket says 172.21.15.46:35306) 2024-01-23T08:55:31.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.843+0000 7fa8d1211640 1 -- 172.21.15.46:0/508428192 learned_addr learned my addr 172.21.15.46:0/508428192 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:31.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.843+0000 7f02a09dc640 1 -- start start 2024-01-23T08:55:31.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.843+0000 7f02a09dc640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f029c0c5b50 0x7f029c0c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.843+0000 7f02a09dc640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f029c06a660 0x7f029c06aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.843+0000 7f02a09dc640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f029c0c8180 con 0x7f029c14f710 2024-01-23T08:55:31.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.843+0000 7f02a09dc640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f029c06afb0 con 0x7f029c06a660 2024-01-23T08:55:31.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.843+0000 7f02a09dc640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f029c156490 con 0x7f029c0c5b50 2024-01-23T08:55:31.845 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-23T08:55:31.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.847+0000 7f0299d9b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f029c0c5b50 0x7f029c0c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.847+0000 7f0299d9b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f029c0c5b50 0x7f029c0c7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:56358/0 (socket says 172.21.15.46:56358) 2024-01-23T08:55:31.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.847+0000 7f0299d9b640 1 -- 172.21.15.46:0/3362610741 learned_addr learned my addr 172.21.15.46:0/3362610741 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:31.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.851+0000 7f0299d9b640 1 -- 172.21.15.46:0/3362610741 >> v2:172.21.15.46:3300/0 conn(0x7f029c06a660 msgr2=0x7f029c06aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:31.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.851+0000 7f0299d9b640 1 --2- 172.21.15.46:0/3362610741 >> v2:172.21.15.46:3300/0 conn(0x7f029c06a660 0x7f029c06aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.851+0000 7f0299d9b640 1 -- 172.21.15.46:0/3362610741 >> v1:172.21.15.46:6789/0 conn(0x7f029c14f710 legacy=0x7f029c155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:31.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.851+0000 7f0299d9b640 1 -- 172.21.15.46:0/3362610741 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029c1558f0 con 0x7f029c0c5b50 2024-01-23T08:55:31.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.855+0000 7fa8d2213640 1 --2- 172.21.15.46:0/508428192 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8cc0c0ac0 0x7fa8cc0c0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.859+0000 7f0299d9b640 1 --2- 172.21.15.46:0/3362610741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f029c0c5b50 0x7f029c0c7c40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f029c0c8400 tx=0x7f02940206c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb982061928f568a server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.859+0000 7fa8d2213640 1 -- 172.21.15.46:0/508428192 >> v2:172.21.15.46:3300/0 conn(0x7fa8cc0c7890 msgr2=0x7fa8cc0c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:31.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.859+0000 7fa8d2213640 1 --2- 172.21.15.46:0/508428192 >> v2:172.21.15.46:3300/0 conn(0x7fa8cc0c7890 0x7fa8cc0c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.859+0000 7fa8d2213640 1 -- 172.21.15.46:0/508428192 >> v1:172.21.15.46:6789/0 conn(0x7fa8cc0c1930 legacy=0x7fa8cc14f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.859+0000 7fa8d2213640 1 -- 172.21.15.46:0/508428192 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc0724c0 con 0x7fa8cc0c0ac0 2024-01-23T08:55:31.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.867+0000 7f029959a640 1 -- 172.21.15.46:0/3362610741 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02940ae3f0 con 0x7f029c0c5b50 2024-01-23T08:55:31.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.867+0000 7f029959a640 1 -- 172.21.15.46:0/3362610741 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02940ae550 con 0x7f029c0c5b50 2024-01-23T08:55:31.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.867+0000 7f029959a640 1 -- 172.21.15.46:0/3362610741 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02940ae8e0 con 0x7f029c0c5b50 2024-01-23T08:55:31.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.867+0000 7fa8d2213640 1 --2- 172.21.15.46:0/508428192 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8cc0c0ac0 0x7fa8cc0c0f30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4009d90 tx=0x7fa8c401f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad5021fb9a90442a server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.867+0000 7f02a09dc640 1 -- 172.21.15.46:0/3362610741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f029c0c5b50 msgr2=0x7f029c0c7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.867+0000 7f02a09dc640 1 --2- 172.21.15.46:0/3362610741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f029c0c5b50 0x7f029c0c7c40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f029c0c8400 tx=0x7f02940206c0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.867+0000 7f02a09dc640 1 -- 172.21.15.46:0/3362610741 shutdown_connections 2024-01-23T08:55:31.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.867+0000 7f02a09dc640 1 --2- 172.21.15.46:0/3362610741 >> v2:172.21.15.46:3300/0 conn(0x7f029c06a660 0x7f029c06aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.867+0000 7f02a09dc640 1 --2- 172.21.15.46:0/3362610741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f029c0c5b50 0x7f029c0c7c40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.867+0000 7f02a09dc640 1 -- 172.21.15.46:0/3362610741 >> 172.21.15.46:0/3362610741 conn(0x7f029c06d290 msgr2=0x7f029c06e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:31.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.867+0000 7f02a09dc640 1 -- 172.21.15.46:0/3362610741 shutdown_connections 2024-01-23T08:55:31.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.867+0000 7f02a09dc640 1 -- 172.21.15.46:0/3362610741 wait complete. 2024-01-23T08:55:31.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.867+0000 7f02a09dc640 1 Processor -- start 2024-01-23T08:55:31.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.867+0000 7f02a09dc640 1 -- start start 2024-01-23T08:55:31.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.871+0000 7f02a09dc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f029c06a660 0x7f029c149850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.871+0000 7f02a09dc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f029c0c5b50 0x7f029c14a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.871+0000 7f02a09dc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f029c14f710 0x7f029c148110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.871+0000 7f02a09dc640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c1fc920 con 0x7f029c0c5b50 2024-01-23T08:55:31.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.871+0000 7f02a09dc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c147cf0 con 0x7f029c14f710 2024-01-23T08:55:31.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.871+0000 7f02a09dc640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029c1fc380 con 0x7f029c06a660 2024-01-23T08:55:31.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.871+0000 7f029ad9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f029c14f710 0x7f029c148110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.871+0000 7f029ad9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f029c14f710 0x7f029c148110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:56374/0 (socket says 172.21.15.46:56374) 2024-01-23T08:55:31.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.871+0000 7f029ad9d640 1 -- 172.21.15.46:0/76675038 learned_addr learned my addr 172.21.15.46:0/76675038 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:31.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.875+0000 7f029a59c640 1 --2- 172.21.15.46:0/76675038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f029c06a660 0x7f029c149850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.875+0000 7fa8d0a10640 1 -- 172.21.15.46:0/508428192 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c40af600 con 0x7fa8cc0c0ac0 2024-01-23T08:55:31.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.875+0000 7fa8d0a10640 1 -- 172.21.15.46:0/508428192 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c40ab050 con 0x7fa8cc0c0ac0 2024-01-23T08:55:31.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.875+0000 7fa8d0a10640 1 -- 172.21.15.46:0/508428192 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c40af980 con 0x7fa8cc0c0ac0 2024-01-23T08:55:31.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.879+0000 7fa8d3c76640 1 -- 172.21.15.46:0/508428192 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8cc0c0ac0 msgr2=0x7fa8cc0c0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.879+0000 7fa8d3c76640 1 --2- 172.21.15.46:0/508428192 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8cc0c0ac0 0x7fa8cc0c0f30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4009d90 tx=0x7fa8c401f130 comp rx=0 tx=0).stop 2024-01-23T08:55:31.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.879+0000 7fa8d3c76640 1 -- 172.21.15.46:0/508428192 shutdown_connections 2024-01-23T08:55:31.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.879+0000 7fa8d3c76640 1 --2- 172.21.15.46:0/508428192 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8cc0c0ac0 0x7fa8cc0c0f30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.879+0000 7fa8d3c76640 1 --2- 172.21.15.46:0/508428192 >> v2:172.21.15.46:3300/0 conn(0x7fa8cc0c7890 0x7fa8cc0c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.879+0000 7fa8d3c76640 1 -- 172.21.15.46:0/508428192 >> 172.21.15.46:0/508428192 conn(0x7fa8cc06aa60 msgr2=0x7fa8cc06ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:31.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.879+0000 7fa8d3c76640 1 -- 172.21.15.46:0/508428192 shutdown_connections 2024-01-23T08:55:31.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.879+0000 7fa8d3c76640 1 -- 172.21.15.46:0/508428192 wait complete. 2024-01-23T08:55:31.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.879+0000 7f0299d9b640 1 --2- 172.21.15.46:0/76675038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f029c0c5b50 0x7f029c14a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.879+0000 7fa8d3c76640 1 Processor -- start 2024-01-23T08:55:31.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.879+0000 7fa8d3c76640 1 -- start start 2024-01-23T08:55:31.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.879+0000 7fa8d3c76640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8cc0c0ac0 0x7fa8cc1489c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.879+0000 7fa8d3c76640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8cc0c1930 0x7fa8cc06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.879+0000 7fa8d3c76640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8cc0c7890 0x7fa8cc06d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.879+0000 7fa8d3c76640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc159350 con 0x7fa8cc0c0ac0 2024-01-23T08:55:31.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.879+0000 7fa8d3c76640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc0c35f0 con 0x7fa8cc0c1930 2024-01-23T08:55:31.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.879+0000 7fa8d3c76640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc0c38d0 con 0x7fa8cc0c7890 2024-01-23T08:55:31.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.883+0000 7f029ad9d640 1 -- 172.21.15.46:0/76675038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f029c06a660 msgr2=0x7f029c149850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.883+0000 7f029ad9d640 1 --2- 172.21.15.46:0/76675038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f029c06a660 0x7f029c149850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.883+0000 7f029ad9d640 1 -- 172.21.15.46:0/76675038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f029c0c5b50 msgr2=0x7f029c14a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.883+0000 7f029ad9d640 1 --2- 172.21.15.46:0/76675038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f029c0c5b50 0x7f029c14a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.883+0000 7f029ad9d640 1 -- 172.21.15.46:0/76675038 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0294009830 con 0x7f029c14f710 2024-01-23T08:55:31.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.887+0000 7fa8d1211640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8cc0c1930 0x7fa8cc06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.891+0000 7fa8d1a12640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8cc0c0ac0 0x7fa8cc1489c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.891+0000 7f029ad9d640 1 --2- 172.21.15.46:0/76675038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f029c14f710 0x7f029c148110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f029000b430 tx=0x7f029000b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.891+0000 7fa8d1a12640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8cc0c0ac0 0x7fa8cc1489c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37738/0 (socket says 172.21.15.46:37738) 2024-01-23T08:55:31.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.891+0000 7fa8d1a12640 1 -- 172.21.15.46:0/158039536 learned_addr learned my addr 172.21.15.46:0/158039536 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:31.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.899+0000 7fa8d2213640 1 --2- 172.21.15.46:0/158039536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8cc0c7890 0x7fa8cc06d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.903+0000 7fd1cd405640 1 Processor -- start 2024-01-23T08:55:31.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.903+0000 7fd1cd405640 1 -- start start 2024-01-23T08:55:31.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.903+0000 7fd1cd405640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd1c80ca220 0x7fd1c80c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.903+0000 7fd1cd405640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1c80c9a00 0x7fd1c80c5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.903+0000 7fd1cd405640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c80ca8d0 con 0x7fd1c814f990 2024-01-23T08:55:31.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.903+0000 7fd1cd405640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c8156510 con 0x7fd1c80ca220 2024-01-23T08:55:31.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.903+0000 7fd1cd405640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c8072d90 con 0x7fd1c80c9a00 2024-01-23T08:55:31.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.903+0000 7fa8d1a12640 1 -- 172.21.15.46:0/158039536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8cc0c7890 msgr2=0x7fa8cc06d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.903+0000 7fa8d1a12640 1 --2- 172.21.15.46:0/158039536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8cc0c7890 0x7fa8cc06d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.903+0000 7fa8d1a12640 1 -- 172.21.15.46:0/158039536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8cc0c1930 msgr2=0x7fa8cc06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.903+0000 7fa8d1a12640 1 --2- 172.21.15.46:0/158039536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8cc0c1930 0x7fa8cc06cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.903+0000 7fa8d1a12640 1 -- 172.21.15.46:0/158039536 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c4009a70 con 0x7fa8cc0c0ac0 2024-01-23T08:55:31.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.907+0000 7fa8d1a12640 1 --2- 172.21.15.46:0/158039536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8cc0c0ac0 0x7fa8cc1489c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800e930 tx=0x7fa8c800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.911+0000 7f028affd640 1 -- 172.21.15.46:0/76675038 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0290011830 con 0x7f029c14f710 2024-01-23T08:55:31.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.911+0000 7f028affd640 1 -- 172.21.15.46:0/76675038 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0290011990 con 0x7f029c14f710 2024-01-23T08:55:31.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.911+0000 7f028affd640 1 -- 172.21.15.46:0/76675038 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0290011d40 con 0x7f029c14f710 2024-01-23T08:55:31.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.911+0000 7f02a09dc640 1 -- 172.21.15.46:0/76675038 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f029c1fc640 con 0x7f029c14f710 2024-01-23T08:55:31.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.911+0000 7f02a09dc640 1 -- 172.21.15.46:0/76675038 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f029c0c9e90 con 0x7f029c14f710 2024-01-23T08:55:31.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.911+0000 7f02a09dc640 1 -- 172.21.15.46:0/76675038 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f029c147e30 con 0x7f029c14f710 2024-01-23T08:55:31.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.911+0000 7fd1c7fff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd1c814f990 0x7fd1c8072680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.46:39936/0 (socket says 172.21.15.46:39936) 2024-01-23T08:55:31.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.911+0000 7fd1c7fff640 1 -- 172.21.15.46:0/1274260183 learned_addr learned my addr 172.21.15.46:0/1274260183 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:31.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.915+0000 7fd1c77fe640 1 --2- 172.21.15.46:0/1274260183 >> v2:172.21.15.46:3300/0 conn(0x7fd1c80ca220 0x7fd1c80c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.915+0000 7fa8c27fc640 1 -- 172.21.15.46:0/158039536 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8009690 con 0x7fa8cc0c0ac0 2024-01-23T08:55:31.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.915+0000 7fa8c27fc640 1 -- 172.21.15.46:0/158039536 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c800ca00 con 0x7fa8cc0c0ac0 2024-01-23T08:55:31.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.915+0000 7fa8d3c76640 1 -- 172.21.15.46:0/158039536 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8cc0c3bb0 con 0x7fa8cc0c0ac0 2024-01-23T08:55:31.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.915+0000 7fa8d3c76640 1 -- 172.21.15.46:0/158039536 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8cc0c4170 con 0x7fa8cc0c0ac0 2024-01-23T08:55:31.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.915+0000 7fa8c27fc640 1 -- 172.21.15.46:0/158039536 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c800cd70 con 0x7fa8cc0c0ac0 2024-01-23T08:55:31.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.919+0000 7fd1ccc04640 1 --2- 172.21.15.46:0/1274260183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1c80c9a00 0x7fd1c80c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.919+0000 7fa8d3c76640 1 -- 172.21.15.46:0/158039536 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b40052a0 con 0x7fa8cc0c0ac0 2024-01-23T08:55:31.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.919+0000 7fd1c77fe640 1 -- 172.21.15.46:0/1274260183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1c80c9a00 msgr2=0x7fd1c80c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:31.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.919+0000 7fd1c77fe640 1 --2- 172.21.15.46:0/1274260183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1c80c9a00 0x7fd1c80c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.919+0000 7fd1c77fe640 1 -- 172.21.15.46:0/1274260183 >> v1:172.21.15.175:6789/0 conn(0x7fd1c814f990 legacy=0x7fd1c8072680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:31.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.919+0000 7fd1c77fe640 1 -- 172.21.15.46:0/1274260183 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c80ca680 con 0x7fd1c80ca220 2024-01-23T08:55:31.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.923+0000 7fe4214f4640 1 Processor -- start 2024-01-23T08:55:31.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.923+0000 7fe4214f4640 1 -- start start 2024-01-23T08:55:31.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.927+0000 7fe4214f4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4140d6dc0 0x7fe414047340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.927+0000 7fe4214f4640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe414047880 0x7fe41404d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.927+0000 7fe4214f4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4140e0130 con 0x7fe41404d8d0 2024-01-23T08:55:31.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.927+0000 7fe4214f4640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4140e0cc0 con 0x7fe414047880 2024-01-23T08:55:31.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.927+0000 7fe4214f4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe414047c60 con 0x7fe4140d6dc0 2024-01-23T08:55:31.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.927+0000 7fe41bfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4140d6dc0 0x7fe414047340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.927+0000 7fe41bfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4140d6dc0 0x7fe414047340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:45312/0 (socket says 172.21.15.46:45312) 2024-01-23T08:55:31.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.927+0000 7fe41bfff640 1 -- 172.21.15.46:0/1120537084 learned_addr learned my addr 172.21.15.46:0/1120537084 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:31.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.931+0000 7f4468a53640 1 Processor -- start 2024-01-23T08:55:31.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.931+0000 7f4468a53640 1 -- start start 2024-01-23T08:55:31.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.931+0000 7f4468a53640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4464151740 0x7f4464157380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.931+0000 7f4468a53640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44640c7990 0x7f446406feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.931+0000 7f4468a53640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44640c7500 con 0x7f44640c5db0 2024-01-23T08:55:31.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.931+0000 7f4468a53640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f446406f190 con 0x7f4464151740 2024-01-23T08:55:31.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.931+0000 7f4468a53640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4464151b20 con 0x7f44640c7990 2024-01-23T08:55:31.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.935+0000 7fe41bfff640 1 -- 172.21.15.46:0/1120537084 >> v2:172.21.15.46:3300/0 conn(0x7fe414047880 msgr2=0x7fe41404d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:31.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.935+0000 7fe41bfff640 1 --2- 172.21.15.46:0/1120537084 >> v2:172.21.15.46:3300/0 conn(0x7fe414047880 0x7fe41404d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.935+0000 7fe41bfff640 1 -- 172.21.15.46:0/1120537084 >> v1:172.21.15.175:6789/0 conn(0x7fe41404d8d0 legacy=0x7fe4140dcb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:31.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.935+0000 7fe41bfff640 1 -- 172.21.15.46:0/1120537084 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4140dd920 con 0x7fe4140d6dc0 2024-01-23T08:55:31.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.935+0000 7f4462d9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44640c7990 0x7f446406feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.939+0000 7f4462d9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44640c7990 0x7f446406feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:45320/0 (socket says 172.21.15.46:45320) 2024-01-23T08:55:31.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.939+0000 7f4462d9d640 1 -- 172.21.15.46:0/1210635422 learned_addr learned my addr 172.21.15.46:0/1210635422 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:31.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.943+0000 7f4462d9d640 1 -- 172.21.15.46:0/1210635422 >> v2:172.21.15.46:3300/0 conn(0x7f4464151740 msgr2=0x7f4464157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:31.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.943+0000 7f4462d9d640 1 --2- 172.21.15.46:0/1210635422 >> v2:172.21.15.46:3300/0 conn(0x7f4464151740 0x7f4464157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.943+0000 7f4462d9d640 1 -- 172.21.15.46:0/1210635422 >> v1:172.21.15.46:6789/0 conn(0x7f44640c5db0 legacy=0x7f446406ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:31.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.943+0000 7f4462d9d640 1 -- 172.21.15.46:0/1210635422 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44640c7e40 con 0x7f44640c7990 2024-01-23T08:55:31.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.943+0000 7fe41bfff640 1 --2- 172.21.15.46:0/1120537084 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4140d6dc0 0x7fe414047340 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe414047da0 tx=0x7fe41001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b18ea5edd227841e server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.951+0000 7fa8c27fc640 1 -- 172.21.15.46:0/158039536 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa8c8013470 con 0x7fa8cc0c0ac0 2024-01-23T08:55:31.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.951+0000 7fa8c27fc640 1 --2- 172.21.15.46:0/158039536 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa8b0066550 0x7fa8b0068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.951+0000 7fa8d1211640 1 --2- 172.21.15.46:0/158039536 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa8b0066550 0x7fa8b0068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.951+0000 7fa8d1211640 1 --2- 172.21.15.46:0/158039536 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa8b0066550 0x7fa8b0068a10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc0c76a0 tx=0x7fa8bc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.951+0000 7f4462d9d640 1 --2- 172.21.15.46:0/1210635422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44640c7990 0x7f446406feb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f445c009e50 tx=0x7f445c01f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c33be8fa978ce0a9 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:31.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.951+0000 7f22a1f7e640 1 Processor -- start 2024-01-23T08:55:31.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.955+0000 7f22a1f7e640 1 -- start start 2024-01-23T08:55:31.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.955+0000 7f22a1f7e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f229c159bd0 0x7f229c0c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.955+0000 7f22a1f7e640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f229c0c28e0 con 0x7f229c14fc80 2024-01-23T08:55:31.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.955+0000 7f22a1f7e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f229c159740 con 0x7f229c0c46c0 2024-01-23T08:55:31.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.955+0000 7f22a1f7e640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f229c159ff0 con 0x7f229c159bd0 2024-01-23T08:55:31.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.975+0000 7f77dc678640 1 Processor -- start 2024-01-23T08:55:31.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.975+0000 7f77dc678640 1 -- start start 2024-01-23T08:55:31.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.975+0000 7f77dc678640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f77d41536b0 0x7f77d40c7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.975+0000 7f77dc678640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d40c6a90 con 0x7f77d4153a90 2024-01-23T08:55:31.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.975+0000 7f77dc678640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d406e000 con 0x7f77d40c2bc0 2024-01-23T08:55:31.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.975+0000 7f77dc678640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77d40c1330 con 0x7f77d41536b0 2024-01-23T08:55:31.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.975+0000 7f4461d9b640 1 -- 172.21.15.46:0/1210635422 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c0af400 con 0x7f44640c7990 2024-01-23T08:55:31.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.975+0000 7f4461d9b640 1 -- 172.21.15.46:0/1210635422 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445c0ab050 con 0x7f44640c7990 2024-01-23T08:55:31.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.975+0000 7f4461d9b640 1 -- 172.21.15.46:0/1210635422 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c0af780 con 0x7f44640c7990 2024-01-23T08:55:31.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.975+0000 7f4468a53640 1 -- 172.21.15.46:0/1210635422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44640c7990 msgr2=0x7f446406feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.975+0000 7f4468a53640 1 --2- 172.21.15.46:0/1210635422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44640c7990 0x7f446406feb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f445c009e50 tx=0x7f445c01f1c0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.975+0000 7f4468a53640 1 -- 172.21.15.46:0/1210635422 shutdown_connections 2024-01-23T08:55:31.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.975+0000 7f4468a53640 1 --2- 172.21.15.46:0/1210635422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44640c7990 0x7f446406feb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.975+0000 7f4468a53640 1 --2- 172.21.15.46:0/1210635422 >> v2:172.21.15.46:3300/0 conn(0x7f4464151740 0x7f4464157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.975+0000 7f4468a53640 1 -- 172.21.15.46:0/1210635422 >> 172.21.15.46:0/1210635422 conn(0x7f446406b770 msgr2=0x7f446406bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:31.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.975+0000 7f4468a53640 1 -- 172.21.15.46:0/1210635422 shutdown_connections 2024-01-23T08:55:31.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.975+0000 7f4468a53640 1 -- 172.21.15.46:0/1210635422 wait complete. 2024-01-23T08:55:31.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.979+0000 7f4468a53640 1 Processor -- start 2024-01-23T08:55:31.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.979+0000 7f4468a53640 1 -- start start 2024-01-23T08:55:31.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.979+0000 7f4468a53640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44640c5db0 0x7f4464151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.979+0000 7f4468a53640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44640c7990 0x7f44640ae830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.979+0000 7f4468a53640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4464151740 0x7f44640aed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.979+0000 7f4468a53640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44641e6710 con 0x7f4464151740 2024-01-23T08:55:31.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.979+0000 7f4468a53640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4464152230 con 0x7f44640c7990 2024-01-23T08:55:31.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.979+0000 7f4468a53640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44640b0c20 con 0x7f44640c5db0 2024-01-23T08:55:31.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.979+0000 7fe41affd640 1 -- 172.21.15.46:0/1120537084 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4100ac410 con 0x7fe4140d6dc0 2024-01-23T08:55:31.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.979+0000 7fe41affd640 1 -- 172.21.15.46:0/1120537084 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4100ac570 con 0x7fe4140d6dc0 2024-01-23T08:55:31.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.979+0000 7fe41affd640 1 -- 172.21.15.46:0/1120537084 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4100ac900 con 0x7fe4140d6dc0 2024-01-23T08:55:31.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.979+0000 7fe4214f4640 1 -- 172.21.15.46:0/1120537084 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4140d6dc0 msgr2=0x7fe414047340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:31.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.979+0000 7fe4214f4640 1 --2- 172.21.15.46:0/1120537084 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4140d6dc0 0x7fe414047340 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe414047da0 tx=0x7fe41001c4e0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.979+0000 7fe4214f4640 1 -- 172.21.15.46:0/1120537084 shutdown_connections 2024-01-23T08:55:31.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.979+0000 7fe4214f4640 1 --2- 172.21.15.46:0/1120537084 >> v2:172.21.15.46:3300/0 conn(0x7fe414047880 0x7fe41404d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.979+0000 7fe4214f4640 1 --2- 172.21.15.46:0/1120537084 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4140d6dc0 0x7fe414047340 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:31.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.979+0000 7fe4214f4640 1 -- 172.21.15.46:0/1120537084 >> 172.21.15.46:0/1120537084 conn(0x7fe41400e090 msgr2=0x7fe41400e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:31.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.979+0000 7fe4214f4640 1 -- 172.21.15.46:0/1120537084 shutdown_connections 2024-01-23T08:55:31.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.979+0000 7fe4214f4640 1 -- 172.21.15.46:0/1120537084 wait complete. 2024-01-23T08:55:31.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.979+0000 7fe4214f4640 1 Processor -- start 2024-01-23T08:55:31.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.979+0000 7fe4214f4640 1 -- start start 2024-01-23T08:55:31.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.983+0000 7fe4214f4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe414047880 0x7fe4140df0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.983+0000 7fe4214f4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe41404d8d0 0x7fe414179b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.983+0000 7fe4214f4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4140d6dc0 0x7fe4140485a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:31.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.983+0000 7fe4214f4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4140dce30 con 0x7fe414047880 2024-01-23T08:55:31.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.983+0000 7fe4214f4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4141796b0 con 0x7fe41404d8d0 2024-01-23T08:55:31.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.983+0000 7fe4214f4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe414049080 con 0x7fe4140d6dc0 2024-01-23T08:55:31.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.987+0000 7f446259c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44640c5db0 0x7f4464151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.987+0000 7fe420cf3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4140d6dc0 0x7fe4140485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:31.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.987+0000 7f446259c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44640c5db0 0x7f4464151cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:45336/0 (socket says 172.21.15.46:45336) 2024-01-23T08:55:31.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.987+0000 7f446259c640 1 -- 172.21.15.46:0/1266627465 learned_addr learned my addr 172.21.15.46:0/1266627465 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:31.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.991+0000 7fe420cf3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4140d6dc0 0x7fe4140485a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:45352/0 (socket says 172.21.15.46:45352) 2024-01-23T08:55:31.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:31.991+0000 7fe420cf3640 1 -- 172.21.15.46:0/4028877682 learned_addr learned my addr 172.21.15.46:0/4028877682 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:32.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.003+0000 7f446259c640 1 -- 172.21.15.46:0/1266627465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44640c7990 msgr2=0x7f44640ae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:32.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.003+0000 7f446259c640 1 --2- 172.21.15.46:0/1266627465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44640c7990 0x7f44640ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.003+0000 7f446259c640 1 -- 172.21.15.46:0/1266627465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4464151740 msgr2=0x7f44640aed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:32.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.003+0000 7f446259c640 1 --2- 172.21.15.46:0/1266627465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4464151740 0x7f44640aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.003+0000 7f446259c640 1 -- 172.21.15.46:0/1266627465 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c009b30 con 0x7f44640c5db0 2024-01-23T08:55:32.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.003+0000 7f41e527a640 1 Processor -- start 2024-01-23T08:55:32.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.003+0000 7f41e527a640 1 -- start start 2024-01-23T08:55:32.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.007+0000 7f41e527a640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f41e015cdb0 0x7f41e0072200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:32.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.007+0000 7f41e527a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f41e0153170 0x7f41e01535e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:32.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.007+0000 7f41e527a640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e00c3ac0 con 0x7f41e00c7660 2024-01-23T08:55:32.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.007+0000 7f41e527a640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e0072740 con 0x7f41e015cdb0 2024-01-23T08:55:32.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.007+0000 7f41e527a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e0072a00 con 0x7f41e0153170 2024-01-23T08:55:32.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.015+0000 7fe420cf3640 1 -- 172.21.15.46:0/4028877682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe41404d8d0 msgr2=0x7fe414179b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:32.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.015+0000 7fe420cf3640 1 --2- 172.21.15.46:0/4028877682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe41404d8d0 0x7fe414179b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.015+0000 7fe420cf3640 1 -- 172.21.15.46:0/4028877682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe414047880 msgr2=0x7fe4140df0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:32.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.015+0000 7fe420cf3640 1 --2- 172.21.15.46:0/4028877682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe414047880 0x7fe4140df0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.015+0000 7fe420cf3640 1 -- 172.21.15.46:0/4028877682 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe410009480 con 0x7fe4140d6dc0 2024-01-23T08:55:32.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.023+0000 7f446259c640 1 --2- 172.21.15.46:0/1266627465 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44640c5db0 0x7f4464151cf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f444c00b410 tx=0x7f444c00b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:32.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.023+0000 7fe420cf3640 1 --2- 172.21.15.46:0/4028877682 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4140d6dc0 0x7fe4140485a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe41c073760 tx=0x7fe41c04eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:32.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.043+0000 7fe418ff9640 1 -- 172.21.15.46:0/4028877682 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c073ec0 con 0x7fe4140d6dc0 2024-01-23T08:55:32.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.043+0000 7fe418ff9640 1 -- 172.21.15.46:0/4028877682 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41c074020 con 0x7fe4140d6dc0 2024-01-23T08:55:32.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.043+0000 7fe418ff9640 1 -- 172.21.15.46:0/4028877682 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c074470 con 0x7fe4140d6dc0 2024-01-23T08:55:32.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.043+0000 7fe4214f4640 1 -- 172.21.15.46:0/4028877682 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe414179360 con 0x7fe4140d6dc0 2024-01-23T08:55:32.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.043+0000 7fe4214f4640 1 -- 172.21.15.46:0/4028877682 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4140dfa50 con 0x7fe4140d6dc0 2024-01-23T08:55:32.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.047+0000 7f445affd640 1 -- 172.21.15.46:0/1266627465 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c011830 con 0x7f44640c5db0 2024-01-23T08:55:32.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.047+0000 7f445affd640 1 -- 172.21.15.46:0/1266627465 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444c011990 con 0x7f44640c5db0 2024-01-23T08:55:32.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.047+0000 7f445affd640 1 -- 172.21.15.46:0/1266627465 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c011d40 con 0x7f44640c5db0 2024-01-23T08:55:32.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.047+0000 7f4468a53640 1 -- 172.21.15.46:0/1266627465 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44640b0f00 con 0x7f44640c5db0 2024-01-23T08:55:32.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.047+0000 7f4468a53640 1 -- 172.21.15.46:0/1266627465 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44640b14c0 con 0x7f44640c5db0 2024-01-23T08:55:32.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.047+0000 7fe4214f4640 1 -- 172.21.15.46:0/4028877682 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe414035620 con 0x7fe4140d6dc0 2024-01-23T08:55:32.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.047+0000 7f4468a53640 1 -- 172.21.15.46:0/1266627465 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4464074340 con 0x7f44640c5db0 2024-01-23T08:55:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.219+0000 7f028affd640 1 -- 172.21.15.46:0/76675038 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f029001a400 con 0x7f029c14f710 2024-01-23T08:55:32.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.219+0000 7f028affd640 1 --2- 172.21.15.46:0/76675038 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f027c06a920 0x7f027c06cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:32.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.219+0000 7fd1c77fe640 1 --2- 172.21.15.46:0/1274260183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1c80ca220 0x7fd1c80c94c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd1b800a960 tx=0x7fd1b8020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc92bd0f9940229 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:32.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.219+0000 7f029a59c640 1 --2- 172.21.15.46:0/76675038 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f027c06a920 0x7f027c06cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:32.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.219+0000 7f029a59c640 1 --2- 172.21.15.46:0/76675038 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f027c06a920 0x7f027c06cde0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f028c0098e0 tx=0x7f028c009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:32.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.223+0000 7f028affd640 1 -- 172.21.15.46:0/76675038 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f02900553e0 con 0x7f029c14f710 2024-01-23T08:55:32.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.239+0000 7f028affd640 1 -- 172.21.15.46:0/76675038 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f0290051720 con 0x7f029c14f710 2024-01-23T08:55:32.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.247+0000 7f77da414640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f77d41536b0 0x7f77d40c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:32.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.247+0000 7f77da414640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f77d41536b0 0x7f77d40c7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:56390/0 (socket says 172.21.15.46:56390) 2024-01-23T08:55:32.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.247+0000 7f77da414640 1 -- 172.21.15.46:0/1150819402 learned_addr learned my addr 172.21.15.46:0/1150819402 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:32.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.247+0000 7f41df7fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f41e0153170 0x7f41e01535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:32.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.247+0000 7f41df7fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f41e0153170 0x7f41e01535e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:56404/0 (socket says 172.21.15.46:56404) 2024-01-23T08:55:32.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.247+0000 7f41df7fe640 1 -- 172.21.15.46:0/1410179544 learned_addr learned my addr 172.21.15.46:0/1410179544 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:32.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.251+0000 7f229bfff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f229c0c46c0 0x7f229c160390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.46:39946/0 (socket says 172.21.15.46:39946) 2024-01-23T08:55:32.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.251+0000 7f229bfff640 1 -- 172.21.15.46:0/12675712 learned_addr learned my addr 172.21.15.46:0/12675712 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:32.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.255+0000 7fa8c27fc640 1 -- 172.21.15.46:0/158039536 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa8c8055960 con 0x7fa8cc0c0ac0 2024-01-23T08:55:32.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.255+0000 7fa8c27fc640 1 -- 172.21.15.46:0/158039536 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa8c8051ca0 con 0x7fa8cc0c0ac0 2024-01-23T08:55:32.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.263+0000 7f77da414640 1 -- 172.21.15.46:0/1150819402 >> v1:172.21.15.175:6789/0 conn(0x7f77d40c2bc0 legacy=0x7f77d40c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:32.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.263+0000 7f77da414640 1 -- 172.21.15.46:0/1150819402 >> v1:172.21.15.46:6789/0 conn(0x7f77d4153a90 legacy=0x7f77d406ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:32.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.263+0000 7f77da414640 1 -- 172.21.15.46:0/1150819402 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d406e2e0 con 0x7f77d41536b0 2024-01-23T08:55:32.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.267+0000 7f41df7fe640 1 -- 172.21.15.46:0/1410179544 >> v2:172.21.15.46:3300/0 conn(0x7f41e015cdb0 msgr2=0x7f41e0072200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:32.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.267+0000 7f41df7fe640 1 --2- 172.21.15.46:0/1410179544 >> v2:172.21.15.46:3300/0 conn(0x7f41e015cdb0 0x7f41e0072200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.267+0000 7f41df7fe640 1 -- 172.21.15.46:0/1410179544 >> v1:172.21.15.46:6789/0 conn(0x7f41e00c7660 legacy=0x7f41e015d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:32.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.267+0000 7f41df7fe640 1 -- 172.21.15.46:0/1410179544 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e00c68a0 con 0x7f41e0153170 2024-01-23T08:55:32.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.271+0000 7fd1c6ffd640 1 -- 172.21.15.46:0/1274260183 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b80a9dd0 con 0x7fd1c80ca220 2024-01-23T08:55:32.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.271+0000 7fd1c6ffd640 1 -- 172.21.15.46:0/1274260183 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b80b1440 con 0x7fd1c80ca220 2024-01-23T08:55:32.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.271+0000 7fd1c6ffd640 1 -- 172.21.15.46:0/1274260183 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b80b17d0 con 0x7fd1c80ca220 2024-01-23T08:55:32.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.271+0000 7fd1cd405640 1 -- 172.21.15.46:0/1274260183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1c80ca220 msgr2=0x7fd1c80c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:32.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.271+0000 7fd1cd405640 1 --2- 172.21.15.46:0/1274260183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1c80ca220 0x7fd1c80c94c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd1b800a960 tx=0x7fd1b8020000 comp rx=0 tx=0).stop 2024-01-23T08:55:32.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.271+0000 7fd1cd405640 1 -- 172.21.15.46:0/1274260183 shutdown_connections 2024-01-23T08:55:32.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.271+0000 7fd1cd405640 1 --2- 172.21.15.46:0/1274260183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1c80c9a00 0x7fd1c80c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.271+0000 7fd1cd405640 1 --2- 172.21.15.46:0/1274260183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1c80ca220 0x7fd1c80c94c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.271+0000 7fd1cd405640 1 -- 172.21.15.46:0/1274260183 >> 172.21.15.46:0/1274260183 conn(0x7fd1c806d490 msgr2=0x7fd1c806e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:32.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.271+0000 7fd1cd405640 1 -- 172.21.15.46:0/1274260183 shutdown_connections 2024-01-23T08:55:32.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.271+0000 7f229affd640 1 --2- 172.21.15.46:0/12675712 >> v2:172.21.15.46:3300/0 conn(0x7f229c159bd0 0x7f229c0c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:32.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.271+0000 7fd1cd405640 1 -- 172.21.15.46:0/1274260183 wait complete. 2024-01-23T08:55:32.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.271+0000 7fd1cd405640 1 Processor -- start 2024-01-23T08:55:32.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.271+0000 7fd1cd405640 1 -- start start 2024-01-23T08:55:32.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.271+0000 7fd1cd405640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1c80c9a00 0x7fd1c8152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:32.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.271+0000 7fd1cd405640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1c80ca220 0x7fd1c81fc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:32.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.271+0000 7fd1cd405640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1c814f990 0x7fd1c81ddc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:32.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.271+0000 7fd1cd405640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c81fce00 con 0x7fd1c80ca220 2024-01-23T08:55:32.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.271+0000 7fd1cd405640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c81debc0 con 0x7fd1c80c9a00 2024-01-23T08:55:32.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.271+0000 7fd1cd405640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c81deea0 con 0x7fd1c814f990 2024-01-23T08:55:32.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.275+0000 7f41df7fe640 1 --2- 172.21.15.46:0/1410179544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41e0153170 0x7f41e01535e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f41e0066cc0 tx=0x7f41d801c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2fc087fb537c061 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:32.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.275+0000 7f229affd640 1 -- 172.21.15.46:0/12675712 >> v1:172.21.15.175:6789/0 conn(0x7f229c0c46c0 legacy=0x7f229c160390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:32.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.275+0000 7f229affd640 1 -- 172.21.15.46:0/12675712 >> v1:172.21.15.46:6789/0 conn(0x7f229c14fc80 legacy=0x7f229c0c7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:32.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.275+0000 7f229affd640 1 -- 172.21.15.46:0/12675712 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229c0c7c20 con 0x7f229c159bd0 2024-01-23T08:55:32.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.279+0000 7f77da414640 1 --2- 172.21.15.46:0/1150819402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77d41536b0 0x7f77d40c7280 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f77d0009870 tx=0x7f77d001ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce38de7ab64ca4a server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:32.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.283+0000 7f229affd640 1 --2- 172.21.15.46:0/12675712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f229c159bd0 0x7f229c0c5de0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f22900097c0 tx=0x7f229001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=622c8208a7699ce7 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:32.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.287+0000 7fd1c77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1c80ca220 0x7fd1c81fc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:32.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.291+0000 7fd1c77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1c80ca220 0x7fd1c81fc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37790/0 (socket says 172.21.15.46:37790) 2024-01-23T08:55:32.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.291+0000 7fd1c77fe640 1 -- 172.21.15.46:0/3489245096 learned_addr learned my addr 172.21.15.46:0/3489245096 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:32.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.291+0000 7fd1c7fff640 1 --2- 172.21.15.46:0/3489245096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1c80c9a00 0x7fd1c8152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:32.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.299+0000 7fd1c77fe640 1 -- 172.21.15.46:0/3489245096 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1c814f990 msgr2=0x7fd1c81ddc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:32.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.299+0000 7fd1c77fe640 1 --2- 172.21.15.46:0/3489245096 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1c814f990 0x7fd1c81ddc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.299+0000 7fd1c77fe640 1 -- 172.21.15.46:0/3489245096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1c80c9a00 msgr2=0x7fd1c8152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:32.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.299+0000 7fd1c77fe640 1 --2- 172.21.15.46:0/3489245096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1c80c9a00 0x7fd1c8152e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.299+0000 7fd1c77fe640 1 -- 172.21.15.46:0/3489245096 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b800a5c0 con 0x7fd1c80ca220 2024-01-23T08:55:32.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.307+0000 7f229a7fc640 1 -- 172.21.15.46:0/12675712 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2290004230 con 0x7f229c159bd0 2024-01-23T08:55:32.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.307+0000 7f229a7fc640 1 -- 172.21.15.46:0/12675712 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22900a7050 con 0x7f229c159bd0 2024-01-23T08:55:32.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.307+0000 7f229a7fc640 1 -- 172.21.15.46:0/12675712 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2290003620 con 0x7f229c159bd0 2024-01-23T08:55:32.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.307+0000 7f22a1f7e640 1 -- 172.21.15.46:0/12675712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f229c159bd0 msgr2=0x7f229c0c5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:32.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.307+0000 7f22a1f7e640 1 --2- 172.21.15.46:0/12675712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f229c159bd0 0x7f229c0c5de0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f22900097c0 tx=0x7f229001c460 comp rx=0 tx=0).stop 2024-01-23T08:55:32.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.307+0000 7fd1c77fe640 1 --2- 172.21.15.46:0/3489245096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1c80ca220 0x7fd1c81fc8c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd1b801e6b0 tx=0x7fd1b801cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:32.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.307+0000 7f22a1f7e640 1 -- 172.21.15.46:0/12675712 shutdown_connections 2024-01-23T08:55:32.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.307+0000 7f22a1f7e640 1 --2- 172.21.15.46:0/12675712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f229c159bd0 0x7f229c0c5de0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.307+0000 7f22a1f7e640 1 -- 172.21.15.46:0/12675712 >> 172.21.15.46:0/12675712 conn(0x7f229c0cb3e0 msgr2=0x7f229c0cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:32.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.307+0000 7f22a1f7e640 1 -- 172.21.15.46:0/12675712 shutdown_connections 2024-01-23T08:55:32.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.307+0000 7f22a1f7e640 1 -- 172.21.15.46:0/12675712 wait complete. 2024-01-23T08:55:32.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.307+0000 7f41ddffb640 1 -- 172.21.15.46:0/1410179544 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d80a5820 con 0x7f41e0153170 2024-01-23T08:55:32.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.307+0000 7f41ddffb640 1 -- 172.21.15.46:0/1410179544 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d80a5980 con 0x7f41e0153170 2024-01-23T08:55:32.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.307+0000 7f41ddffb640 1 -- 172.21.15.46:0/1410179544 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d80a5d10 con 0x7f41e0153170 2024-01-23T08:55:32.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f22a1f7e640 1 Processor -- start 2024-01-23T08:55:32.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f41e527a640 1 -- 172.21.15.46:0/1410179544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41e0153170 msgr2=0x7f41e01535e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:32.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f41e527a640 1 --2- 172.21.15.46:0/1410179544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41e0153170 0x7f41e01535e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f41e0066cc0 tx=0x7f41d801c960 comp rx=0 tx=0).stop 2024-01-23T08:55:32.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f41e527a640 1 -- 172.21.15.46:0/1410179544 shutdown_connections 2024-01-23T08:55:32.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f41e527a640 1 --2- 172.21.15.46:0/1410179544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41e0153170 0x7f41e01535e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f41e527a640 1 --2- 172.21.15.46:0/1410179544 >> v2:172.21.15.46:3300/0 conn(0x7f41e015cdb0 0x7f41e0072200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f41e527a640 1 -- 172.21.15.46:0/1410179544 >> 172.21.15.46:0/1410179544 conn(0x7f41e00cb3e0 msgr2=0x7f41e00cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:32.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f22a1f7e640 1 -- start start 2024-01-23T08:55:32.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f22a1f7e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f229c0c46c0 0x7f229c1572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:32.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f22a1f7e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f229c14fc80 0x7f229c0c1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:32.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f22a1f7e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f229c159bd0 0x7f229c0c1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:32.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f22a1f7e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229c1582a0 con 0x7f229c0c46c0 2024-01-23T08:55:32.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f22a1f7e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229c0cb050 con 0x7f229c159bd0 2024-01-23T08:55:32.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f22a1f7e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f229c0bf870 con 0x7f229c14fc80 2024-01-23T08:55:32.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f41e527a640 1 -- 172.21.15.46:0/1410179544 shutdown_connections 2024-01-23T08:55:32.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f41e527a640 1 -- 172.21.15.46:0/1410179544 wait complete. 2024-01-23T08:55:32.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f77d9412640 1 -- 172.21.15.46:0/1150819402 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d00a89f0 con 0x7f77d41536b0 2024-01-23T08:55:32.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f77d9412640 1 -- 172.21.15.46:0/1150819402 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d00a8b50 con 0x7f77d41536b0 2024-01-23T08:55:32.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f77d9412640 1 -- 172.21.15.46:0/1150819402 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d00b0440 con 0x7f77d41536b0 2024-01-23T08:55:32.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f77dc678640 1 -- 172.21.15.46:0/1150819402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77d41536b0 msgr2=0x7f77d40c7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:32.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f77dc678640 1 --2- 172.21.15.46:0/1150819402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77d41536b0 0x7f77d40c7280 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f77d0009870 tx=0x7f77d001ecf0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f41e527a640 1 Processor -- start 2024-01-23T08:55:32.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f41e527a640 1 -- start start 2024-01-23T08:55:32.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f77dc678640 1 -- 172.21.15.46:0/1150819402 shutdown_connections 2024-01-23T08:55:32.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f77dc678640 1 --2- 172.21.15.46:0/1150819402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77d41536b0 0x7f77d40c7280 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f77dc678640 1 -- 172.21.15.46:0/1150819402 >> 172.21.15.46:0/1150819402 conn(0x7f77d406b770 msgr2=0x7f77d406bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:32.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f77dc678640 1 -- 172.21.15.46:0/1150819402 shutdown_connections 2024-01-23T08:55:32.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f77dc678640 1 -- 172.21.15.46:0/1150819402 wait complete. 2024-01-23T08:55:32.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f229b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f229c0c46c0 0x7f229c1572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:32.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f229b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f229c0c46c0 0x7f229c1572f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37802/0 (socket says 172.21.15.46:37802) 2024-01-23T08:55:32.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f229b7fe640 1 -- 172.21.15.46:0/4163113529 learned_addr learned my addr 172.21.15.46:0/4163113529 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:32.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f41e527a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41e00c7660 0x7f41e0144dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:32.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f41e527a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41e0153170 0x7f41e0157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:32.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.311+0000 7f41e527a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41e015cdb0 0x7f41e0145a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:32.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.315+0000 7f41e527a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e0147a00 con 0x7f41e015cdb0 2024-01-23T08:55:32.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.315+0000 7f41e527a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e01f2ab0 con 0x7f41e00c7660 2024-01-23T08:55:32.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.315+0000 7f41e527a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e0147720 con 0x7f41e0153170 2024-01-23T08:55:32.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.315+0000 7fd1c4ff9640 1 -- 172.21.15.46:0/3489245096 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b80b1da0 con 0x7fd1c80ca220 2024-01-23T08:55:32.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.315+0000 7fd1c4ff9640 1 -- 172.21.15.46:0/3489245096 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b80ba410 con 0x7fd1c80ca220 2024-01-23T08:55:32.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.315+0000 7fd1c4ff9640 1 -- 172.21.15.46:0/3489245096 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b80ba7c0 con 0x7fd1c80ca220 2024-01-23T08:55:32.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.315+0000 7fd1cd405640 1 -- 172.21.15.46:0/3489245096 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c81df180 con 0x7fd1c80ca220 2024-01-23T08:55:32.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.315+0000 7fd1cd405640 1 -- 172.21.15.46:0/3489245096 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c81df740 con 0x7fd1c80ca220 2024-01-23T08:55:32.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.315+0000 7f229bfff640 1 --2- 172.21.15.46:0/4163113529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f229c159bd0 0x7f229c0c1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:32.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.315+0000 7f77dc678640 1 Processor -- start 2024-01-23T08:55:32.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.315+0000 7f77dc678640 1 -- start start 2024-01-23T08:55:32.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.315+0000 7f77dc678640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77d40c2bc0 0x7f77d414eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:32.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.315+0000 7f77dc678640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77d41536b0 0x7f77d40cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:32.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.315+0000 7f77dc678640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77d414faa0 0x7f77d40cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:32.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.315+0000 7f77dc678640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d41fcc20 con 0x7f77d414faa0 2024-01-23T08:55:32.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.315+0000 7f77dc678640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d414f6a0 con 0x7f77d41536b0 2024-01-23T08:55:32.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.315+0000 7f77dc678640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d41fbfe0 con 0x7f77d40c2bc0 2024-01-23T08:55:32.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.315+0000 7fd1cd405640 1 -- 172.21.15.46:0/3489245096 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a80052a0 con 0x7fd1c80ca220 2024-01-23T08:55:32.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.319+0000 7f41deffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41e00c7660 0x7f41e0144dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:32.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.319+0000 7f77d9c13640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77d41536b0 0x7f77d40cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:32.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.319+0000 7f77d9c13640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77d41536b0 0x7f77d40cacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:56452/0 (socket says 172.21.15.46:56452) 2024-01-23T08:55:32.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.319+0000 7f77d9c13640 1 -- 172.21.15.46:0/1070155819 learned_addr learned my addr 172.21.15.46:0/1070155819 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:32.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.327+0000 7f41deffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41e00c7660 0x7f41e0144dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:56438/0 (socket says 172.21.15.46:56438) 2024-01-23T08:55:32.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.327+0000 7f41deffd640 1 -- 172.21.15.46:0/2401940126 learned_addr learned my addr 172.21.15.46:0/2401940126 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:32.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.335+0000 7f229bfff640 1 -- 172.21.15.46:0/4163113529 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f229c14fc80 msgr2=0x7f229c0c1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:32.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.335+0000 7f229bfff640 1 --2- 172.21.15.46:0/4163113529 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f229c14fc80 0x7f229c0c1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.335+0000 7f229bfff640 1 -- 172.21.15.46:0/4163113529 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f229c0c46c0 msgr2=0x7f229c1572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:32.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.335+0000 7f229bfff640 1 --2- 172.21.15.46:0/4163113529 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f229c0c46c0 0x7f229c1572f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.335+0000 7f229bfff640 1 -- 172.21.15.46:0/4163113529 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2290009420 con 0x7f229c159bd0 2024-01-23T08:55:32.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.339+0000 7f77d9c13640 1 -- 172.21.15.46:0/1070155819 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77d40c2bc0 msgr2=0x7f77d414eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:32.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.339+0000 7f77d9c13640 1 --2- 172.21.15.46:0/1070155819 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77d40c2bc0 0x7f77d414eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.339+0000 7f77d9c13640 1 -- 172.21.15.46:0/1070155819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77d414faa0 msgr2=0x7f77d40cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:32.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.339+0000 7f77d9c13640 1 --2- 172.21.15.46:0/1070155819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77d414faa0 0x7f77d40cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.339+0000 7f77d9c13640 1 -- 172.21.15.46:0/1070155819 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d00094d0 con 0x7f77d41536b0 2024-01-23T08:55:32.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.359+0000 7f41deffd640 1 -- 172.21.15.46:0/2401940126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41e0153170 msgr2=0x7f41e0157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:32.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.359+0000 7f41deffd640 1 --2- 172.21.15.46:0/2401940126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41e0153170 0x7f41e0157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.359+0000 7f41deffd640 1 -- 172.21.15.46:0/2401940126 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41e015cdb0 msgr2=0x7f41e0145a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:32.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.359+0000 7f41deffd640 1 --2- 172.21.15.46:0/2401940126 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41e015cdb0 0x7f41e0145a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.359+0000 7f41deffd640 1 -- 172.21.15.46:0/2401940126 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d8009b30 con 0x7f41e00c7660 2024-01-23T08:55:32.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.367+0000 7f77d9c13640 1 --2- 172.21.15.46:0/1070155819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77d41536b0 0x7f77d40cacc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f77c400b410 tx=0x7f77c400b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:32.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.367+0000 7f229bfff640 1 --2- 172.21.15.46:0/4163113529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f229c159bd0 0x7f229c0c1890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f229400ca70 tx=0x7f229400cf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:32.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.375+0000 7f41deffd640 1 --2- 172.21.15.46:0/2401940126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41e00c7660 0x7f41e0144dc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f41d400b410 tx=0x7f41d400b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:32.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.395+0000 7f2283fff640 1 -- 172.21.15.46:0/4163113529 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229400ab70 con 0x7f229c159bd0 2024-01-23T08:55:32.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.395+0000 7f2283fff640 1 -- 172.21.15.46:0/4163113529 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229400acd0 con 0x7f229c159bd0 2024-01-23T08:55:32.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.395+0000 7f22a1f7e640 1 -- 172.21.15.46:0/4163113529 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f229c1584b0 con 0x7f229c159bd0 2024-01-23T08:55:32.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.395+0000 7f2283fff640 1 -- 172.21.15.46:0/4163113529 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294012620 con 0x7f229c159bd0 2024-01-23T08:55:32.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.395+0000 7f22a1f7e640 1 -- 172.21.15.46:0/4163113529 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f229c158a70 con 0x7f229c159bd0 2024-01-23T08:55:32.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.395+0000 7f22a1f7e640 1 -- 172.21.15.46:0/4163113529 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f229c074340 con 0x7f229c159bd0 2024-01-23T08:55:32.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.399+0000 7f41c77fe640 1 -- 172.21.15.46:0/2401940126 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d4011830 con 0x7f41e00c7660 2024-01-23T08:55:32.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.399+0000 7f41c77fe640 1 -- 172.21.15.46:0/2401940126 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d4011990 con 0x7f41e00c7660 2024-01-23T08:55:32.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.399+0000 7f41c77fe640 1 -- 172.21.15.46:0/2401940126 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d4011d40 con 0x7f41e00c7660 2024-01-23T08:55:32.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.399+0000 7f41e527a640 1 -- 172.21.15.46:0/2401940126 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e01f1cf0 con 0x7f41e00c7660 2024-01-23T08:55:32.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.399+0000 7f41e527a640 1 -- 172.21.15.46:0/2401940126 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e01f22b0 con 0x7f41e00c7660 2024-01-23T08:55:32.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.399+0000 7f41e527a640 1 -- 172.21.15.46:0/2401940126 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e0074340 con 0x7f41e00c7660 2024-01-23T08:55:32.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.451+0000 7fa8d3c76640 1 -- 172.21.15.46:0/158039536 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa8b4005820 con 0x7fa8cc0c0ac0 2024-01-23T08:55:32.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.463+0000 7f02a09dc640 1 -- 172.21.15.46:0/76675038 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f029c147e30 con 0x7f029c14f710 2024-01-23T08:55:32.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.599+0000 7fd1c4ff9640 1 -- 172.21.15.46:0/3489245096 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd1b80b8040 con 0x7fd1c80ca220 2024-01-23T08:55:32.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.603+0000 7fd1c4ff9640 1 --2- 172.21.15.46:0/3489245096 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd1b4066580 0x7fd1b4068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:32.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.603+0000 7fd1c7fff640 1 --2- 172.21.15.46:0/3489245096 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd1b4066580 0x7fd1b4068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:32.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.603+0000 7fd1c7fff640 1 --2- 172.21.15.46:0/3489245096 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd1b4066580 0x7fd1b4068a40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc00ac80 tx=0x7fd1bc00a210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:32.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.603+0000 7fe418ff9640 1 -- 172.21.15.46:0/4028877682 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fe41c090070 con 0x7fe4140d6dc0 2024-01-23T08:55:32.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.603+0000 7fe418ff9640 1 --2- 172.21.15.46:0/4028877682 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fe400066550 0x7fe400068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:32.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.603+0000 7fe41bfff640 1 --2- 172.21.15.46:0/4028877682 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fe400066550 0x7fe400068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:32.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.607+0000 7fe41bfff640 1 --2- 172.21.15.46:0/4028877682 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fe400066550 0x7fe400068a10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe4100ae000 tx=0x7fe410004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:32.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.611+0000 7fe418ff9640 1 -- 172.21.15.46:0/4028877682 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe41c0cf640 con 0x7fe4140d6dc0 2024-01-23T08:55:32.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.623+0000 7fe418ff9640 1 -- 172.21.15.46:0/4028877682 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fe41c0cb980 con 0x7fe4140d6dc0 2024-01-23T08:55:32.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.643+0000 7fd1c4ff9640 1 -- 172.21.15.46:0/3489245096 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd1b80f3be0 con 0x7fd1c80ca220 2024-01-23T08:55:32.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.651+0000 7fd1c4ff9640 1 -- 172.21.15.46:0/3489245096 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd1b80ef820 con 0x7fd1c80ca220 2024-01-23T08:55:32.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.659+0000 7f445affd640 1 -- 172.21.15.46:0/1266627465 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f444c01a400 con 0x7f44640c5db0 2024-01-23T08:55:32.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.659+0000 7f445affd640 1 --2- 172.21.15.46:0/1266627465 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4444066550 0x7f4444068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:32.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.659+0000 7f445bfff640 1 --2- 172.21.15.46:0/1266627465 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4444066550 0x7f4444068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:32.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.659+0000 7f445bfff640 1 --2- 172.21.15.46:0/1266627465 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4444066550 0x7f4444068a10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4454007fd0 tx=0x7f44540079a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:32.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.667+0000 7f445affd640 1 -- 172.21.15.46:0/1266627465 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f444c055c80 con 0x7f44640c5db0 2024-01-23T08:55:32.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.679+0000 7fa8c27fc640 1 -- 172.21.15.46:0/158039536 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa8c8021020 con 0x7fa8cc0c0ac0 2024-01-23T08:55:32.677 INFO:teuthology.orchestra.run.smithi046.stdout:64424509461 2024-01-23T08:55:32.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.683+0000 7fa8d3c76640 1 -- 172.21.15.46:0/158039536 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa8b0066550 msgr2=0x7fa8b0068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:32.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.683+0000 7fa8d3c76640 1 --2- 172.21.15.46:0/158039536 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa8b0066550 0x7fa8b0068a10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc0c76a0 tx=0x7fa8bc009040 comp rx=0 tx=0).stop 2024-01-23T08:55:32.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.683+0000 7fa8d3c76640 1 -- 172.21.15.46:0/158039536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8cc0c0ac0 msgr2=0x7fa8cc1489c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:32.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.683+0000 7fa8d3c76640 1 --2- 172.21.15.46:0/158039536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8cc0c0ac0 0x7fa8cc1489c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800e930 tx=0x7fa8c800edf0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.683+0000 7fa8d3c76640 1 -- 172.21.15.46:0/158039536 shutdown_connections 2024-01-23T08:55:32.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.683+0000 7fa8d3c76640 1 --2- 172.21.15.46:0/158039536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8cc0c7890 0x7fa8cc06d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.683+0000 7fa8d3c76640 1 --2- 172.21.15.46:0/158039536 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa8b0066550 0x7fa8b0068a10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.683+0000 7fa8d3c76640 1 --2- 172.21.15.46:0/158039536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8cc0c1930 0x7fa8cc06cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.683+0000 7fa8d3c76640 1 --2- 172.21.15.46:0/158039536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa8cc0c0ac0 0x7fa8cc1489c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.683+0000 7fa8d3c76640 1 -- 172.21.15.46:0/158039536 >> 172.21.15.46:0/158039536 conn(0x7fa8cc06aa60 msgr2=0x7fa8cc0c6be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:32.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.683+0000 7fa8d3c76640 1 -- 172.21.15.46:0/158039536 shutdown_connections 2024-01-23T08:55:32.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.683+0000 7fa8d3c76640 1 -- 172.21.15.46:0/158039536 wait complete. 2024-01-23T08:55:32.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.703+0000 7f445affd640 1 -- 172.21.15.46:0/1266627465 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f444c0518c0 con 0x7f44640c5db0 2024-01-23T08:55:32.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.703+0000 7f77caffd640 1 -- 172.21.15.46:0/1070155819 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c4011830 con 0x7f77d41536b0 2024-01-23T08:55:32.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.703+0000 7f77caffd640 1 -- 172.21.15.46:0/1070155819 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c4011990 con 0x7f77d41536b0 2024-01-23T08:55:32.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.703+0000 7f77caffd640 1 -- 172.21.15.46:0/1070155819 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c4011d40 con 0x7f77d41536b0 2024-01-23T08:55:32.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.703+0000 7f77dc678640 1 -- 172.21.15.46:0/1070155819 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d414f3e0 con 0x7f77d41536b0 2024-01-23T08:55:32.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.703+0000 7f77dc678640 1 -- 172.21.15.46:0/1070155819 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d41fc560 con 0x7f77d41536b0 2024-01-23T08:55:32.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.703+0000 7f77dc678640 1 -- 172.21.15.46:0/1070155819 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d41fcd60 con 0x7f77d41536b0 2024-01-23T08:55:32.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509462 got 64424509461 for osd.1 2024-01-23T08:55:32.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.803+0000 7fe4214f4640 1 -- 172.21.15.46:0/4028877682 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe414179820 con 0x7fe4140d6dc0 2024-01-23T08:55:32.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.855+0000 7fd1cd405640 1 -- 172.21.15.46:0/3489245096 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd1a8005820 con 0x7fd1c80ca220 2024-01-23T08:55:32.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.863+0000 7fd1c4ff9640 1 -- 172.21.15.46:0/3489245096 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd1b80b6090 con 0x7fd1c80ca220 2024-01-23T08:55:32.860 INFO:teuthology.orchestra.run.smithi046.stdout:64424509463 2024-01-23T08:55:32.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.863+0000 7fe418ff9640 1 -- 172.21.15.46:0/4028877682 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe41c0cefa0 con 0x7fe4140d6dc0 2024-01-23T08:55:32.862 INFO:teuthology.orchestra.run.smithi046.stdout:64424509461 2024-01-23T08:55:32.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.867+0000 7fd1cd405640 1 -- 172.21.15.46:0/3489245096 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd1b4066580 msgr2=0x7fd1b4068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:32.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.867+0000 7fd1cd405640 1 --2- 172.21.15.46:0/3489245096 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd1b4066580 0x7fd1b4068a40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc00ac80 tx=0x7fd1bc00a210 comp rx=0 tx=0).stop 2024-01-23T08:55:32.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.867+0000 7fd1cd405640 1 -- 172.21.15.46:0/3489245096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1c80ca220 msgr2=0x7fd1c81fc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:32.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.867+0000 7fd1cd405640 1 --2- 172.21.15.46:0/3489245096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1c80ca220 0x7fd1c81fc8c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd1b801e6b0 tx=0x7fd1b801cda0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.867+0000 7fd1cd405640 1 -- 172.21.15.46:0/3489245096 shutdown_connections 2024-01-23T08:55:32.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.867+0000 7fd1cd405640 1 --2- 172.21.15.46:0/3489245096 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1c814f990 0x7fd1c81ddc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.867+0000 7fd1cd405640 1 --2- 172.21.15.46:0/3489245096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1c80ca220 0x7fd1c81fc8c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.867+0000 7fd1cd405640 1 --2- 172.21.15.46:0/3489245096 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd1b4066580 0x7fd1b4068a40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.867+0000 7fd1cd405640 1 --2- 172.21.15.46:0/3489245096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1c80c9a00 0x7fd1c8152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.867+0000 7fd1cd405640 1 -- 172.21.15.46:0/3489245096 >> 172.21.15.46:0/3489245096 conn(0x7fd1c806d490 msgr2=0x7fd1c81e3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:32.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.867+0000 7fd1cd405640 1 -- 172.21.15.46:0/3489245096 shutdown_connections 2024-01-23T08:55:32.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.867+0000 7fd1cd405640 1 -- 172.21.15.46:0/3489245096 wait complete. 2024-01-23T08:55:32.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.867+0000 7fe4214f4640 1 -- 172.21.15.46:0/4028877682 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fe400066550 msgr2=0x7fe400068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:32.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.867+0000 7fe4214f4640 1 --2- 172.21.15.46:0/4028877682 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fe400066550 0x7fe400068a10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe4100ae000 tx=0x7fe410004740 comp rx=0 tx=0).stop 2024-01-23T08:55:32.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.867+0000 7fe4214f4640 1 -- 172.21.15.46:0/4028877682 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4140d6dc0 msgr2=0x7fe4140485a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:32.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.867+0000 7fe4214f4640 1 --2- 172.21.15.46:0/4028877682 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4140d6dc0 0x7fe4140485a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe41c073760 tx=0x7fe41c04eef0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.867+0000 7fe4214f4640 1 -- 172.21.15.46:0/4028877682 shutdown_connections 2024-01-23T08:55:32.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.867+0000 7fe4214f4640 1 --2- 172.21.15.46:0/4028877682 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4140d6dc0 0x7fe4140485a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.867+0000 7fe4214f4640 1 --2- 172.21.15.46:0/4028877682 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fe400066550 0x7fe400068a10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.867+0000 7fe4214f4640 1 --2- 172.21.15.46:0/4028877682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe41404d8d0 0x7fe414179b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.867+0000 7fe4214f4640 1 --2- 172.21.15.46:0/4028877682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe414047880 0x7fe4140df0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.867+0000 7fe4214f4640 1 -- 172.21.15.46:0/4028877682 >> 172.21.15.46:0/4028877682 conn(0x7fe41400e090 msgr2=0x7fe4140d58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:32.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.867+0000 7fe4214f4640 1 -- 172.21.15.46:0/4028877682 shutdown_connections 2024-01-23T08:55:32.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.867+0000 7fe4214f4640 1 -- 172.21.15.46:0/4028877682 wait complete. 2024-01-23T08:55:32.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509464 got 64424509463 for osd.3 2024-01-23T08:55:32.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509462 got 64424509461 for osd.5 2024-01-23T08:55:32.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.919+0000 7f4468a53640 1 -- 172.21.15.46:0/1266627465 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f44640709f0 con 0x7f44640c5db0 2024-01-23T08:55:32.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.927+0000 7f445affd640 1 -- 172.21.15.46:0/1266627465 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f444c015020 con 0x7f44640c5db0 2024-01-23T08:55:32.925 INFO:teuthology.orchestra.run.smithi046.stdout:60129542165 2024-01-23T08:55:32.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.927+0000 7f4468a53640 1 -- 172.21.15.46:0/1266627465 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4444066550 msgr2=0x7f4444068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:32.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.927+0000 7f4468a53640 1 --2- 172.21.15.46:0/1266627465 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4444066550 0x7f4444068a10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4454007fd0 tx=0x7f44540079a0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.927+0000 7f4468a53640 1 -- 172.21.15.46:0/1266627465 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44640c5db0 msgr2=0x7f4464151cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:32.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.927+0000 7f4468a53640 1 --2- 172.21.15.46:0/1266627465 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44640c5db0 0x7f4464151cf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f444c00b410 tx=0x7f444c00b8d0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.927+0000 7f4468a53640 1 -- 172.21.15.46:0/1266627465 shutdown_connections 2024-01-23T08:55:32.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.927+0000 7f4468a53640 1 --2- 172.21.15.46:0/1266627465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4464151740 0x7f44640aed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.927+0000 7f4468a53640 1 --2- 172.21.15.46:0/1266627465 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4444066550 0x7f4444068a10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.927+0000 7f4468a53640 1 --2- 172.21.15.46:0/1266627465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44640c7990 0x7f44640ae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.927+0000 7f4468a53640 1 --2- 172.21.15.46:0/1266627465 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44640c5db0 0x7f4464151cf0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:32.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.927+0000 7f4468a53640 1 -- 172.21.15.46:0/1266627465 >> 172.21.15.46:0/1266627465 conn(0x7f446406b770 msgr2=0x7f44640c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:32.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.931+0000 7f4468a53640 1 -- 172.21.15.46:0/1266627465 shutdown_connections 2024-01-23T08:55:32.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.931+0000 7f4468a53640 1 -- 172.21.15.46:0/1266627465 wait complete. 2024-01-23T08:55:32.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.939+0000 7f2283fff640 1 -- 172.21.15.46:0/4163113529 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2294007070 con 0x7f229c159bd0 2024-01-23T08:55:32.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.939+0000 7f2283fff640 1 --2- 172.21.15.46:0/4163113529 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f2288066530 0x7f22880689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:32.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.939+0000 7f229b7fe640 1 --2- 172.21.15.46:0/4163113529 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f2288066530 0x7f22880689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:32.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.939+0000 7f229b7fe640 1 --2- 172.21.15.46:0/4163113529 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f2288066530 0x7f22880689f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f228c001960 tx=0x7f228c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:32.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.943+0000 7f2283fff640 1 -- 172.21.15.46:0/4163113529 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f22940550b0 con 0x7f229c159bd0 2024-01-23T08:55:32.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542167 got 60129542165 for osd.6 2024-01-23T08:55:32.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.955+0000 7f41c77fe640 1 -- 172.21.15.46:0/2401940126 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f41d401a400 con 0x7f41e00c7660 2024-01-23T08:55:32.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.955+0000 7f41c77fe640 1 --2- 172.21.15.46:0/2401940126 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f41cc066550 0x7f41cc068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:32.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.955+0000 7f41de7fc640 1 --2- 172.21.15.46:0/2401940126 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f41cc066550 0x7f41cc068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:32.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:32.955+0000 7f41de7fc640 1 --2- 172.21.15.46:0/2401940126 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f41cc066550 0x7f41cc068a10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f41d0007fd0 tx=0x7f41d00079a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:33.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.035+0000 7f41c77fe640 1 -- 172.21.15.46:0/2401940126 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f41d4055cb0 con 0x7f41e00c7660 2024-01-23T08:55:33.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.063+0000 7f41c77fe640 1 -- 172.21.15.46:0/2401940126 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f41d40518f0 con 0x7f41e00c7660 2024-01-23T08:55:33.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.067+0000 7f028affd640 1 -- 172.21.15.46:0/76675038 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f029c147e30 con 0x7f029c14f710 2024-01-23T08:55:33.065 INFO:teuthology.orchestra.run.smithi046.stdout:64424509462 2024-01-23T08:55:33.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.067+0000 7f02a09dc640 1 -- 172.21.15.46:0/76675038 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f027c06a920 msgr2=0x7f027c06cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:33.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.067+0000 7f02a09dc640 1 --2- 172.21.15.46:0/76675038 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f027c06a920 0x7f027c06cde0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f028c0098e0 tx=0x7f028c009060 comp rx=0 tx=0).stop 2024-01-23T08:55:33.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.067+0000 7f02a09dc640 1 -- 172.21.15.46:0/76675038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f029c14f710 msgr2=0x7f029c148110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:33.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.067+0000 7f02a09dc640 1 --2- 172.21.15.46:0/76675038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f029c14f710 0x7f029c148110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f029000b430 tx=0x7f029000b8f0 comp rx=0 tx=0).stop 2024-01-23T08:55:33.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.071+0000 7f02a09dc640 1 -- 172.21.15.46:0/76675038 shutdown_connections 2024-01-23T08:55:33.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.071+0000 7f02a09dc640 1 --2- 172.21.15.46:0/76675038 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f027c06a920 0x7f027c06cde0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:33.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.071+0000 7f02a09dc640 1 --2- 172.21.15.46:0/76675038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f029c14f710 0x7f029c148110 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:33.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.071+0000 7f02a09dc640 1 --2- 172.21.15.46:0/76675038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f029c0c5b50 0x7f029c14a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:33.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.071+0000 7f02a09dc640 1 --2- 172.21.15.46:0/76675038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f029c06a660 0x7f029c149850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:33.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.071+0000 7f02a09dc640 1 -- 172.21.15.46:0/76675038 >> 172.21.15.46:0/76675038 conn(0x7f029c06d290 msgr2=0x7f029c0c7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:33.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.071+0000 7f02a09dc640 1 -- 172.21.15.46:0/76675038 shutdown_connections 2024-01-23T08:55:33.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.071+0000 7f02a09dc640 1 -- 172.21.15.46:0/76675038 wait complete. 2024-01-23T08:55:33.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509463 got 64424509462 for osd.2 2024-01-23T08:55:33.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.099+0000 7f2283fff640 1 -- 172.21.15.46:0/4163113529 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f22940513f0 con 0x7f229c159bd0 2024-01-23T08:55:33.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.235+0000 7f41e527a640 1 -- 172.21.15.46:0/2401940126 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f41e00c41e0 con 0x7f41e00c7660 2024-01-23T08:55:33.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.283+0000 7f22a1f7e640 1 -- 172.21.15.46:0/4163113529 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f229c06bec0 con 0x7f229c159bd0 2024-01-23T08:55:33.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.559+0000 7f77caffd640 1 -- 172.21.15.46:0/1070155819 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f77c401a400 con 0x7f77d41536b0 2024-01-23T08:55:33.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.559+0000 7f77caffd640 1 --2- 172.21.15.46:0/1070155819 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f77b8066550 0x7f77b8068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:33.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.559+0000 7f77da414640 1 --2- 172.21.15.46:0/1070155819 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f77b8066550 0x7f77b8068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:33.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.559+0000 7f77da414640 1 --2- 172.21.15.46:0/1070155819 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f77b8066550 0x7f77b8068a10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f77d00b2000 tx=0x7f77d0004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:33.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.563+0000 7f77caffd640 1 -- 172.21.15.46:0/1070155819 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f77c400f2e0 con 0x7f77d41536b0 2024-01-23T08:55:33.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.603+0000 7f77caffd640 1 -- 172.21.15.46:0/1070155819 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f77c4051720 con 0x7f77d41536b0 2024-01-23T08:55:33.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.623+0000 7f2283fff640 1 -- 172.21.15.46:0/4163113529 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2294017030 con 0x7f229c159bd0 2024-01-23T08:55:33.620 INFO:teuthology.orchestra.run.smithi046.stdout:64424509462 2024-01-23T08:55:33.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.627+0000 7f22a1f7e640 1 -- 172.21.15.46:0/4163113529 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f2288066530 msgr2=0x7f22880689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:33.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.627+0000 7f22a1f7e640 1 --2- 172.21.15.46:0/4163113529 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f2288066530 0x7f22880689f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f228c001960 tx=0x7f228c009040 comp rx=0 tx=0).stop 2024-01-23T08:55:33.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.627+0000 7f22a1f7e640 1 -- 172.21.15.46:0/4163113529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f229c159bd0 msgr2=0x7f229c0c1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:33.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.627+0000 7f22a1f7e640 1 --2- 172.21.15.46:0/4163113529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f229c159bd0 0x7f229c0c1890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f229400ca70 tx=0x7f229400cf30 comp rx=0 tx=0).stop 2024-01-23T08:55:33.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.627+0000 7f22a1f7e640 1 -- 172.21.15.46:0/4163113529 shutdown_connections 2024-01-23T08:55:33.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.627+0000 7f22a1f7e640 1 --2- 172.21.15.46:0/4163113529 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f2288066530 0x7f22880689f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:33.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.627+0000 7f22a1f7e640 1 --2- 172.21.15.46:0/4163113529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f229c159bd0 0x7f229c0c1890 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:33.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.627+0000 7f22a1f7e640 1 --2- 172.21.15.46:0/4163113529 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f229c14fc80 0x7f229c0c1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:33.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.627+0000 7f22a1f7e640 1 --2- 172.21.15.46:0/4163113529 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f229c0c46c0 0x7f229c1572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:33.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.627+0000 7f22a1f7e640 1 -- 172.21.15.46:0/4163113529 >> 172.21.15.46:0/4163113529 conn(0x7f229c0cb3e0 msgr2=0x7f229c066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:33.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.627+0000 7f22a1f7e640 1 -- 172.21.15.46:0/4163113529 shutdown_connections 2024-01-23T08:55:33.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.627+0000 7f22a1f7e640 1 -- 172.21.15.46:0/4163113529 wait complete. 2024-01-23T08:55:33.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.631+0000 7f41c77fe640 1 -- 172.21.15.46:0/2401940126 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f41d4015070 con 0x7f41e00c7660 2024-01-23T08:55:33.631 INFO:teuthology.orchestra.run.smithi046.stdout:64424509461 2024-01-23T08:55:33.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.635+0000 7f41e527a640 1 -- 172.21.15.46:0/2401940126 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f41cc066550 msgr2=0x7f41cc068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:33.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.635+0000 7f41e527a640 1 --2- 172.21.15.46:0/2401940126 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f41cc066550 0x7f41cc068a10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f41d0007fd0 tx=0x7f41d00079a0 comp rx=0 tx=0).stop 2024-01-23T08:55:33.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.635+0000 7f41e527a640 1 -- 172.21.15.46:0/2401940126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41e00c7660 msgr2=0x7f41e0144dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:33.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.635+0000 7f41e527a640 1 --2- 172.21.15.46:0/2401940126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41e00c7660 0x7f41e0144dc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f41d400b410 tx=0x7f41d400b8d0 comp rx=0 tx=0).stop 2024-01-23T08:55:33.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.635+0000 7f41e527a640 1 -- 172.21.15.46:0/2401940126 shutdown_connections 2024-01-23T08:55:33.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.635+0000 7f41e527a640 1 --2- 172.21.15.46:0/2401940126 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41e015cdb0 0x7f41e0145a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:33.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.635+0000 7f41e527a640 1 --2- 172.21.15.46:0/2401940126 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41e0153170 0x7f41e0157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:33.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.635+0000 7f41e527a640 1 --2- 172.21.15.46:0/2401940126 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f41cc066550 0x7f41cc068a10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:33.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.635+0000 7f41e527a640 1 --2- 172.21.15.46:0/2401940126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41e00c7660 0x7f41e0144dc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:33.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.635+0000 7f41e527a640 1 -- 172.21.15.46:0/2401940126 >> 172.21.15.46:0/2401940126 conn(0x7f41e00cb3e0 msgr2=0x7f41e015d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:33.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.635+0000 7f41e527a640 1 -- 172.21.15.46:0/2401940126 shutdown_connections 2024-01-23T08:55:33.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.635+0000 7f41e527a640 1 -- 172.21.15.46:0/2401940126 wait complete. 2024-01-23T08:55:33.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509463 got 64424509462 for osd.7 2024-01-23T08:55:33.656 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509462 got 64424509461 for osd.0 2024-01-23T08:55:33.705 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-23T08:55:33.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.795+0000 7f77dc678640 1 -- 172.21.15.46:0/1070155819 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f77d41fcd60 con 0x7f77d41536b0 2024-01-23T08:55:33.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.835+0000 7f366c631640 1 Processor -- start 2024-01-23T08:55:33.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.835+0000 7f366c631640 1 -- start start 2024-01-23T08:55:33.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.835+0000 7f366c631640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3664151740 0x7f3664157380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:33.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.835+0000 7f366c631640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f36640c5db0 0x7f36640c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:33.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.835+0000 7f366c631640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f366406ea80 0x7f366406feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:33.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.835+0000 7f366c631640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36640c7ed0 con 0x7f36640c5db0 2024-01-23T08:55:33.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.835+0000 7f366c631640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36640c7500 con 0x7f3664151740 2024-01-23T08:55:33.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.835+0000 7f366c631640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3664151b20 con 0x7f366406ea80 2024-01-23T08:55:33.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.871+0000 7f3669bcc640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f36640c5db0 0x7f36640c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:33.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.871+0000 7f3669bcc640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f36640c5db0 0x7f36640c7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54618/0 (socket says 172.21.15.46:54618) 2024-01-23T08:55:33.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.871+0000 7f3669bcc640 1 -- 172.21.15.46:0/3969025043 learned_addr learned my addr 172.21.15.46:0/3969025043 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:33.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.875+0000 7f3669bcc640 1 -- 172.21.15.46:0/3969025043 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f366406ea80 msgr2=0x7f366406feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:33.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.875+0000 7f3669bcc640 1 --2- 172.21.15.46:0/3969025043 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f366406ea80 0x7f366406feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:33.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.875+0000 7f3669bcc640 1 -- 172.21.15.46:0/3969025043 >> v2:172.21.15.175:3300/0 conn(0x7f3664151740 msgr2=0x7f3664157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:33.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.875+0000 7f3669bcc640 1 --2- 172.21.15.46:0/3969025043 >> v2:172.21.15.175:3300/0 conn(0x7f3664151740 0x7f3664157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:33.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.875+0000 7f3669bcc640 1 -- 172.21.15.46:0/3969025043 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36640c8d40 con 0x7f36640c5db0 2024-01-23T08:55:33.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.879+0000 7f3669bcc640 1 --2- 172.21.15.46:0/3969025043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36640c5db0 0x7f36640c7990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f36640c88d0 tx=0x7f365801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2afc7a019fcae3 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:33.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.887+0000 7f36693cb640 1 -- 172.21.15.46:0/3969025043 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36580a89b0 con 0x7f36640c5db0 2024-01-23T08:55:33.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.887+0000 7f36693cb640 1 -- 172.21.15.46:0/3969025043 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36580a8b10 con 0x7f36640c5db0 2024-01-23T08:55:33.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.887+0000 7f36693cb640 1 -- 172.21.15.46:0/3969025043 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36580a8ea0 con 0x7f36640c5db0 2024-01-23T08:55:33.883 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-23T08:55:33.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.887+0000 7f366c631640 1 -- 172.21.15.46:0/3969025043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36640c5db0 msgr2=0x7f36640c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:33.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.887+0000 7f366c631640 1 --2- 172.21.15.46:0/3969025043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36640c5db0 0x7f36640c7990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f36640c88d0 tx=0x7f365801ecf0 comp rx=0 tx=0).stop 2024-01-23T08:55:33.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.887+0000 7f366c631640 1 -- 172.21.15.46:0/3969025043 shutdown_connections 2024-01-23T08:55:33.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.887+0000 7f366c631640 1 --2- 172.21.15.46:0/3969025043 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f366406ea80 0x7f366406feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:33.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.887+0000 7f366c631640 1 --2- 172.21.15.46:0/3969025043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36640c5db0 0x7f36640c7990 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:33.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.887+0000 7f366c631640 1 --2- 172.21.15.46:0/3969025043 >> v2:172.21.15.175:3300/0 conn(0x7f3664151740 0x7f3664157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:33.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.887+0000 7f366c631640 1 -- 172.21.15.46:0/3969025043 >> 172.21.15.46:0/3969025043 conn(0x7f366406b770 msgr2=0x7f366406bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:33.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.887+0000 7f366c631640 1 -- 172.21.15.46:0/3969025043 shutdown_connections 2024-01-23T08:55:33.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.887+0000 7f366c631640 1 -- 172.21.15.46:0/3969025043 wait complete. 2024-01-23T08:55:33.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.887+0000 7f366c631640 1 Processor -- start 2024-01-23T08:55:33.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.887+0000 7f366c631640 1 -- start start 2024-01-23T08:55:33.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.887+0000 7f366c631640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f366406ea80 0x7f3664156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:33.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.887+0000 7f366c631640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36640c5db0 0x7f3664150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:33.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.887+0000 7f366c631640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3664151740 0x7f36641f24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:33.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.887+0000 7f366c631640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36640ad470 con 0x7f366406ea80 2024-01-23T08:55:33.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.887+0000 7f366c631640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36640ac880 con 0x7f3664151740 2024-01-23T08:55:33.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.887+0000 7f366c631640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36641575e0 con 0x7f36640c5db0 2024-01-23T08:55:33.888 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-23T08:55:33.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.891+0000 7f366a3cd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f366406ea80 0x7f3664156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:33.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.891+0000 7f366a3cd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f366406ea80 0x7f3664156f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54630/0 (socket says 172.21.15.46:54630) 2024-01-23T08:55:33.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.891+0000 7f366a3cd640 1 -- 172.21.15.46:0/502185236 learned_addr learned my addr 172.21.15.46:0/502185236 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:33.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.899+0000 7f366a3cd640 1 -- 172.21.15.46:0/502185236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36640c5db0 msgr2=0x7f3664150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:33.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.899+0000 7f366a3cd640 1 --2- 172.21.15.46:0/502185236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36640c5db0 0x7f3664150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:33.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.899+0000 7f366a3cd640 1 -- 172.21.15.46:0/502185236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3664151740 msgr2=0x7f36641f24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:33.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.899+0000 7f366a3cd640 1 --2- 172.21.15.46:0/502185236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3664151740 0x7f36641f24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:33.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.899+0000 7f366a3cd640 1 -- 172.21.15.46:0/502185236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36580094d0 con 0x7f366406ea80 2024-01-23T08:55:33.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.903+0000 7f366a3cd640 1 --2- 172.21.15.46:0/502185236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f366406ea80 0x7f3664156f50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f365c00b550 tx=0x7f365c00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:33.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.911+0000 7f77caffd640 1 -- 172.21.15.46:0/1070155819 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f77d41fcd60 con 0x7f77d41536b0 2024-01-23T08:55:33.908 INFO:teuthology.orchestra.run.smithi046.stdout:64424509460 2024-01-23T08:55:33.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.911+0000 7f3662ffd640 1 -- 172.21.15.46:0/502185236 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c010870 con 0x7f366406ea80 2024-01-23T08:55:33.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.911+0000 7f3662ffd640 1 -- 172.21.15.46:0/502185236 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365c0109f0 con 0x7f366406ea80 2024-01-23T08:55:33.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.911+0000 7f366c631640 1 -- 172.21.15.46:0/502185236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36640acad0 con 0x7f366406ea80 2024-01-23T08:55:33.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.911+0000 7f3662ffd640 1 -- 172.21.15.46:0/502185236 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c010da0 con 0x7f366406ea80 2024-01-23T08:55:33.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.911+0000 7f366c631640 1 -- 172.21.15.46:0/502185236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36640ad090 con 0x7f366406ea80 2024-01-23T08:55:33.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.911+0000 7f366c631640 1 -- 172.21.15.46:0/502185236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36640c4020 con 0x7f366406ea80 2024-01-23T08:55:33.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.915+0000 7f77dc678640 1 -- 172.21.15.46:0/1070155819 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f77b8066550 msgr2=0x7f77b8068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:33.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.915+0000 7f77dc678640 1 --2- 172.21.15.46:0/1070155819 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f77b8066550 0x7f77b8068a10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f77d00b2000 tx=0x7f77d0004740 comp rx=0 tx=0).stop 2024-01-23T08:55:33.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.915+0000 7f77dc678640 1 -- 172.21.15.46:0/1070155819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77d41536b0 msgr2=0x7f77d40cacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:33.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.915+0000 7f77dc678640 1 --2- 172.21.15.46:0/1070155819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77d41536b0 0x7f77d40cacc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f77c400b410 tx=0x7f77c400b8d0 comp rx=0 tx=0).stop 2024-01-23T08:55:33.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.915+0000 7f77dc678640 1 -- 172.21.15.46:0/1070155819 shutdown_connections 2024-01-23T08:55:33.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.915+0000 7f77dc678640 1 --2- 172.21.15.46:0/1070155819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77d414faa0 0x7f77d40cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:33.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.915+0000 7f77dc678640 1 --2- 172.21.15.46:0/1070155819 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f77b8066550 0x7f77b8068a10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:33.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.915+0000 7f77dc678640 1 --2- 172.21.15.46:0/1070155819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77d41536b0 0x7f77d40cacc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:33.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.915+0000 7f77dc678640 1 --2- 172.21.15.46:0/1070155819 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77d40c2bc0 0x7f77d414eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:33.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.915+0000 7f77dc678640 1 -- 172.21.15.46:0/1070155819 >> 172.21.15.46:0/1070155819 conn(0x7f77d406b770 msgr2=0x7f77d40cbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:33.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.915+0000 7f77dc678640 1 -- 172.21.15.46:0/1070155819 shutdown_connections 2024-01-23T08:55:33.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.915+0000 7f77dc678640 1 -- 172.21.15.46:0/1070155819 wait complete. 2024-01-23T08:55:33.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509461 got 64424509460 for osd.4 2024-01-23T08:55:33.944 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-23T08:55:33.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.951+0000 7f3662ffd640 1 -- 172.21.15.46:0/502185236 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f365c023480 con 0x7f366406ea80 2024-01-23T08:55:33.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.951+0000 7f3662ffd640 1 --2- 172.21.15.46:0/502185236 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3650066550 0x7f3650068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:33.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.951+0000 7f3669bcc640 1 --2- 172.21.15.46:0/502185236 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3650066550 0x7f3650068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:33.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:33.951+0000 7f3669bcc640 1 --2- 172.21.15.46:0/502185236 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3650066550 0x7f3650068a10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f36580b2000 tx=0x7f3658004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:34.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.019+0000 7faaf713a640 1 Processor -- start 2024-01-23T08:55:34.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.019+0000 7faaf713a640 1 -- start start 2024-01-23T08:55:34.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.019+0000 7faaf713a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7faaf00c2e00 0x7faaf00c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.019+0000 7faaf713a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaf006e460 0x7faaf015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.019+0000 7faaf713a640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaf0156a20 con 0x7faaf0150500 2024-01-23T08:55:34.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.019+0000 7faaf713a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaf0156d00 con 0x7faaf00c2e00 2024-01-23T08:55:34.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.019+0000 7faaf713a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf0156fe0 con 0x7faaf006e460 2024-01-23T08:55:34.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.023+0000 7faaeffff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7faaf00c2e00 0x7faaf00c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:34.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.023+0000 7faaf56d7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaf006e460 0x7faaf015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:34.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.023+0000 7faaeffff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7faaf00c2e00 0x7faaf00c5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:56336/0 (socket says 172.21.15.46:56336) 2024-01-23T08:55:34.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.023+0000 7faaeffff640 1 -- 172.21.15.46:0/3929864986 learned_addr learned my addr 172.21.15.46:0/3929864986 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:34.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.031+0000 7faaeffff640 1 -- 172.21.15.46:0/3929864986 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaf006e460 msgr2=0x7faaf015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:34.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.031+0000 7faaeffff640 1 --2- 172.21.15.46:0/3929864986 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaf006e460 0x7faaf015a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.031+0000 7faaeffff640 1 -- 172.21.15.46:0/3929864986 >> v1:172.21.15.46:6789/0 conn(0x7faaf0150500 legacy=0x7faaf0156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:34.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.031+0000 7faaeffff640 1 -- 172.21.15.46:0/3929864986 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf01599e0 con 0x7faaf00c2e00 2024-01-23T08:55:34.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.035+0000 7faaeffff640 1 --2- 172.21.15.46:0/3929864986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaf00c2e00 0x7faaf00c5f20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faaf00c3240 tx=0x7faae001ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4af5cc64f2a617af server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:34.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.043+0000 7fd2ebfa0640 1 Processor -- start 2024-01-23T08:55:34.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.043+0000 7fd2ebfa0640 1 -- start start 2024-01-23T08:55:34.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.043+0000 7fd2ebfa0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd2e4150500 0x7fd2e40c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.043+0000 7fd2ebfa0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd2e40c2e00 0x7fd2e4156250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.043+0000 7fd2ebfa0640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e4156790 con 0x7fd2e406e460 2024-01-23T08:55:34.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.043+0000 7fd2ebfa0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e4156a20 con 0x7fd2e40c2e00 2024-01-23T08:55:34.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.043+0000 7fd2ebfa0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e4156d00 con 0x7fd2e4150500 2024-01-23T08:55:34.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.047+0000 7fd2e9d3c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd2e4150500 0x7fd2e40c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:34.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.047+0000 7fd2e9d3c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd2e4150500 0x7fd2e40c5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:46516/0 (socket says 172.21.15.46:46516) 2024-01-23T08:55:34.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.047+0000 7fd2e9d3c640 1 -- 172.21.15.46:0/1635775143 learned_addr learned my addr 172.21.15.46:0/1635775143 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:34.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.047+0000 7faaef7fe640 1 -- 172.21.15.46:0/3929864986 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae00a8990 con 0x7faaf00c2e00 2024-01-23T08:55:34.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.047+0000 7faaef7fe640 1 -- 172.21.15.46:0/3929864986 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae00a8af0 con 0x7faaf00c2e00 2024-01-23T08:55:34.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.047+0000 7faaef7fe640 1 -- 172.21.15.46:0/3929864986 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae00a8e80 con 0x7faaf00c2e00 2024-01-23T08:55:34.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.047+0000 7fd2e953b640 1 --2- 172.21.15.46:0/1635775143 >> v2:172.21.15.175:3300/0 conn(0x7fd2e40c2e00 0x7fd2e4156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:34.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.047+0000 7faaf713a640 1 -- 172.21.15.46:0/3929864986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaf00c2e00 msgr2=0x7faaf00c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:34.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.047+0000 7faaf713a640 1 --2- 172.21.15.46:0/3929864986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaf00c2e00 0x7faaf00c5f20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faaf00c3240 tx=0x7faae001ecd0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.047+0000 7faaf713a640 1 -- 172.21.15.46:0/3929864986 shutdown_connections 2024-01-23T08:55:34.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.047+0000 7faaf713a640 1 --2- 172.21.15.46:0/3929864986 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaf006e460 0x7faaf015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.047+0000 7faaf713a640 1 --2- 172.21.15.46:0/3929864986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaf00c2e00 0x7faaf00c5f20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.047+0000 7faaf713a640 1 -- 172.21.15.46:0/3929864986 >> 172.21.15.46:0/3929864986 conn(0x7faaf006b770 msgr2=0x7faaf006bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:34.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.047+0000 7faaf713a640 1 -- 172.21.15.46:0/3929864986 shutdown_connections 2024-01-23T08:55:34.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.047+0000 7faaf713a640 1 -- 172.21.15.46:0/3929864986 wait complete. 2024-01-23T08:55:34.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.051+0000 7faaf713a640 1 Processor -- start 2024-01-23T08:55:34.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.051+0000 7faaf713a640 1 -- start start 2024-01-23T08:55:34.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.051+0000 7faaf713a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaf006e460 0x7faaf0145740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.051+0000 7faaf713a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faaf00c2e00 0x7faaf0155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.051+0000 7faaf713a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaf0150500 0x7faaf00c4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.051+0000 7faaf713a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf0146170 con 0x7faaf00c2e00 2024-01-23T08:55:34.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.051+0000 7faaf713a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf00c5430 con 0x7faaf006e460 2024-01-23T08:55:34.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.051+0000 7faaf713a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf00c3be0 con 0x7faaf0150500 2024-01-23T08:55:34.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.051+0000 7fd2e9d3c640 1 -- 172.21.15.46:0/1635775143 >> v2:172.21.15.175:3300/0 conn(0x7fd2e40c2e00 msgr2=0x7fd2e4156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:34.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.051+0000 7fd2e9d3c640 1 --2- 172.21.15.46:0/1635775143 >> v2:172.21.15.175:3300/0 conn(0x7fd2e40c2e00 0x7fd2e4156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.051+0000 7fd2e9d3c640 1 -- 172.21.15.46:0/1635775143 >> v1:172.21.15.46:6789/0 conn(0x7fd2e406e460 legacy=0x7fd2e415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:34.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.051+0000 7fd2e9d3c640 1 -- 172.21.15.46:0/1635775143 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e4156fe0 con 0x7fd2e4150500 2024-01-23T08:55:34.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.059+0000 7faaf56d7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaf0150500 0x7faaf00c4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:34.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.059+0000 7fd2e9d3c640 1 --2- 172.21.15.46:0/1635775143 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd2e4150500 0x7fd2e40c5f20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd2e000bb10 tx=0x7fd2e00213c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a830e0fd214539d8 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:34.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.063+0000 7faaf4ed6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaf006e460 0x7faaf0145740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:34.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.067+0000 7faaf4ed6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaf006e460 0x7faaf0145740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:56352/0 (socket says 172.21.15.46:56352) 2024-01-23T08:55:34.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.067+0000 7faaf4ed6640 1 -- 172.21.15.46:0/2434373418 learned_addr learned my addr 172.21.15.46:0/2434373418 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:34.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.067+0000 7fd2e8d3a640 1 -- 172.21.15.46:0/1635775143 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e00b1600 con 0x7fd2e4150500 2024-01-23T08:55:34.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.071+0000 7fd2e8d3a640 1 -- 172.21.15.46:0/1635775143 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e00ad050 con 0x7fd2e4150500 2024-01-23T08:55:34.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.071+0000 7fd2e8d3a640 1 -- 172.21.15.46:0/1635775143 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e00b1980 con 0x7fd2e4150500 2024-01-23T08:55:34.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.071+0000 7fd2ebfa0640 1 -- 172.21.15.46:0/1635775143 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd2e4150500 msgr2=0x7fd2e40c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:34.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.071+0000 7fd2ebfa0640 1 --2- 172.21.15.46:0/1635775143 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd2e4150500 0x7fd2e40c5f20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd2e000bb10 tx=0x7fd2e00213c0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.071+0000 7fd2ebfa0640 1 -- 172.21.15.46:0/1635775143 shutdown_connections 2024-01-23T08:55:34.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.071+0000 7fd2ebfa0640 1 --2- 172.21.15.46:0/1635775143 >> v2:172.21.15.175:3300/0 conn(0x7fd2e40c2e00 0x7fd2e4156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.071+0000 7fd2ebfa0640 1 --2- 172.21.15.46:0/1635775143 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd2e4150500 0x7fd2e40c5f20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.071+0000 7fd2ebfa0640 1 -- 172.21.15.46:0/1635775143 >> 172.21.15.46:0/1635775143 conn(0x7fd2e406b770 msgr2=0x7fd2e406bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:34.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.071+0000 7fd2ebfa0640 1 -- 172.21.15.46:0/1635775143 shutdown_connections 2024-01-23T08:55:34.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.071+0000 7fd2ebfa0640 1 -- 172.21.15.46:0/1635775143 wait complete. 2024-01-23T08:55:34.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.071+0000 7fd2ebfa0640 1 Processor -- start 2024-01-23T08:55:34.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.071+0000 7fd2ebfa0640 1 -- start start 2024-01-23T08:55:34.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.071+0000 7fd2ebfa0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2e406e460 0x7fd2e4149f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.071+0000 7fd2ebfa0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2e40c2e00 0x7fd2e41eb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.071+0000 7fd2ebfa0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd2e4150500 0x7fd2e406f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.071+0000 7fd2ebfa0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e41eadb0 con 0x7fd2e40c2e00 2024-01-23T08:55:34.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.071+0000 7fd2ebfa0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e4157af0 con 0x7fd2e406e460 2024-01-23T08:55:34.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.071+0000 7fd2ebfa0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e41eea80 con 0x7fd2e4150500 2024-01-23T08:55:34.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.075+0000 7faaf4ed6640 1 -- 172.21.15.46:0/2434373418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaf0150500 msgr2=0x7faaf00c4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:34.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.075+0000 7faaf4ed6640 1 --2- 172.21.15.46:0/2434373418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaf0150500 0x7faaf00c4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.075+0000 7faaf4ed6640 1 -- 172.21.15.46:0/2434373418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faaf00c2e00 msgr2=0x7faaf0155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:34.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.075+0000 7faaf4ed6640 1 --2- 172.21.15.46:0/2434373418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faaf00c2e00 0x7faaf0155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.075+0000 7faaf4ed6640 1 -- 172.21.15.46:0/2434373418 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae00094d0 con 0x7faaf006e460 2024-01-23T08:55:34.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.083+0000 7fd2e9d3c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2e406e460 0x7fd2e4149f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:34.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.087+0000 7f4807dbf640 1 Processor -- start 2024-01-23T08:55:34.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.087+0000 7f4807dbf640 1 -- start start 2024-01-23T08:55:34.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.087+0000 7faaf4ed6640 1 --2- 172.21.15.46:0/2434373418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaf006e460 0x7faaf0145740 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faae400b440 tx=0x7faae400b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:34.084 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-23T08:55:34.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.087+0000 7fd2e9d3c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2e406e460 0x7fd2e4149f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:56368/0 (socket says 172.21.15.46:56368) 2024-01-23T08:55:34.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.087+0000 7fd2e9d3c640 1 -- 172.21.15.46:0/974809213 learned_addr learned my addr 172.21.15.46:0/974809213 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:34.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.087+0000 7f4807dbf640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4800150500 0x7f48000c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.087+0000 7f4807dbf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48000c2e00 0x7f4800156250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.087+0000 7f4807dbf640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f480006e460 0x7f480015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.087+0000 7f4807dbf640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4800156790 con 0x7f4800150500 2024-01-23T08:55:34.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.087+0000 7f4807dbf640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4800156a20 con 0x7f480006e460 2024-01-23T08:55:34.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.087+0000 7f4807dbf640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4800156d00 con 0x7f48000c2e00 2024-01-23T08:55:34.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.095+0000 7f480535a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48000c2e00 0x7f4800156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:34.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.095+0000 7f480535a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48000c2e00 0x7f4800156250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:46540/0 (socket says 172.21.15.46:46540) 2024-01-23T08:55:34.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.095+0000 7f480535a640 1 -- 172.21.15.46:0/2401292440 learned_addr learned my addr 172.21.15.46:0/2401292440 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:34.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.095+0000 7fd2ea53d640 1 --2- 172.21.15.46:0/974809213 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd2e4150500 0x7fd2e406f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:34.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.103+0000 7f480535a640 1 -- 172.21.15.46:0/2401292440 >> v2:172.21.15.175:3300/0 conn(0x7f480006e460 msgr2=0x7f480015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:34.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.103+0000 7f480535a640 1 --2- 172.21.15.46:0/2401292440 >> v2:172.21.15.175:3300/0 conn(0x7f480006e460 0x7f480015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.103+0000 7f480535a640 1 -- 172.21.15.46:0/2401292440 >> v2:172.21.15.46:3300/0 conn(0x7f4800150500 msgr2=0x7f48000c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:34.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.103+0000 7f480535a640 1 --2- 172.21.15.46:0/2401292440 >> v2:172.21.15.46:3300/0 conn(0x7f4800150500 0x7f48000c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.103+0000 7f480535a640 1 -- 172.21.15.46:0/2401292440 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4800156fe0 con 0x7f48000c2e00 2024-01-23T08:55:34.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.103+0000 7fd2e9d3c640 1 -- 172.21.15.46:0/974809213 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd2e4150500 msgr2=0x7fd2e406f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:34.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.103+0000 7fd2e9d3c640 1 --2- 172.21.15.46:0/974809213 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd2e4150500 0x7fd2e406f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.103+0000 7fd2e9d3c640 1 -- 172.21.15.46:0/974809213 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2e40c2e00 msgr2=0x7fd2e41eb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:34.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.103+0000 7fd2e9d3c640 1 --2- 172.21.15.46:0/974809213 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2e40c2e00 0x7fd2e41eb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.103+0000 7fd2e9d3c640 1 -- 172.21.15.46:0/974809213 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e000b770 con 0x7fd2e406e460 2024-01-23T08:55:34.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.111+0000 7faaed7fa640 1 -- 172.21.15.46:0/2434373418 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae4011890 con 0x7faaf006e460 2024-01-23T08:55:34.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.111+0000 7faaed7fa640 1 -- 172.21.15.46:0/2434373418 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae4011a10 con 0x7faaf006e460 2024-01-23T08:55:34.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.111+0000 7faaed7fa640 1 -- 172.21.15.46:0/2434373418 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae4011dc0 con 0x7faaf006e460 2024-01-23T08:55:34.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.111+0000 7faaf713a640 1 -- 172.21.15.46:0/2434373418 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf0146d20 con 0x7faaf006e460 2024-01-23T08:55:34.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.111+0000 7faaf713a640 1 -- 172.21.15.46:0/2434373418 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf00c5150 con 0x7faaf006e460 2024-01-23T08:55:34.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.111+0000 7faaf713a640 1 -- 172.21.15.46:0/2434373418 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf0074340 con 0x7faaf006e460 2024-01-23T08:55:34.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.115+0000 7f480535a640 1 --2- 172.21.15.46:0/2401292440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48000c2e00 0x7f4800156250 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4800072050 tx=0x7f47f001ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7935e2711c754de3 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:34.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.123+0000 7f4804b59640 1 -- 172.21.15.46:0/2401292440 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f00a89b0 con 0x7f48000c2e00 2024-01-23T08:55:34.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.123+0000 7f4804b59640 1 -- 172.21.15.46:0/2401292440 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f00a8b10 con 0x7f48000c2e00 2024-01-23T08:55:34.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.123+0000 7f4804b59640 1 -- 172.21.15.46:0/2401292440 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f00a8ea0 con 0x7f48000c2e00 2024-01-23T08:55:34.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.123+0000 7f4807dbf640 1 -- 172.21.15.46:0/2401292440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48000c2e00 msgr2=0x7f4800156250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:34.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.123+0000 7f4807dbf640 1 --2- 172.21.15.46:0/2401292440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48000c2e00 0x7f4800156250 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4800072050 tx=0x7f47f001ecf0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.123+0000 7f4807dbf640 1 -- 172.21.15.46:0/2401292440 shutdown_connections 2024-01-23T08:55:34.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.123+0000 7f4807dbf640 1 --2- 172.21.15.46:0/2401292440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48000c2e00 0x7f4800156250 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.123+0000 7f4807dbf640 1 --2- 172.21.15.46:0/2401292440 >> v2:172.21.15.175:3300/0 conn(0x7f480006e460 0x7f480015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.123+0000 7f4807dbf640 1 --2- 172.21.15.46:0/2401292440 >> v2:172.21.15.46:3300/0 conn(0x7f4800150500 0x7f48000c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.123+0000 7f4807dbf640 1 -- 172.21.15.46:0/2401292440 >> 172.21.15.46:0/2401292440 conn(0x7f480006b770 msgr2=0x7f480006bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:34.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.123+0000 7f4807dbf640 1 -- 172.21.15.46:0/2401292440 shutdown_connections 2024-01-23T08:55:34.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.127+0000 7f4807dbf640 1 -- 172.21.15.46:0/2401292440 wait complete. 2024-01-23T08:55:34.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.127+0000 7f4807dbf640 1 Processor -- start 2024-01-23T08:55:34.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.127+0000 7f4807dbf640 1 -- start start 2024-01-23T08:55:34.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.127+0000 7f4807dbf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f480006e460 0x7f48000c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.127+0000 7f4807dbf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48000c2e00 0x7f48001f2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.127+0000 7f4807dbf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4800150500 0x7f480014e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.127+0000 7f4807dbf640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48001e2460 con 0x7f48000c2e00 2024-01-23T08:55:34.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.127+0000 7f4807dbf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48001574b0 con 0x7f4800150500 2024-01-23T08:55:34.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.127+0000 7f4807dbf640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48000c4130 con 0x7f480006e460 2024-01-23T08:55:34.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.131+0000 7f4805b5b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f480006e460 0x7f48000c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:34.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.131+0000 7f4805b5b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f480006e460 0x7f48000c3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:46548/0 (socket says 172.21.15.46:46548) 2024-01-23T08:55:34.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.131+0000 7f4805b5b640 1 -- 172.21.15.46:0/1644660919 learned_addr learned my addr 172.21.15.46:0/1644660919 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:34.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.139+0000 7f4805b5b640 1 -- 172.21.15.46:0/1644660919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4800150500 msgr2=0x7f480014e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:34.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.139+0000 7f4805b5b640 1 --2- 172.21.15.46:0/1644660919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4800150500 0x7f480014e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.139+0000 7f4805b5b640 1 -- 172.21.15.46:0/1644660919 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48000c2e00 msgr2=0x7f48001f2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:34.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.139+0000 7f4805b5b640 1 --2- 172.21.15.46:0/1644660919 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48000c2e00 0x7f48001f2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.139+0000 7f4805b5b640 1 -- 172.21.15.46:0/1644660919 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f00094d0 con 0x7f480006e460 2024-01-23T08:55:34.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.147+0000 7f4805b5b640 1 --2- 172.21.15.46:0/1644660919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f480006e460 0x7f48000c3bf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f47fc00b440 tx=0x7f47fc00b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:34.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.155+0000 7f47f67fc640 1 -- 172.21.15.46:0/1644660919 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc011890 con 0x7f480006e460 2024-01-23T08:55:34.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.155+0000 7f47f67fc640 1 -- 172.21.15.46:0/1644660919 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47fc011a10 con 0x7f480006e460 2024-01-23T08:55:34.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.155+0000 7f47f67fc640 1 -- 172.21.15.46:0/1644660919 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc011dc0 con 0x7f480006e460 2024-01-23T08:55:34.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.155+0000 7f4807dbf640 1 -- 172.21.15.46:0/1644660919 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4800157ce0 con 0x7f480006e460 2024-01-23T08:55:34.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.155+0000 7f4807dbf640 1 -- 172.21.15.46:0/1644660919 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4800157a00 con 0x7f480006e460 2024-01-23T08:55:34.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.159+0000 7f4807dbf640 1 -- 172.21.15.46:0/1644660919 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4800074340 con 0x7f480006e460 2024-01-23T08:55:34.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.207+0000 7f487dd0f640 1 Processor -- start 2024-01-23T08:55:34.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.207+0000 7f487dd0f640 1 -- start start 2024-01-23T08:55:34.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.207+0000 7f487dd0f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48781512f0 0x7f487815b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.207+0000 7f487dd0f640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f48781574d0 0x7f48780c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.207+0000 7f487dd0f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48780c65a0 con 0x7f487815b6c0 2024-01-23T08:55:34.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.207+0000 7f487dd0f640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f487815aa70 con 0x7f48781574d0 2024-01-23T08:55:34.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.207+0000 7f487dd0f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4878157960 con 0x7f48781512f0 2024-01-23T08:55:34.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.311+0000 7f3662ffd640 1 -- 172.21.15.46:0/502185236 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f365c055960 con 0x7f366406ea80 2024-01-23T08:55:34.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.311+0000 7f3662ffd640 1 -- 172.21.15.46:0/502185236 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f365c055030 con 0x7f366406ea80 2024-01-23T08:55:34.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.339+0000 7f486ffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f48781574d0 0x7f48780c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:34.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.343+0000 7f486ffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f48781574d0 0x7f48780c52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54668/0 (socket says 172.21.15.46:54668) 2024-01-23T08:55:34.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.343+0000 7f486ffff640 1 -- 172.21.15.46:0/3505391314 learned_addr learned my addr 172.21.15.46:0/3505391314 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:34.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.351+0000 7f486ffff640 1 -- 172.21.15.46:0/3505391314 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48781512f0 msgr2=0x7f487815b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:34.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.351+0000 7f486ffff640 1 --2- 172.21.15.46:0/3505391314 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48781512f0 0x7f487815b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.351+0000 7f486ffff640 1 -- 172.21.15.46:0/3505391314 >> v1:172.21.15.175:6789/0 conn(0x7f487815b6c0 legacy=0x7f487806a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:34.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.351+0000 7f486ffff640 1 -- 172.21.15.46:0/3505391314 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4878157c40 con 0x7f48781574d0 2024-01-23T08:55:34.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.431+0000 7fd2e9d3c640 1 --2- 172.21.15.46:0/974809213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2e406e460 0x7fd2e4149f10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd2e000b2c0 tx=0x7fd2e001e160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:34.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.431+0000 7faaed7fa640 1 -- 172.21.15.46:0/2434373418 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7faae401a400 con 0x7faaf006e460 2024-01-23T08:55:34.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.431+0000 7faaed7fa640 1 --2- 172.21.15.46:0/2434373418 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7faadc066500 0x7faadc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.435+0000 7faaeffff640 1 --2- 172.21.15.46:0/2434373418 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7faadc066500 0x7faadc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:34.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.435+0000 7faaeffff640 1 --2- 172.21.15.46:0/2434373418 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7faadc066500 0x7faadc0689c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7faae00b2000 tx=0x7faae0004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:34.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.435+0000 7faaed7fa640 1 -- 172.21.15.46:0/2434373418 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faae4055c30 con 0x7faaf006e460 2024-01-23T08:55:34.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.439+0000 7f486ffff640 1 --2- 172.21.15.46:0/3505391314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48781574d0 0x7f48780c52b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4860009870 tx=0x7f486001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68367c1b8143a597 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:34.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.451+0000 7faaed7fa640 1 -- 172.21.15.46:0/2434373418 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7faae4051870 con 0x7faaf006e460 2024-01-23T08:55:34.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.451+0000 7f4876ffd640 1 -- 172.21.15.46:0/3505391314 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48600a89b0 con 0x7f48781574d0 2024-01-23T08:55:34.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.451+0000 7f4876ffd640 1 -- 172.21.15.46:0/3505391314 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48600a8b10 con 0x7f48781574d0 2024-01-23T08:55:34.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.451+0000 7f4876ffd640 1 -- 172.21.15.46:0/3505391314 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48600a8ea0 con 0x7f48781574d0 2024-01-23T08:55:34.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.455+0000 7f487dd0f640 1 -- 172.21.15.46:0/3505391314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48781574d0 msgr2=0x7f48780c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:34.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.455+0000 7f487dd0f640 1 --2- 172.21.15.46:0/3505391314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48781574d0 0x7f48780c52b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4860009870 tx=0x7f486001ecf0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.455+0000 7f487dd0f640 1 -- 172.21.15.46:0/3505391314 shutdown_connections 2024-01-23T08:55:34.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.455+0000 7f487dd0f640 1 --2- 172.21.15.46:0/3505391314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48781574d0 0x7f48780c52b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.455+0000 7f487dd0f640 1 --2- 172.21.15.46:0/3505391314 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48781512f0 0x7f487815b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.455+0000 7f487dd0f640 1 -- 172.21.15.46:0/3505391314 >> 172.21.15.46:0/3505391314 conn(0x7f4878072890 msgr2=0x7f487806e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:34.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.455+0000 7f487dd0f640 1 -- 172.21.15.46:0/3505391314 shutdown_connections 2024-01-23T08:55:34.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.455+0000 7f487dd0f640 1 -- 172.21.15.46:0/3505391314 wait complete. 2024-01-23T08:55:34.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.455+0000 7f487dd0f640 1 Processor -- start 2024-01-23T08:55:34.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.455+0000 7f487dd0f640 1 -- start start 2024-01-23T08:55:34.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.455+0000 7fd2da7fc640 1 -- 172.21.15.46:0/974809213 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0006ee0 con 0x7fd2e406e460 2024-01-23T08:55:34.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.455+0000 7fd2da7fc640 1 -- 172.21.15.46:0/974809213 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e00ba810 con 0x7fd2e406e460 2024-01-23T08:55:34.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.455+0000 7fd2ebfa0640 1 -- 172.21.15.46:0/974809213 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e4150b20 con 0x7fd2e406e460 2024-01-23T08:55:34.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.455+0000 7fd2da7fc640 1 -- 172.21.15.46:0/974809213 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e00babc0 con 0x7fd2e406e460 2024-01-23T08:55:34.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.455+0000 7fd2ebfa0640 1 -- 172.21.15.46:0/974809213 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e41eecf0 con 0x7fd2e406e460 2024-01-23T08:55:34.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.455+0000 7f487dd0f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48781512f0 0x7f48781f34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.455+0000 7f487dd0f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f487815b6c0 0x7f48781558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.455+0000 7f487dd0f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f487806abd0 0x7f487814c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.459+0000 7f487dd0f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48780ca1f0 con 0x7f487806abd0 2024-01-23T08:55:34.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.459+0000 7f487dd0f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48780c9a20 con 0x7f48781512f0 2024-01-23T08:55:34.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.459+0000 7f487dd0f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48781ef570 con 0x7f487815b6c0 2024-01-23T08:55:34.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.459+0000 7fd2ebfa0640 1 -- 172.21.15.46:0/974809213 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e414fab0 con 0x7fd2e406e460 2024-01-23T08:55:34.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.459+0000 7f4877fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f487806abd0 0x7f487814c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:34.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.459+0000 7f4877fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f487806abd0 0x7f487814c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54682/0 (socket says 172.21.15.46:54682) 2024-01-23T08:55:34.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.459+0000 7f4877fff640 1 -- 172.21.15.46:0/2078388204 learned_addr learned my addr 172.21.15.46:0/2078388204 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:34.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.467+0000 7f4877fff640 1 -- 172.21.15.46:0/2078388204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f487815b6c0 msgr2=0x7f48781558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:34.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.467+0000 7f4877fff640 1 --2- 172.21.15.46:0/2078388204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f487815b6c0 0x7f48781558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.467+0000 7f4877fff640 1 -- 172.21.15.46:0/2078388204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48781512f0 msgr2=0x7f48781f34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:34.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.467+0000 7f4877fff640 1 --2- 172.21.15.46:0/2078388204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48781512f0 0x7f48781f34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.467+0000 7f4877fff640 1 -- 172.21.15.46:0/2078388204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48600094d0 con 0x7f487806abd0 2024-01-23T08:55:34.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.471+0000 7f4877fff640 1 --2- 172.21.15.46:0/2078388204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f487806abd0 0x7f487814c5c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f487000b9e0 tx=0x7f487000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:34.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.475+0000 7f4874ff9640 1 -- 172.21.15.46:0/2078388204 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487000cb20 con 0x7f487806abd0 2024-01-23T08:55:34.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.475+0000 7f487dd0f640 1 -- 172.21.15.46:0/2078388204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48780c38c0 con 0x7f487806abd0 2024-01-23T08:55:34.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.475+0000 7f487dd0f640 1 -- 172.21.15.46:0/2078388204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48780c9c30 con 0x7f487806abd0 2024-01-23T08:55:34.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.475+0000 7f4874ff9640 1 -- 172.21.15.46:0/2078388204 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487000cc80 con 0x7f487806abd0 2024-01-23T08:55:34.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.475+0000 7f487dd0f640 1 -- 172.21.15.46:0/2078388204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48781ef6e0 con 0x7f487806abd0 2024-01-23T08:55:34.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.475+0000 7f4874ff9640 1 -- 172.21.15.46:0/2078388204 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487001e640 con 0x7f487806abd0 2024-01-23T08:55:34.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.499+0000 7f47f67fc640 1 -- 172.21.15.46:0/1644660919 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f47fc01a400 con 0x7f480006e460 2024-01-23T08:55:34.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.499+0000 7f47f67fc640 1 --2- 172.21.15.46:0/1644660919 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f47e4066550 0x7f47e4068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.499+0000 7f480535a640 1 --2- 172.21.15.46:0/1644660919 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f47e4066550 0x7f47e4068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:34.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.499+0000 7f480535a640 1 --2- 172.21.15.46:0/1644660919 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f47e4066550 0x7f47e4068a10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f47f00b2000 tx=0x7f47f0004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:34.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.503+0000 7f366c631640 1 -- 172.21.15.46:0/502185236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3664074340 con 0x7f366406ea80 2024-01-23T08:55:34.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.511+0000 7f47f67fc640 1 -- 172.21.15.46:0/1644660919 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f47fc055e00 con 0x7f480006e460 2024-01-23T08:55:34.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.567+0000 7f47f67fc640 1 -- 172.21.15.46:0/1644660919 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f47fc051a40 con 0x7f480006e460 2024-01-23T08:55:34.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.627+0000 7faaf713a640 1 -- 172.21.15.46:0/2434373418 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faaf0146d20 con 0x7faaf006e460 2024-01-23T08:55:34.647 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-23T08:55:34.656 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-23T08:55:34.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.735+0000 7f4807dbf640 1 -- 172.21.15.46:0/1644660919 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f48000c23b0 con 0x7f480006e460 2024-01-23T08:55:34.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.739+0000 7f47f67fc640 1 -- 172.21.15.46:0/1644660919 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f47fc015020 con 0x7f480006e460 2024-01-23T08:55:34.738 INFO:teuthology.orchestra.run.smithi046.stdout:60129542165 2024-01-23T08:55:34.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.743+0000 7f4807dbf640 1 -- 172.21.15.46:0/1644660919 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f47e4066550 msgr2=0x7f47e4068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:34.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.743+0000 7f4807dbf640 1 --2- 172.21.15.46:0/1644660919 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f47e4066550 0x7f47e4068a10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f47f00b2000 tx=0x7f47f0004740 comp rx=0 tx=0).stop 2024-01-23T08:55:34.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.743+0000 7f4807dbf640 1 -- 172.21.15.46:0/1644660919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f480006e460 msgr2=0x7f48000c3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:34.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.743+0000 7f4807dbf640 1 --2- 172.21.15.46:0/1644660919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f480006e460 0x7f48000c3bf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f47fc00b440 tx=0x7f47fc00b900 comp rx=0 tx=0).stop 2024-01-23T08:55:34.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.743+0000 7f4807dbf640 1 -- 172.21.15.46:0/1644660919 shutdown_connections 2024-01-23T08:55:34.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.743+0000 7f4807dbf640 1 --2- 172.21.15.46:0/1644660919 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f47e4066550 0x7f47e4068a10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.743+0000 7f4807dbf640 1 --2- 172.21.15.46:0/1644660919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4800150500 0x7f480014e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.743+0000 7f4807dbf640 1 --2- 172.21.15.46:0/1644660919 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48000c2e00 0x7f48001f2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.743+0000 7f4807dbf640 1 --2- 172.21.15.46:0/1644660919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f480006e460 0x7f48000c3bf0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.743+0000 7f4807dbf640 1 -- 172.21.15.46:0/1644660919 >> 172.21.15.46:0/1644660919 conn(0x7f480006b770 msgr2=0x7f48000c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:34.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.743+0000 7f4807dbf640 1 -- 172.21.15.46:0/1644660919 shutdown_connections 2024-01-23T08:55:34.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.743+0000 7f4807dbf640 1 -- 172.21.15.46:0/1644660919 wait complete. 2024-01-23T08:55:34.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.759+0000 7f4874ff9640 1 -- 172.21.15.46:0/2078388204 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f487001e7a0 con 0x7f487806abd0 2024-01-23T08:55:34.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542167 got 60129542165 for osd.6 2024-01-23T08:55:34.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.759+0000 7f4874ff9640 1 --2- 172.21.15.46:0/2078388204 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4858066530 0x7f48580689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.763+0000 7f48777fe640 1 --2- 172.21.15.46:0/2078388204 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4858066530 0x7f48580689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:34.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.763+0000 7f48777fe640 1 --2- 172.21.15.46:0/2078388204 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4858066530 0x7f48580689f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4868009730 tx=0x7f4868006ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:34.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.763+0000 7f3662ffd640 1 -- 172.21.15.46:0/502185236 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f365c01e020 con 0x7f366406ea80 2024-01-23T08:55:34.761 INFO:teuthology.orchestra.run.smithi046.stdout:64424509461 2024-01-23T08:55:34.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.767+0000 7f366c631640 1 -- 172.21.15.46:0/502185236 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3650066550 msgr2=0x7f3650068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:34.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.767+0000 7f366c631640 1 --2- 172.21.15.46:0/502185236 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3650066550 0x7f3650068a10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f36580b2000 tx=0x7f3658004740 comp rx=0 tx=0).stop 2024-01-23T08:55:34.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.767+0000 7f366c631640 1 -- 172.21.15.46:0/502185236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f366406ea80 msgr2=0x7f3664156f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:34.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.767+0000 7f366c631640 1 --2- 172.21.15.46:0/502185236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f366406ea80 0x7f3664156f50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f365c00b550 tx=0x7f365c00ba10 comp rx=0 tx=0).stop 2024-01-23T08:55:34.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.767+0000 7f366c631640 1 -- 172.21.15.46:0/502185236 shutdown_connections 2024-01-23T08:55:34.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.767+0000 7f366c631640 1 --2- 172.21.15.46:0/502185236 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3650066550 0x7f3650068a10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.767+0000 7f366c631640 1 --2- 172.21.15.46:0/502185236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3664151740 0x7f36641f24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.767+0000 7f366c631640 1 --2- 172.21.15.46:0/502185236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36640c5db0 0x7f3664150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.767+0000 7f366c631640 1 --2- 172.21.15.46:0/502185236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f366406ea80 0x7f3664156f50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.767+0000 7f366c631640 1 -- 172.21.15.46:0/502185236 >> 172.21.15.46:0/502185236 conn(0x7f366406b770 msgr2=0x7f36640cb660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:34.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.767+0000 7f366c631640 1 -- 172.21.15.46:0/502185236 shutdown_connections 2024-01-23T08:55:34.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.767+0000 7f366c631640 1 -- 172.21.15.46:0/502185236 wait complete. 2024-01-23T08:55:34.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.783+0000 7fd79a2fc640 1 Processor -- start 2024-01-23T08:55:34.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.783+0000 7fd79a2fc640 1 -- start start 2024-01-23T08:55:34.782 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509462 got 64424509461 for osd.1 2024-01-23T08:55:34.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.783+0000 7fd79a2fc640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd7941596c0 0x7fd794165050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.783+0000 7fd79a2fc640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd794159af0 con 0x7fd7940cc3e0 2024-01-23T08:55:34.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.783+0000 7fd79a2fc640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd794159d50 con 0x7fd794153800 2024-01-23T08:55:34.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.783+0000 7fd79a2fc640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd794159ff0 con 0x7fd7941596c0 2024-01-23T08:55:34.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.791+0000 7f4874ff9640 1 -- 172.21.15.46:0/2078388204 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4870055340 con 0x7f487806abd0 2024-01-23T08:55:34.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.791+0000 7f4874ff9640 1 -- 172.21.15.46:0/2078388204 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f4870051680 con 0x7f487806abd0 2024-01-23T08:55:34.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.811+0000 7fd798899640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd7941596c0 0x7fd794165050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:34.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.811+0000 7fd798899640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd7941596c0 0x7fd794165050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54688/0 (socket says 172.21.15.46:54688) 2024-01-23T08:55:34.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.811+0000 7fd798899640 1 -- 172.21.15.46:0/3532909035 learned_addr learned my addr 172.21.15.46:0/3532909035 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:34.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.819+0000 7fd798899640 1 -- 172.21.15.46:0/3532909035 >> v1:172.21.15.175:6789/0 conn(0x7fd794153800 legacy=0x7fd79415d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:34.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.819+0000 7fd798899640 1 -- 172.21.15.46:0/3532909035 >> v1:172.21.15.46:6789/0 conn(0x7fd7940cc3e0 legacy=0x7fd79406fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:34.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.819+0000 7fd798899640 1 -- 172.21.15.46:0/3532909035 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79415a2b0 con 0x7fd7941596c0 2024-01-23T08:55:34.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.827+0000 7fba78ab6640 1 Processor -- start 2024-01-23T08:55:34.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.827+0000 7fba78ab6640 1 -- start start 2024-01-23T08:55:34.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.831+0000 7fba78ab6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba74070290 0x7fba74159a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.831+0000 7fba78ab6640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fba740c65a0 0x7fba740c18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.831+0000 7fba78ab6640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba740c0e90 con 0x7fba7406feb0 2024-01-23T08:55:34.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.831+0000 7fba78ab6640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba74156d20 con 0x7fba740c65a0 2024-01-23T08:55:34.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.831+0000 7fba78ab6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba74156fc0 con 0x7fba74070290 2024-01-23T08:55:34.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.831+0000 7fba71d9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba74070290 0x7fba74159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:34.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.831+0000 7fba71d9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba74070290 0x7fba74159a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:46574/0 (socket says 172.21.15.46:46574) 2024-01-23T08:55:34.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.831+0000 7fba71d9b640 1 -- 172.21.15.46:0/2530029679 learned_addr learned my addr 172.21.15.46:0/2530029679 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:34.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.835+0000 7fba71d9b640 1 -- 172.21.15.46:0/2530029679 >> v2:172.21.15.46:3300/0 conn(0x7fba740c65a0 msgr2=0x7fba740c18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:34.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.835+0000 7fba71d9b640 1 --2- 172.21.15.46:0/2530029679 >> v2:172.21.15.46:3300/0 conn(0x7fba740c65a0 0x7fba740c18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.835+0000 7fba71d9b640 1 -- 172.21.15.46:0/2530029679 >> v1:172.21.15.175:6789/0 conn(0x7fba7406feb0 legacy=0x7fba74156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:34.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.835+0000 7fba71d9b640 1 -- 172.21.15.46:0/2530029679 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba74157280 con 0x7fba74070290 2024-01-23T08:55:34.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.843+0000 7fba71d9b640 1 --2- 172.21.15.46:0/2530029679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba74070290 0x7fba74159a20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fba68009870 tx=0x7fba6801c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c69668bc5f15d688 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:34.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.851+0000 7fba7159a640 1 -- 172.21.15.46:0/2530029679 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba680ab600 con 0x7fba74070290 2024-01-23T08:55:34.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.851+0000 7fba7159a640 1 -- 172.21.15.46:0/2530029679 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba680a7050 con 0x7fba74070290 2024-01-23T08:55:34.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.851+0000 7fba7159a640 1 -- 172.21.15.46:0/2530029679 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba680ab980 con 0x7fba74070290 2024-01-23T08:55:34.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.851+0000 7fba78ab6640 1 -- 172.21.15.46:0/2530029679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba74070290 msgr2=0x7fba74159a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:34.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.851+0000 7fba78ab6640 1 --2- 172.21.15.46:0/2530029679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba74070290 0x7fba74159a20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fba68009870 tx=0x7fba6801c3b0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.851+0000 7fba78ab6640 1 -- 172.21.15.46:0/2530029679 shutdown_connections 2024-01-23T08:55:34.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.851+0000 7fba78ab6640 1 --2- 172.21.15.46:0/2530029679 >> v2:172.21.15.46:3300/0 conn(0x7fba740c65a0 0x7fba740c18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.851+0000 7fba78ab6640 1 --2- 172.21.15.46:0/2530029679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba74070290 0x7fba74159a20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.851+0000 7fba78ab6640 1 -- 172.21.15.46:0/2530029679 >> 172.21.15.46:0/2530029679 conn(0x7fba74072890 msgr2=0x7fba7406e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:34.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.851+0000 7fba78ab6640 1 -- 172.21.15.46:0/2530029679 shutdown_connections 2024-01-23T08:55:34.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.851+0000 7fba78ab6640 1 -- 172.21.15.46:0/2530029679 wait complete. 2024-01-23T08:55:34.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.855+0000 7fba78ab6640 1 Processor -- start 2024-01-23T08:55:34.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.855+0000 7fba78ab6640 1 -- start start 2024-01-23T08:55:34.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.855+0000 7fba78ab6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba7406feb0 0x7fba74158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.855+0000 7fba78ab6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba74070290 0x7fba740cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.855+0000 7fba78ab6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba740c65a0 0x7fba740cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.855+0000 7fba78ab6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba740ca510 con 0x7fba74070290 2024-01-23T08:55:34.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.855+0000 7fba78ab6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba740c9f30 con 0x7fba7406feb0 2024-01-23T08:55:34.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.855+0000 7fba78ab6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba741f33d0 con 0x7fba740c65a0 2024-01-23T08:55:34.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.855+0000 7fd2da7fc640 1 -- 172.21.15.46:0/974809213 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd2e00b8040 con 0x7fd2e406e460 2024-01-23T08:55:34.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.855+0000 7fd2da7fc640 1 --2- 172.21.15.46:0/974809213 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd2c8066580 0x7fd2c8068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.855+0000 7fd2e953b640 1 --2- 172.21.15.46:0/974809213 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd2c8066580 0x7fd2c8068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:34.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.855+0000 7fba72d9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba740c65a0 0x7fba740cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:34.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.855+0000 7fd2e953b640 1 --2- 172.21.15.46:0/974809213 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd2c8066580 0x7fd2c8068a40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4006aa0 tx=0x7fd2d4006a30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:34.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.855+0000 7fba72d9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba740c65a0 0x7fba740cbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:46576/0 (socket says 172.21.15.46:46576) 2024-01-23T08:55:34.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.855+0000 7fba72d9d640 1 -- 172.21.15.46:0/3846546242 learned_addr learned my addr 172.21.15.46:0/3846546242 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:34.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.863+0000 7fd2da7fc640 1 -- 172.21.15.46:0/974809213 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd2e00f63a0 con 0x7fd2e406e460 2024-01-23T08:55:34.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.863+0000 7fba72d9d640 1 -- 172.21.15.46:0/3846546242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba7406feb0 msgr2=0x7fba74158a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:34.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.863+0000 7fba72d9d640 1 --2- 172.21.15.46:0/3846546242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba7406feb0 0x7fba74158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.863+0000 7fba72d9d640 1 -- 172.21.15.46:0/3846546242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba74070290 msgr2=0x7fba740cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:34.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.863+0000 7fba72d9d640 1 --2- 172.21.15.46:0/3846546242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba74070290 0x7fba740cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.863+0000 7fba72d9d640 1 -- 172.21.15.46:0/3846546242 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba680094d0 con 0x7fba740c65a0 2024-01-23T08:55:34.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.871+0000 7fba72d9d640 1 --2- 172.21.15.46:0/3846546242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba740c65a0 0x7fba740cbba0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fba6c00b9a0 tx=0x7fba6c00be60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:34.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.879+0000 7faaed7fa640 1 -- 172.21.15.46:0/2434373418 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faaf0146d20 con 0x7faaf006e460 2024-01-23T08:55:34.875 INFO:teuthology.orchestra.run.smithi046.stdout:64424509463 2024-01-23T08:55:34.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.879+0000 7fba62ffd640 1 -- 172.21.15.46:0/3846546242 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c00cba0 con 0x7fba740c65a0 2024-01-23T08:55:34.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.879+0000 7fba62ffd640 1 -- 172.21.15.46:0/3846546242 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6c00cd20 con 0x7fba740c65a0 2024-01-23T08:55:34.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.879+0000 7fba62ffd640 1 -- 172.21.15.46:0/3846546242 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c014680 con 0x7fba740c65a0 2024-01-23T08:55:34.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.879+0000 7fba78ab6640 1 -- 172.21.15.46:0/3846546242 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba740c9660 con 0x7fba740c65a0 2024-01-23T08:55:34.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.879+0000 7fba78ab6640 1 -- 172.21.15.46:0/3846546242 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba741f3640 con 0x7fba740c65a0 2024-01-23T08:55:34.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.879+0000 7fba78ab6640 1 -- 172.21.15.46:0/3846546242 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba741f3830 con 0x7fba740c65a0 2024-01-23T08:55:34.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.879+0000 7faaf713a640 1 -- 172.21.15.46:0/2434373418 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7faadc066500 msgr2=0x7faadc0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:34.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.879+0000 7faaf713a640 1 --2- 172.21.15.46:0/2434373418 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7faadc066500 0x7faadc0689c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7faae00b2000 tx=0x7faae0004740 comp rx=0 tx=0).stop 2024-01-23T08:55:34.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.879+0000 7faaf713a640 1 -- 172.21.15.46:0/2434373418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaf006e460 msgr2=0x7faaf0145740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:34.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.879+0000 7faaf713a640 1 --2- 172.21.15.46:0/2434373418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaf006e460 0x7faaf0145740 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faae400b440 tx=0x7faae400b900 comp rx=0 tx=0).stop 2024-01-23T08:55:34.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.879+0000 7faaf713a640 1 -- 172.21.15.46:0/2434373418 shutdown_connections 2024-01-23T08:55:34.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.879+0000 7faaf713a640 1 --2- 172.21.15.46:0/2434373418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaf0150500 0x7faaf00c4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.879+0000 7faaf713a640 1 --2- 172.21.15.46:0/2434373418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faaf00c2e00 0x7faaf0155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.879+0000 7faaf713a640 1 --2- 172.21.15.46:0/2434373418 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7faadc066500 0x7faadc0689c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.879+0000 7faaf713a640 1 --2- 172.21.15.46:0/2434373418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaf006e460 0x7faaf0145740 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.879+0000 7faaf713a640 1 -- 172.21.15.46:0/2434373418 >> 172.21.15.46:0/2434373418 conn(0x7faaf006b770 msgr2=0x7faaf00c5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:34.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.879+0000 7faaf713a640 1 -- 172.21.15.46:0/2434373418 shutdown_connections 2024-01-23T08:55:34.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.879+0000 7faaf713a640 1 -- 172.21.15.46:0/2434373418 wait complete. 2024-01-23T08:55:34.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.883+0000 7fd798899640 1 --2- 172.21.15.46:0/3532909035 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7941596c0 0x7fd794165050 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd7940c6260 tx=0x7fd78c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc656c6b9bf6851 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:34.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.887+0000 7fd792ffd640 1 -- 172.21.15.46:0/3532909035 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c0ab600 con 0x7fd7941596c0 2024-01-23T08:55:34.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.887+0000 7fd792ffd640 1 -- 172.21.15.46:0/3532909035 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78c0a7050 con 0x7fd7941596c0 2024-01-23T08:55:34.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.887+0000 7fd792ffd640 1 -- 172.21.15.46:0/3532909035 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c0ab980 con 0x7fd7941596c0 2024-01-23T08:55:34.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.887+0000 7fd79a2fc640 1 -- 172.21.15.46:0/3532909035 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7941596c0 msgr2=0x7fd794165050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:34.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.887+0000 7fd79a2fc640 1 --2- 172.21.15.46:0/3532909035 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7941596c0 0x7fd794165050 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd7940c6260 tx=0x7fd78c01c410 comp rx=0 tx=0).stop 2024-01-23T08:55:34.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.887+0000 7fd79a2fc640 1 -- 172.21.15.46:0/3532909035 shutdown_connections 2024-01-23T08:55:34.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.887+0000 7fd79a2fc640 1 --2- 172.21.15.46:0/3532909035 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7941596c0 0x7fd794165050 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.887+0000 7fd79a2fc640 1 -- 172.21.15.46:0/3532909035 >> 172.21.15.46:0/3532909035 conn(0x7fd794072890 msgr2=0x7fd79406e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:34.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.891+0000 7fd79a2fc640 1 -- 172.21.15.46:0/3532909035 shutdown_connections 2024-01-23T08:55:34.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.891+0000 7fd79a2fc640 1 -- 172.21.15.46:0/3532909035 wait complete. 2024-01-23T08:55:34.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.891+0000 7fd79a2fc640 1 Processor -- start 2024-01-23T08:55:34.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.891+0000 7fd79a2fc640 1 -- start start 2024-01-23T08:55:34.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.891+0000 7fd79a2fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7940cc3e0 0x7fd794155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.891+0000 7fd79a2fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd794153800 0x7fd7940cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.891+0000 7fd79a2fc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7941596c0 0x7fd7941454c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:34.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.891+0000 7fd79a2fc640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7941f5710 con 0x7fd7940cc3e0 2024-01-23T08:55:34.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.891+0000 7fd79a2fc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd794156490 con 0x7fd794153800 2024-01-23T08:55:34.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.891+0000 7fd79a2fc640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd794156750 con 0x7fd7941596c0 2024-01-23T08:55:34.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.891+0000 7fd793fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7940cc3e0 0x7fd794155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:34.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.895+0000 7fd793fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7940cc3e0 0x7fd794155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54726/0 (socket says 172.21.15.46:54726) 2024-01-23T08:55:34.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.895+0000 7fd793fff640 1 -- 172.21.15.46:0/3456707909 learned_addr learned my addr 172.21.15.46:0/3456707909 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:34.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.899+0000 7fd793fff640 1 -- 172.21.15.46:0/3456707909 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7941596c0 msgr2=0x7fd7941454c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:34.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.899+0000 7fd793fff640 1 --2- 172.21.15.46:0/3456707909 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7941596c0 0x7fd7941454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.899+0000 7fd793fff640 1 -- 172.21.15.46:0/3456707909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd794153800 msgr2=0x7fd7940cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:34.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.899+0000 7fd793fff640 1 --2- 172.21.15.46:0/3456707909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd794153800 0x7fd7940cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:34.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.899+0000 7fd793fff640 1 -- 172.21.15.46:0/3456707909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78c0094d0 con 0x7fd7940cc3e0 2024-01-23T08:55:34.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.899+0000 7fd793fff640 1 --2- 172.21.15.46:0/3456707909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7940cc3e0 0x7fd794155d20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd78400c7a0 tx=0x7fd78400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:34.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509464 got 64424509463 for osd.3 2024-01-23T08:55:34.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.903+0000 7fd790ff9640 1 -- 172.21.15.46:0/3456707909 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd784003d90 con 0x7fd7940cc3e0 2024-01-23T08:55:34.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.903+0000 7fd790ff9640 1 -- 172.21.15.46:0/3456707909 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd784005070 con 0x7fd7940cc3e0 2024-01-23T08:55:34.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.903+0000 7fd79a2fc640 1 -- 172.21.15.46:0/3456707909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd794156a30 con 0x7fd7940cc3e0 2024-01-23T08:55:34.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.903+0000 7fd790ff9640 1 -- 172.21.15.46:0/3456707909 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd784005460 con 0x7fd7940cc3e0 2024-01-23T08:55:34.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.903+0000 7fd79a2fc640 1 -- 172.21.15.46:0/3456707909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd794156ff0 con 0x7fd7940cc3e0 2024-01-23T08:55:34.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.903+0000 7fd79a2fc640 1 -- 172.21.15.46:0/3456707909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd794074340 con 0x7fd7940cc3e0 2024-01-23T08:55:34.934 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-23T08:55:34.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.975+0000 7f487dd0f640 1 -- 172.21.15.46:0/2078388204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f48781ef6e0 con 0x7f487806abd0 2024-01-23T08:55:34.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:34.979+0000 7fd2da7fc640 1 -- 172.21.15.46:0/974809213 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd2e00f1fe0 con 0x7fd2e406e460 2024-01-23T08:55:35.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.087+0000 7f50dcf57640 1 Processor -- start 2024-01-23T08:55:35.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.087+0000 7f50dcf57640 1 -- start start 2024-01-23T08:55:35.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.087+0000 7f50dcf57640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f50d80707c0 0x7f50d80c7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:35.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.087+0000 7f50dcf57640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d806ad60 con 0x7f50d81516b0 2024-01-23T08:55:35.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.087+0000 7f50dcf57640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d8157f60 con 0x7f50d80c7e50 2024-01-23T08:55:35.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.087+0000 7f50dcf57640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50d8157420 con 0x7f50d80707c0 2024-01-23T08:55:35.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.091+0000 7f50d5d9b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f50d80707c0 0x7f50d80c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:35.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.091+0000 7f50d5d9b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f50d80707c0 0x7f50d80c7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:56434/0 (socket says 172.21.15.46:56434) 2024-01-23T08:55:35.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.091+0000 7f50d5d9b640 1 -- 172.21.15.46:0/1368733033 learned_addr learned my addr 172.21.15.46:0/1368733033 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:35.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.099+0000 7f50d5d9b640 1 -- 172.21.15.46:0/1368733033 >> v1:172.21.15.175:6789/0 conn(0x7f50d80c7e50 legacy=0x7f50d806b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:35.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.099+0000 7f50d5d9b640 1 -- 172.21.15.46:0/1368733033 >> v1:172.21.15.46:6789/0 conn(0x7f50d81516b0 legacy=0x7f50d815b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:35.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.099+0000 7f50d5d9b640 1 -- 172.21.15.46:0/1368733033 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d81583f0 con 0x7f50d80707c0 2024-01-23T08:55:35.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.107+0000 7f50d5d9b640 1 --2- 172.21.15.46:0/1368733033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50d80707c0 0x7f50d80c7910 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009870 tx=0x7f50cc01c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cc6c53908618ca5 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:35.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.119+0000 7f50d559a640 1 -- 172.21.15.46:0/1368733033 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0ab5f0 con 0x7f50d80707c0 2024-01-23T08:55:35.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.119+0000 7f50d559a640 1 -- 172.21.15.46:0/1368733033 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50cc0ab750 con 0x7f50d80707c0 2024-01-23T08:55:35.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.119+0000 7f50d559a640 1 -- 172.21.15.46:0/1368733033 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0abae0 con 0x7f50d80707c0 2024-01-23T08:55:35.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.119+0000 7f50dcf57640 1 -- 172.21.15.46:0/1368733033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50d80707c0 msgr2=0x7f50d80c7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:35.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.119+0000 7f50dcf57640 1 --2- 172.21.15.46:0/1368733033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50d80707c0 0x7f50d80c7910 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009870 tx=0x7f50cc01c500 comp rx=0 tx=0).stop 2024-01-23T08:55:35.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.119+0000 7f50dcf57640 1 -- 172.21.15.46:0/1368733033 shutdown_connections 2024-01-23T08:55:35.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.119+0000 7f50dcf57640 1 --2- 172.21.15.46:0/1368733033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50d80707c0 0x7f50d80c7910 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.119+0000 7f50dcf57640 1 -- 172.21.15.46:0/1368733033 >> 172.21.15.46:0/1368733033 conn(0x7f50d8072450 msgr2=0x7f50d806fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:35.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.119+0000 7f50dcf57640 1 -- 172.21.15.46:0/1368733033 shutdown_connections 2024-01-23T08:55:35.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.119+0000 7f50dcf57640 1 -- 172.21.15.46:0/1368733033 wait complete. 2024-01-23T08:55:35.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.119+0000 7f50dcf57640 1 Processor -- start 2024-01-23T08:55:35.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.119+0000 7f50dcf57640 1 -- start start 2024-01-23T08:55:35.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.119+0000 7f50dcf57640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50d80707c0 0x7f50d8142380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:35.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.119+0000 7f50dcf57640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50d80c7e50 0x7f50d814b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:35.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.119+0000 7f50dcf57640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50d81516b0 0x7f50d80c14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:35.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.119+0000 7f50dcf57640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d80cb050 con 0x7f50d80707c0 2024-01-23T08:55:35.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.119+0000 7f50dcf57640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d8141e40 con 0x7f50d80c7e50 2024-01-23T08:55:35.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.119+0000 7f50dcf57640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d8142ed0 con 0x7f50d81516b0 2024-01-23T08:55:35.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.123+0000 7f50d5d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50d80c7e50 0x7f50d814b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:35.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.123+0000 7f50d5d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50d80c7e50 0x7f50d814b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:56446/0 (socket says 172.21.15.46:56446) 2024-01-23T08:55:35.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.123+0000 7f50d5d9b640 1 -- 172.21.15.46:0/1461695439 learned_addr learned my addr 172.21.15.46:0/1461695439 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:35.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.131+0000 7f50d5d9b640 1 -- 172.21.15.46:0/1461695439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50d81516b0 msgr2=0x7f50d80c14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:35.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.131+0000 7f50d5d9b640 1 --2- 172.21.15.46:0/1461695439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50d81516b0 0x7f50d80c14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.131+0000 7f50d5d9b640 1 -- 172.21.15.46:0/1461695439 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50d80707c0 msgr2=0x7f50d8142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:35.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.131+0000 7f50d5d9b640 1 --2- 172.21.15.46:0/1461695439 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50d80707c0 0x7f50d8142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.131+0000 7f50d5d9b640 1 -- 172.21.15.46:0/1461695439 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50cc0094d0 con 0x7f50d80c7e50 2024-01-23T08:55:35.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.135+0000 7f50d5d9b640 1 --2- 172.21.15.46:0/1461695439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50d80c7e50 0x7f50d814b940 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0ad040 tx=0x7f50cc01ad40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:35.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.139+0000 7f50c6ffd640 1 -- 172.21.15.46:0/1461695439 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0be5f0 con 0x7f50d80c7e50 2024-01-23T08:55:35.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.139+0000 7f50dcf57640 1 -- 172.21.15.46:0/1461695439 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d8143400 con 0x7f50d80c7e50 2024-01-23T08:55:35.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.139+0000 7f50dcf57640 1 -- 172.21.15.46:0/1461695439 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d80ca6b0 con 0x7f50d80c7e50 2024-01-23T08:55:35.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.139+0000 7f50dcf57640 1 -- 172.21.15.46:0/1461695439 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d813d8f0 con 0x7f50d80c7e50 2024-01-23T08:55:35.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.143+0000 7f50c6ffd640 1 -- 172.21.15.46:0/1461695439 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50cc0059a0 con 0x7f50d80c7e50 2024-01-23T08:55:35.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.143+0000 7f50c6ffd640 1 -- 172.21.15.46:0/1461695439 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc005d10 con 0x7f50d80c7e50 2024-01-23T08:55:35.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.163+0000 7fd790ff9640 1 -- 172.21.15.46:0/3456707909 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd7840055c0 con 0x7fd7940cc3e0 2024-01-23T08:55:35.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.167+0000 7fd790ff9640 1 --2- 172.21.15.46:0/3456707909 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd774066500 0x7fd7740689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:35.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.167+0000 7fd7937fe640 1 --2- 172.21.15.46:0/3456707909 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd774066500 0x7fd7740689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:35.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.167+0000 7fd7937fe640 1 --2- 172.21.15.46:0/3456707909 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd774066500 0x7fd7740689c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd77c007fd0 tx=0x7fd77c0079a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:35.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.183+0000 7fd790ff9640 1 -- 172.21.15.46:0/3456707909 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd7840552d0 con 0x7fd7940cc3e0 2024-01-23T08:55:35.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.183+0000 7fd790ff9640 1 -- 172.21.15.46:0/3456707909 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd784050f10 con 0x7fd7940cc3e0 2024-01-23T08:55:35.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.187+0000 7fd2ebfa0640 1 -- 172.21.15.46:0/974809213 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fd2e41eeee0 con 0x7fd2e406e460 2024-01-23T08:55:35.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.267+0000 7fba62ffd640 1 -- 172.21.15.46:0/3846546242 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fba6c007370 con 0x7fba740c65a0 2024-01-23T08:55:35.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.271+0000 7fba62ffd640 1 --2- 172.21.15.46:0/3846546242 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fba54066550 0x7fba54068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:35.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.271+0000 7fba7259c640 1 --2- 172.21.15.46:0/3846546242 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fba54066550 0x7fba54068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:35.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.271+0000 7fba7259c640 1 --2- 172.21.15.46:0/3846546242 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fba54066550 0x7fba54068a10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fba64009650 tx=0x7fba64006bb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:35.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.279+0000 7fba62ffd640 1 -- 172.21.15.46:0/3846546242 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fba6c0558d0 con 0x7fba740c65a0 2024-01-23T08:55:35.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.299+0000 7fba62ffd640 1 -- 172.21.15.46:0/3846546242 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fba6c051510 con 0x7fba740c65a0 2024-01-23T08:55:35.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.307+0000 7f4874ff9640 1 -- 172.21.15.46:0/2078388204 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f48781ef6e0 con 0x7f487806abd0 2024-01-23T08:55:35.303 INFO:teuthology.orchestra.run.smithi046.stdout:64424509463 2024-01-23T08:55:35.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.307+0000 7f487dd0f640 1 -- 172.21.15.46:0/2078388204 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4858066530 msgr2=0x7f48580689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:35.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.307+0000 7f487dd0f640 1 --2- 172.21.15.46:0/2078388204 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4858066530 0x7f48580689f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4868009730 tx=0x7f4868006ca0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.307+0000 7f487dd0f640 1 -- 172.21.15.46:0/2078388204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f487806abd0 msgr2=0x7f487814c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:35.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.307+0000 7f487dd0f640 1 --2- 172.21.15.46:0/2078388204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f487806abd0 0x7f487814c5c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f487000b9e0 tx=0x7f487000bea0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.307+0000 7f487dd0f640 1 -- 172.21.15.46:0/2078388204 shutdown_connections 2024-01-23T08:55:35.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.307+0000 7f487dd0f640 1 --2- 172.21.15.46:0/2078388204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f487806abd0 0x7f487814c5c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.307+0000 7f487dd0f640 1 --2- 172.21.15.46:0/2078388204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f487815b6c0 0x7f48781558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.307+0000 7f487dd0f640 1 --2- 172.21.15.46:0/2078388204 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4858066530 0x7f48580689f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.307+0000 7f487dd0f640 1 --2- 172.21.15.46:0/2078388204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48781512f0 0x7f48781f34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.307+0000 7f487dd0f640 1 -- 172.21.15.46:0/2078388204 >> 172.21.15.46:0/2078388204 conn(0x7f4878072890 msgr2=0x7f48780c17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:35.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.311+0000 7f487dd0f640 1 -- 172.21.15.46:0/2078388204 shutdown_connections 2024-01-23T08:55:35.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.311+0000 7f487dd0f640 1 -- 172.21.15.46:0/2078388204 wait complete. 2024-01-23T08:55:35.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509463 got 64424509463 for osd.2 2024-01-23T08:55:35.330 DEBUG:teuthology.parallel:result is None 2024-01-23T08:55:35.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.383+0000 7fd79a2fc640 1 -- 172.21.15.46:0/3456707909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd7940cca30 con 0x7fd7940cc3e0 2024-01-23T08:55:35.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.395+0000 7fd790ff9640 1 -- 172.21.15.46:0/3456707909 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd784017070 con 0x7fd7940cc3e0 2024-01-23T08:55:35.393 INFO:teuthology.orchestra.run.smithi046.stdout:64424509463 2024-01-23T08:55:35.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.395+0000 7fd79a2fc640 1 -- 172.21.15.46:0/3456707909 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd774066500 msgr2=0x7fd7740689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:35.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.395+0000 7fd79a2fc640 1 --2- 172.21.15.46:0/3456707909 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd774066500 0x7fd7740689c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd77c007fd0 tx=0x7fd77c0079a0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.395+0000 7fd79a2fc640 1 -- 172.21.15.46:0/3456707909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7940cc3e0 msgr2=0x7fd794155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:35.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.395+0000 7fd79a2fc640 1 --2- 172.21.15.46:0/3456707909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7940cc3e0 0x7fd794155d20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd78400c7a0 tx=0x7fd78400cc60 comp rx=0 tx=0).stop 2024-01-23T08:55:35.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.395+0000 7fd79a2fc640 1 -- 172.21.15.46:0/3456707909 shutdown_connections 2024-01-23T08:55:35.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.395+0000 7fd79a2fc640 1 --2- 172.21.15.46:0/3456707909 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7941596c0 0x7fd7941454c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.395+0000 7fd79a2fc640 1 --2- 172.21.15.46:0/3456707909 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd774066500 0x7fd7740689c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.395+0000 7fd79a2fc640 1 --2- 172.21.15.46:0/3456707909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd794153800 0x7fd7940cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.395+0000 7fd79a2fc640 1 --2- 172.21.15.46:0/3456707909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7940cc3e0 0x7fd794155d20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.395+0000 7fd79a2fc640 1 -- 172.21.15.46:0/3456707909 >> 172.21.15.46:0/3456707909 conn(0x7fd794072890 msgr2=0x7fd79406a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:35.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.395+0000 7fd79a2fc640 1 -- 172.21.15.46:0/3456707909 shutdown_connections 2024-01-23T08:55:35.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.395+0000 7fd79a2fc640 1 -- 172.21.15.46:0/3456707909 wait complete. 2024-01-23T08:55:35.411 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509463 got 64424509463 for osd.7 2024-01-23T08:55:35.411 DEBUG:teuthology.parallel:result is None 2024-01-23T08:55:35.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.467+0000 7f50c6ffd640 1 -- 172.21.15.46:0/1461695439 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f50cc0c8420 con 0x7f50d80c7e50 2024-01-23T08:55:35.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.467+0000 7f50c6ffd640 1 --2- 172.21.15.46:0/1461695439 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f50b8066500 0x7f50b80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:35.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.467+0000 7f50d659c640 1 --2- 172.21.15.46:0/1461695439 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f50b8066500 0x7f50b80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:35.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.467+0000 7f50d659c640 1 --2- 172.21.15.46:0/1461695439 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f50b8066500 0x7f50b80689c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f50c8001c90 tx=0x7f50c8007d20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:35.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.471+0000 7fba78ab6640 1 -- 172.21.15.46:0/3846546242 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fba741444d0 con 0x7fba740c65a0 2024-01-23T08:55:35.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.475+0000 7f50c6ffd640 1 -- 172.21.15.46:0/1461695439 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f50cc0a8050 con 0x7f50d80c7e50 2024-01-23T08:55:35.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.487+0000 7fba62ffd640 1 -- 172.21.15.46:0/3846546242 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fba6c019070 con 0x7fba740c65a0 2024-01-23T08:55:35.483 INFO:teuthology.orchestra.run.smithi046.stdout:64424509462 2024-01-23T08:55:35.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.487+0000 7fba78ab6640 1 -- 172.21.15.46:0/3846546242 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fba54066550 msgr2=0x7fba54068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:35.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.487+0000 7fba78ab6640 1 --2- 172.21.15.46:0/3846546242 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fba54066550 0x7fba54068a10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fba64009650 tx=0x7fba64006bb0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.487+0000 7fba78ab6640 1 -- 172.21.15.46:0/3846546242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba740c65a0 msgr2=0x7fba740cbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:35.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.487+0000 7fba78ab6640 1 --2- 172.21.15.46:0/3846546242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba740c65a0 0x7fba740cbba0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fba6c00b9a0 tx=0x7fba6c00be60 comp rx=0 tx=0).stop 2024-01-23T08:55:35.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.487+0000 7fba78ab6640 1 -- 172.21.15.46:0/3846546242 shutdown_connections 2024-01-23T08:55:35.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.487+0000 7fba78ab6640 1 --2- 172.21.15.46:0/3846546242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba740c65a0 0x7fba740cbba0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.487+0000 7fba78ab6640 1 --2- 172.21.15.46:0/3846546242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba74070290 0x7fba740cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.487+0000 7fba78ab6640 1 --2- 172.21.15.46:0/3846546242 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fba54066550 0x7fba54068a10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.487+0000 7fba78ab6640 1 --2- 172.21.15.46:0/3846546242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba7406feb0 0x7fba74158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.487+0000 7fba78ab6640 1 -- 172.21.15.46:0/3846546242 >> 172.21.15.46:0/3846546242 conn(0x7fba74072890 msgr2=0x7fba740c3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:35.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.487+0000 7fba78ab6640 1 -- 172.21.15.46:0/3846546242 shutdown_connections 2024-01-23T08:55:35.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.487+0000 7fba78ab6640 1 -- 172.21.15.46:0/3846546242 wait complete. 2024-01-23T08:55:35.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.503+0000 7f50c6ffd640 1 -- 172.21.15.46:0/1461695439 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f50cc0eb780 con 0x7f50d80c7e50 2024-01-23T08:55:35.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.503+0000 7fd2da7fc640 1 -- 172.21.15.46:0/974809213 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd2e00b6020 con 0x7fd2e406e460 2024-01-23T08:55:35.502 INFO:teuthology.orchestra.run.smithi046.stdout:64424509462 2024-01-23T08:55:35.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509462 got 64424509462 for osd.0 2024-01-23T08:55:35.503 DEBUG:teuthology.parallel:result is None 2024-01-23T08:55:35.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.507+0000 7fd2ebfa0640 1 -- 172.21.15.46:0/974809213 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd2c8066580 msgr2=0x7fd2c8068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:35.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.507+0000 7fd2ebfa0640 1 --2- 172.21.15.46:0/974809213 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd2c8066580 0x7fd2c8068a40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4006aa0 tx=0x7fd2d4006a30 comp rx=0 tx=0).stop 2024-01-23T08:55:35.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.507+0000 7fd2ebfa0640 1 -- 172.21.15.46:0/974809213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2e406e460 msgr2=0x7fd2e4149f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:35.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.507+0000 7fd2ebfa0640 1 --2- 172.21.15.46:0/974809213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2e406e460 0x7fd2e4149f10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd2e000b2c0 tx=0x7fd2e001e160 comp rx=0 tx=0).stop 2024-01-23T08:55:35.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.507+0000 7fd2ebfa0640 1 -- 172.21.15.46:0/974809213 shutdown_connections 2024-01-23T08:55:35.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.507+0000 7fd2ebfa0640 1 --2- 172.21.15.46:0/974809213 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd2e4150500 0x7fd2e406f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.507+0000 7fd2ebfa0640 1 --2- 172.21.15.46:0/974809213 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2e40c2e00 0x7fd2e41eb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.507+0000 7fd2ebfa0640 1 --2- 172.21.15.46:0/974809213 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd2c8066580 0x7fd2c8068a40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.507+0000 7fd2ebfa0640 1 --2- 172.21.15.46:0/974809213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2e406e460 0x7fd2e4149f10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.507+0000 7fd2ebfa0640 1 -- 172.21.15.46:0/974809213 >> 172.21.15.46:0/974809213 conn(0x7fd2e406b770 msgr2=0x7fd2e40c8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:35.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.507+0000 7fd2ebfa0640 1 -- 172.21.15.46:0/974809213 shutdown_connections 2024-01-23T08:55:35.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.507+0000 7fd2ebfa0640 1 -- 172.21.15.46:0/974809213 wait complete. 2024-01-23T08:55:35.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509462 got 64424509462 for osd.5 2024-01-23T08:55:35.521 DEBUG:teuthology.parallel:result is None 2024-01-23T08:55:35.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.659+0000 7f50dcf57640 1 -- 172.21.15.46:0/1461695439 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f50d806ad60 con 0x7f50d80c7e50 2024-01-23T08:55:35.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.679+0000 7f50c6ffd640 1 -- 172.21.15.46:0/1461695439 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f50d806ad60 con 0x7f50d80c7e50 2024-01-23T08:55:35.676 INFO:teuthology.orchestra.run.smithi046.stdout:64424509461 2024-01-23T08:55:35.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.679+0000 7f50dcf57640 1 -- 172.21.15.46:0/1461695439 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f50b8066500 msgr2=0x7f50b80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:35.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.679+0000 7f50dcf57640 1 --2- 172.21.15.46:0/1461695439 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f50b8066500 0x7f50b80689c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f50c8001c90 tx=0x7f50c8007d20 comp rx=0 tx=0).stop 2024-01-23T08:55:35.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.679+0000 7f50dcf57640 1 -- 172.21.15.46:0/1461695439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50d80c7e50 msgr2=0x7f50d814b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:35.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.679+0000 7f50dcf57640 1 --2- 172.21.15.46:0/1461695439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50d80c7e50 0x7f50d814b940 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0ad040 tx=0x7f50cc01ad40 comp rx=0 tx=0).stop 2024-01-23T08:55:35.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.679+0000 7f50dcf57640 1 -- 172.21.15.46:0/1461695439 shutdown_connections 2024-01-23T08:55:35.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.679+0000 7f50dcf57640 1 --2- 172.21.15.46:0/1461695439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50d81516b0 0x7f50d80c14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.679+0000 7f50dcf57640 1 --2- 172.21.15.46:0/1461695439 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f50b8066500 0x7f50b80689c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.679+0000 7f50dcf57640 1 --2- 172.21.15.46:0/1461695439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50d80c7e50 0x7f50d814b940 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.679+0000 7f50dcf57640 1 --2- 172.21.15.46:0/1461695439 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50d80707c0 0x7f50d8142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.679+0000 7f50dcf57640 1 -- 172.21.15.46:0/1461695439 >> 172.21.15.46:0/1461695439 conn(0x7f50d8072450 msgr2=0x7f50d806af00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:35.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.679+0000 7f50dcf57640 1 -- 172.21.15.46:0/1461695439 shutdown_connections 2024-01-23T08:55:35.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.679+0000 7f50dcf57640 1 -- 172.21.15.46:0/1461695439 wait complete. 2024-01-23T08:55:35.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509461 got 64424509461 for osd.4 2024-01-23T08:55:35.695 DEBUG:teuthology.parallel:result is None 2024-01-23T08:55:35.760 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-23T08:55:35.783 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-23T08:55:35.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.887+0000 7fb591c5b640 1 Processor -- start 2024-01-23T08:55:35.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.891+0000 7fb591c5b640 1 -- start start 2024-01-23T08:55:35.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.891+0000 7fb591c5b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb58c0c8160 0x7fb58c0c3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:35.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.891+0000 7fb591c5b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb58c0c8dc0 0x7fb58c15a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:35.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.891+0000 7fb591c5b640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb58c0c3200 con 0x7fb58c151640 2024-01-23T08:55:35.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.891+0000 7fb591c5b640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb58c0b0530 con 0x7fb58c0c8dc0 2024-01-23T08:55:35.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.891+0000 7fb591c5b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb58c0c9230 con 0x7fb58c0c8160 2024-01-23T08:55:35.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.891+0000 7fb58affd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb58c0c8160 0x7fb58c0c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:35.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.891+0000 7fb58affd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb58c0c8160 0x7fb58c0c3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:56450/0 (socket says 172.21.15.46:56450) 2024-01-23T08:55:35.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.891+0000 7fb58affd640 1 -- 172.21.15.46:0/1082196076 learned_addr learned my addr 172.21.15.46:0/1082196076 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:35.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.899+0000 7fb58affd640 1 -- 172.21.15.46:0/1082196076 >> v2:172.21.15.46:3300/0 conn(0x7fb58c0c8dc0 msgr2=0x7fb58c15a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:35.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.899+0000 7fb58affd640 1 --2- 172.21.15.46:0/1082196076 >> v2:172.21.15.46:3300/0 conn(0x7fb58c0c8dc0 0x7fb58c15a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.899+0000 7fb58affd640 1 -- 172.21.15.46:0/1082196076 >> v1:172.21.15.46:6789/0 conn(0x7fb58c151640 legacy=0x7fb58c0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:35.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.899+0000 7fb58affd640 1 -- 172.21.15.46:0/1082196076 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58c15b4f0 con 0x7fb58c0c8160 2024-01-23T08:55:35.900 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-23T08:55:35.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.903+0000 7fb58affd640 1 --2- 172.21.15.46:0/1082196076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb58c0c8160 0x7fb58c0c3690 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb58c0cdc10 tx=0x7fb58001ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f275eff16fe3bb26 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:35.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.915+0000 7fb58a7fc640 1 -- 172.21.15.46:0/1082196076 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5800a89b0 con 0x7fb58c0c8160 2024-01-23T08:55:35.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.915+0000 7fb58a7fc640 1 -- 172.21.15.46:0/1082196076 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5800a8b10 con 0x7fb58c0c8160 2024-01-23T08:55:35.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.915+0000 7fb58a7fc640 1 -- 172.21.15.46:0/1082196076 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5800a8ea0 con 0x7fb58c0c8160 2024-01-23T08:55:35.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.915+0000 7fb591c5b640 1 -- 172.21.15.46:0/1082196076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb58c0c8160 msgr2=0x7fb58c0c3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:35.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.915+0000 7fb591c5b640 1 --2- 172.21.15.46:0/1082196076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb58c0c8160 0x7fb58c0c3690 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb58c0cdc10 tx=0x7fb58001ecb0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.919+0000 7fb591c5b640 1 -- 172.21.15.46:0/1082196076 shutdown_connections 2024-01-23T08:55:35.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.919+0000 7fb591c5b640 1 --2- 172.21.15.46:0/1082196076 >> v2:172.21.15.46:3300/0 conn(0x7fb58c0c8dc0 0x7fb58c15a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.919+0000 7fb591c5b640 1 --2- 172.21.15.46:0/1082196076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb58c0c8160 0x7fb58c0c3690 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.919+0000 7fb591c5b640 1 -- 172.21.15.46:0/1082196076 >> 172.21.15.46:0/1082196076 conn(0x7fb58c06a660 msgr2=0x7fb58c06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:35.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.919+0000 7fb591c5b640 1 -- 172.21.15.46:0/1082196076 shutdown_connections 2024-01-23T08:55:35.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.919+0000 7fb591c5b640 1 -- 172.21.15.46:0/1082196076 wait complete. 2024-01-23T08:55:35.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.919+0000 7fb591c5b640 1 Processor -- start 2024-01-23T08:55:35.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.919+0000 7fb591c5b640 1 -- start start 2024-01-23T08:55:35.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.919+0000 7fb591c5b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb58c0c8160 0x7fb58c0cae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:35.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.919+0000 7fb591c5b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb58c0c8dc0 0x7fb58c1e2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:35.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.919+0000 7fb591c5b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb58c151640 0x7fb58c147660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:35.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.919+0000 7fb591c5b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c14a400 con 0x7fb58c0c8160 2024-01-23T08:55:35.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.919+0000 7fb591c5b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c1ece50 con 0x7fb58c0c8dc0 2024-01-23T08:55:35.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.919+0000 7fb591c5b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c14a6a0 con 0x7fb58c151640 2024-01-23T08:55:35.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.923+0000 7fb58affd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb58c0c8dc0 0x7fb58c1e2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:35.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.923+0000 7fb58affd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb58c0c8dc0 0x7fb58c1e2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:56466/0 (socket says 172.21.15.46:56466) 2024-01-23T08:55:35.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.923+0000 7fb58affd640 1 -- 172.21.15.46:0/227002247 learned_addr learned my addr 172.21.15.46:0/227002247 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:35.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.931+0000 7f39a4f48640 1 Processor -- start 2024-01-23T08:55:35.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.931+0000 7f39a4f48640 1 -- start start 2024-01-23T08:55:35.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.931+0000 7f39a4f48640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f39a0153a90 0x7f39a00c7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:35.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.931+0000 7f39a4f48640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f39a00c2bc0 0x7f39a00c8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:35.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.931+0000 7f39a4f48640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a00c6a90 con 0x7f39a01536b0 2024-01-23T08:55:35.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.931+0000 7f39a4f48640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a00c1330 con 0x7f39a0153a90 2024-01-23T08:55:35.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.931+0000 7f39a4f48640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a006e000 con 0x7f39a00c2bc0 2024-01-23T08:55:35.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.935+0000 7fb58affd640 1 -- 172.21.15.46:0/227002247 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb58c151640 msgr2=0x7fb58c147660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:35.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.935+0000 7fb58affd640 1 --2- 172.21.15.46:0/227002247 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb58c151640 0x7fb58c147660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.935+0000 7fb58affd640 1 -- 172.21.15.46:0/227002247 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb58c0c8160 msgr2=0x7fb58c0cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:35.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.935+0000 7fb58affd640 1 --2- 172.21.15.46:0/227002247 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb58c0c8160 0x7fb58c0cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.935+0000 7fb58affd640 1 -- 172.21.15.46:0/227002247 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5800094d0 con 0x7fb58c0c8dc0 2024-01-23T08:55:35.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.939+0000 7fb58affd640 1 --2- 172.21.15.46:0/227002247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb58c0c8dc0 0x7fb58c1e2e50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb58001b8c0 tx=0x7fb58001ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:35.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.947+0000 7f399e59c640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f39a01536b0 0x7f39a006ebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38658/0 (socket says 172.21.15.46:38658) 2024-01-23T08:55:35.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.947+0000 7f399e59c640 1 -- 172.21.15.46:0/1037491591 learned_addr learned my addr 172.21.15.46:0/1037491591 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:35.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.947+0000 7f399dd9b640 1 --2- 172.21.15.46:0/1037491591 >> v2:172.21.15.46:3300/0 conn(0x7f39a0153a90 0x7f39a00c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:35.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.951+0000 7f399ed9d640 1 --2- 172.21.15.46:0/1037491591 >> v2:172.21.15.175:3300/0 conn(0x7f39a00c2bc0 0x7f39a00c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:35.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.955+0000 7f399dd9b640 1 -- 172.21.15.46:0/1037491591 >> v2:172.21.15.175:3300/0 conn(0x7f39a00c2bc0 msgr2=0x7f39a00c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:35.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.955+0000 7f399dd9b640 1 --2- 172.21.15.46:0/1037491591 >> v2:172.21.15.175:3300/0 conn(0x7f39a00c2bc0 0x7f39a00c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.955+0000 7f399dd9b640 1 -- 172.21.15.46:0/1037491591 >> v1:172.21.15.46:6789/0 conn(0x7f39a01536b0 legacy=0x7f39a006ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:35.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.955+0000 7f399dd9b640 1 -- 172.21.15.46:0/1037491591 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a006e2e0 con 0x7f39a0153a90 2024-01-23T08:55:35.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.959+0000 7f399dd9b640 1 --2- 172.21.15.46:0/1037491591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39a0153a90 0x7f39a00c7280 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f39a006c300 tx=0x7f398801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26aff8813b3dda3 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:35.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.963+0000 7f399d59a640 1 -- 172.21.15.46:0/1037491591 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39880a8950 con 0x7f39a0153a90 2024-01-23T08:55:35.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.963+0000 7f399d59a640 1 -- 172.21.15.46:0/1037491591 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39880a8ab0 con 0x7f39a0153a90 2024-01-23T08:55:35.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.963+0000 7f399d59a640 1 -- 172.21.15.46:0/1037491591 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39880a8e40 con 0x7f39a0153a90 2024-01-23T08:55:35.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.967+0000 7f39a4f48640 1 -- 172.21.15.46:0/1037491591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39a0153a90 msgr2=0x7f39a00c7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:35.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.967+0000 7f39a4f48640 1 --2- 172.21.15.46:0/1037491591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39a0153a90 0x7f39a00c7280 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f39a006c300 tx=0x7f398801ec50 comp rx=0 tx=0).stop 2024-01-23T08:55:35.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.967+0000 7f39a4f48640 1 -- 172.21.15.46:0/1037491591 shutdown_connections 2024-01-23T08:55:35.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.967+0000 7f39a4f48640 1 --2- 172.21.15.46:0/1037491591 >> v2:172.21.15.175:3300/0 conn(0x7f39a00c2bc0 0x7f39a00c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.967+0000 7f39a4f48640 1 --2- 172.21.15.46:0/1037491591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39a0153a90 0x7f39a00c7280 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.967+0000 7f39a4f48640 1 -- 172.21.15.46:0/1037491591 >> 172.21.15.46:0/1037491591 conn(0x7f39a006b770 msgr2=0x7f39a006bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:35.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.967+0000 7f39a4f48640 1 -- 172.21.15.46:0/1037491591 shutdown_connections 2024-01-23T08:55:35.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.967+0000 7f39a4f48640 1 -- 172.21.15.46:0/1037491591 wait complete. 2024-01-23T08:55:35.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.967+0000 7f39a4f48640 1 Processor -- start 2024-01-23T08:55:35.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.967+0000 7f39a4f48640 1 -- start start 2024-01-23T08:55:35.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.967+0000 7f39a4f48640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39a00c2bc0 0x7f39a01e2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:35.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.967+0000 7f39a4f48640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39a01536b0 0x7f39a00cb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:35.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.967+0000 7f39a4f48640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39a015a750 0x7f39a015c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:35.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.967+0000 7f39a4f48640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a014e920 con 0x7f39a01536b0 2024-01-23T08:55:35.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.967+0000 7f39a4f48640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a015c440 con 0x7f39a00c2bc0 2024-01-23T08:55:35.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.967+0000 7f39a4f48640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a014f3f0 con 0x7f39a015a750 2024-01-23T08:55:35.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.967+0000 7f399dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39a01536b0 0x7f39a00cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:35.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.967+0000 7f399dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39a01536b0 0x7f39a00cb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54762/0 (socket says 172.21.15.46:54762) 2024-01-23T08:55:35.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.967+0000 7f399dd9b640 1 -- 172.21.15.46:0/1342986180 learned_addr learned my addr 172.21.15.46:0/1342986180 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:35.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.975+0000 7f399dd9b640 1 -- 172.21.15.46:0/1342986180 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39a015a750 msgr2=0x7f39a015c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:35.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.975+0000 7f399dd9b640 1 --2- 172.21.15.46:0/1342986180 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39a015a750 0x7f39a015c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.975+0000 7f399dd9b640 1 -- 172.21.15.46:0/1342986180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39a00c2bc0 msgr2=0x7f39a01e2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:35.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.975+0000 7f399dd9b640 1 --2- 172.21.15.46:0/1342986180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39a00c2bc0 0x7f39a01e2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:35.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.975+0000 7f399dd9b640 1 -- 172.21.15.46:0/1342986180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3988009420 con 0x7f39a01536b0 2024-01-23T08:55:35.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.979+0000 7f399dd9b640 1 --2- 172.21.15.46:0/1342986180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39a01536b0 0x7f39a00cb050 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f398801c880 tx=0x7f398801b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:35.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.983+0000 7f3996ffd640 1 -- 172.21.15.46:0/1342986180 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39880b9630 con 0x7f39a01536b0 2024-01-23T08:55:35.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.983+0000 7f3996ffd640 1 -- 172.21.15.46:0/1342986180 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39880b97b0 con 0x7f39a01536b0 2024-01-23T08:55:35.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.983+0000 7f3996ffd640 1 -- 172.21.15.46:0/1342986180 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39880b9b60 con 0x7f39a01536b0 2024-01-23T08:55:35.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.983+0000 7f39a4f48640 1 -- 172.21.15.46:0/1342986180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a014f6d0 con 0x7f39a01536b0 2024-01-23T08:55:35.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.983+0000 7f39a4f48640 1 -- 172.21.15.46:0/1342986180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a00cba40 con 0x7f39a01536b0 2024-01-23T08:55:35.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:35.983+0000 7f39a4f48640 1 -- 172.21.15.46:0/1342986180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a015bf10 con 0x7f39a01536b0 2024-01-23T08:55:36.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.015+0000 7f3996ffd640 1 -- 172.21.15.46:0/1342986180 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f39880b7040 con 0x7f39a01536b0 2024-01-23T08:55:36.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.015+0000 7f3996ffd640 1 --2- 172.21.15.46:0/1342986180 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3980066550 0x7f3980068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:36.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.015+0000 7f399e59c640 1 --2- 172.21.15.46:0/1342986180 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3980066550 0x7f3980068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:36.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.015+0000 7f399e59c640 1 --2- 172.21.15.46:0/1342986180 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3980066550 0x7f3980068a10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3998000f70 tx=0x7f3998007a90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:36.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.039+0000 7f079442b640 1 Processor -- start 2024-01-23T08:55:36.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.039+0000 7f079442b640 1 -- start start 2024-01-23T08:55:36.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.039+0000 7f079442b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f078c1507a0 0x7f078c0c7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:36.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.039+0000 7f079442b640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078c0c7c10 con 0x7f078c0c5580 2024-01-23T08:55:36.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.039+0000 7f079442b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078c159850 con 0x7f078c0c51a0 2024-01-23T08:55:36.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.039+0000 7f079442b640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f078c159b30 con 0x7f078c1507a0 2024-01-23T08:55:36.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.047+0000 7fb573fff640 1 -- 172.21.15.46:0/227002247 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5800b0e20 con 0x7fb58c0c8dc0 2024-01-23T08:55:36.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.047+0000 7fb573fff640 1 -- 172.21.15.46:0/227002247 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5800ba440 con 0x7fb58c0c8dc0 2024-01-23T08:55:36.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.047+0000 7fb573fff640 1 -- 172.21.15.46:0/227002247 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5800ba7f0 con 0x7fb58c0c8dc0 2024-01-23T08:55:36.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.047+0000 7fb591c5b640 1 -- 172.21.15.46:0/227002247 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58c14a980 con 0x7fb58c0c8dc0 2024-01-23T08:55:36.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.047+0000 7fb591c5b640 1 -- 172.21.15.46:0/227002247 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58c1ed3f0 con 0x7fb58c0c8dc0 2024-01-23T08:55:36.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.047+0000 7fb591c5b640 1 -- 172.21.15.46:0/227002247 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb58c074340 con 0x7fb58c0c8dc0 2024-01-23T08:55:36.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.335+0000 7f3996ffd640 1 -- 172.21.15.46:0/1342986180 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f39880aee20 con 0x7f39a01536b0 2024-01-23T08:55:36.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.335+0000 7f3996ffd640 1 -- 172.21.15.46:0/1342986180 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f39880eff40 con 0x7f39a01536b0 2024-01-23T08:55:36.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.343+0000 7f07919c6640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f078c1507a0 0x7f078c0c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:36.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.343+0000 7f07919c6640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f078c1507a0 0x7f078c0c7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54770/0 (socket says 172.21.15.46:54770) 2024-01-23T08:55:36.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.343+0000 7f07919c6640 1 -- 172.21.15.46:0/1688563704 learned_addr learned my addr 172.21.15.46:0/1688563704 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:36.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.351+0000 7f07919c6640 1 -- 172.21.15.46:0/1688563704 >> v1:172.21.15.175:6789/0 conn(0x7f078c0c51a0 legacy=0x7f078c150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:36.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.351+0000 7f07919c6640 1 -- 172.21.15.46:0/1688563704 >> v1:172.21.15.46:6789/0 conn(0x7f078c0c5580 legacy=0x7f078c0c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:36.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.351+0000 7f07919c6640 1 -- 172.21.15.46:0/1688563704 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078c159e10 con 0x7f078c1507a0 2024-01-23T08:55:36.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.355+0000 7fb573fff640 1 -- 172.21.15.46:0/227002247 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb5800ba950 con 0x7fb58c0c8dc0 2024-01-23T08:55:36.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.355+0000 7fb573fff640 1 --2- 172.21.15.46:0/227002247 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fb578066530 0x7fb5780689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:36.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.355+0000 7fb58b7fe640 1 --2- 172.21.15.46:0/227002247 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fb578066530 0x7fb5780689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:36.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.355+0000 7fb58b7fe640 1 --2- 172.21.15.46:0/227002247 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fb578066530 0x7fb5780689f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb57c007fd0 tx=0x7fb57c0079a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:36.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.359+0000 7f07919c6640 1 --2- 172.21.15.46:0/1688563704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f078c1507a0 0x7f078c0c7620 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f078000bb10 tx=0x7f0780021380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba31ffd0685e6ff3 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:36.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.363+0000 7fb573fff640 1 -- 172.21.15.46:0/227002247 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb5800f4350 con 0x7fb58c0c8dc0 2024-01-23T08:55:36.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.367+0000 7f07911c5640 1 -- 172.21.15.46:0/1688563704 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07800b1600 con 0x7f078c1507a0 2024-01-23T08:55:36.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.367+0000 7f07911c5640 1 -- 172.21.15.46:0/1688563704 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07800ad050 con 0x7f078c1507a0 2024-01-23T08:55:36.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.367+0000 7f07911c5640 1 -- 172.21.15.46:0/1688563704 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07800b1980 con 0x7f078c1507a0 2024-01-23T08:55:36.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.367+0000 7f079442b640 1 -- 172.21.15.46:0/1688563704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f078c1507a0 msgr2=0x7f078c0c7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:36.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.367+0000 7f079442b640 1 --2- 172.21.15.46:0/1688563704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f078c1507a0 0x7f078c0c7620 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f078000bb10 tx=0x7f0780021380 comp rx=0 tx=0).stop 2024-01-23T08:55:36.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.367+0000 7f079442b640 1 -- 172.21.15.46:0/1688563704 shutdown_connections 2024-01-23T08:55:36.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.367+0000 7f079442b640 1 --2- 172.21.15.46:0/1688563704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f078c1507a0 0x7f078c0c7620 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:36.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.367+0000 7f079442b640 1 -- 172.21.15.46:0/1688563704 >> 172.21.15.46:0/1688563704 conn(0x7f078c0cb3e0 msgr2=0x7f078c0cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:36.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.367+0000 7f079442b640 1 -- 172.21.15.46:0/1688563704 shutdown_connections 2024-01-23T08:55:36.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.367+0000 7f079442b640 1 -- 172.21.15.46:0/1688563704 wait complete. 2024-01-23T08:55:36.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.371+0000 7f079442b640 1 Processor -- start 2024-01-23T08:55:36.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.371+0000 7f079442b640 1 -- start start 2024-01-23T08:55:36.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.371+0000 7f079442b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f078c0c51a0 0x7f078c06b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:36.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.371+0000 7f079442b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f078c0c5580 0x7f078c1ef1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:36.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.371+0000 7f079442b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f078c1507a0 0x7f078c1ef720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:36.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.371+0000 7f079442b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078c1f2750 con 0x7f078c1507a0 2024-01-23T08:55:36.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.371+0000 7f079442b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078c14a9e0 con 0x7f078c0c51a0 2024-01-23T08:55:36.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.371+0000 7f079442b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078c1f29a0 con 0x7f078c0c5580 2024-01-23T08:55:36.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.371+0000 7f07929c8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f078c1507a0 0x7f078c1ef720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:36.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.371+0000 7f07929c8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f078c1507a0 0x7f078c1ef720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54778/0 (socket says 172.21.15.46:54778) 2024-01-23T08:55:36.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.371+0000 7f07929c8640 1 -- 172.21.15.46:0/3977469132 learned_addr learned my addr 172.21.15.46:0/3977469132 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:36.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.371+0000 7f07919c6640 1 --2- 172.21.15.46:0/3977469132 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f078c0c5580 0x7f078c1ef1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:36.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.375+0000 7f07929c8640 1 -- 172.21.15.46:0/3977469132 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f078c0c5580 msgr2=0x7f078c1ef1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:36.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.375+0000 7f07929c8640 1 --2- 172.21.15.46:0/3977469132 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f078c0c5580 0x7f078c1ef1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:36.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.375+0000 7f07929c8640 1 -- 172.21.15.46:0/3977469132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f078c0c51a0 msgr2=0x7f078c06b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:36.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.375+0000 7f07929c8640 1 --2- 172.21.15.46:0/3977469132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f078c0c51a0 0x7f078c06b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:36.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.375+0000 7f07929c8640 1 -- 172.21.15.46:0/3977469132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078000b770 con 0x7f078c1507a0 2024-01-23T08:55:36.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.379+0000 7f07929c8640 1 --2- 172.21.15.46:0/3977469132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f078c1507a0 0x7f078c1ef720 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f078400c780 tx=0x7f078400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:36.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.383+0000 7f077effd640 1 -- 172.21.15.46:0/3977469132 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0784004b70 con 0x7f078c1507a0 2024-01-23T08:55:36.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.383+0000 7f077effd640 1 -- 172.21.15.46:0/3977469132 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078400ce90 con 0x7f078c1507a0 2024-01-23T08:55:36.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.383+0000 7f079442b640 1 -- 172.21.15.46:0/3977469132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f078c1f2c80 con 0x7f078c1507a0 2024-01-23T08:55:36.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.383+0000 7f077effd640 1 -- 172.21.15.46:0/3977469132 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078400a850 con 0x7f078c1507a0 2024-01-23T08:55:36.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.383+0000 7f079442b640 1 -- 172.21.15.46:0/3977469132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f078c1f3240 con 0x7f078c1507a0 2024-01-23T08:55:36.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.383+0000 7f079442b640 1 -- 172.21.15.46:0/3977469132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f078c1f3430 con 0x7f078c1507a0 2024-01-23T08:55:36.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.403+0000 7fb573fff640 1 -- 172.21.15.46:0/227002247 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb5800eff90 con 0x7fb58c0c8dc0 2024-01-23T08:55:36.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.527+0000 7f39a4f48640 1 -- 172.21.15.46:0/1342986180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f39a014f8c0 con 0x7f39a01536b0 2024-01-23T08:55:36.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.571+0000 7fb591c5b640 1 -- 172.21.15.46:0/227002247 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fb58c074340 con 0x7fb58c0c8dc0 2024-01-23T08:55:36.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.579+0000 7fb573fff640 1 -- 172.21.15.46:0/227002247 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb5800b5030 con 0x7fb58c0c8dc0 2024-01-23T08:55:36.577 INFO:teuthology.orchestra.run.smithi046.stdout:60129542167 2024-01-23T08:55:36.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.583+0000 7fb591c5b640 1 -- 172.21.15.46:0/227002247 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fb578066530 msgr2=0x7fb5780689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:36.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.583+0000 7fb591c5b640 1 --2- 172.21.15.46:0/227002247 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fb578066530 0x7fb5780689f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb57c007fd0 tx=0x7fb57c0079a0 comp rx=0 tx=0).stop 2024-01-23T08:55:36.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.583+0000 7fb591c5b640 1 -- 172.21.15.46:0/227002247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb58c0c8dc0 msgr2=0x7fb58c1e2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:36.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.583+0000 7fb591c5b640 1 --2- 172.21.15.46:0/227002247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb58c0c8dc0 0x7fb58c1e2e50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb58001b8c0 tx=0x7fb58001ba50 comp rx=0 tx=0).stop 2024-01-23T08:55:36.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.583+0000 7fb591c5b640 1 -- 172.21.15.46:0/227002247 shutdown_connections 2024-01-23T08:55:36.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.583+0000 7fb591c5b640 1 --2- 172.21.15.46:0/227002247 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb58c151640 0x7fb58c147660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:36.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.583+0000 7fb591c5b640 1 --2- 172.21.15.46:0/227002247 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fb578066530 0x7fb5780689f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:36.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.583+0000 7fb591c5b640 1 --2- 172.21.15.46:0/227002247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb58c0c8dc0 0x7fb58c1e2e50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:36.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.583+0000 7fb591c5b640 1 --2- 172.21.15.46:0/227002247 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb58c0c8160 0x7fb58c0cae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:36.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.583+0000 7fb591c5b640 1 -- 172.21.15.46:0/227002247 >> 172.21.15.46:0/227002247 conn(0x7fb58c06a660 msgr2=0x7fb58c15a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:36.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.583+0000 7fb591c5b640 1 -- 172.21.15.46:0/227002247 shutdown_connections 2024-01-23T08:55:36.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.583+0000 7fb591c5b640 1 -- 172.21.15.46:0/227002247 wait complete. 2024-01-23T08:55:36.597 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542167 got 60129542167 for osd.6 2024-01-23T08:55:36.597 DEBUG:teuthology.parallel:result is None 2024-01-23T08:55:36.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.659+0000 7f077effd640 1 -- 172.21.15.46:0/3977469132 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f0784006b60 con 0x7f078c1507a0 2024-01-23T08:55:36.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.659+0000 7f077effd640 1 --2- 172.21.15.46:0/3977469132 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f0770066550 0x7f0770068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:36.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.659+0000 7f07921c7640 1 --2- 172.21.15.46:0/3977469132 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f0770066550 0x7f0770068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:36.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.659+0000 7f07921c7640 1 --2- 172.21.15.46:0/3977469132 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f0770066550 0x7f0770068a10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0788007fd0 tx=0x7f07880079a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:36.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.671+0000 7f077effd640 1 -- 172.21.15.46:0/3977469132 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0784056180 con 0x7f078c1507a0 2024-01-23T08:55:36.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.671+0000 7f077effd640 1 -- 172.21.15.46:0/3977469132 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f0784051dc0 con 0x7f078c1507a0 2024-01-23T08:55:36.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.739+0000 7f3996ffd640 1 -- 172.21.15.46:0/1342986180 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f39880f3560 con 0x7f39a01536b0 2024-01-23T08:55:36.739 INFO:teuthology.orchestra.run.smithi046.stdout:64424509463 2024-01-23T08:55:36.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.743+0000 7f39a4f48640 1 -- 172.21.15.46:0/1342986180 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3980066550 msgr2=0x7f3980068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:36.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.743+0000 7f39a4f48640 1 --2- 172.21.15.46:0/1342986180 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3980066550 0x7f3980068a10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3998000f70 tx=0x7f3998007a90 comp rx=0 tx=0).stop 2024-01-23T08:55:36.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.743+0000 7f39a4f48640 1 -- 172.21.15.46:0/1342986180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39a01536b0 msgr2=0x7f39a00cb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:36.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.743+0000 7f39a4f48640 1 --2- 172.21.15.46:0/1342986180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39a01536b0 0x7f39a00cb050 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f398801c880 tx=0x7f398801b9f0 comp rx=0 tx=0).stop 2024-01-23T08:55:36.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.743+0000 7f39a4f48640 1 -- 172.21.15.46:0/1342986180 shutdown_connections 2024-01-23T08:55:36.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.743+0000 7f39a4f48640 1 --2- 172.21.15.46:0/1342986180 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39a015a750 0x7f39a015c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:36.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.743+0000 7f39a4f48640 1 --2- 172.21.15.46:0/1342986180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39a01536b0 0x7f39a00cb050 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:36.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.743+0000 7f39a4f48640 1 --2- 172.21.15.46:0/1342986180 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3980066550 0x7f3980068a10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:36.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.743+0000 7f39a4f48640 1 --2- 172.21.15.46:0/1342986180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39a00c2bc0 0x7f39a01e2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:36.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.743+0000 7f39a4f48640 1 -- 172.21.15.46:0/1342986180 >> 172.21.15.46:0/1342986180 conn(0x7f39a006b770 msgr2=0x7f39a0151e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:36.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.743+0000 7f39a4f48640 1 -- 172.21.15.46:0/1342986180 shutdown_connections 2024-01-23T08:55:36.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.743+0000 7f39a4f48640 1 -- 172.21.15.46:0/1342986180 wait complete. 2024-01-23T08:55:36.763 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509462 got 64424509463 for osd.1 2024-01-23T08:55:36.763 DEBUG:teuthology.parallel:result is None 2024-01-23T08:55:36.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.863+0000 7f079442b640 1 -- 172.21.15.46:0/3977469132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f078c074340 con 0x7f078c1507a0 2024-01-23T08:55:36.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.871+0000 7f077effd640 1 -- 172.21.15.46:0/3977469132 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f07840553e0 con 0x7f078c1507a0 2024-01-23T08:55:36.870 INFO:teuthology.orchestra.run.smithi046.stdout:64424509465 2024-01-23T08:55:36.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.875+0000 7f079442b640 1 -- 172.21.15.46:0/3977469132 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f0770066550 msgr2=0x7f0770068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:36.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.875+0000 7f079442b640 1 --2- 172.21.15.46:0/3977469132 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f0770066550 0x7f0770068a10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0788007fd0 tx=0x7f07880079a0 comp rx=0 tx=0).stop 2024-01-23T08:55:36.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.875+0000 7f079442b640 1 -- 172.21.15.46:0/3977469132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f078c1507a0 msgr2=0x7f078c1ef720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:36.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.875+0000 7f079442b640 1 --2- 172.21.15.46:0/3977469132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f078c1507a0 0x7f078c1ef720 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f078400c780 tx=0x7f078400cc40 comp rx=0 tx=0).stop 2024-01-23T08:55:36.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.875+0000 7f079442b640 1 -- 172.21.15.46:0/3977469132 shutdown_connections 2024-01-23T08:55:36.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.875+0000 7f079442b640 1 --2- 172.21.15.46:0/3977469132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f078c1507a0 0x7f078c1ef720 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:36.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.875+0000 7f079442b640 1 --2- 172.21.15.46:0/3977469132 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f078c0c5580 0x7f078c1ef1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:36.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.875+0000 7f079442b640 1 --2- 172.21.15.46:0/3977469132 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f0770066550 0x7f0770068a10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:36.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.875+0000 7f079442b640 1 --2- 172.21.15.46:0/3977469132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f078c0c51a0 0x7f078c06b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:36.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.875+0000 7f079442b640 1 -- 172.21.15.46:0/3977469132 >> 172.21.15.46:0/3977469132 conn(0x7f078c0cb3e0 msgr2=0x7f078c14caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:36.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.875+0000 7f079442b640 1 -- 172.21.15.46:0/3977469132 shutdown_connections 2024-01-23T08:55:36.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:36.875+0000 7f079442b640 1 -- 172.21.15.46:0/3977469132 wait complete. 2024-01-23T08:55:36.893 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509464 got 64424509465 for osd.3 2024-01-23T08:55:36.893 DEBUG:teuthology.parallel:result is None 2024-01-23T08:55:36.893 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-23T08:55:36.893 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-23T08:55:37.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.015+0000 7f7068b40640 1 Processor -- start 2024-01-23T08:55:37.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.015+0000 7f7068b40640 1 -- start start 2024-01-23T08:55:37.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.015+0000 7f7068b40640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7064151600 0x7f706415b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:37.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.015+0000 7f7068b40640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f70641519e0 0x7f70640c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:37.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.015+0000 7f7068b40640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f706406f350 0x7f7064157460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:37.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.015+0000 7f7068b40640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7064158390 con 0x7f706406f350 2024-01-23T08:55:37.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.015+0000 7f7068b40640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f706415b0e0 con 0x7f7064151600 2024-01-23T08:55:37.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.015+0000 7f7068b40640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7064157dd0 con 0x7f70641519e0 2024-01-23T08:55:37.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.015+0000 7f7062d9d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f706406f350 0x7f7064157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:37.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.015+0000 7f7062d9d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f706406f350 0x7f7064157460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54788/0 (socket says 172.21.15.46:54788) 2024-01-23T08:55:37.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.015+0000 7f7062d9d640 1 -- 172.21.15.46:0/3316611204 learned_addr learned my addr 172.21.15.46:0/3316611204 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:37.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.019+0000 7f7062d9d640 1 -- 172.21.15.46:0/3316611204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f70641519e0 msgr2=0x7f70640c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:37.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.019+0000 7f7062d9d640 1 --2- 172.21.15.46:0/3316611204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f70641519e0 0x7f70640c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:37.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.019+0000 7f7062d9d640 1 -- 172.21.15.46:0/3316611204 >> v2:172.21.15.175:3300/0 conn(0x7f7064151600 msgr2=0x7f706415b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:37.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.019+0000 7f7062d9d640 1 --2- 172.21.15.46:0/3316611204 >> v2:172.21.15.175:3300/0 conn(0x7f7064151600 0x7f706415b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:37.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.019+0000 7f7062d9d640 1 -- 172.21.15.46:0/3316611204 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70641580b0 con 0x7f706406f350 2024-01-23T08:55:37.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.023+0000 7f7062d9d640 1 --2- 172.21.15.46:0/3316611204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f706406f350 0x7f7064157460 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7064066e80 tx=0x7f705c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e69168610e7b73a server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:37.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.027+0000 7f706159a640 1 -- 172.21.15.46:0/3316611204 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c0ac410 con 0x7f706406f350 2024-01-23T08:55:37.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.027+0000 7f706159a640 1 -- 172.21.15.46:0/3316611204 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705c0ac570 con 0x7f706406f350 2024-01-23T08:55:37.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.027+0000 7f706159a640 1 -- 172.21.15.46:0/3316611204 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c0ac900 con 0x7f706406f350 2024-01-23T08:55:37.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.027+0000 7f7068b40640 1 -- 172.21.15.46:0/3316611204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f706406f350 msgr2=0x7f7064157460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:37.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.027+0000 7f7068b40640 1 --2- 172.21.15.46:0/3316611204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f706406f350 0x7f7064157460 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7064066e80 tx=0x7f705c01c500 comp rx=0 tx=0).stop 2024-01-23T08:55:37.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.027+0000 7f7068b40640 1 -- 172.21.15.46:0/3316611204 shutdown_connections 2024-01-23T08:55:37.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.027+0000 7f7068b40640 1 --2- 172.21.15.46:0/3316611204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f70641519e0 0x7f70640c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:37.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.027+0000 7f7068b40640 1 --2- 172.21.15.46:0/3316611204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f706406f350 0x7f7064157460 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:37.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.027+0000 7f7068b40640 1 --2- 172.21.15.46:0/3316611204 >> v2:172.21.15.175:3300/0 conn(0x7f7064151600 0x7f706415b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:37.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.027+0000 7f7068b40640 1 -- 172.21.15.46:0/3316611204 >> 172.21.15.46:0/3316611204 conn(0x7f706406d590 msgr2=0x7f7064066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:37.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.027+0000 7f7068b40640 1 -- 172.21.15.46:0/3316611204 shutdown_connections 2024-01-23T08:55:37.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.027+0000 7f7068b40640 1 -- 172.21.15.46:0/3316611204 wait complete. 2024-01-23T08:55:37.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.027+0000 7f7068b40640 1 Processor -- start 2024-01-23T08:55:37.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.027+0000 7f7068b40640 1 -- start start 2024-01-23T08:55:37.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.031+0000 7f7068b40640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f706406f350 0x7f706413cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:37.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.031+0000 7f7068b40640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7064151600 0x7f70640c0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:37.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.031+0000 7f7068b40640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7064159bf0 0x7f70641f1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:37.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.031+0000 7f7068b40640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70640c0010 con 0x7f7064159bf0 2024-01-23T08:55:37.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.031+0000 7f7068b40640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70640c14c0 con 0x7f706406f350 2024-01-23T08:55:37.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.031+0000 7f7068b40640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70640c0a40 con 0x7f7064151600 2024-01-23T08:55:37.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.031+0000 7f7062d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7064159bf0 0x7f70641f1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:37.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.031+0000 7f7062d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7064159bf0 0x7f70641f1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54790/0 (socket says 172.21.15.46:54790) 2024-01-23T08:55:37.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.031+0000 7f7062d9d640 1 -- 172.21.15.46:0/1847791884 learned_addr learned my addr 172.21.15.46:0/1847791884 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:37.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.035+0000 7f7062d9d640 1 -- 172.21.15.46:0/1847791884 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7064151600 msgr2=0x7f70640c0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:37.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.035+0000 7f7062d9d640 1 --2- 172.21.15.46:0/1847791884 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7064151600 0x7f70640c0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:37.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.035+0000 7f7062d9d640 1 -- 172.21.15.46:0/1847791884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f706406f350 msgr2=0x7f706413cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:37.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.035+0000 7f7062d9d640 1 --2- 172.21.15.46:0/1847791884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f706406f350 0x7f706413cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:37.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.035+0000 7f7062d9d640 1 -- 172.21.15.46:0/1847791884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c0094d0 con 0x7f7064159bf0 2024-01-23T08:55:37.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.035+0000 7f7062d9d640 1 --2- 172.21.15.46:0/1847791884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7064159bf0 0x7f70641f1f90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f705c01a130 tx=0x7f705c0192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:37.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.039+0000 7f7052ffd640 1 -- 172.21.15.46:0/1847791884 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c0b5460 con 0x7f7064159bf0 2024-01-23T08:55:37.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.039+0000 7f7052ffd640 1 -- 172.21.15.46:0/1847791884 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705c0b55c0 con 0x7f7064159bf0 2024-01-23T08:55:37.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.039+0000 7f7068b40640 1 -- 172.21.15.46:0/1847791884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70641589e0 con 0x7f7064159bf0 2024-01-23T08:55:37.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.039+0000 7f7052ffd640 1 -- 172.21.15.46:0/1847791884 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c0b5970 con 0x7f7064159bf0 2024-01-23T08:55:37.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.039+0000 7f7068b40640 1 -- 172.21.15.46:0/1847791884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70640c0220 con 0x7f7064159bf0 2024-01-23T08:55:37.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.043+0000 7f7068b40640 1 -- 172.21.15.46:0/1847791884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70640c4dd0 con 0x7f7064159bf0 2024-01-23T08:55:37.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.359+0000 7f7052ffd640 1 -- 172.21.15.46:0/1847791884 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f705c0b3070 con 0x7f7064159bf0 2024-01-23T08:55:37.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.363+0000 7f7052ffd640 1 --2- 172.21.15.46:0/1847791884 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7044066550 0x7f7044068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:37.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.363+0000 7f706259c640 1 --2- 172.21.15.46:0/1847791884 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7044066550 0x7f7044068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:37.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.363+0000 7f706259c640 1 --2- 172.21.15.46:0/1847791884 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7044066550 0x7f7044068a10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7054009730 tx=0x7f7054006ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:37.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.395+0000 7f7052ffd640 1 -- 172.21.15.46:0/1847791884 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f705c0f0340 con 0x7f7064159bf0 2024-01-23T08:55:37.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.395+0000 7f7052ffd640 1 -- 172.21.15.46:0/1847791884 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f705c0ebf80 con 0x7f7064159bf0 2024-01-23T08:55:37.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.555+0000 7f7068b40640 1 -- 172.21.15.46:0/1847791884 --> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7064070f20 con 0x7f7044066550 2024-01-23T08:55:37.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.583+0000 7f7052ffd640 1 -- 172.21.15.46:0/1847791884 <== mgr.4107 v2:172.21.15.46:6800/2324478006 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368108 (secure 0 0 0) 0x7f705400b4b0 con 0x7f7044066550 2024-01-23T08:55:37.587 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:55:37.589 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-01-23T08:55:37.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.587+0000 7f7068b40640 1 -- 172.21.15.46:0/1847791884 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7044066550 msgr2=0x7f7044068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:37.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.587+0000 7f7068b40640 1 --2- 172.21.15.46:0/1847791884 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7044066550 0x7f7044068a10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7054009730 tx=0x7f7054006ca0 comp rx=0 tx=0).stop 2024-01-23T08:55:37.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.587+0000 7f7068b40640 1 -- 172.21.15.46:0/1847791884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7064159bf0 msgr2=0x7f70641f1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:37.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.587+0000 7f7068b40640 1 --2- 172.21.15.46:0/1847791884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7064159bf0 0x7f70641f1f90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f705c01a130 tx=0x7f705c0192a0 comp rx=0 tx=0).stop 2024-01-23T08:55:37.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.587+0000 7f7068b40640 1 -- 172.21.15.46:0/1847791884 shutdown_connections 2024-01-23T08:55:37.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.587+0000 7f7068b40640 1 --2- 172.21.15.46:0/1847791884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7064159bf0 0x7f70641f1f90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:37.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.591+0000 7f7068b40640 1 --2- 172.21.15.46:0/1847791884 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7064151600 0x7f70640c0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:37.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.591+0000 7f7068b40640 1 --2- 172.21.15.46:0/1847791884 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7044066550 0x7f7044068a10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:37.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.591+0000 7f7068b40640 1 --2- 172.21.15.46:0/1847791884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f706406f350 0x7f706413cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:37.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.591+0000 7f7068b40640 1 -- 172.21.15.46:0/1847791884 >> 172.21.15.46:0/1847791884 conn(0x7f706406d590 msgr2=0x7f706414f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:37.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.591+0000 7f7068b40640 1 -- 172.21.15.46:0/1847791884 shutdown_connections 2024-01-23T08:55:37.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.591+0000 7f7068b40640 1 -- 172.21.15.46:0/1847791884 wait complete. 2024-01-23T08:55:37.607 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-01-23T08:55:36.585360+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600631,"num_objects":97,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":369,"num_write_kb":2478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":300,"ondisk_log_size":300,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236468,"kb_used_data":3700,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738252,"statfs":{"total":773094113280,"available":772851970048,"internally_reserved":0,"allocated":3788800,"data_stored":2136524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4862,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005708"},"pg_stats":[{"pgid":"2.1f","version":"28'13","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:32.928462+0000","last_change":"2024-01-23T08:54:40.661700+0000","last_active":"2024-01-23T08:55:32.928462+0000","last_peered":"2024-01-23T08:55:32.928462+0000","last_clean":"2024-01-23T08:55:32.928462+0000","last_became_active":"2024-01-23T08:54:40.660901+0000","last_became_peered":"2024-01-23T08:54:40.660901+0000","last_unstale":"2024-01-23T08:55:32.928462+0000","last_undegraded":"2024-01-23T08:55:32.928462+0000","last_fullsized":"2024-01-23T08:55:32.928462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:59:22.804479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.662103+0000","last_change":"2024-01-23T08:54:42.159130+0000","last_active":"2024-01-23T08:54:49.662103+0000","last_peered":"2024-01-23T08:54:49.662103+0000","last_clean":"2024-01-23T08:54:49.662103+0000","last_became_active":"2024-01-23T08:54:42.158776+0000","last_became_peered":"2024-01-23T08:54:42.158776+0000","last_unstale":"2024-01-23T08:54:49.662103+0000","last_undegraded":"2024-01-23T08:54:49.662103+0000","last_fullsized":"2024-01-23T08:54:49.662103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:06.320845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.833180+0000","last_change":"2024-01-23T08:54:49.752558+0000","last_active":"2024-01-23T08:54:50.833180+0000","last_peered":"2024-01-23T08:54:50.833180+0000","last_clean":"2024-01-23T08:54:50.833180+0000","last_became_active":"2024-01-23T08:54:49.752077+0000","last_became_peered":"2024-01-23T08:54:49.752077+0000","last_unstale":"2024-01-23T08:54:50.833180+0000","last_undegraded":"2024-01-23T08:54:50.833180+0000","last_fullsized":"2024-01-23T08:54:50.833180+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:20:50.653881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"28'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.316966+0000","last_change":"2024-01-23T08:54:40.700164+0000","last_active":"2024-01-23T08:54:51.316966+0000","last_peered":"2024-01-23T08:54:51.316966+0000","last_clean":"2024-01-23T08:54:51.316966+0000","last_became_active":"2024-01-23T08:54:40.699449+0000","last_became_peered":"2024-01-23T08:54:40.699449+0000","last_unstale":"2024-01-23T08:54:51.316966+0000","last_undegraded":"2024-01-23T08:54:51.316966+0000","last_fullsized":"2024-01-23T08:54:51.316966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:16:32.814250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.660624+0000","last_change":"2024-01-23T08:54:42.092833+0000","last_active":"2024-01-23T08:54:49.660624+0000","last_peered":"2024-01-23T08:54:49.660624+0000","last_clean":"2024-01-23T08:54:49.660624+0000","last_became_active":"2024-01-23T08:54:42.091950+0000","last_became_peered":"2024-01-23T08:54:42.091950+0000","last_unstale":"2024-01-23T08:54:49.660624+0000","last_undegraded":"2024-01-23T08:54:49.660624+0000","last_fullsized":"2024-01-23T08:54:49.660624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:46.594970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.816521+0000","last_change":"2024-01-23T08:54:49.747131+0000","last_active":"2024-01-23T08:54:50.816521+0000","last_peered":"2024-01-23T08:54:50.816521+0000","last_clean":"2024-01-23T08:54:50.816521+0000","last_became_active":"2024-01-23T08:54:49.746481+0000","last_became_peered":"2024-01-23T08:54:49.746481+0000","last_unstale":"2024-01-23T08:54:50.816521+0000","last_undegraded":"2024-01-23T08:54:50.816521+0000","last_fullsized":"2024-01-23T08:54:50.816521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:45:19.670524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"28'11","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:32.973357+0000","last_change":"2024-01-23T08:54:40.687614+0000","last_active":"2024-01-23T08:55:32.973357+0000","last_peered":"2024-01-23T08:55:32.973357+0000","last_clean":"2024-01-23T08:55:32.973357+0000","last_became_active":"2024-01-23T08:54:40.687234+0000","last_became_peered":"2024-01-23T08:54:40.687234+0000","last_unstale":"2024-01-23T08:55:32.973357+0000","last_undegraded":"2024-01-23T08:55:32.973357+0000","last_fullsized":"2024-01-23T08:55:32.973357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:54:17.627706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.711014+0000","last_change":"2024-01-23T08:54:42.114480+0000","last_active":"2024-01-23T08:54:49.711014+0000","last_peered":"2024-01-23T08:54:49.711014+0000","last_clean":"2024-01-23T08:54:49.711014+0000","last_became_active":"2024-01-23T08:54:42.113946+0000","last_became_peered":"2024-01-23T08:54:42.113946+0000","last_unstale":"2024-01-23T08:54:49.711014+0000","last_undegraded":"2024-01-23T08:54:49.711014+0000","last_fullsized":"2024-01-23T08:54:49.711014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:19:25.718244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.817755+0000","last_change":"2024-01-23T08:54:49.747332+0000","last_active":"2024-01-23T08:54:50.817755+0000","last_peered":"2024-01-23T08:54:50.817755+0000","last_clean":"2024-01-23T08:54:50.817755+0000","last_became_active":"2024-01-23T08:54:49.746474+0000","last_became_peered":"2024-01-23T08:54:49.746474+0000","last_unstale":"2024-01-23T08:54:50.817755+0000","last_undegraded":"2024-01-23T08:54:50.817755+0000","last_fullsized":"2024-01-23T08:54:50.817755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:28:57.975606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:32.973091+0000","last_change":"2024-01-23T08:54:40.687290+0000","last_active":"2024-01-23T08:55:32.973091+0000","last_peered":"2024-01-23T08:55:32.973091+0000","last_clean":"2024-01-23T08:55:32.973091+0000","last_became_active":"2024-01-23T08:54:40.686903+0000","last_became_peered":"2024-01-23T08:54:40.686903+0000","last_unstale":"2024-01-23T08:55:32.973091+0000","last_undegraded":"2024-01-23T08:55:32.973091+0000","last_fullsized":"2024-01-23T08:55:32.973091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:57:23.064188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.639122+0000","last_change":"2024-01-23T08:54:42.109485+0000","last_active":"2024-01-23T08:54:49.639122+0000","last_peered":"2024-01-23T08:54:49.639122+0000","last_clean":"2024-01-23T08:54:49.639122+0000","last_became_active":"2024-01-23T08:54:42.108182+0000","last_became_peered":"2024-01-23T08:54:42.108182+0000","last_unstale":"2024-01-23T08:54:49.639122+0000","last_undegraded":"2024-01-23T08:54:49.639122+0000","last_fullsized":"2024-01-23T08:54:49.639122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:51:12.417589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.816879+0000","last_change":"2024-01-23T08:54:49.747949+0000","last_active":"2024-01-23T08:54:50.816879+0000","last_peered":"2024-01-23T08:54:50.816879+0000","last_clean":"2024-01-23T08:54:50.816879+0000","last_became_active":"2024-01-23T08:54:49.746880+0000","last_became_peered":"2024-01-23T08:54:49.746880+0000","last_unstale":"2024-01-23T08:54:50.816879+0000","last_undegraded":"2024-01-23T08:54:50.816879+0000","last_fullsized":"2024-01-23T08:54:50.816879+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:54:26.728005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.638029+0000","last_change":"2024-01-23T08:54:42.088786+0000","last_active":"2024-01-23T08:54:49.638029+0000","last_peered":"2024-01-23T08:54:49.638029+0000","last_clean":"2024-01-23T08:54:49.638029+0000","last_became_active":"2024-01-23T08:54:42.088068+0000","last_became_peered":"2024-01-23T08:54:42.088068+0000","last_unstale":"2024-01-23T08:54:49.638029+0000","last_undegraded":"2024-01-23T08:54:49.638029+0000","last_fullsized":"2024-01-23T08:54:49.638029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:38:41.382732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:23.612198+0000","last_change":"2024-01-23T08:54:40.612044+0000","last_active":"2024-01-23T08:55:23.612198+0000","last_peered":"2024-01-23T08:55:23.612198+0000","last_clean":"2024-01-23T08:55:23.612198+0000","last_became_active":"2024-01-23T08:54:40.611589+0000","last_became_peered":"2024-01-23T08:54:40.611589+0000","last_unstale":"2024-01-23T08:55:23.612198+0000","last_undegraded":"2024-01-23T08:55:23.612198+0000","last_fullsized":"2024-01-23T08:55:23.612198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:36.177844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.311704+0000","last_change":"2024-01-23T08:54:49.716713+0000","last_active":"2024-01-23T08:54:51.311704+0000","last_peered":"2024-01-23T08:54:51.311704+0000","last_clean":"2024-01-23T08:54:51.311704+0000","last_became_active":"2024-01-23T08:54:49.715843+0000","last_became_peered":"2024-01-23T08:54:49.715843+0000","last_unstale":"2024-01-23T08:54:51.311704+0000","last_undegraded":"2024-01-23T08:54:51.311704+0000","last_fullsized":"2024-01-23T08:54:51.311704+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:46:24.157230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.715500+0000","last_change":"2024-01-23T08:54:42.230199+0000","last_active":"2024-01-23T08:54:49.715500+0000","last_peered":"2024-01-23T08:54:49.715500+0000","last_clean":"2024-01-23T08:54:49.715500+0000","last_became_active":"2024-01-23T08:54:42.229547+0000","last_became_peered":"2024-01-23T08:54:42.229547+0000","last_unstale":"2024-01-23T08:54:49.715500+0000","last_undegraded":"2024-01-23T08:54:49.715500+0000","last_fullsized":"2024-01-23T08:54:49.715500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:07:07.781698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"28'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:26.430901+0000","last_change":"2024-01-23T08:54:40.688971+0000","last_active":"2024-01-23T08:55:26.430901+0000","last_peered":"2024-01-23T08:55:26.430901+0000","last_clean":"2024-01-23T08:55:26.430901+0000","last_became_active":"2024-01-23T08:54:40.688230+0000","last_became_peered":"2024-01-23T08:54:40.688230+0000","last_unstale":"2024-01-23T08:55:26.430901+0000","last_undegraded":"2024-01-23T08:55:26.430901+0000","last_fullsized":"2024-01-23T08:55:26.430901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:40:12.245110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.314784+0000","last_change":"2024-01-23T08:54:49.748471+0000","last_active":"2024-01-23T08:54:51.314784+0000","last_peered":"2024-01-23T08:54:51.314784+0000","last_clean":"2024-01-23T08:54:51.314784+0000","last_became_active":"2024-01-23T08:54:49.747958+0000","last_became_peered":"2024-01-23T08:54:49.747958+0000","last_unstale":"2024-01-23T08:54:51.314784+0000","last_undegraded":"2024-01-23T08:54:51.314784+0000","last_fullsized":"2024-01-23T08:54:51.314784+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:46:36.583078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.709746+0000","last_change":"2024-01-23T08:54:42.194148+0000","last_active":"2024-01-23T08:54:49.709746+0000","last_peered":"2024-01-23T08:54:49.709746+0000","last_clean":"2024-01-23T08:54:49.709746+0000","last_became_active":"2024-01-23T08:54:42.193403+0000","last_became_peered":"2024-01-23T08:54:42.193403+0000","last_unstale":"2024-01-23T08:54:49.709746+0000","last_undegraded":"2024-01-23T08:54:49.709746+0000","last_fullsized":"2024-01-23T08:54:49.709746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:38:42.543776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'7","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:32.924540+0000","last_change":"2024-01-23T08:54:40.688897+0000","last_active":"2024-01-23T08:55:32.924540+0000","last_peered":"2024-01-23T08:55:32.924540+0000","last_clean":"2024-01-23T08:55:32.924540+0000","last_became_active":"2024-01-23T08:54:40.688122+0000","last_became_peered":"2024-01-23T08:54:40.688122+0000","last_unstale":"2024-01-23T08:55:32.924540+0000","last_undegraded":"2024-01-23T08:55:32.924540+0000","last_fullsized":"2024-01-23T08:55:32.924540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:19:16.760424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.834576+0000","last_change":"2024-01-23T08:54:49.738331+0000","last_active":"2024-01-23T08:54:50.834576+0000","last_peered":"2024-01-23T08:54:50.834576+0000","last_clean":"2024-01-23T08:54:50.834576+0000","last_became_active":"2024-01-23T08:54:49.737442+0000","last_became_peered":"2024-01-23T08:54:49.737442+0000","last_unstale":"2024-01-23T08:54:50.834576+0000","last_undegraded":"2024-01-23T08:54:50.834576+0000","last_fullsized":"2024-01-23T08:54:50.834576+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:59:20.106849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.637930+0000","last_change":"2024-01-23T08:54:42.192681+0000","last_active":"2024-01-23T08:54:49.637930+0000","last_peered":"2024-01-23T08:54:49.637930+0000","last_clean":"2024-01-23T08:54:49.637930+0000","last_became_active":"2024-01-23T08:54:42.192225+0000","last_became_peered":"2024-01-23T08:54:42.192225+0000","last_unstale":"2024-01-23T08:54:49.637930+0000","last_undegraded":"2024-01-23T08:54:49.637930+0000","last_fullsized":"2024-01-23T08:54:49.637930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:20:26.263299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"28'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:23.630105+0000","last_change":"2024-01-23T08:54:40.686987+0000","last_active":"2024-01-23T08:55:23.630105+0000","last_peered":"2024-01-23T08:55:23.630105+0000","last_clean":"2024-01-23T08:55:23.630105+0000","last_became_active":"2024-01-23T08:54:40.686654+0000","last_became_peered":"2024-01-23T08:54:40.686654+0000","last_unstale":"2024-01-23T08:55:23.630105+0000","last_undegraded":"2024-01-23T08:55:23.630105+0000","last_fullsized":"2024-01-23T08:55:23.630105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:43:26.442461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.818343+0000","last_change":"2024-01-23T08:54:49.736471+0000","last_active":"2024-01-23T08:54:50.818343+0000","last_peered":"2024-01-23T08:54:50.818343+0000","last_clean":"2024-01-23T08:54:50.818343+0000","last_became_active":"2024-01-23T08:54:49.735971+0000","last_became_peered":"2024-01-23T08:54:49.735971+0000","last_unstale":"2024-01-23T08:54:50.818343+0000","last_undegraded":"2024-01-23T08:54:50.818343+0000","last_fullsized":"2024-01-23T08:54:50.818343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:18:10.354308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.710027+0000","last_change":"2024-01-23T08:54:42.195854+0000","last_active":"2024-01-23T08:54:49.710027+0000","last_peered":"2024-01-23T08:54:49.710027+0000","last_clean":"2024-01-23T08:54:49.710027+0000","last_became_active":"2024-01-23T08:54:42.195052+0000","last_became_peered":"2024-01-23T08:54:42.195052+0000","last_unstale":"2024-01-23T08:54:49.710027+0000","last_undegraded":"2024-01-23T08:54:49.710027+0000","last_fullsized":"2024-01-23T08:54:49.710027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:54:18.859903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'7","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:32.924571+0000","last_change":"2024-01-23T08:54:40.694194+0000","last_active":"2024-01-23T08:55:32.924571+0000","last_peered":"2024-01-23T08:55:32.924571+0000","last_clean":"2024-01-23T08:55:32.924571+0000","last_became_active":"2024-01-23T08:54:40.693610+0000","last_became_peered":"2024-01-23T08:54:40.693610+0000","last_unstale":"2024-01-23T08:55:32.924571+0000","last_undegraded":"2024-01-23T08:55:32.924571+0000","last_fullsized":"2024-01-23T08:55:32.924571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:47:30.746915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.817667+0000","last_change":"2024-01-23T08:54:49.747205+0000","last_active":"2024-01-23T08:54:50.817667+0000","last_peered":"2024-01-23T08:54:50.817667+0000","last_clean":"2024-01-23T08:54:50.817667+0000","last_became_active":"2024-01-23T08:54:49.746792+0000","last_became_peered":"2024-01-23T08:54:49.746792+0000","last_unstale":"2024-01-23T08:54:50.817667+0000","last_undegraded":"2024-01-23T08:54:50.817667+0000","last_fullsized":"2024-01-23T08:54:50.817667+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:58:42.245045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.708442+0000","last_change":"2024-01-23T08:54:42.233783+0000","last_active":"2024-01-23T08:54:49.708442+0000","last_peered":"2024-01-23T08:54:49.708442+0000","last_clean":"2024-01-23T08:54:49.708442+0000","last_became_active":"2024-01-23T08:54:42.233018+0000","last_became_peered":"2024-01-23T08:54:42.233018+0000","last_unstale":"2024-01-23T08:54:49.708442+0000","last_undegraded":"2024-01-23T08:54:49.708442+0000","last_fullsized":"2024-01-23T08:54:49.708442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:04:58.998914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'9","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:29.756869+0000","last_change":"2024-01-23T08:54:40.690385+0000","last_active":"2024-01-23T08:55:29.756869+0000","last_peered":"2024-01-23T08:55:29.756869+0000","last_clean":"2024-01-23T08:55:29.756869+0000","last_became_active":"2024-01-23T08:54:40.689528+0000","last_became_peered":"2024-01-23T08:54:40.689528+0000","last_unstale":"2024-01-23T08:55:29.756869+0000","last_undegraded":"2024-01-23T08:55:29.756869+0000","last_fullsized":"2024-01-23T08:55:29.756869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:59:11.006550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.314560+0000","last_change":"2024-01-23T08:54:49.731870+0000","last_active":"2024-01-23T08:54:51.314560+0000","last_peered":"2024-01-23T08:54:51.314560+0000","last_clean":"2024-01-23T08:54:51.314560+0000","last_became_active":"2024-01-23T08:54:49.731414+0000","last_became_peered":"2024-01-23T08:54:49.731414+0000","last_unstale":"2024-01-23T08:54:51.314560+0000","last_undegraded":"2024-01-23T08:54:51.314560+0000","last_fullsized":"2024-01-23T08:54:51.314560+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:30.315625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.679440+0000","last_change":"2024-01-23T08:54:42.227885+0000","last_active":"2024-01-23T08:54:49.679440+0000","last_peered":"2024-01-23T08:54:49.679440+0000","last_clean":"2024-01-23T08:54:49.679440+0000","last_became_active":"2024-01-23T08:54:42.227188+0000","last_became_peered":"2024-01-23T08:54:42.227188+0000","last_unstale":"2024-01-23T08:54:49.679440+0000","last_undegraded":"2024-01-23T08:54:49.679440+0000","last_fullsized":"2024-01-23T08:54:49.679440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:02:13.790208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:29.699700+0000","last_change":"2024-01-23T08:54:40.658365+0000","last_active":"2024-01-23T08:55:29.699700+0000","last_peered":"2024-01-23T08:55:29.699700+0000","last_clean":"2024-01-23T08:55:29.699700+0000","last_became_active":"2024-01-23T08:54:40.657616+0000","last_became_peered":"2024-01-23T08:54:40.657616+0000","last_unstale":"2024-01-23T08:55:29.699700+0000","last_undegraded":"2024-01-23T08:55:29.699700+0000","last_fullsized":"2024-01-23T08:55:29.699700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:23:50.053046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.315400+0000","last_change":"2024-01-23T08:54:49.739474+0000","last_active":"2024-01-23T08:54:51.315400+0000","last_peered":"2024-01-23T08:54:51.315400+0000","last_clean":"2024-01-23T08:54:51.315400+0000","last_became_active":"2024-01-23T08:54:49.738579+0000","last_became_peered":"2024-01-23T08:54:49.738579+0000","last_unstale":"2024-01-23T08:54:51.315400+0000","last_undegraded":"2024-01-23T08:54:51.315400+0000","last_fullsized":"2024-01-23T08:54:51.315400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:23:32.238072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.702527+0000","last_change":"2024-01-23T08:54:42.228302+0000","last_active":"2024-01-23T08:54:49.702527+0000","last_peered":"2024-01-23T08:54:49.702527+0000","last_clean":"2024-01-23T08:54:49.702527+0000","last_became_active":"2024-01-23T08:54:42.227558+0000","last_became_peered":"2024-01-23T08:54:42.227558+0000","last_unstale":"2024-01-23T08:54:49.702527+0000","last_undegraded":"2024-01-23T08:54:49.702527+0000","last_fullsized":"2024-01-23T08:54:49.702527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:19:17.992621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"28'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.315589+0000","last_change":"2024-01-23T08:54:40.697453+0000","last_active":"2024-01-23T08:54:51.315589+0000","last_peered":"2024-01-23T08:54:51.315589+0000","last_clean":"2024-01-23T08:54:51.315589+0000","last_became_active":"2024-01-23T08:54:40.696688+0000","last_became_peered":"2024-01-23T08:54:40.696688+0000","last_unstale":"2024-01-23T08:54:51.315589+0000","last_undegraded":"2024-01-23T08:54:51.315589+0000","last_fullsized":"2024-01-23T08:54:51.315589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:59:22.804479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.314513+0000","last_change":"2024-01-23T08:54:49.726678+0000","last_active":"2024-01-23T08:54:51.314513+0000","last_peered":"2024-01-23T08:54:51.314513+0000","last_clean":"2024-01-23T08:54:51.314513+0000","last_became_active":"2024-01-23T08:54:49.725830+0000","last_became_peered":"2024-01-23T08:54:49.725830+0000","last_unstale":"2024-01-23T08:54:51.314513+0000","last_undegraded":"2024-01-23T08:54:51.314513+0000","last_fullsized":"2024-01-23T08:54:51.314513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:12:34.009779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705119+0000","last_change":"2024-01-23T08:54:42.149751+0000","last_active":"2024-01-23T08:54:49.705119+0000","last_peered":"2024-01-23T08:54:49.705119+0000","last_clean":"2024-01-23T08:54:49.705119+0000","last_became_active":"2024-01-23T08:54:42.149019+0000","last_became_peered":"2024-01-23T08:54:42.149019+0000","last_unstale":"2024-01-23T08:54:49.705119+0000","last_undegraded":"2024-01-23T08:54:49.705119+0000","last_fullsized":"2024-01-23T08:54:49.705119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:38:36.083606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'5","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:32.927419+0000","last_change":"2024-01-23T08:54:40.680243+0000","last_active":"2024-01-23T08:55:32.927419+0000","last_peered":"2024-01-23T08:55:32.927419+0000","last_clean":"2024-01-23T08:55:32.927419+0000","last_became_active":"2024-01-23T08:54:40.679839+0000","last_became_peered":"2024-01-23T08:54:40.679839+0000","last_unstale":"2024-01-23T08:55:32.927419+0000","last_undegraded":"2024-01-23T08:55:32.927419+0000","last_fullsized":"2024-01-23T08:55:32.927419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:38:34.851409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.317036+0000","last_change":"2024-01-23T08:54:49.727785+0000","last_active":"2024-01-23T08:54:51.317036+0000","last_peered":"2024-01-23T08:54:51.317036+0000","last_clean":"2024-01-23T08:54:51.317036+0000","last_became_active":"2024-01-23T08:54:49.726855+0000","last_became_peered":"2024-01-23T08:54:49.726855+0000","last_unstale":"2024-01-23T08:54:51.317036+0000","last_undegraded":"2024-01-23T08:54:51.317036+0000","last_fullsized":"2024-01-23T08:54:51.317036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:13:39.452120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.659533+0000","last_change":"2024-01-23T08:54:42.108793+0000","last_active":"2024-01-23T08:54:49.659533+0000","last_peered":"2024-01-23T08:54:49.659533+0000","last_clean":"2024-01-23T08:54:49.659533+0000","last_became_active":"2024-01-23T08:54:42.108346+0000","last_became_peered":"2024-01-23T08:54:42.108346+0000","last_unstale":"2024-01-23T08:54:49.659533+0000","last_undegraded":"2024-01-23T08:54:49.659533+0000","last_fullsized":"2024-01-23T08:54:49.659533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:18:02.486206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'5","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:26.672476+0000","last_change":"2024-01-23T08:54:40.708494+0000","last_active":"2024-01-23T08:55:26.672476+0000","last_peered":"2024-01-23T08:55:26.672476+0000","last_clean":"2024-01-23T08:55:26.672476+0000","last_became_active":"2024-01-23T08:54:40.707841+0000","last_became_peered":"2024-01-23T08:54:40.707841+0000","last_unstale":"2024-01-23T08:55:26.672476+0000","last_undegraded":"2024-01-23T08:55:26.672476+0000","last_fullsized":"2024-01-23T08:55:26.672476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:53:17.764440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.319565+0000","last_change":"2024-01-23T08:54:49.738198+0000","last_active":"2024-01-23T08:54:51.319565+0000","last_peered":"2024-01-23T08:54:51.319565+0000","last_clean":"2024-01-23T08:54:51.319565+0000","last_became_active":"2024-01-23T08:54:49.737677+0000","last_became_peered":"2024-01-23T08:54:49.737677+0000","last_unstale":"2024-01-23T08:54:51.319565+0000","last_undegraded":"2024-01-23T08:54:51.319565+0000","last_fullsized":"2024-01-23T08:54:51.319565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:57:26.436916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.676533+0000","last_change":"2024-01-23T08:54:42.228222+0000","last_active":"2024-01-23T08:54:49.676533+0000","last_peered":"2024-01-23T08:54:49.676533+0000","last_clean":"2024-01-23T08:54:49.676533+0000","last_became_active":"2024-01-23T08:54:42.227335+0000","last_became_peered":"2024-01-23T08:54:42.227335+0000","last_unstale":"2024-01-23T08:54:49.676533+0000","last_undegraded":"2024-01-23T08:54:49.676533+0000","last_fullsized":"2024-01-23T08:54:49.676533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:29:51.842390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:26.691290+0000","last_change":"2024-01-23T08:54:40.679852+0000","last_active":"2024-01-23T08:55:26.691290+0000","last_peered":"2024-01-23T08:55:26.691290+0000","last_clean":"2024-01-23T08:55:26.691290+0000","last_became_active":"2024-01-23T08:54:40.679467+0000","last_became_peered":"2024-01-23T08:54:40.679467+0000","last_unstale":"2024-01-23T08:55:26.691290+0000","last_undegraded":"2024-01-23T08:55:26.691290+0000","last_fullsized":"2024-01-23T08:55:26.691290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:17.915137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.316103+0000","last_change":"2024-01-23T08:54:49.730538+0000","last_active":"2024-01-23T08:54:51.316103+0000","last_peered":"2024-01-23T08:54:51.316103+0000","last_clean":"2024-01-23T08:54:51.316103+0000","last_became_active":"2024-01-23T08:54:49.729861+0000","last_became_peered":"2024-01-23T08:54:49.729861+0000","last_unstale":"2024-01-23T08:54:51.316103+0000","last_undegraded":"2024-01-23T08:54:51.316103+0000","last_fullsized":"2024-01-23T08:54:51.316103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:46:36.583078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.709127+0000","last_change":"2024-01-23T08:54:42.196505+0000","last_active":"2024-01-23T08:54:49.709127+0000","last_peered":"2024-01-23T08:54:49.709127+0000","last_clean":"2024-01-23T08:54:49.709127+0000","last_became_active":"2024-01-23T08:54:42.195555+0000","last_became_peered":"2024-01-23T08:54:42.195555+0000","last_unstale":"2024-01-23T08:54:49.709127+0000","last_undegraded":"2024-01-23T08:54:49.709127+0000","last_fullsized":"2024-01-23T08:54:49.709127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:57:24.296384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'6","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:29.700115+0000","last_change":"2024-01-23T08:54:40.612594+0000","last_active":"2024-01-23T08:55:29.700115+0000","last_peered":"2024-01-23T08:55:29.700115+0000","last_clean":"2024-01-23T08:55:29.700115+0000","last_became_active":"2024-01-23T08:54:40.611932+0000","last_became_peered":"2024-01-23T08:54:40.611932+0000","last_unstale":"2024-01-23T08:55:29.700115+0000","last_undegraded":"2024-01-23T08:55:29.700115+0000","last_fullsized":"2024-01-23T08:55:29.700115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:05.088648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.709873+0000","last_change":"2024-01-23T08:54:01.491195+0000","last_active":"2024-01-23T08:54:49.709873+0000","last_peered":"2024-01-23T08:54:49.709873+0000","last_clean":"2024-01-23T08:54:49.709873+0000","last_became_active":"2024-01-23T08:54:01.490869+0000","last_became_peered":"2024-01-23T08:54:01.490869+0000","last_unstale":"2024-01-23T08:54:49.709873+0000","last_undegraded":"2024-01-23T08:54:49.709873+0000","last_fullsized":"2024-01-23T08:54:49.709873+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:53:59.492955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:53:59.492955+0000","last_clean_scrub_stamp":"2024-01-23T08:53:59.492955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:18:58.446726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.312760+0000","last_change":"2024-01-23T08:54:49.716297+0000","last_active":"2024-01-23T08:54:51.312760+0000","last_peered":"2024-01-23T08:54:51.312760+0000","last_clean":"2024-01-23T08:54:51.312760+0000","last_became_active":"2024-01-23T08:54:49.715231+0000","last_became_peered":"2024-01-23T08:54:49.715231+0000","last_unstale":"2024-01-23T08:54:51.312760+0000","last_undegraded":"2024-01-23T08:54:51.312760+0000","last_fullsized":"2024-01-23T08:54:51.312760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:17:59.837409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.639265+0000","last_change":"2024-01-23T08:54:42.089174+0000","last_active":"2024-01-23T08:54:49.639265+0000","last_peered":"2024-01-23T08:54:49.639265+0000","last_clean":"2024-01-23T08:54:49.639265+0000","last_became_active":"2024-01-23T08:54:42.088303+0000","last_became_peered":"2024-01-23T08:54:42.088303+0000","last_unstale":"2024-01-23T08:54:49.639265+0000","last_undegraded":"2024-01-23T08:54:49.639265+0000","last_fullsized":"2024-01-23T08:54:49.639265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:06:49.326117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"28'5","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:29.763102+0000","last_change":"2024-01-23T08:54:40.690720+0000","last_active":"2024-01-23T08:55:29.763102+0000","last_peered":"2024-01-23T08:55:29.763102+0000","last_clean":"2024-01-23T08:55:29.763102+0000","last_became_active":"2024-01-23T08:54:40.689895+0000","last_became_peered":"2024-01-23T08:54:40.689895+0000","last_unstale":"2024-01-23T08:55:29.763102+0000","last_undegraded":"2024-01-23T08:55:29.763102+0000","last_fullsized":"2024-01-23T08:55:29.763102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:33:12.542607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.817001+0000","last_change":"2024-01-23T08:54:49.736539+0000","last_active":"2024-01-23T08:54:50.817001+0000","last_peered":"2024-01-23T08:54:50.817001+0000","last_clean":"2024-01-23T08:54:50.817001+0000","last_became_active":"2024-01-23T08:54:49.735777+0000","last_became_peered":"2024-01-23T08:54:49.735777+0000","last_unstale":"2024-01-23T08:54:50.817001+0000","last_undegraded":"2024-01-23T08:54:50.817001+0000","last_fullsized":"2024-01-23T08:54:50.817001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:05:06.867017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.709023+0000","last_change":"2024-01-23T08:54:42.107066+0000","last_active":"2024-01-23T08:54:49.709023+0000","last_peered":"2024-01-23T08:54:49.709023+0000","last_clean":"2024-01-23T08:54:49.709023+0000","last_became_active":"2024-01-23T08:54:42.106757+0000","last_became_peered":"2024-01-23T08:54:42.106757+0000","last_unstale":"2024-01-23T08:54:49.709023+0000","last_undegraded":"2024-01-23T08:54:49.709023+0000","last_fullsized":"2024-01-23T08:54:49.709023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:47:31.979111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:29.601880+0000","last_change":"2024-01-23T08:54:40.687942+0000","last_active":"2024-01-23T08:55:29.601880+0000","last_peered":"2024-01-23T08:55:29.601880+0000","last_clean":"2024-01-23T08:55:29.601880+0000","last_became_active":"2024-01-23T08:54:40.686860+0000","last_became_peered":"2024-01-23T08:54:40.686860+0000","last_unstale":"2024-01-23T08:55:29.601880+0000","last_undegraded":"2024-01-23T08:55:29.601880+0000","last_fullsized":"2024-01-23T08:55:29.601880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:04:57.766717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.315714+0000","last_change":"2024-01-23T08:54:49.727416+0000","last_active":"2024-01-23T08:54:51.315714+0000","last_peered":"2024-01-23T08:54:51.315714+0000","last_clean":"2024-01-23T08:54:51.315714+0000","last_became_active":"2024-01-23T08:54:49.721494+0000","last_became_peered":"2024-01-23T08:54:49.721494+0000","last_unstale":"2024-01-23T08:54:51.315714+0000","last_undegraded":"2024-01-23T08:54:51.315714+0000","last_fullsized":"2024-01-23T08:54:51.315714+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:52:20.767279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.706168+0000","last_change":"2024-01-23T08:54:42.117785+0000","last_active":"2024-01-23T08:54:49.706168+0000","last_peered":"2024-01-23T08:54:49.706168+0000","last_clean":"2024-01-23T08:54:49.706168+0000","last_became_active":"2024-01-23T08:54:42.117317+0000","last_became_peered":"2024-01-23T08:54:42.117317+0000","last_unstale":"2024-01-23T08:54:49.706168+0000","last_undegraded":"2024-01-23T08:54:49.706168+0000","last_fullsized":"2024-01-23T08:54:49.706168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:48:28.943781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"28'5","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:32.924737+0000","last_change":"2024-01-23T08:54:40.682656+0000","last_active":"2024-01-23T08:55:32.924737+0000","last_peered":"2024-01-23T08:55:32.924737+0000","last_clean":"2024-01-23T08:55:32.924737+0000","last_became_active":"2024-01-23T08:54:40.681954+0000","last_became_peered":"2024-01-23T08:54:40.681954+0000","last_unstale":"2024-01-23T08:55:32.924737+0000","last_undegraded":"2024-01-23T08:55:32.924737+0000","last_fullsized":"2024-01-23T08:55:32.924737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:20:41.553582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.311198+0000","last_change":"2024-01-23T08:54:49.716316+0000","last_active":"2024-01-23T08:54:51.311198+0000","last_peered":"2024-01-23T08:54:51.311198+0000","last_clean":"2024-01-23T08:54:51.311198+0000","last_became_active":"2024-01-23T08:54:49.715917+0000","last_became_peered":"2024-01-23T08:54:49.715917+0000","last_unstale":"2024-01-23T08:54:51.311198+0000","last_undegraded":"2024-01-23T08:54:51.311198+0000","last_fullsized":"2024-01-23T08:54:51.311198+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:56:01.803823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.708070+0000","last_change":"2024-01-23T08:54:42.158814+0000","last_active":"2024-01-23T08:54:49.708070+0000","last_peered":"2024-01-23T08:54:49.708070+0000","last_clean":"2024-01-23T08:54:49.708070+0000","last_became_active":"2024-01-23T08:54:42.155411+0000","last_became_peered":"2024-01-23T08:54:42.155411+0000","last_unstale":"2024-01-23T08:54:49.708070+0000","last_undegraded":"2024-01-23T08:54:49.708070+0000","last_fullsized":"2024-01-23T08:54:49.708070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:28:02.074838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"28'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.315271+0000","last_change":"2024-01-23T08:54:40.696522+0000","last_active":"2024-01-23T08:54:51.315271+0000","last_peered":"2024-01-23T08:54:51.315271+0000","last_clean":"2024-01-23T08:54:51.315271+0000","last_became_active":"2024-01-23T08:54:40.696128+0000","last_became_peered":"2024-01-23T08:54:40.696128+0000","last_unstale":"2024-01-23T08:54:51.315271+0000","last_undegraded":"2024-01-23T08:54:51.315271+0000","last_fullsized":"2024-01-23T08:54:51.315271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:18:01.254009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.850403+0000","last_change":"2024-01-23T08:54:49.724660+0000","last_active":"2024-01-23T08:54:50.850403+0000","last_peered":"2024-01-23T08:54:50.850403+0000","last_clean":"2024-01-23T08:54:50.850403+0000","last_became_active":"2024-01-23T08:54:49.723038+0000","last_became_peered":"2024-01-23T08:54:49.723038+0000","last_unstale":"2024-01-23T08:54:50.850403+0000","last_undegraded":"2024-01-23T08:54:50.850403+0000","last_fullsized":"2024-01-23T08:54:50.850403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:20:50.653881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.637799+0000","last_change":"2024-01-23T08:54:42.149978+0000","last_active":"2024-01-23T08:54:49.637799+0000","last_peered":"2024-01-23T08:54:49.637799+0000","last_clean":"2024-01-23T08:54:49.637799+0000","last_became_active":"2024-01-23T08:54:42.149180+0000","last_became_peered":"2024-01-23T08:54:42.149180+0000","last_unstale":"2024-01-23T08:54:49.637799+0000","last_undegraded":"2024-01-23T08:54:49.637799+0000","last_fullsized":"2024-01-23T08:54:49.637799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:52:12.899176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'17","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:29.754272+0000","last_change":"2024-01-23T08:54:40.699997+0000","last_active":"2024-01-23T08:55:29.754272+0000","last_peered":"2024-01-23T08:55:29.754272+0000","last_clean":"2024-01-23T08:55:29.754272+0000","last_became_active":"2024-01-23T08:54:40.699246+0000","last_became_peered":"2024-01-23T08:54:40.699246+0000","last_unstale":"2024-01-23T08:55:29.754272+0000","last_undegraded":"2024-01-23T08:55:29.754272+0000","last_fullsized":"2024-01-23T08:55:29.754272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:19:24.486048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.317431+0000","last_change":"2024-01-23T08:54:49.729218+0000","last_active":"2024-01-23T08:54:51.317431+0000","last_peered":"2024-01-23T08:54:51.317431+0000","last_clean":"2024-01-23T08:54:51.317431+0000","last_became_active":"2024-01-23T08:54:49.728448+0000","last_became_peered":"2024-01-23T08:54:49.728448+0000","last_unstale":"2024-01-23T08:54:51.317431+0000","last_undegraded":"2024-01-23T08:54:51.317431+0000","last_fullsized":"2024-01-23T08:54:51.317431+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:56:52.671943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.709676+0000","last_change":"2024-01-23T08:54:42.087980+0000","last_active":"2024-01-23T08:54:49.709676+0000","last_peered":"2024-01-23T08:54:49.709676+0000","last_clean":"2024-01-23T08:54:49.709676+0000","last_became_active":"2024-01-23T08:54:42.087328+0000","last_became_peered":"2024-01-23T08:54:42.087328+0000","last_unstale":"2024-01-23T08:54:49.709676+0000","last_undegraded":"2024-01-23T08:54:49.709676+0000","last_fullsized":"2024-01-23T08:54:49.709676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:07:07.781698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"28'5","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:29.596819+0000","last_change":"2024-01-23T08:54:40.693906+0000","last_active":"2024-01-23T08:55:29.596819+0000","last_peered":"2024-01-23T08:55:29.596819+0000","last_clean":"2024-01-23T08:55:29.596819+0000","last_became_active":"2024-01-23T08:54:40.693530+0000","last_became_peered":"2024-01-23T08:54:40.693530+0000","last_unstale":"2024-01-23T08:55:29.596819+0000","last_undegraded":"2024-01-23T08:55:29.596819+0000","last_fullsized":"2024-01-23T08:55:29.596819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:59:11.006550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.317201+0000","last_change":"2024-01-23T08:54:49.730687+0000","last_active":"2024-01-23T08:54:51.317201+0000","last_peered":"2024-01-23T08:54:51.317201+0000","last_clean":"2024-01-23T08:54:51.317201+0000","last_became_active":"2024-01-23T08:54:49.729689+0000","last_became_peered":"2024-01-23T08:54:49.729689+0000","last_unstale":"2024-01-23T08:54:51.317201+0000","last_undegraded":"2024-01-23T08:54:51.317201+0000","last_fullsized":"2024-01-23T08:54:51.317201+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:54:47.041161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.638496+0000","last_change":"2024-01-23T08:54:42.108919+0000","last_active":"2024-01-23T08:54:49.638496+0000","last_peered":"2024-01-23T08:54:49.638496+0000","last_clean":"2024-01-23T08:54:49.638496+0000","last_became_active":"2024-01-23T08:54:42.108253+0000","last_became_peered":"2024-01-23T08:54:42.108253+0000","last_unstale":"2024-01-23T08:54:49.638496+0000","last_undegraded":"2024-01-23T08:54:49.638496+0000","last_fullsized":"2024-01-23T08:54:49.638496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:46:28.714976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'5","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:29.702672+0000","last_change":"2024-01-23T08:54:40.696080+0000","last_active":"2024-01-23T08:55:29.702672+0000","last_peered":"2024-01-23T08:55:29.702672+0000","last_clean":"2024-01-23T08:55:29.702672+0000","last_became_active":"2024-01-23T08:54:40.695699+0000","last_became_peered":"2024-01-23T08:54:40.695699+0000","last_unstale":"2024-01-23T08:55:29.702672+0000","last_undegraded":"2024-01-23T08:55:29.702672+0000","last_fullsized":"2024-01-23T08:55:29.702672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:21.215326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.316997+0000","last_change":"2024-01-23T08:54:49.740480+0000","last_active":"2024-01-23T08:54:51.316997+0000","last_peered":"2024-01-23T08:54:51.316997+0000","last_clean":"2024-01-23T08:54:51.316997+0000","last_became_active":"2024-01-23T08:54:49.739524+0000","last_became_peered":"2024-01-23T08:54:49.739524+0000","last_unstale":"2024-01-23T08:54:51.316997+0000","last_undegraded":"2024-01-23T08:54:51.316997+0000","last_fullsized":"2024-01-23T08:54:51.316997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:45:25.447987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.677949+0000","last_change":"2024-01-23T08:54:42.230659+0000","last_active":"2024-01-23T08:54:49.677949+0000","last_peered":"2024-01-23T08:54:49.677949+0000","last_clean":"2024-01-23T08:54:49.677949+0000","last_became_active":"2024-01-23T08:54:42.229952+0000","last_became_peered":"2024-01-23T08:54:42.229952+0000","last_unstale":"2024-01-23T08:54:49.677949+0000","last_undegraded":"2024-01-23T08:54:49.677949+0000","last_fullsized":"2024-01-23T08:54:49.677949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:41:53.265527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'9","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:32.854707+0000","last_change":"2024-01-23T08:54:40.698779+0000","last_active":"2024-01-23T08:55:32.854707+0000","last_peered":"2024-01-23T08:55:32.854707+0000","last_clean":"2024-01-23T08:55:32.854707+0000","last_became_active":"2024-01-23T08:54:40.698059+0000","last_became_peered":"2024-01-23T08:54:40.698059+0000","last_unstale":"2024-01-23T08:55:32.854707+0000","last_undegraded":"2024-01-23T08:55:32.854707+0000","last_fullsized":"2024-01-23T08:55:32.854707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:24:40.655839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.313021+0000","last_change":"2024-01-23T08:54:49.708388+0000","last_active":"2024-01-23T08:54:51.313021+0000","last_peered":"2024-01-23T08:54:51.313021+0000","last_clean":"2024-01-23T08:54:51.313021+0000","last_became_active":"2024-01-23T08:54:49.707837+0000","last_became_peered":"2024-01-23T08:54:49.707837+0000","last_unstale":"2024-01-23T08:54:51.313021+0000","last_undegraded":"2024-01-23T08:54:51.313021+0000","last_fullsized":"2024-01-23T08:54:51.313021+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:49:25.509880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705781+0000","last_change":"2024-01-23T08:54:42.229836+0000","last_active":"2024-01-23T08:54:49.705781+0000","last_peered":"2024-01-23T08:54:49.705781+0000","last_clean":"2024-01-23T08:54:49.705781+0000","last_became_active":"2024-01-23T08:54:42.229252+0000","last_became_peered":"2024-01-23T08:54:42.229252+0000","last_unstale":"2024-01-23T08:54:49.705781+0000","last_undegraded":"2024-01-23T08:54:49.705781+0000","last_fullsized":"2024-01-23T08:54:49.705781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:23:51.285243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'15","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:32.842615+0000","last_change":"2024-01-23T08:54:40.658490+0000","last_active":"2024-01-23T08:55:32.842615+0000","last_peered":"2024-01-23T08:55:32.842615+0000","last_clean":"2024-01-23T08:55:32.842615+0000","last_became_active":"2024-01-23T08:54:40.657711+0000","last_became_peered":"2024-01-23T08:54:40.657711+0000","last_unstale":"2024-01-23T08:55:32.842615+0000","last_undegraded":"2024-01-23T08:55:32.842615+0000","last_fullsized":"2024-01-23T08:55:32.842615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:37:29.479181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.313979+0000","last_change":"2024-01-23T08:54:49.737210+0000","last_active":"2024-01-23T08:54:51.313979+0000","last_peered":"2024-01-23T08:54:51.313979+0000","last_clean":"2024-01-23T08:54:51.313979+0000","last_became_active":"2024-01-23T08:54:49.735023+0000","last_became_peered":"2024-01-23T08:54:49.735023+0000","last_unstale":"2024-01-23T08:54:51.313979+0000","last_undegraded":"2024-01-23T08:54:51.313979+0000","last_fullsized":"2024-01-23T08:54:51.313979+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:27.015436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.638868+0000","last_change":"2024-01-23T08:54:42.154453+0000","last_active":"2024-01-23T08:54:49.638868+0000","last_peered":"2024-01-23T08:54:49.638868+0000","last_clean":"2024-01-23T08:54:49.638868+0000","last_became_active":"2024-01-23T08:54:42.153735+0000","last_became_peered":"2024-01-23T08:54:42.153735+0000","last_unstale":"2024-01-23T08:54:49.638868+0000","last_undegraded":"2024-01-23T08:54:49.638868+0000","last_fullsized":"2024-01-23T08:54:49.638868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:54:39.173058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'5","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:23.535982+0000","last_change":"2024-01-23T08:54:40.702888+0000","last_active":"2024-01-23T08:55:23.535982+0000","last_peered":"2024-01-23T08:55:23.535982+0000","last_clean":"2024-01-23T08:55:23.535982+0000","last_became_active":"2024-01-23T08:54:40.701827+0000","last_became_peered":"2024-01-23T08:54:40.701827+0000","last_unstale":"2024-01-23T08:55:23.535982+0000","last_undegraded":"2024-01-23T08:55:23.535982+0000","last_fullsized":"2024-01-23T08:55:23.535982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:18:17.748052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.817591+0000","last_change":"2024-01-23T08:54:49.736262+0000","last_active":"2024-01-23T08:54:50.817591+0000","last_peered":"2024-01-23T08:54:50.817591+0000","last_clean":"2024-01-23T08:54:50.817591+0000","last_became_active":"2024-01-23T08:54:49.735765+0000","last_became_peered":"2024-01-23T08:54:49.735765+0000","last_unstale":"2024-01-23T08:54:50.817591+0000","last_undegraded":"2024-01-23T08:54:50.817591+0000","last_fullsized":"2024-01-23T08:54:50.817591+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:29:59.191326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.660727+0000","last_change":"2024-01-23T08:54:42.071292+0000","last_active":"2024-01-23T08:54:49.660727+0000","last_peered":"2024-01-23T08:54:49.660727+0000","last_clean":"2024-01-23T08:54:49.660727+0000","last_became_active":"2024-01-23T08:54:42.070703+0000","last_became_peered":"2024-01-23T08:54:42.070703+0000","last_unstale":"2024-01-23T08:54:49.660727+0000","last_undegraded":"2024-01-23T08:54:49.660727+0000","last_fullsized":"2024-01-23T08:54:49.660727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:37.410041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:32.972921+0000","last_change":"2024-01-23T08:54:40.687946+0000","last_active":"2024-01-23T08:55:32.972921+0000","last_peered":"2024-01-23T08:55:32.972921+0000","last_clean":"2024-01-23T08:55:32.972921+0000","last_became_active":"2024-01-23T08:54:40.687656+0000","last_became_peered":"2024-01-23T08:54:40.687656+0000","last_unstale":"2024-01-23T08:55:32.972921+0000","last_undegraded":"2024-01-23T08:55:32.972921+0000","last_fullsized":"2024-01-23T08:55:32.972921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:29:50.091026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.833039+0000","last_change":"2024-01-23T08:54:49.729434+0000","last_active":"2024-01-23T08:54:50.833039+0000","last_peered":"2024-01-23T08:54:50.833039+0000","last_clean":"2024-01-23T08:54:50.833039+0000","last_became_active":"2024-01-23T08:54:49.728191+0000","last_became_peered":"2024-01-23T08:54:49.728191+0000","last_unstale":"2024-01-23T08:54:50.833039+0000","last_undegraded":"2024-01-23T08:54:50.833039+0000","last_fullsized":"2024-01-23T08:54:50.833039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:30:27.390400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.707973+0000","last_change":"2024-01-23T08:54:42.155857+0000","last_active":"2024-01-23T08:54:49.707973+0000","last_peered":"2024-01-23T08:54:49.707973+0000","last_clean":"2024-01-23T08:54:49.707973+0000","last_became_active":"2024-01-23T08:54:42.153539+0000","last_became_peered":"2024-01-23T08:54:42.153539+0000","last_unstale":"2024-01-23T08:54:49.707973+0000","last_undegraded":"2024-01-23T08:54:49.707973+0000","last_fullsized":"2024-01-23T08:54:49.707973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:27:34.618270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:23.616930+0000","last_change":"2024-01-23T08:54:40.683174+0000","last_active":"2024-01-23T08:55:23.616930+0000","last_peered":"2024-01-23T08:55:23.616930+0000","last_clean":"2024-01-23T08:55:23.616930+0000","last_became_active":"2024-01-23T08:54:40.682765+0000","last_became_peered":"2024-01-23T08:54:40.682765+0000","last_unstale":"2024-01-23T08:55:23.616930+0000","last_undegraded":"2024-01-23T08:55:23.616930+0000","last_fullsized":"2024-01-23T08:55:23.616930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:13:10.191082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.313951+0000","last_change":"2024-01-23T08:54:49.728962+0000","last_active":"2024-01-23T08:54:51.313951+0000","last_peered":"2024-01-23T08:54:51.313951+0000","last_clean":"2024-01-23T08:54:51.313951+0000","last_became_active":"2024-01-23T08:54:49.724121+0000","last_became_peered":"2024-01-23T08:54:49.724121+0000","last_unstale":"2024-01-23T08:54:51.313951+0000","last_undegraded":"2024-01-23T08:54:51.313951+0000","last_fullsized":"2024-01-23T08:54:51.313951+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:14.188947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.315305+0000","last_change":"2024-01-23T08:54:49.735678+0000","last_active":"2024-01-23T08:54:51.315305+0000","last_peered":"2024-01-23T08:54:51.315305+0000","last_clean":"2024-01-23T08:54:51.315305+0000","last_became_active":"2024-01-23T08:54:49.732632+0000","last_became_peered":"2024-01-23T08:54:49.732632+0000","last_unstale":"2024-01-23T08:54:51.315305+0000","last_undegraded":"2024-01-23T08:54:51.315305+0000","last_fullsized":"2024-01-23T08:54:51.315305+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:54.463072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.707967+0000","last_change":"2024-01-23T08:54:42.196434+0000","last_active":"2024-01-23T08:54:49.707967+0000","last_peered":"2024-01-23T08:54:49.707967+0000","last_clean":"2024-01-23T08:54:49.707967+0000","last_became_active":"2024-01-23T08:54:42.195570+0000","last_became_peered":"2024-01-23T08:54:42.195570+0000","last_unstale":"2024-01-23T08:54:49.707967+0000","last_undegraded":"2024-01-23T08:54:49.707967+0000","last_fullsized":"2024-01-23T08:54:49.707967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:04:44.856358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:29.702675+0000","last_change":"2024-01-23T08:54:40.678920+0000","last_active":"2024-01-23T08:55:29.702675+0000","last_peered":"2024-01-23T08:55:29.702675+0000","last_clean":"2024-01-23T08:55:29.702675+0000","last_became_active":"2024-01-23T08:54:40.678527+0000","last_became_peered":"2024-01-23T08:54:40.678527+0000","last_unstale":"2024-01-23T08:55:29.702675+0000","last_undegraded":"2024-01-23T08:55:29.702675+0000","last_fullsized":"2024-01-23T08:55:29.702675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:48:02.807942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.313485+0000","last_change":"2024-01-23T08:54:49.719401+0000","last_active":"2024-01-23T08:54:51.313485+0000","last_peered":"2024-01-23T08:54:51.313485+0000","last_clean":"2024-01-23T08:54:51.313485+0000","last_became_active":"2024-01-23T08:54:49.717116+0000","last_became_peered":"2024-01-23T08:54:49.717116+0000","last_unstale":"2024-01-23T08:54:51.313485+0000","last_undegraded":"2024-01-23T08:54:51.313485+0000","last_fullsized":"2024-01-23T08:54:51.313485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:58:50.143993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.659808+0000","last_change":"2024-01-23T08:54:42.235843+0000","last_active":"2024-01-23T08:54:49.659808+0000","last_peered":"2024-01-23T08:54:49.659808+0000","last_clean":"2024-01-23T08:54:49.659808+0000","last_became_active":"2024-01-23T08:54:42.235116+0000","last_became_peered":"2024-01-23T08:54:42.235116+0000","last_unstale":"2024-01-23T08:54:49.659808+0000","last_undegraded":"2024-01-23T08:54:49.659808+0000","last_fullsized":"2024-01-23T08:54:49.659808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:43:27.674658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"28'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:26.578851+0000","last_change":"2024-01-23T08:54:40.690150+0000","last_active":"2024-01-23T08:55:26.578851+0000","last_peered":"2024-01-23T08:55:26.578851+0000","last_clean":"2024-01-23T08:55:26.578851+0000","last_became_active":"2024-01-23T08:54:40.689433+0000","last_became_peered":"2024-01-23T08:54:40.689433+0000","last_unstale":"2024-01-23T08:55:26.578851+0000","last_undegraded":"2024-01-23T08:55:26.578851+0000","last_fullsized":"2024-01-23T08:55:26.578851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:35:11.315349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'7","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:29.701675+0000","last_change":"2024-01-23T08:54:40.686731+0000","last_active":"2024-01-23T08:55:29.701675+0000","last_peered":"2024-01-23T08:55:29.701675+0000","last_clean":"2024-01-23T08:55:29.701675+0000","last_became_active":"2024-01-23T08:54:40.686371+0000","last_became_peered":"2024-01-23T08:54:40.686371+0000","last_unstale":"2024-01-23T08:55:29.701675+0000","last_undegraded":"2024-01-23T08:55:29.701675+0000","last_fullsized":"2024-01-23T08:55:29.701675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:45.362773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.707184+0000","last_change":"2024-01-23T08:54:42.200428+0000","last_active":"2024-01-23T08:54:49.707184+0000","last_peered":"2024-01-23T08:54:49.707184+0000","last_clean":"2024-01-23T08:54:49.707184+0000","last_became_active":"2024-01-23T08:54:42.198648+0000","last_became_peered":"2024-01-23T08:54:42.198648+0000","last_unstale":"2024-01-23T08:54:49.707184+0000","last_undegraded":"2024-01-23T08:54:49.707184+0000","last_fullsized":"2024-01-23T08:54:49.707184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:45:11.802421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.314977+0000","last_change":"2024-01-23T08:54:49.742269+0000","last_active":"2024-01-23T08:54:51.314977+0000","last_peered":"2024-01-23T08:54:51.314977+0000","last_clean":"2024-01-23T08:54:51.314977+0000","last_became_active":"2024-01-23T08:54:49.741692+0000","last_became_peered":"2024-01-23T08:54:49.741692+0000","last_unstale":"2024-01-23T08:54:51.314977+0000","last_undegraded":"2024-01-23T08:54:51.314977+0000","last_fullsized":"2024-01-23T08:54:51.314977+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:45.278144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'5","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:23.630537+0000","last_change":"2024-01-23T08:54:40.687352+0000","last_active":"2024-01-23T08:55:23.630537+0000","last_peered":"2024-01-23T08:55:23.630537+0000","last_clean":"2024-01-23T08:55:23.630537+0000","last_became_active":"2024-01-23T08:54:40.686125+0000","last_became_peered":"2024-01-23T08:54:40.686125+0000","last_unstale":"2024-01-23T08:55:23.630537+0000","last_undegraded":"2024-01-23T08:55:23.630537+0000","last_fullsized":"2024-01-23T08:55:23.630537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:38:41.311580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.710758+0000","last_change":"2024-01-23T08:54:42.090249+0000","last_active":"2024-01-23T08:54:49.710758+0000","last_peered":"2024-01-23T08:54:49.710758+0000","last_clean":"2024-01-23T08:54:49.710758+0000","last_became_active":"2024-01-23T08:54:42.089826+0000","last_became_peered":"2024-01-23T08:54:42.089826+0000","last_unstale":"2024-01-23T08:54:49.710758+0000","last_undegraded":"2024-01-23T08:54:49.710758+0000","last_fullsized":"2024-01-23T08:54:49.710758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:07:39.007667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.834012+0000","last_change":"2024-01-23T08:54:49.737089+0000","last_active":"2024-01-23T08:54:50.834012+0000","last_peered":"2024-01-23T08:54:50.834012+0000","last_clean":"2024-01-23T08:54:50.834012+0000","last_became_active":"2024-01-23T08:54:49.736197+0000","last_became_peered":"2024-01-23T08:54:49.736197+0000","last_unstale":"2024-01-23T08:54:50.834012+0000","last_undegraded":"2024-01-23T08:54:50.834012+0000","last_fullsized":"2024-01-23T08:54:50.834012+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:27:36.690726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.703007+0000","last_change":"2024-01-23T08:54:42.228128+0000","last_active":"2024-01-23T08:54:49.703007+0000","last_peered":"2024-01-23T08:54:49.703007+0000","last_clean":"2024-01-23T08:54:49.703007+0000","last_became_active":"2024-01-23T08:54:42.227421+0000","last_became_peered":"2024-01-23T08:54:42.227421+0000","last_unstale":"2024-01-23T08:54:49.703007+0000","last_undegraded":"2024-01-23T08:54:49.703007+0000","last_fullsized":"2024-01-23T08:54:49.703007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:47:09.171802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.713503+0000","last_change":"2024-01-23T08:54:42.112162+0000","last_active":"2024-01-23T08:54:49.713503+0000","last_peered":"2024-01-23T08:54:49.713503+0000","last_clean":"2024-01-23T08:54:49.713503+0000","last_became_active":"2024-01-23T08:54:42.111635+0000","last_became_peered":"2024-01-23T08:54:42.111635+0000","last_unstale":"2024-01-23T08:54:49.713503+0000","last_undegraded":"2024-01-23T08:54:49.713503+0000","last_fullsized":"2024-01-23T08:54:49.713503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:13:11.423278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.637930+0000","last_change":"2024-01-23T08:54:42.069982+0000","last_active":"2024-01-23T08:54:49.637930+0000","last_peered":"2024-01-23T08:54:49.637930+0000","last_clean":"2024-01-23T08:54:49.637930+0000","last_became_active":"2024-01-23T08:54:42.069262+0000","last_became_peered":"2024-01-23T08:54:42.069262+0000","last_unstale":"2024-01-23T08:54:49.637930+0000","last_undegraded":"2024-01-23T08:54:49.637930+0000","last_fullsized":"2024-01-23T08:54:49.637930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:56:44.803841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.660259+0000","last_change":"2024-01-23T08:54:42.108709+0000","last_active":"2024-01-23T08:54:49.660259+0000","last_peered":"2024-01-23T08:54:49.660259+0000","last_clean":"2024-01-23T08:54:49.660259+0000","last_became_active":"2024-01-23T08:54:42.107985+0000","last_became_peered":"2024-01-23T08:54:42.107985+0000","last_unstale":"2024-01-23T08:54:49.660259+0000","last_undegraded":"2024-01-23T08:54:49.660259+0000","last_fullsized":"2024-01-23T08:54:49.660259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:27:28.770059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.679217+0000","last_change":"2024-01-23T08:54:42.229100+0000","last_active":"2024-01-23T08:54:49.679217+0000","last_peered":"2024-01-23T08:54:49.679217+0000","last_clean":"2024-01-23T08:54:49.679217+0000","last_became_active":"2024-01-23T08:54:42.227918+0000","last_became_peered":"2024-01-23T08:54:42.227918+0000","last_unstale":"2024-01-23T08:54:49.679217+0000","last_undegraded":"2024-01-23T08:54:49.679217+0000","last_fullsized":"2024-01-23T08:54:49.679217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:54:47.705445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.677129+0000","last_change":"2024-01-23T08:54:42.231357+0000","last_active":"2024-01-23T08:54:49.677129+0000","last_peered":"2024-01-23T08:54:49.677129+0000","last_clean":"2024-01-23T08:54:49.677129+0000","last_became_active":"2024-01-23T08:54:42.230615+0000","last_became_peered":"2024-01-23T08:54:42.230615+0000","last_unstale":"2024-01-23T08:54:49.677129+0000","last_undegraded":"2024-01-23T08:54:49.677129+0000","last_fullsized":"2024-01-23T08:54:49.677129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:12:12.757498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.707876+0000","last_change":"2024-01-23T08:54:42.158739+0000","last_active":"2024-01-23T08:54:49.707876+0000","last_peered":"2024-01-23T08:54:49.707876+0000","last_clean":"2024-01-23T08:54:49.707876+0000","last_became_active":"2024-01-23T08:54:42.157106+0000","last_became_peered":"2024-01-23T08:54:42.157106+0000","last_unstale":"2024-01-23T08:54:49.707876+0000","last_undegraded":"2024-01-23T08:54:49.707876+0000","last_fullsized":"2024-01-23T08:54:49.707876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:32:37.961458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.660441+0000","last_change":"2024-01-23T08:54:42.092942+0000","last_active":"2024-01-23T08:54:49.660441+0000","last_peered":"2024-01-23T08:54:49.660441+0000","last_clean":"2024-01-23T08:54:49.660441+0000","last_became_active":"2024-01-23T08:54:42.092149+0000","last_became_peered":"2024-01-23T08:54:42.092149+0000","last_unstale":"2024-01-23T08:54:49.660441+0000","last_undegraded":"2024-01-23T08:54:49.660441+0000","last_fullsized":"2024-01-23T08:54:49.660441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:19.147334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.637829+0000","last_change":"2024-01-23T08:54:42.069948+0000","last_active":"2024-01-23T08:54:49.637829+0000","last_peered":"2024-01-23T08:54:49.637829+0000","last_clean":"2024-01-23T08:54:49.637829+0000","last_became_active":"2024-01-23T08:54:42.069305+0000","last_became_peered":"2024-01-23T08:54:42.069305+0000","last_unstale":"2024-01-23T08:54:49.637829+0000","last_undegraded":"2024-01-23T08:54:49.637829+0000","last_fullsized":"2024-01-23T08:54:49.637829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:21:50.684517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.659901+0000","last_change":"2024-01-23T08:54:42.158120+0000","last_active":"2024-01-23T08:54:49.659901+0000","last_peered":"2024-01-23T08:54:49.659901+0000","last_clean":"2024-01-23T08:54:49.659901+0000","last_became_active":"2024-01-23T08:54:42.157647+0000","last_became_peered":"2024-01-23T08:54:42.157647+0000","last_unstale":"2024-01-23T08:54:49.659901+0000","last_undegraded":"2024-01-23T08:54:49.659901+0000","last_fullsized":"2024-01-23T08:54:49.659901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:28:50.107504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.710525+0000","last_change":"2024-01-23T08:54:42.119253+0000","last_active":"2024-01-23T08:54:49.710525+0000","last_peered":"2024-01-23T08:54:49.710525+0000","last_clean":"2024-01-23T08:54:49.710525+0000","last_became_active":"2024-01-23T08:54:42.118528+0000","last_became_peered":"2024-01-23T08:54:42.118528+0000","last_unstale":"2024-01-23T08:54:49.710525+0000","last_undegraded":"2024-01-23T08:54:49.710525+0000","last_fullsized":"2024-01-23T08:54:49.710525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:47:09.171802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.706925+0000","last_change":"2024-01-23T08:54:42.197561+0000","last_active":"2024-01-23T08:54:49.706925+0000","last_peered":"2024-01-23T08:54:49.706925+0000","last_clean":"2024-01-23T08:54:49.706925+0000","last_became_active":"2024-01-23T08:54:42.196809+0000","last_became_peered":"2024-01-23T08:54:42.196809+0000","last_unstale":"2024-01-23T08:54:49.706925+0000","last_undegraded":"2024-01-23T08:54:49.706925+0000","last_fullsized":"2024-01-23T08:54:49.706925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:16:34.046447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.708919+0000","last_change":"2024-01-23T08:54:42.112093+0000","last_active":"2024-01-23T08:54:49.708919+0000","last_peered":"2024-01-23T08:54:49.708919+0000","last_clean":"2024-01-23T08:54:49.708919+0000","last_became_active":"2024-01-23T08:54:42.111207+0000","last_became_peered":"2024-01-23T08:54:42.111207+0000","last_unstale":"2024-01-23T08:54:49.708919+0000","last_undegraded":"2024-01-23T08:54:49.708919+0000","last_fullsized":"2024-01-23T08:54:49.708919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:37.410041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.639633+0000","last_change":"2024-01-23T08:54:42.195803+0000","last_active":"2024-01-23T08:54:49.639633+0000","last_peered":"2024-01-23T08:54:49.639633+0000","last_clean":"2024-01-23T08:54:49.639633+0000","last_became_active":"2024-01-23T08:54:42.194562+0000","last_became_peered":"2024-01-23T08:54:42.194562+0000","last_unstale":"2024-01-23T08:54:49.639633+0000","last_undegraded":"2024-01-23T08:54:49.639633+0000","last_fullsized":"2024-01-23T08:54:49.639633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:53:56.379892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.716004+0000","last_change":"2024-01-23T08:54:42.161219+0000","last_active":"2024-01-23T08:54:49.716004+0000","last_peered":"2024-01-23T08:54:49.716004+0000","last_clean":"2024-01-23T08:54:49.716004+0000","last_became_active":"2024-01-23T08:54:42.160570+0000","last_became_peered":"2024-01-23T08:54:42.160570+0000","last_unstale":"2024-01-23T08:54:49.716004+0000","last_undegraded":"2024-01-23T08:54:49.716004+0000","last_fullsized":"2024-01-23T08:54:49.716004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:47:09.171802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.640590+0000","last_change":"2024-01-23T08:54:42.115468+0000","last_active":"2024-01-23T08:54:49.640590+0000","last_peered":"2024-01-23T08:54:49.640590+0000","last_clean":"2024-01-23T08:54:49.640590+0000","last_became_active":"2024-01-23T08:54:42.114759+0000","last_became_peered":"2024-01-23T08:54:42.114759+0000","last_unstale":"2024-01-23T08:54:49.640590+0000","last_undegraded":"2024-01-23T08:54:49.640590+0000","last_fullsized":"2024-01-23T08:54:49.640590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:00:35.095097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.637665+0000","last_change":"2024-01-23T08:54:42.150054+0000","last_active":"2024-01-23T08:54:49.637665+0000","last_peered":"2024-01-23T08:54:49.637665+0000","last_clean":"2024-01-23T08:54:49.637665+0000","last_became_active":"2024-01-23T08:54:42.149278+0000","last_became_peered":"2024-01-23T08:54:42.149278+0000","last_unstale":"2024-01-23T08:54:49.637665+0000","last_undegraded":"2024-01-23T08:54:49.637665+0000","last_fullsized":"2024-01-23T08:54:49.637665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:16:33.710981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.659573+0000","last_change":"2024-01-23T08:54:42.110442+0000","last_active":"2024-01-23T08:54:49.659573+0000","last_peered":"2024-01-23T08:54:49.659573+0000","last_clean":"2024-01-23T08:54:49.659573+0000","last_became_active":"2024-01-23T08:54:42.109743+0000","last_became_peered":"2024-01-23T08:54:42.109743+0000","last_unstale":"2024-01-23T08:54:49.659573+0000","last_undegraded":"2024-01-23T08:54:49.659573+0000","last_fullsized":"2024-01-23T08:54:49.659573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:58:34.376942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.677729+0000","last_change":"2024-01-23T08:54:42.228264+0000","last_active":"2024-01-23T08:54:49.677729+0000","last_peered":"2024-01-23T08:54:49.677729+0000","last_clean":"2024-01-23T08:54:49.677729+0000","last_became_active":"2024-01-23T08:54:42.227537+0000","last_became_peered":"2024-01-23T08:54:42.227537+0000","last_unstale":"2024-01-23T08:54:49.677729+0000","last_undegraded":"2024-01-23T08:54:49.677729+0000","last_fullsized":"2024-01-23T08:54:49.677729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:54:25.960679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.677826+0000","last_change":"2024-01-23T08:54:42.225968+0000","last_active":"2024-01-23T08:54:49.677826+0000","last_peered":"2024-01-23T08:54:49.677826+0000","last_clean":"2024-01-23T08:54:49.677826+0000","last_became_active":"2024-01-23T08:54:42.224541+0000","last_became_peered":"2024-01-23T08:54:42.224541+0000","last_unstale":"2024-01-23T08:54:49.677826+0000","last_undegraded":"2024-01-23T08:54:49.677826+0000","last_fullsized":"2024-01-23T08:54:49.677826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:04:03.310087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.708825+0000","last_change":"2024-01-23T08:54:42.111363+0000","last_active":"2024-01-23T08:54:49.708825+0000","last_peered":"2024-01-23T08:54:49.708825+0000","last_clean":"2024-01-23T08:54:49.708825+0000","last_became_active":"2024-01-23T08:54:42.111043+0000","last_became_peered":"2024-01-23T08:54:42.111043+0000","last_unstale":"2024-01-23T08:54:49.708825+0000","last_undegraded":"2024-01-23T08:54:49.708825+0000","last_fullsized":"2024-01-23T08:54:49.708825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:22.447523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705684+0000","last_change":"2024-01-23T08:54:42.116234+0000","last_active":"2024-01-23T08:54:49.705684+0000","last_peered":"2024-01-23T08:54:49.705684+0000","last_clean":"2024-01-23T08:54:49.705684+0000","last_became_active":"2024-01-23T08:54:42.115911+0000","last_became_peered":"2024-01-23T08:54:42.115911+0000","last_unstale":"2024-01-23T08:54:49.705684+0000","last_undegraded":"2024-01-23T08:54:49.705684+0000","last_fullsized":"2024-01-23T08:54:49.705684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:06.320845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705399+0000","last_change":"2024-01-23T08:54:42.158134+0000","last_active":"2024-01-23T08:54:49.705399+0000","last_peered":"2024-01-23T08:54:49.705399+0000","last_clean":"2024-01-23T08:54:49.705399+0000","last_became_active":"2024-01-23T08:54:42.157331+0000","last_became_peered":"2024-01-23T08:54:42.157331+0000","last_unstale":"2024-01-23T08:54:49.705399+0000","last_undegraded":"2024-01-23T08:54:49.705399+0000","last_fullsized":"2024-01-23T08:54:49.705399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:46.594970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.715272+0000","last_change":"2024-01-23T08:54:42.092495+0000","last_active":"2024-01-23T08:54:49.715272+0000","last_peered":"2024-01-23T08:54:49.715272+0000","last_clean":"2024-01-23T08:54:49.715272+0000","last_became_active":"2024-01-23T08:54:42.091726+0000","last_became_peered":"2024-01-23T08:54:42.091726+0000","last_unstale":"2024-01-23T08:54:49.715272+0000","last_undegraded":"2024-01-23T08:54:49.715272+0000","last_fullsized":"2024-01-23T08:54:49.715272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:19:17.992621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.659528+0000","last_change":"2024-01-23T08:54:42.120617+0000","last_active":"2024-01-23T08:54:49.659528+0000","last_peered":"2024-01-23T08:54:49.659528+0000","last_clean":"2024-01-23T08:54:49.659528+0000","last_became_active":"2024-01-23T08:54:42.119847+0000","last_became_peered":"2024-01-23T08:54:42.119847+0000","last_unstale":"2024-01-23T08:54:49.659528+0000","last_undegraded":"2024-01-23T08:54:49.659528+0000","last_fullsized":"2024-01-23T08:54:49.659528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:29:51.323223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.699912+0000","last_change":"2024-01-23T08:54:42.197133+0000","last_active":"2024-01-23T08:54:49.699912+0000","last_peered":"2024-01-23T08:54:49.699912+0000","last_clean":"2024-01-23T08:54:49.699912+0000","last_became_active":"2024-01-23T08:54:42.195743+0000","last_became_peered":"2024-01-23T08:54:42.195743+0000","last_unstale":"2024-01-23T08:54:49.699912+0000","last_undegraded":"2024-01-23T08:54:49.699912+0000","last_fullsized":"2024-01-23T08:54:49.699912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:48:04.040139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705359+0000","last_change":"2024-01-23T08:54:42.195979+0000","last_active":"2024-01-23T08:54:49.705359+0000","last_peered":"2024-01-23T08:54:49.705359+0000","last_clean":"2024-01-23T08:54:49.705359+0000","last_became_active":"2024-01-23T08:54:42.194846+0000","last_became_peered":"2024-01-23T08:54:42.194846+0000","last_unstale":"2024-01-23T08:54:49.705359+0000","last_undegraded":"2024-01-23T08:54:49.705359+0000","last_fullsized":"2024-01-23T08:54:49.705359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:07:39.007667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705207+0000","last_change":"2024-01-23T08:54:42.118056+0000","last_active":"2024-01-23T08:54:49.705207+0000","last_peered":"2024-01-23T08:54:49.705207+0000","last_clean":"2024-01-23T08:54:49.705207+0000","last_became_active":"2024-01-23T08:54:42.117735+0000","last_became_peered":"2024-01-23T08:54:42.117735+0000","last_unstale":"2024-01-23T08:54:49.705207+0000","last_undegraded":"2024-01-23T08:54:49.705207+0000","last_fullsized":"2024-01-23T08:54:49.705207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:19.147334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.707758+0000","last_change":"2024-01-23T08:54:42.195159+0000","last_active":"2024-01-23T08:54:49.707758+0000","last_peered":"2024-01-23T08:54:49.707758+0000","last_clean":"2024-01-23T08:54:49.707758+0000","last_became_active":"2024-01-23T08:54:42.194331+0000","last_became_peered":"2024-01-23T08:54:42.194331+0000","last_unstale":"2024-01-23T08:54:49.707758+0000","last_undegraded":"2024-01-23T08:54:49.707758+0000","last_fullsized":"2024-01-23T08:54:49.707758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:19:25.718244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.662214+0000","last_change":"2024-01-23T08:54:42.197096+0000","last_active":"2024-01-23T08:54:49.662214+0000","last_peered":"2024-01-23T08:54:49.662214+0000","last_clean":"2024-01-23T08:54:49.662214+0000","last_became_active":"2024-01-23T08:54:42.196391+0000","last_became_peered":"2024-01-23T08:54:42.196391+0000","last_unstale":"2024-01-23T08:54:49.662214+0000","last_undegraded":"2024-01-23T08:54:49.662214+0000","last_fullsized":"2024-01-23T08:54:49.662214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:22.447523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.661112+0000","last_change":"2024-01-23T08:54:42.231430+0000","last_active":"2024-01-23T08:54:49.661112+0000","last_peered":"2024-01-23T08:54:49.661112+0000","last_clean":"2024-01-23T08:54:49.661112+0000","last_became_active":"2024-01-23T08:54:42.229220+0000","last_became_peered":"2024-01-23T08:54:42.229220+0000","last_unstale":"2024-01-23T08:54:49.661112+0000","last_undegraded":"2024-01-23T08:54:49.661112+0000","last_fullsized":"2024-01-23T08:54:49.661112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:48:04.040139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705952+0000","last_change":"2024-01-23T08:54:42.118613+0000","last_active":"2024-01-23T08:54:49.705952+0000","last_peered":"2024-01-23T08:54:49.705952+0000","last_clean":"2024-01-23T08:54:49.705952+0000","last_became_active":"2024-01-23T08:54:42.118233+0000","last_became_peered":"2024-01-23T08:54:42.118233+0000","last_unstale":"2024-01-23T08:54:49.705952+0000","last_undegraded":"2024-01-23T08:54:49.705952+0000","last_fullsized":"2024-01-23T08:54:49.705952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:16:33.710981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10263,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":19938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.80500000000000005}]},{"osd":1,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.69999999999999996}]},{"osd":2,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.88600000000000001}]},{"osd":3,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.93600000000000005}]},{"osd":4,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.2530000000000001,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.46000000000000002}]},{"osd":5,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.748}]},{"osd":6,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":0.59399999999999997},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":0.61699999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":913408,"data_stored":708397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.502}]},{"osd":1,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":1.0209999999999999}]},{"osd":2,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.79900000000000004}]},{"osd":3,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.91800000000000004}]},{"osd":4,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.89900000000000002}]},{"osd":6,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.157}]},{"osd":7,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":1.218}]}]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":122882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.738,"5min":2.738,"15min":2.738},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.77800000000000002}]},{"osd":1,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.4529999999999998,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":1.081}]},{"osd":2,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":2.524,"5min":2.524,"15min":2.524},"last":0.88800000000000001}]},{"osd":3,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":1.323},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":1.0249999999999999}]},{"osd":5,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.3690000000000002,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.202},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.1439999999999999}]},{"osd":6,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.28},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.6030000000000002,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.3700000000000001}]},{"osd":7,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.53},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":1.1060000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509464,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31484,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340356,"statfs":{"total":96636764160,"available":96604524544,"internally_reserved":0,"allocated":315392,"data_stored":121112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.41699999999999998}]},{"osd":1,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.38400000000000001}]},{"osd":3,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":1.016}]},{"osd":4,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.503}]},{"osd":5,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.52700000000000002},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.99099999999999999}]},{"osd":6,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.58699999999999997}]},{"osd":7,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.56100000000000005}]}]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":905216,"data_stored":708403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.69999999999999996}]},{"osd":2,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.317},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.505}]},{"osd":3,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.77200000000000002}]},{"osd":4,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.625},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.65500000000000003}]},{"osd":5,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.747}]},{"osd":6,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.67900000000000005}]},{"osd":7,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.92500000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509463,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":327680,"data_stored":119163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.246},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.20000000000000001}]},{"osd":2,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.312},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.28999999999999998}]},{"osd":3,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.35699999999999998}]},{"osd":4,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.61399999999999999}]},{"osd":5,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.377}]},{"osd":6,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.57899999999999996}]},{"osd":7,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.71199999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":335872,"data_stored":119337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.38}]},{"osd":1,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.52300000000000002}]},{"osd":2,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.41999999999999998}]},{"osd":4,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.55800000000000005},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.69599999999999995}]},{"osd":5,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.67900000000000005}]},{"osd":6,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.77700000000000002}]},{"osd":7,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.74199999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":118995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.63900000000000001}]},{"osd":1,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.99099999999999999}]},{"osd":2,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.52900000000000003}]},{"osd":3,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.0229999999999999}]},{"osd":4,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.81000000000000005}]},{"osd":5,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.1100000000000001}]},{"osd":7,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.67900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":5679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-23T08:55:37.614 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-23T08:55:37.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.779+0000 7f1258be9640 1 Processor -- start 2024-01-23T08:55:37.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.779+0000 7f1258be9640 1 -- start start 2024-01-23T08:55:37.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.779+0000 7f1258be9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1254151570 0x7f1254157e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:37.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.779+0000 7f1258be9640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1254071ce0 0x7f1254072110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:37.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.779+0000 7f1258be9640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1254158360 con 0x7f12540c8660 2024-01-23T08:55:37.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.779+0000 7f1258be9640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12540c78c0 con 0x7f1254071ce0 2024-01-23T08:55:37.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.779+0000 7f1258be9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125406ad40 con 0x7f1254151570 2024-01-23T08:55:37.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.783+0000 7f125259c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1254151570 0x7f1254157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:37.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.783+0000 7f125259c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1254151570 0x7f1254157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:46640/0 (socket says 172.21.15.46:46640) 2024-01-23T08:55:37.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.783+0000 7f125259c640 1 -- 172.21.15.46:0/2192864506 learned_addr learned my addr 172.21.15.46:0/2192864506 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:37.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.787+0000 7f125259c640 1 -- 172.21.15.46:0/2192864506 >> v2:172.21.15.46:3300/0 conn(0x7f1254071ce0 msgr2=0x7f1254072110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:37.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.787+0000 7f125259c640 1 --2- 172.21.15.46:0/2192864506 >> v2:172.21.15.46:3300/0 conn(0x7f1254071ce0 0x7f1254072110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:37.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.787+0000 7f125259c640 1 -- 172.21.15.46:0/2192864506 >> v1:172.21.15.46:6789/0 conn(0x7f12540c8660 legacy=0x7f12540c4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:37.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.787+0000 7f125259c640 1 -- 172.21.15.46:0/2192864506 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1254072650 con 0x7f1254151570 2024-01-23T08:55:37.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.795+0000 7f125259c640 1 --2- 172.21.15.46:0/2192864506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1254151570 0x7f1254157e20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1248009870 tx=0x7f124801c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e3936650361d609 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:37.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.911+0000 7f125159a640 1 -- 172.21.15.46:0/2192864506 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12480ab600 con 0x7f1254151570 2024-01-23T08:55:37.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.911+0000 7f125159a640 1 -- 172.21.15.46:0/2192864506 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12480a7050 con 0x7f1254151570 2024-01-23T08:55:37.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.911+0000 7f125159a640 1 -- 172.21.15.46:0/2192864506 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12480ab980 con 0x7f1254151570 2024-01-23T08:55:37.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.911+0000 7f1258be9640 1 -- 172.21.15.46:0/2192864506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1254151570 msgr2=0x7f1254157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:37.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.911+0000 7f1258be9640 1 --2- 172.21.15.46:0/2192864506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1254151570 0x7f1254157e20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1248009870 tx=0x7f124801c4b0 comp rx=0 tx=0).stop 2024-01-23T08:55:37.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.911+0000 7f1258be9640 1 -- 172.21.15.46:0/2192864506 shutdown_connections 2024-01-23T08:55:37.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.911+0000 7f1258be9640 1 --2- 172.21.15.46:0/2192864506 >> v2:172.21.15.46:3300/0 conn(0x7f1254071ce0 0x7f1254072110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:37.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.911+0000 7f1258be9640 1 --2- 172.21.15.46:0/2192864506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1254151570 0x7f1254157e20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:37.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.911+0000 7f1258be9640 1 -- 172.21.15.46:0/2192864506 >> 172.21.15.46:0/2192864506 conn(0x7f12540cbb60 msgr2=0x7f12540c7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:37.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.911+0000 7f1258be9640 1 -- 172.21.15.46:0/2192864506 shutdown_connections 2024-01-23T08:55:37.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.911+0000 7f1258be9640 1 -- 172.21.15.46:0/2192864506 wait complete. 2024-01-23T08:55:37.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.915+0000 7f1258be9640 1 Processor -- start 2024-01-23T08:55:37.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.915+0000 7f1258be9640 1 -- start start 2024-01-23T08:55:37.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.915+0000 7f1258be9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1254071ce0 0x7f125414ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:37.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.915+0000 7f1258be9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12540c8660 0x7f125413e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:37.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.915+0000 7f1258be9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1254151570 0x7f12541f2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:37.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.915+0000 7f1258be9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12541f2790 con 0x7f12540c8660 2024-01-23T08:55:37.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.915+0000 7f1258be9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125414b390 con 0x7f1254151570 2024-01-23T08:55:37.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.915+0000 7f1258be9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125414c6d0 con 0x7f1254071ce0 2024-01-23T08:55:37.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.919+0000 7f1251d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12540c8660 0x7f125413e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:37.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.919+0000 7f1251d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12540c8660 0x7f125413e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54810/0 (socket says 172.21.15.46:54810) 2024-01-23T08:55:37.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.919+0000 7f1251d9b640 1 -- 172.21.15.46:0/2164036163 learned_addr learned my addr 172.21.15.46:0/2164036163 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:37.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.923+0000 7f125259c640 1 --2- 172.21.15.46:0/2164036163 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1254071ce0 0x7f125414ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:37.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.923+0000 7f1252d9d640 1 --2- 172.21.15.46:0/2164036163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1254151570 0x7f12541f2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:37.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.927+0000 7f1251d9b640 1 -- 172.21.15.46:0/2164036163 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1254071ce0 msgr2=0x7f125414ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:37.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.927+0000 7f1251d9b640 1 --2- 172.21.15.46:0/2164036163 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1254071ce0 0x7f125414ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:37.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.927+0000 7f1251d9b640 1 -- 172.21.15.46:0/2164036163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1254151570 msgr2=0x7f12541f2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:37.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.927+0000 7f1251d9b640 1 --2- 172.21.15.46:0/2164036163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1254151570 0x7f12541f2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:37.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.927+0000 7f1251d9b640 1 -- 172.21.15.46:0/2164036163 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12480094d0 con 0x7f12540c8660 2024-01-23T08:55:37.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.939+0000 7f1251d9b640 1 --2- 172.21.15.46:0/2164036163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12540c8660 0x7f125413e260 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f124400c450 tx=0x7f124400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:37.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.951+0000 7f1242ffd640 1 -- 172.21.15.46:0/2164036163 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12440052d0 con 0x7f12540c8660 2024-01-23T08:55:37.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.951+0000 7f1242ffd640 1 -- 172.21.15.46:0/2164036163 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1244005430 con 0x7f12540c8660 2024-01-23T08:55:37.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.951+0000 7f1242ffd640 1 -- 172.21.15.46:0/2164036163 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1244007260 con 0x7f12540c8660 2024-01-23T08:55:37.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.951+0000 7f1258be9640 1 -- 172.21.15.46:0/2164036163 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f125413e7a0 con 0x7f12540c8660 2024-01-23T08:55:37.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.951+0000 7f1258be9640 1 -- 172.21.15.46:0/2164036163 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125414be30 con 0x7f12540c8660 2024-01-23T08:55:37.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:37.951+0000 7f1258be9640 1 -- 172.21.15.46:0/2164036163 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12541f24f0 con 0x7f12540c8660 2024-01-23T08:55:38.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.007+0000 7f1242ffd640 1 -- 172.21.15.46:0/2164036163 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f12440073c0 con 0x7f12540c8660 2024-01-23T08:55:38.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.007+0000 7f1242ffd640 1 --2- 172.21.15.46:0/2164036163 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f1234066580 0x7f1234068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:38.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.007+0000 7f125259c640 1 --2- 172.21.15.46:0/2164036163 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f1234066580 0x7f1234068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:38.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.011+0000 7f125259c640 1 --2- 172.21.15.46:0/2164036163 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f1234066580 0x7f1234068a40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f12480ad000 tx=0x7f1248008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:38.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.015+0000 7f1242ffd640 1 -- 172.21.15.46:0/2164036163 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1244054880 con 0x7f12540c8660 2024-01-23T08:55:38.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.323+0000 7f1242ffd640 1 -- 172.21.15.46:0/2164036163 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f1244050bc0 con 0x7f12540c8660 2024-01-23T08:55:38.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.487+0000 7f1258be9640 1 -- 172.21.15.46:0/2164036163 --> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f12540c5b40 con 0x7f1234066580 2024-01-23T08:55:38.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.515+0000 7f1242ffd640 1 -- 172.21.15.46:0/2164036163 <== mgr.4107 v2:172.21.15.46:6800/2324478006 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368108 (secure 0 0 0) 0x7f12540c5b40 con 0x7f1234066580 2024-01-23T08:55:38.517 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:55:38.519 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-01-23T08:55:38.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.519+0000 7f1258be9640 1 -- 172.21.15.46:0/2164036163 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f1234066580 msgr2=0x7f1234068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:38.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.519+0000 7f1258be9640 1 --2- 172.21.15.46:0/2164036163 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f1234066580 0x7f1234068a40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f12480ad000 tx=0x7f1248008040 comp rx=0 tx=0).stop 2024-01-23T08:55:38.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.519+0000 7f1258be9640 1 -- 172.21.15.46:0/2164036163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12540c8660 msgr2=0x7f125413e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:38.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.519+0000 7f1258be9640 1 --2- 172.21.15.46:0/2164036163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12540c8660 0x7f125413e260 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f124400c450 tx=0x7f124400c910 comp rx=0 tx=0).stop 2024-01-23T08:55:38.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.519+0000 7f1258be9640 1 -- 172.21.15.46:0/2164036163 shutdown_connections 2024-01-23T08:55:38.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.519+0000 7f1258be9640 1 --2- 172.21.15.46:0/2164036163 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f1234066580 0x7f1234068a40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:38.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.519+0000 7f1258be9640 1 --2- 172.21.15.46:0/2164036163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1254151570 0x7f12541f2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:38.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.519+0000 7f1258be9640 1 --2- 172.21.15.46:0/2164036163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12540c8660 0x7f125413e260 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:38.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.519+0000 7f1258be9640 1 --2- 172.21.15.46:0/2164036163 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1254071ce0 0x7f125414ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:38.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.519+0000 7f1258be9640 1 -- 172.21.15.46:0/2164036163 >> 172.21.15.46:0/2164036163 conn(0x7f12540cbb60 msgr2=0x7f12541500c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:38.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.523+0000 7f1258be9640 1 -- 172.21.15.46:0/2164036163 shutdown_connections 2024-01-23T08:55:38.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.523+0000 7f1258be9640 1 -- 172.21.15.46:0/2164036163 wait complete. 2024-01-23T08:55:38.541 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-01-23T08:55:36.585360+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600631,"num_objects":97,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":369,"num_write_kb":2478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":300,"ondisk_log_size":300,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236468,"kb_used_data":3700,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738252,"statfs":{"total":773094113280,"available":772851970048,"internally_reserved":0,"allocated":3788800,"data_stored":2136524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4862,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005708"},"pg_stats":[{"pgid":"2.1f","version":"28'13","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:32.928462+0000","last_change":"2024-01-23T08:54:40.661700+0000","last_active":"2024-01-23T08:55:32.928462+0000","last_peered":"2024-01-23T08:55:32.928462+0000","last_clean":"2024-01-23T08:55:32.928462+0000","last_became_active":"2024-01-23T08:54:40.660901+0000","last_became_peered":"2024-01-23T08:54:40.660901+0000","last_unstale":"2024-01-23T08:55:32.928462+0000","last_undegraded":"2024-01-23T08:55:32.928462+0000","last_fullsized":"2024-01-23T08:55:32.928462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:59:22.804479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.662103+0000","last_change":"2024-01-23T08:54:42.159130+0000","last_active":"2024-01-23T08:54:49.662103+0000","last_peered":"2024-01-23T08:54:49.662103+0000","last_clean":"2024-01-23T08:54:49.662103+0000","last_became_active":"2024-01-23T08:54:42.158776+0000","last_became_peered":"2024-01-23T08:54:42.158776+0000","last_unstale":"2024-01-23T08:54:49.662103+0000","last_undegraded":"2024-01-23T08:54:49.662103+0000","last_fullsized":"2024-01-23T08:54:49.662103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:06.320845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.833180+0000","last_change":"2024-01-23T08:54:49.752558+0000","last_active":"2024-01-23T08:54:50.833180+0000","last_peered":"2024-01-23T08:54:50.833180+0000","last_clean":"2024-01-23T08:54:50.833180+0000","last_became_active":"2024-01-23T08:54:49.752077+0000","last_became_peered":"2024-01-23T08:54:49.752077+0000","last_unstale":"2024-01-23T08:54:50.833180+0000","last_undegraded":"2024-01-23T08:54:50.833180+0000","last_fullsized":"2024-01-23T08:54:50.833180+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:20:50.653881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"28'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.316966+0000","last_change":"2024-01-23T08:54:40.700164+0000","last_active":"2024-01-23T08:54:51.316966+0000","last_peered":"2024-01-23T08:54:51.316966+0000","last_clean":"2024-01-23T08:54:51.316966+0000","last_became_active":"2024-01-23T08:54:40.699449+0000","last_became_peered":"2024-01-23T08:54:40.699449+0000","last_unstale":"2024-01-23T08:54:51.316966+0000","last_undegraded":"2024-01-23T08:54:51.316966+0000","last_fullsized":"2024-01-23T08:54:51.316966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:16:32.814250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.660624+0000","last_change":"2024-01-23T08:54:42.092833+0000","last_active":"2024-01-23T08:54:49.660624+0000","last_peered":"2024-01-23T08:54:49.660624+0000","last_clean":"2024-01-23T08:54:49.660624+0000","last_became_active":"2024-01-23T08:54:42.091950+0000","last_became_peered":"2024-01-23T08:54:42.091950+0000","last_unstale":"2024-01-23T08:54:49.660624+0000","last_undegraded":"2024-01-23T08:54:49.660624+0000","last_fullsized":"2024-01-23T08:54:49.660624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:46.594970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.816521+0000","last_change":"2024-01-23T08:54:49.747131+0000","last_active":"2024-01-23T08:54:50.816521+0000","last_peered":"2024-01-23T08:54:50.816521+0000","last_clean":"2024-01-23T08:54:50.816521+0000","last_became_active":"2024-01-23T08:54:49.746481+0000","last_became_peered":"2024-01-23T08:54:49.746481+0000","last_unstale":"2024-01-23T08:54:50.816521+0000","last_undegraded":"2024-01-23T08:54:50.816521+0000","last_fullsized":"2024-01-23T08:54:50.816521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:45:19.670524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"28'11","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:32.973357+0000","last_change":"2024-01-23T08:54:40.687614+0000","last_active":"2024-01-23T08:55:32.973357+0000","last_peered":"2024-01-23T08:55:32.973357+0000","last_clean":"2024-01-23T08:55:32.973357+0000","last_became_active":"2024-01-23T08:54:40.687234+0000","last_became_peered":"2024-01-23T08:54:40.687234+0000","last_unstale":"2024-01-23T08:55:32.973357+0000","last_undegraded":"2024-01-23T08:55:32.973357+0000","last_fullsized":"2024-01-23T08:55:32.973357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:54:17.627706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.711014+0000","last_change":"2024-01-23T08:54:42.114480+0000","last_active":"2024-01-23T08:54:49.711014+0000","last_peered":"2024-01-23T08:54:49.711014+0000","last_clean":"2024-01-23T08:54:49.711014+0000","last_became_active":"2024-01-23T08:54:42.113946+0000","last_became_peered":"2024-01-23T08:54:42.113946+0000","last_unstale":"2024-01-23T08:54:49.711014+0000","last_undegraded":"2024-01-23T08:54:49.711014+0000","last_fullsized":"2024-01-23T08:54:49.711014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:19:25.718244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.817755+0000","last_change":"2024-01-23T08:54:49.747332+0000","last_active":"2024-01-23T08:54:50.817755+0000","last_peered":"2024-01-23T08:54:50.817755+0000","last_clean":"2024-01-23T08:54:50.817755+0000","last_became_active":"2024-01-23T08:54:49.746474+0000","last_became_peered":"2024-01-23T08:54:49.746474+0000","last_unstale":"2024-01-23T08:54:50.817755+0000","last_undegraded":"2024-01-23T08:54:50.817755+0000","last_fullsized":"2024-01-23T08:54:50.817755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:28:57.975606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:32.973091+0000","last_change":"2024-01-23T08:54:40.687290+0000","last_active":"2024-01-23T08:55:32.973091+0000","last_peered":"2024-01-23T08:55:32.973091+0000","last_clean":"2024-01-23T08:55:32.973091+0000","last_became_active":"2024-01-23T08:54:40.686903+0000","last_became_peered":"2024-01-23T08:54:40.686903+0000","last_unstale":"2024-01-23T08:55:32.973091+0000","last_undegraded":"2024-01-23T08:55:32.973091+0000","last_fullsized":"2024-01-23T08:55:32.973091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:57:23.064188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.639122+0000","last_change":"2024-01-23T08:54:42.109485+0000","last_active":"2024-01-23T08:54:49.639122+0000","last_peered":"2024-01-23T08:54:49.639122+0000","last_clean":"2024-01-23T08:54:49.639122+0000","last_became_active":"2024-01-23T08:54:42.108182+0000","last_became_peered":"2024-01-23T08:54:42.108182+0000","last_unstale":"2024-01-23T08:54:49.639122+0000","last_undegraded":"2024-01-23T08:54:49.639122+0000","last_fullsized":"2024-01-23T08:54:49.639122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:51:12.417589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.816879+0000","last_change":"2024-01-23T08:54:49.747949+0000","last_active":"2024-01-23T08:54:50.816879+0000","last_peered":"2024-01-23T08:54:50.816879+0000","last_clean":"2024-01-23T08:54:50.816879+0000","last_became_active":"2024-01-23T08:54:49.746880+0000","last_became_peered":"2024-01-23T08:54:49.746880+0000","last_unstale":"2024-01-23T08:54:50.816879+0000","last_undegraded":"2024-01-23T08:54:50.816879+0000","last_fullsized":"2024-01-23T08:54:50.816879+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:54:26.728005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.638029+0000","last_change":"2024-01-23T08:54:42.088786+0000","last_active":"2024-01-23T08:54:49.638029+0000","last_peered":"2024-01-23T08:54:49.638029+0000","last_clean":"2024-01-23T08:54:49.638029+0000","last_became_active":"2024-01-23T08:54:42.088068+0000","last_became_peered":"2024-01-23T08:54:42.088068+0000","last_unstale":"2024-01-23T08:54:49.638029+0000","last_undegraded":"2024-01-23T08:54:49.638029+0000","last_fullsized":"2024-01-23T08:54:49.638029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:38:41.382732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:23.612198+0000","last_change":"2024-01-23T08:54:40.612044+0000","last_active":"2024-01-23T08:55:23.612198+0000","last_peered":"2024-01-23T08:55:23.612198+0000","last_clean":"2024-01-23T08:55:23.612198+0000","last_became_active":"2024-01-23T08:54:40.611589+0000","last_became_peered":"2024-01-23T08:54:40.611589+0000","last_unstale":"2024-01-23T08:55:23.612198+0000","last_undegraded":"2024-01-23T08:55:23.612198+0000","last_fullsized":"2024-01-23T08:55:23.612198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:36.177844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.311704+0000","last_change":"2024-01-23T08:54:49.716713+0000","last_active":"2024-01-23T08:54:51.311704+0000","last_peered":"2024-01-23T08:54:51.311704+0000","last_clean":"2024-01-23T08:54:51.311704+0000","last_became_active":"2024-01-23T08:54:49.715843+0000","last_became_peered":"2024-01-23T08:54:49.715843+0000","last_unstale":"2024-01-23T08:54:51.311704+0000","last_undegraded":"2024-01-23T08:54:51.311704+0000","last_fullsized":"2024-01-23T08:54:51.311704+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:46:24.157230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.715500+0000","last_change":"2024-01-23T08:54:42.230199+0000","last_active":"2024-01-23T08:54:49.715500+0000","last_peered":"2024-01-23T08:54:49.715500+0000","last_clean":"2024-01-23T08:54:49.715500+0000","last_became_active":"2024-01-23T08:54:42.229547+0000","last_became_peered":"2024-01-23T08:54:42.229547+0000","last_unstale":"2024-01-23T08:54:49.715500+0000","last_undegraded":"2024-01-23T08:54:49.715500+0000","last_fullsized":"2024-01-23T08:54:49.715500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:07:07.781698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"28'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:26.430901+0000","last_change":"2024-01-23T08:54:40.688971+0000","last_active":"2024-01-23T08:55:26.430901+0000","last_peered":"2024-01-23T08:55:26.430901+0000","last_clean":"2024-01-23T08:55:26.430901+0000","last_became_active":"2024-01-23T08:54:40.688230+0000","last_became_peered":"2024-01-23T08:54:40.688230+0000","last_unstale":"2024-01-23T08:55:26.430901+0000","last_undegraded":"2024-01-23T08:55:26.430901+0000","last_fullsized":"2024-01-23T08:55:26.430901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:40:12.245110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.314784+0000","last_change":"2024-01-23T08:54:49.748471+0000","last_active":"2024-01-23T08:54:51.314784+0000","last_peered":"2024-01-23T08:54:51.314784+0000","last_clean":"2024-01-23T08:54:51.314784+0000","last_became_active":"2024-01-23T08:54:49.747958+0000","last_became_peered":"2024-01-23T08:54:49.747958+0000","last_unstale":"2024-01-23T08:54:51.314784+0000","last_undegraded":"2024-01-23T08:54:51.314784+0000","last_fullsized":"2024-01-23T08:54:51.314784+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:46:36.583078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.709746+0000","last_change":"2024-01-23T08:54:42.194148+0000","last_active":"2024-01-23T08:54:49.709746+0000","last_peered":"2024-01-23T08:54:49.709746+0000","last_clean":"2024-01-23T08:54:49.709746+0000","last_became_active":"2024-01-23T08:54:42.193403+0000","last_became_peered":"2024-01-23T08:54:42.193403+0000","last_unstale":"2024-01-23T08:54:49.709746+0000","last_undegraded":"2024-01-23T08:54:49.709746+0000","last_fullsized":"2024-01-23T08:54:49.709746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:38:42.543776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'7","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:32.924540+0000","last_change":"2024-01-23T08:54:40.688897+0000","last_active":"2024-01-23T08:55:32.924540+0000","last_peered":"2024-01-23T08:55:32.924540+0000","last_clean":"2024-01-23T08:55:32.924540+0000","last_became_active":"2024-01-23T08:54:40.688122+0000","last_became_peered":"2024-01-23T08:54:40.688122+0000","last_unstale":"2024-01-23T08:55:32.924540+0000","last_undegraded":"2024-01-23T08:55:32.924540+0000","last_fullsized":"2024-01-23T08:55:32.924540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:19:16.760424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.834576+0000","last_change":"2024-01-23T08:54:49.738331+0000","last_active":"2024-01-23T08:54:50.834576+0000","last_peered":"2024-01-23T08:54:50.834576+0000","last_clean":"2024-01-23T08:54:50.834576+0000","last_became_active":"2024-01-23T08:54:49.737442+0000","last_became_peered":"2024-01-23T08:54:49.737442+0000","last_unstale":"2024-01-23T08:54:50.834576+0000","last_undegraded":"2024-01-23T08:54:50.834576+0000","last_fullsized":"2024-01-23T08:54:50.834576+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:59:20.106849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.637930+0000","last_change":"2024-01-23T08:54:42.192681+0000","last_active":"2024-01-23T08:54:49.637930+0000","last_peered":"2024-01-23T08:54:49.637930+0000","last_clean":"2024-01-23T08:54:49.637930+0000","last_became_active":"2024-01-23T08:54:42.192225+0000","last_became_peered":"2024-01-23T08:54:42.192225+0000","last_unstale":"2024-01-23T08:54:49.637930+0000","last_undegraded":"2024-01-23T08:54:49.637930+0000","last_fullsized":"2024-01-23T08:54:49.637930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:20:26.263299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"28'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:23.630105+0000","last_change":"2024-01-23T08:54:40.686987+0000","last_active":"2024-01-23T08:55:23.630105+0000","last_peered":"2024-01-23T08:55:23.630105+0000","last_clean":"2024-01-23T08:55:23.630105+0000","last_became_active":"2024-01-23T08:54:40.686654+0000","last_became_peered":"2024-01-23T08:54:40.686654+0000","last_unstale":"2024-01-23T08:55:23.630105+0000","last_undegraded":"2024-01-23T08:55:23.630105+0000","last_fullsized":"2024-01-23T08:55:23.630105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:43:26.442461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.818343+0000","last_change":"2024-01-23T08:54:49.736471+0000","last_active":"2024-01-23T08:54:50.818343+0000","last_peered":"2024-01-23T08:54:50.818343+0000","last_clean":"2024-01-23T08:54:50.818343+0000","last_became_active":"2024-01-23T08:54:49.735971+0000","last_became_peered":"2024-01-23T08:54:49.735971+0000","last_unstale":"2024-01-23T08:54:50.818343+0000","last_undegraded":"2024-01-23T08:54:50.818343+0000","last_fullsized":"2024-01-23T08:54:50.818343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:18:10.354308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.710027+0000","last_change":"2024-01-23T08:54:42.195854+0000","last_active":"2024-01-23T08:54:49.710027+0000","last_peered":"2024-01-23T08:54:49.710027+0000","last_clean":"2024-01-23T08:54:49.710027+0000","last_became_active":"2024-01-23T08:54:42.195052+0000","last_became_peered":"2024-01-23T08:54:42.195052+0000","last_unstale":"2024-01-23T08:54:49.710027+0000","last_undegraded":"2024-01-23T08:54:49.710027+0000","last_fullsized":"2024-01-23T08:54:49.710027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:54:18.859903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'7","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:32.924571+0000","last_change":"2024-01-23T08:54:40.694194+0000","last_active":"2024-01-23T08:55:32.924571+0000","last_peered":"2024-01-23T08:55:32.924571+0000","last_clean":"2024-01-23T08:55:32.924571+0000","last_became_active":"2024-01-23T08:54:40.693610+0000","last_became_peered":"2024-01-23T08:54:40.693610+0000","last_unstale":"2024-01-23T08:55:32.924571+0000","last_undegraded":"2024-01-23T08:55:32.924571+0000","last_fullsized":"2024-01-23T08:55:32.924571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:47:30.746915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.817667+0000","last_change":"2024-01-23T08:54:49.747205+0000","last_active":"2024-01-23T08:54:50.817667+0000","last_peered":"2024-01-23T08:54:50.817667+0000","last_clean":"2024-01-23T08:54:50.817667+0000","last_became_active":"2024-01-23T08:54:49.746792+0000","last_became_peered":"2024-01-23T08:54:49.746792+0000","last_unstale":"2024-01-23T08:54:50.817667+0000","last_undegraded":"2024-01-23T08:54:50.817667+0000","last_fullsized":"2024-01-23T08:54:50.817667+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:58:42.245045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.708442+0000","last_change":"2024-01-23T08:54:42.233783+0000","last_active":"2024-01-23T08:54:49.708442+0000","last_peered":"2024-01-23T08:54:49.708442+0000","last_clean":"2024-01-23T08:54:49.708442+0000","last_became_active":"2024-01-23T08:54:42.233018+0000","last_became_peered":"2024-01-23T08:54:42.233018+0000","last_unstale":"2024-01-23T08:54:49.708442+0000","last_undegraded":"2024-01-23T08:54:49.708442+0000","last_fullsized":"2024-01-23T08:54:49.708442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:04:58.998914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"28'9","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:29.756869+0000","last_change":"2024-01-23T08:54:40.690385+0000","last_active":"2024-01-23T08:55:29.756869+0000","last_peered":"2024-01-23T08:55:29.756869+0000","last_clean":"2024-01-23T08:55:29.756869+0000","last_became_active":"2024-01-23T08:54:40.689528+0000","last_became_peered":"2024-01-23T08:54:40.689528+0000","last_unstale":"2024-01-23T08:55:29.756869+0000","last_undegraded":"2024-01-23T08:55:29.756869+0000","last_fullsized":"2024-01-23T08:55:29.756869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:59:11.006550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.314560+0000","last_change":"2024-01-23T08:54:49.731870+0000","last_active":"2024-01-23T08:54:51.314560+0000","last_peered":"2024-01-23T08:54:51.314560+0000","last_clean":"2024-01-23T08:54:51.314560+0000","last_became_active":"2024-01-23T08:54:49.731414+0000","last_became_peered":"2024-01-23T08:54:49.731414+0000","last_unstale":"2024-01-23T08:54:51.314560+0000","last_undegraded":"2024-01-23T08:54:51.314560+0000","last_fullsized":"2024-01-23T08:54:51.314560+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:30.315625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.679440+0000","last_change":"2024-01-23T08:54:42.227885+0000","last_active":"2024-01-23T08:54:49.679440+0000","last_peered":"2024-01-23T08:54:49.679440+0000","last_clean":"2024-01-23T08:54:49.679440+0000","last_became_active":"2024-01-23T08:54:42.227188+0000","last_became_peered":"2024-01-23T08:54:42.227188+0000","last_unstale":"2024-01-23T08:54:49.679440+0000","last_undegraded":"2024-01-23T08:54:49.679440+0000","last_fullsized":"2024-01-23T08:54:49.679440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:02:13.790208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:29.699700+0000","last_change":"2024-01-23T08:54:40.658365+0000","last_active":"2024-01-23T08:55:29.699700+0000","last_peered":"2024-01-23T08:55:29.699700+0000","last_clean":"2024-01-23T08:55:29.699700+0000","last_became_active":"2024-01-23T08:54:40.657616+0000","last_became_peered":"2024-01-23T08:54:40.657616+0000","last_unstale":"2024-01-23T08:55:29.699700+0000","last_undegraded":"2024-01-23T08:55:29.699700+0000","last_fullsized":"2024-01-23T08:55:29.699700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:23:50.053046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.315400+0000","last_change":"2024-01-23T08:54:49.739474+0000","last_active":"2024-01-23T08:54:51.315400+0000","last_peered":"2024-01-23T08:54:51.315400+0000","last_clean":"2024-01-23T08:54:51.315400+0000","last_became_active":"2024-01-23T08:54:49.738579+0000","last_became_peered":"2024-01-23T08:54:49.738579+0000","last_unstale":"2024-01-23T08:54:51.315400+0000","last_undegraded":"2024-01-23T08:54:51.315400+0000","last_fullsized":"2024-01-23T08:54:51.315400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:23:32.238072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.702527+0000","last_change":"2024-01-23T08:54:42.228302+0000","last_active":"2024-01-23T08:54:49.702527+0000","last_peered":"2024-01-23T08:54:49.702527+0000","last_clean":"2024-01-23T08:54:49.702527+0000","last_became_active":"2024-01-23T08:54:42.227558+0000","last_became_peered":"2024-01-23T08:54:42.227558+0000","last_unstale":"2024-01-23T08:54:49.702527+0000","last_undegraded":"2024-01-23T08:54:49.702527+0000","last_fullsized":"2024-01-23T08:54:49.702527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:19:17.992621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"28'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.315589+0000","last_change":"2024-01-23T08:54:40.697453+0000","last_active":"2024-01-23T08:54:51.315589+0000","last_peered":"2024-01-23T08:54:51.315589+0000","last_clean":"2024-01-23T08:54:51.315589+0000","last_became_active":"2024-01-23T08:54:40.696688+0000","last_became_peered":"2024-01-23T08:54:40.696688+0000","last_unstale":"2024-01-23T08:54:51.315589+0000","last_undegraded":"2024-01-23T08:54:51.315589+0000","last_fullsized":"2024-01-23T08:54:51.315589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:59:22.804479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.314513+0000","last_change":"2024-01-23T08:54:49.726678+0000","last_active":"2024-01-23T08:54:51.314513+0000","last_peered":"2024-01-23T08:54:51.314513+0000","last_clean":"2024-01-23T08:54:51.314513+0000","last_became_active":"2024-01-23T08:54:49.725830+0000","last_became_peered":"2024-01-23T08:54:49.725830+0000","last_unstale":"2024-01-23T08:54:51.314513+0000","last_undegraded":"2024-01-23T08:54:51.314513+0000","last_fullsized":"2024-01-23T08:54:51.314513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:12:34.009779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705119+0000","last_change":"2024-01-23T08:54:42.149751+0000","last_active":"2024-01-23T08:54:49.705119+0000","last_peered":"2024-01-23T08:54:49.705119+0000","last_clean":"2024-01-23T08:54:49.705119+0000","last_became_active":"2024-01-23T08:54:42.149019+0000","last_became_peered":"2024-01-23T08:54:42.149019+0000","last_unstale":"2024-01-23T08:54:49.705119+0000","last_undegraded":"2024-01-23T08:54:49.705119+0000","last_fullsized":"2024-01-23T08:54:49.705119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:38:36.083606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'5","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:32.927419+0000","last_change":"2024-01-23T08:54:40.680243+0000","last_active":"2024-01-23T08:55:32.927419+0000","last_peered":"2024-01-23T08:55:32.927419+0000","last_clean":"2024-01-23T08:55:32.927419+0000","last_became_active":"2024-01-23T08:54:40.679839+0000","last_became_peered":"2024-01-23T08:54:40.679839+0000","last_unstale":"2024-01-23T08:55:32.927419+0000","last_undegraded":"2024-01-23T08:55:32.927419+0000","last_fullsized":"2024-01-23T08:55:32.927419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:38:34.851409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.317036+0000","last_change":"2024-01-23T08:54:49.727785+0000","last_active":"2024-01-23T08:54:51.317036+0000","last_peered":"2024-01-23T08:54:51.317036+0000","last_clean":"2024-01-23T08:54:51.317036+0000","last_became_active":"2024-01-23T08:54:49.726855+0000","last_became_peered":"2024-01-23T08:54:49.726855+0000","last_unstale":"2024-01-23T08:54:51.317036+0000","last_undegraded":"2024-01-23T08:54:51.317036+0000","last_fullsized":"2024-01-23T08:54:51.317036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:13:39.452120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.659533+0000","last_change":"2024-01-23T08:54:42.108793+0000","last_active":"2024-01-23T08:54:49.659533+0000","last_peered":"2024-01-23T08:54:49.659533+0000","last_clean":"2024-01-23T08:54:49.659533+0000","last_became_active":"2024-01-23T08:54:42.108346+0000","last_became_peered":"2024-01-23T08:54:42.108346+0000","last_unstale":"2024-01-23T08:54:49.659533+0000","last_undegraded":"2024-01-23T08:54:49.659533+0000","last_fullsized":"2024-01-23T08:54:49.659533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:18:02.486206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'5","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:26.672476+0000","last_change":"2024-01-23T08:54:40.708494+0000","last_active":"2024-01-23T08:55:26.672476+0000","last_peered":"2024-01-23T08:55:26.672476+0000","last_clean":"2024-01-23T08:55:26.672476+0000","last_became_active":"2024-01-23T08:54:40.707841+0000","last_became_peered":"2024-01-23T08:54:40.707841+0000","last_unstale":"2024-01-23T08:55:26.672476+0000","last_undegraded":"2024-01-23T08:55:26.672476+0000","last_fullsized":"2024-01-23T08:55:26.672476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:53:17.764440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.319565+0000","last_change":"2024-01-23T08:54:49.738198+0000","last_active":"2024-01-23T08:54:51.319565+0000","last_peered":"2024-01-23T08:54:51.319565+0000","last_clean":"2024-01-23T08:54:51.319565+0000","last_became_active":"2024-01-23T08:54:49.737677+0000","last_became_peered":"2024-01-23T08:54:49.737677+0000","last_unstale":"2024-01-23T08:54:51.319565+0000","last_undegraded":"2024-01-23T08:54:51.319565+0000","last_fullsized":"2024-01-23T08:54:51.319565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:57:26.436916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.676533+0000","last_change":"2024-01-23T08:54:42.228222+0000","last_active":"2024-01-23T08:54:49.676533+0000","last_peered":"2024-01-23T08:54:49.676533+0000","last_clean":"2024-01-23T08:54:49.676533+0000","last_became_active":"2024-01-23T08:54:42.227335+0000","last_became_peered":"2024-01-23T08:54:42.227335+0000","last_unstale":"2024-01-23T08:54:49.676533+0000","last_undegraded":"2024-01-23T08:54:49.676533+0000","last_fullsized":"2024-01-23T08:54:49.676533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:29:51.842390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:26.691290+0000","last_change":"2024-01-23T08:54:40.679852+0000","last_active":"2024-01-23T08:55:26.691290+0000","last_peered":"2024-01-23T08:55:26.691290+0000","last_clean":"2024-01-23T08:55:26.691290+0000","last_became_active":"2024-01-23T08:54:40.679467+0000","last_became_peered":"2024-01-23T08:54:40.679467+0000","last_unstale":"2024-01-23T08:55:26.691290+0000","last_undegraded":"2024-01-23T08:55:26.691290+0000","last_fullsized":"2024-01-23T08:55:26.691290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:17.915137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.316103+0000","last_change":"2024-01-23T08:54:49.730538+0000","last_active":"2024-01-23T08:54:51.316103+0000","last_peered":"2024-01-23T08:54:51.316103+0000","last_clean":"2024-01-23T08:54:51.316103+0000","last_became_active":"2024-01-23T08:54:49.729861+0000","last_became_peered":"2024-01-23T08:54:49.729861+0000","last_unstale":"2024-01-23T08:54:51.316103+0000","last_undegraded":"2024-01-23T08:54:51.316103+0000","last_fullsized":"2024-01-23T08:54:51.316103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:46:36.583078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.709127+0000","last_change":"2024-01-23T08:54:42.196505+0000","last_active":"2024-01-23T08:54:49.709127+0000","last_peered":"2024-01-23T08:54:49.709127+0000","last_clean":"2024-01-23T08:54:49.709127+0000","last_became_active":"2024-01-23T08:54:42.195555+0000","last_became_peered":"2024-01-23T08:54:42.195555+0000","last_unstale":"2024-01-23T08:54:49.709127+0000","last_undegraded":"2024-01-23T08:54:49.709127+0000","last_fullsized":"2024-01-23T08:54:49.709127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:57:24.296384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"28'6","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:29.700115+0000","last_change":"2024-01-23T08:54:40.612594+0000","last_active":"2024-01-23T08:55:29.700115+0000","last_peered":"2024-01-23T08:55:29.700115+0000","last_clean":"2024-01-23T08:55:29.700115+0000","last_became_active":"2024-01-23T08:54:40.611932+0000","last_became_peered":"2024-01-23T08:54:40.611932+0000","last_unstale":"2024-01-23T08:55:29.700115+0000","last_undegraded":"2024-01-23T08:55:29.700115+0000","last_fullsized":"2024-01-23T08:55:29.700115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:05.088648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.709873+0000","last_change":"2024-01-23T08:54:01.491195+0000","last_active":"2024-01-23T08:54:49.709873+0000","last_peered":"2024-01-23T08:54:49.709873+0000","last_clean":"2024-01-23T08:54:49.709873+0000","last_became_active":"2024-01-23T08:54:01.490869+0000","last_became_peered":"2024-01-23T08:54:01.490869+0000","last_unstale":"2024-01-23T08:54:49.709873+0000","last_undegraded":"2024-01-23T08:54:49.709873+0000","last_fullsized":"2024-01-23T08:54:49.709873+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:53:59.492955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:53:59.492955+0000","last_clean_scrub_stamp":"2024-01-23T08:53:59.492955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:18:58.446726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.312760+0000","last_change":"2024-01-23T08:54:49.716297+0000","last_active":"2024-01-23T08:54:51.312760+0000","last_peered":"2024-01-23T08:54:51.312760+0000","last_clean":"2024-01-23T08:54:51.312760+0000","last_became_active":"2024-01-23T08:54:49.715231+0000","last_became_peered":"2024-01-23T08:54:49.715231+0000","last_unstale":"2024-01-23T08:54:51.312760+0000","last_undegraded":"2024-01-23T08:54:51.312760+0000","last_fullsized":"2024-01-23T08:54:51.312760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:17:59.837409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.639265+0000","last_change":"2024-01-23T08:54:42.089174+0000","last_active":"2024-01-23T08:54:49.639265+0000","last_peered":"2024-01-23T08:54:49.639265+0000","last_clean":"2024-01-23T08:54:49.639265+0000","last_became_active":"2024-01-23T08:54:42.088303+0000","last_became_peered":"2024-01-23T08:54:42.088303+0000","last_unstale":"2024-01-23T08:54:49.639265+0000","last_undegraded":"2024-01-23T08:54:49.639265+0000","last_fullsized":"2024-01-23T08:54:49.639265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:06:49.326117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"28'5","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:29.763102+0000","last_change":"2024-01-23T08:54:40.690720+0000","last_active":"2024-01-23T08:55:29.763102+0000","last_peered":"2024-01-23T08:55:29.763102+0000","last_clean":"2024-01-23T08:55:29.763102+0000","last_became_active":"2024-01-23T08:54:40.689895+0000","last_became_peered":"2024-01-23T08:54:40.689895+0000","last_unstale":"2024-01-23T08:55:29.763102+0000","last_undegraded":"2024-01-23T08:55:29.763102+0000","last_fullsized":"2024-01-23T08:55:29.763102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:33:12.542607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.817001+0000","last_change":"2024-01-23T08:54:49.736539+0000","last_active":"2024-01-23T08:54:50.817001+0000","last_peered":"2024-01-23T08:54:50.817001+0000","last_clean":"2024-01-23T08:54:50.817001+0000","last_became_active":"2024-01-23T08:54:49.735777+0000","last_became_peered":"2024-01-23T08:54:49.735777+0000","last_unstale":"2024-01-23T08:54:50.817001+0000","last_undegraded":"2024-01-23T08:54:50.817001+0000","last_fullsized":"2024-01-23T08:54:50.817001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:05:06.867017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.709023+0000","last_change":"2024-01-23T08:54:42.107066+0000","last_active":"2024-01-23T08:54:49.709023+0000","last_peered":"2024-01-23T08:54:49.709023+0000","last_clean":"2024-01-23T08:54:49.709023+0000","last_became_active":"2024-01-23T08:54:42.106757+0000","last_became_peered":"2024-01-23T08:54:42.106757+0000","last_unstale":"2024-01-23T08:54:49.709023+0000","last_undegraded":"2024-01-23T08:54:49.709023+0000","last_fullsized":"2024-01-23T08:54:49.709023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:47:31.979111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:29.601880+0000","last_change":"2024-01-23T08:54:40.687942+0000","last_active":"2024-01-23T08:55:29.601880+0000","last_peered":"2024-01-23T08:55:29.601880+0000","last_clean":"2024-01-23T08:55:29.601880+0000","last_became_active":"2024-01-23T08:54:40.686860+0000","last_became_peered":"2024-01-23T08:54:40.686860+0000","last_unstale":"2024-01-23T08:55:29.601880+0000","last_undegraded":"2024-01-23T08:55:29.601880+0000","last_fullsized":"2024-01-23T08:55:29.601880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:04:57.766717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.315714+0000","last_change":"2024-01-23T08:54:49.727416+0000","last_active":"2024-01-23T08:54:51.315714+0000","last_peered":"2024-01-23T08:54:51.315714+0000","last_clean":"2024-01-23T08:54:51.315714+0000","last_became_active":"2024-01-23T08:54:49.721494+0000","last_became_peered":"2024-01-23T08:54:49.721494+0000","last_unstale":"2024-01-23T08:54:51.315714+0000","last_undegraded":"2024-01-23T08:54:51.315714+0000","last_fullsized":"2024-01-23T08:54:51.315714+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:52:20.767279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.706168+0000","last_change":"2024-01-23T08:54:42.117785+0000","last_active":"2024-01-23T08:54:49.706168+0000","last_peered":"2024-01-23T08:54:49.706168+0000","last_clean":"2024-01-23T08:54:49.706168+0000","last_became_active":"2024-01-23T08:54:42.117317+0000","last_became_peered":"2024-01-23T08:54:42.117317+0000","last_unstale":"2024-01-23T08:54:49.706168+0000","last_undegraded":"2024-01-23T08:54:49.706168+0000","last_fullsized":"2024-01-23T08:54:49.706168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:48:28.943781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"28'5","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:32.924737+0000","last_change":"2024-01-23T08:54:40.682656+0000","last_active":"2024-01-23T08:55:32.924737+0000","last_peered":"2024-01-23T08:55:32.924737+0000","last_clean":"2024-01-23T08:55:32.924737+0000","last_became_active":"2024-01-23T08:54:40.681954+0000","last_became_peered":"2024-01-23T08:54:40.681954+0000","last_unstale":"2024-01-23T08:55:32.924737+0000","last_undegraded":"2024-01-23T08:55:32.924737+0000","last_fullsized":"2024-01-23T08:55:32.924737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:20:41.553582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.311198+0000","last_change":"2024-01-23T08:54:49.716316+0000","last_active":"2024-01-23T08:54:51.311198+0000","last_peered":"2024-01-23T08:54:51.311198+0000","last_clean":"2024-01-23T08:54:51.311198+0000","last_became_active":"2024-01-23T08:54:49.715917+0000","last_became_peered":"2024-01-23T08:54:49.715917+0000","last_unstale":"2024-01-23T08:54:51.311198+0000","last_undegraded":"2024-01-23T08:54:51.311198+0000","last_fullsized":"2024-01-23T08:54:51.311198+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:56:01.803823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.708070+0000","last_change":"2024-01-23T08:54:42.158814+0000","last_active":"2024-01-23T08:54:49.708070+0000","last_peered":"2024-01-23T08:54:49.708070+0000","last_clean":"2024-01-23T08:54:49.708070+0000","last_became_active":"2024-01-23T08:54:42.155411+0000","last_became_peered":"2024-01-23T08:54:42.155411+0000","last_unstale":"2024-01-23T08:54:49.708070+0000","last_undegraded":"2024-01-23T08:54:49.708070+0000","last_fullsized":"2024-01-23T08:54:49.708070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:28:02.074838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"28'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.315271+0000","last_change":"2024-01-23T08:54:40.696522+0000","last_active":"2024-01-23T08:54:51.315271+0000","last_peered":"2024-01-23T08:54:51.315271+0000","last_clean":"2024-01-23T08:54:51.315271+0000","last_became_active":"2024-01-23T08:54:40.696128+0000","last_became_peered":"2024-01-23T08:54:40.696128+0000","last_unstale":"2024-01-23T08:54:51.315271+0000","last_undegraded":"2024-01-23T08:54:51.315271+0000","last_fullsized":"2024-01-23T08:54:51.315271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:18:01.254009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.850403+0000","last_change":"2024-01-23T08:54:49.724660+0000","last_active":"2024-01-23T08:54:50.850403+0000","last_peered":"2024-01-23T08:54:50.850403+0000","last_clean":"2024-01-23T08:54:50.850403+0000","last_became_active":"2024-01-23T08:54:49.723038+0000","last_became_peered":"2024-01-23T08:54:49.723038+0000","last_unstale":"2024-01-23T08:54:50.850403+0000","last_undegraded":"2024-01-23T08:54:50.850403+0000","last_fullsized":"2024-01-23T08:54:50.850403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:20:50.653881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.637799+0000","last_change":"2024-01-23T08:54:42.149978+0000","last_active":"2024-01-23T08:54:49.637799+0000","last_peered":"2024-01-23T08:54:49.637799+0000","last_clean":"2024-01-23T08:54:49.637799+0000","last_became_active":"2024-01-23T08:54:42.149180+0000","last_became_peered":"2024-01-23T08:54:42.149180+0000","last_unstale":"2024-01-23T08:54:49.637799+0000","last_undegraded":"2024-01-23T08:54:49.637799+0000","last_fullsized":"2024-01-23T08:54:49.637799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:52:12.899176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"28'17","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:29.754272+0000","last_change":"2024-01-23T08:54:40.699997+0000","last_active":"2024-01-23T08:55:29.754272+0000","last_peered":"2024-01-23T08:55:29.754272+0000","last_clean":"2024-01-23T08:55:29.754272+0000","last_became_active":"2024-01-23T08:54:40.699246+0000","last_became_peered":"2024-01-23T08:54:40.699246+0000","last_unstale":"2024-01-23T08:55:29.754272+0000","last_undegraded":"2024-01-23T08:55:29.754272+0000","last_fullsized":"2024-01-23T08:55:29.754272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:19:24.486048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.317431+0000","last_change":"2024-01-23T08:54:49.729218+0000","last_active":"2024-01-23T08:54:51.317431+0000","last_peered":"2024-01-23T08:54:51.317431+0000","last_clean":"2024-01-23T08:54:51.317431+0000","last_became_active":"2024-01-23T08:54:49.728448+0000","last_became_peered":"2024-01-23T08:54:49.728448+0000","last_unstale":"2024-01-23T08:54:51.317431+0000","last_undegraded":"2024-01-23T08:54:51.317431+0000","last_fullsized":"2024-01-23T08:54:51.317431+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:56:52.671943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.709676+0000","last_change":"2024-01-23T08:54:42.087980+0000","last_active":"2024-01-23T08:54:49.709676+0000","last_peered":"2024-01-23T08:54:49.709676+0000","last_clean":"2024-01-23T08:54:49.709676+0000","last_became_active":"2024-01-23T08:54:42.087328+0000","last_became_peered":"2024-01-23T08:54:42.087328+0000","last_unstale":"2024-01-23T08:54:49.709676+0000","last_undegraded":"2024-01-23T08:54:49.709676+0000","last_fullsized":"2024-01-23T08:54:49.709676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:07:07.781698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"28'5","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:29.596819+0000","last_change":"2024-01-23T08:54:40.693906+0000","last_active":"2024-01-23T08:55:29.596819+0000","last_peered":"2024-01-23T08:55:29.596819+0000","last_clean":"2024-01-23T08:55:29.596819+0000","last_became_active":"2024-01-23T08:54:40.693530+0000","last_became_peered":"2024-01-23T08:54:40.693530+0000","last_unstale":"2024-01-23T08:55:29.596819+0000","last_undegraded":"2024-01-23T08:55:29.596819+0000","last_fullsized":"2024-01-23T08:55:29.596819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:59:11.006550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.317201+0000","last_change":"2024-01-23T08:54:49.730687+0000","last_active":"2024-01-23T08:54:51.317201+0000","last_peered":"2024-01-23T08:54:51.317201+0000","last_clean":"2024-01-23T08:54:51.317201+0000","last_became_active":"2024-01-23T08:54:49.729689+0000","last_became_peered":"2024-01-23T08:54:49.729689+0000","last_unstale":"2024-01-23T08:54:51.317201+0000","last_undegraded":"2024-01-23T08:54:51.317201+0000","last_fullsized":"2024-01-23T08:54:51.317201+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:54:47.041161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.638496+0000","last_change":"2024-01-23T08:54:42.108919+0000","last_active":"2024-01-23T08:54:49.638496+0000","last_peered":"2024-01-23T08:54:49.638496+0000","last_clean":"2024-01-23T08:54:49.638496+0000","last_became_active":"2024-01-23T08:54:42.108253+0000","last_became_peered":"2024-01-23T08:54:42.108253+0000","last_unstale":"2024-01-23T08:54:49.638496+0000","last_undegraded":"2024-01-23T08:54:49.638496+0000","last_fullsized":"2024-01-23T08:54:49.638496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:46:28.714976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'5","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:29.702672+0000","last_change":"2024-01-23T08:54:40.696080+0000","last_active":"2024-01-23T08:55:29.702672+0000","last_peered":"2024-01-23T08:55:29.702672+0000","last_clean":"2024-01-23T08:55:29.702672+0000","last_became_active":"2024-01-23T08:54:40.695699+0000","last_became_peered":"2024-01-23T08:54:40.695699+0000","last_unstale":"2024-01-23T08:55:29.702672+0000","last_undegraded":"2024-01-23T08:55:29.702672+0000","last_fullsized":"2024-01-23T08:55:29.702672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:21.215326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.316997+0000","last_change":"2024-01-23T08:54:49.740480+0000","last_active":"2024-01-23T08:54:51.316997+0000","last_peered":"2024-01-23T08:54:51.316997+0000","last_clean":"2024-01-23T08:54:51.316997+0000","last_became_active":"2024-01-23T08:54:49.739524+0000","last_became_peered":"2024-01-23T08:54:49.739524+0000","last_unstale":"2024-01-23T08:54:51.316997+0000","last_undegraded":"2024-01-23T08:54:51.316997+0000","last_fullsized":"2024-01-23T08:54:51.316997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:45:25.447987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.677949+0000","last_change":"2024-01-23T08:54:42.230659+0000","last_active":"2024-01-23T08:54:49.677949+0000","last_peered":"2024-01-23T08:54:49.677949+0000","last_clean":"2024-01-23T08:54:49.677949+0000","last_became_active":"2024-01-23T08:54:42.229952+0000","last_became_peered":"2024-01-23T08:54:42.229952+0000","last_unstale":"2024-01-23T08:54:49.677949+0000","last_undegraded":"2024-01-23T08:54:49.677949+0000","last_fullsized":"2024-01-23T08:54:49.677949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:41:53.265527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'9","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:32.854707+0000","last_change":"2024-01-23T08:54:40.698779+0000","last_active":"2024-01-23T08:55:32.854707+0000","last_peered":"2024-01-23T08:55:32.854707+0000","last_clean":"2024-01-23T08:55:32.854707+0000","last_became_active":"2024-01-23T08:54:40.698059+0000","last_became_peered":"2024-01-23T08:54:40.698059+0000","last_unstale":"2024-01-23T08:55:32.854707+0000","last_undegraded":"2024-01-23T08:55:32.854707+0000","last_fullsized":"2024-01-23T08:55:32.854707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:24:40.655839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.313021+0000","last_change":"2024-01-23T08:54:49.708388+0000","last_active":"2024-01-23T08:54:51.313021+0000","last_peered":"2024-01-23T08:54:51.313021+0000","last_clean":"2024-01-23T08:54:51.313021+0000","last_became_active":"2024-01-23T08:54:49.707837+0000","last_became_peered":"2024-01-23T08:54:49.707837+0000","last_unstale":"2024-01-23T08:54:51.313021+0000","last_undegraded":"2024-01-23T08:54:51.313021+0000","last_fullsized":"2024-01-23T08:54:51.313021+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:49:25.509880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705781+0000","last_change":"2024-01-23T08:54:42.229836+0000","last_active":"2024-01-23T08:54:49.705781+0000","last_peered":"2024-01-23T08:54:49.705781+0000","last_clean":"2024-01-23T08:54:49.705781+0000","last_became_active":"2024-01-23T08:54:42.229252+0000","last_became_peered":"2024-01-23T08:54:42.229252+0000","last_unstale":"2024-01-23T08:54:49.705781+0000","last_undegraded":"2024-01-23T08:54:49.705781+0000","last_fullsized":"2024-01-23T08:54:49.705781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:23:51.285243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"28'15","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:32.842615+0000","last_change":"2024-01-23T08:54:40.658490+0000","last_active":"2024-01-23T08:55:32.842615+0000","last_peered":"2024-01-23T08:55:32.842615+0000","last_clean":"2024-01-23T08:55:32.842615+0000","last_became_active":"2024-01-23T08:54:40.657711+0000","last_became_peered":"2024-01-23T08:54:40.657711+0000","last_unstale":"2024-01-23T08:55:32.842615+0000","last_undegraded":"2024-01-23T08:55:32.842615+0000","last_fullsized":"2024-01-23T08:55:32.842615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:37:29.479181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.313979+0000","last_change":"2024-01-23T08:54:49.737210+0000","last_active":"2024-01-23T08:54:51.313979+0000","last_peered":"2024-01-23T08:54:51.313979+0000","last_clean":"2024-01-23T08:54:51.313979+0000","last_became_active":"2024-01-23T08:54:49.735023+0000","last_became_peered":"2024-01-23T08:54:49.735023+0000","last_unstale":"2024-01-23T08:54:51.313979+0000","last_undegraded":"2024-01-23T08:54:51.313979+0000","last_fullsized":"2024-01-23T08:54:51.313979+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:27.015436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.638868+0000","last_change":"2024-01-23T08:54:42.154453+0000","last_active":"2024-01-23T08:54:49.638868+0000","last_peered":"2024-01-23T08:54:49.638868+0000","last_clean":"2024-01-23T08:54:49.638868+0000","last_became_active":"2024-01-23T08:54:42.153735+0000","last_became_peered":"2024-01-23T08:54:42.153735+0000","last_unstale":"2024-01-23T08:54:49.638868+0000","last_undegraded":"2024-01-23T08:54:49.638868+0000","last_fullsized":"2024-01-23T08:54:49.638868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:54:39.173058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"28'5","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:23.535982+0000","last_change":"2024-01-23T08:54:40.702888+0000","last_active":"2024-01-23T08:55:23.535982+0000","last_peered":"2024-01-23T08:55:23.535982+0000","last_clean":"2024-01-23T08:55:23.535982+0000","last_became_active":"2024-01-23T08:54:40.701827+0000","last_became_peered":"2024-01-23T08:54:40.701827+0000","last_unstale":"2024-01-23T08:55:23.535982+0000","last_undegraded":"2024-01-23T08:55:23.535982+0000","last_fullsized":"2024-01-23T08:55:23.535982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:18:17.748052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.817591+0000","last_change":"2024-01-23T08:54:49.736262+0000","last_active":"2024-01-23T08:54:50.817591+0000","last_peered":"2024-01-23T08:54:50.817591+0000","last_clean":"2024-01-23T08:54:50.817591+0000","last_became_active":"2024-01-23T08:54:49.735765+0000","last_became_peered":"2024-01-23T08:54:49.735765+0000","last_unstale":"2024-01-23T08:54:50.817591+0000","last_undegraded":"2024-01-23T08:54:50.817591+0000","last_fullsized":"2024-01-23T08:54:50.817591+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:29:59.191326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.660727+0000","last_change":"2024-01-23T08:54:42.071292+0000","last_active":"2024-01-23T08:54:49.660727+0000","last_peered":"2024-01-23T08:54:49.660727+0000","last_clean":"2024-01-23T08:54:49.660727+0000","last_became_active":"2024-01-23T08:54:42.070703+0000","last_became_peered":"2024-01-23T08:54:42.070703+0000","last_unstale":"2024-01-23T08:54:49.660727+0000","last_undegraded":"2024-01-23T08:54:49.660727+0000","last_fullsized":"2024-01-23T08:54:49.660727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:37.410041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:32.972921+0000","last_change":"2024-01-23T08:54:40.687946+0000","last_active":"2024-01-23T08:55:32.972921+0000","last_peered":"2024-01-23T08:55:32.972921+0000","last_clean":"2024-01-23T08:55:32.972921+0000","last_became_active":"2024-01-23T08:54:40.687656+0000","last_became_peered":"2024-01-23T08:54:40.687656+0000","last_unstale":"2024-01-23T08:55:32.972921+0000","last_undegraded":"2024-01-23T08:55:32.972921+0000","last_fullsized":"2024-01-23T08:55:32.972921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:29:50.091026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.833039+0000","last_change":"2024-01-23T08:54:49.729434+0000","last_active":"2024-01-23T08:54:50.833039+0000","last_peered":"2024-01-23T08:54:50.833039+0000","last_clean":"2024-01-23T08:54:50.833039+0000","last_became_active":"2024-01-23T08:54:49.728191+0000","last_became_peered":"2024-01-23T08:54:49.728191+0000","last_unstale":"2024-01-23T08:54:50.833039+0000","last_undegraded":"2024-01-23T08:54:50.833039+0000","last_fullsized":"2024-01-23T08:54:50.833039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:30:27.390400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.707973+0000","last_change":"2024-01-23T08:54:42.155857+0000","last_active":"2024-01-23T08:54:49.707973+0000","last_peered":"2024-01-23T08:54:49.707973+0000","last_clean":"2024-01-23T08:54:49.707973+0000","last_became_active":"2024-01-23T08:54:42.153539+0000","last_became_peered":"2024-01-23T08:54:42.153539+0000","last_unstale":"2024-01-23T08:54:49.707973+0000","last_undegraded":"2024-01-23T08:54:49.707973+0000","last_fullsized":"2024-01-23T08:54:49.707973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:27:34.618270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:23.616930+0000","last_change":"2024-01-23T08:54:40.683174+0000","last_active":"2024-01-23T08:55:23.616930+0000","last_peered":"2024-01-23T08:55:23.616930+0000","last_clean":"2024-01-23T08:55:23.616930+0000","last_became_active":"2024-01-23T08:54:40.682765+0000","last_became_peered":"2024-01-23T08:54:40.682765+0000","last_unstale":"2024-01-23T08:55:23.616930+0000","last_undegraded":"2024-01-23T08:55:23.616930+0000","last_fullsized":"2024-01-23T08:55:23.616930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:13:10.191082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.313951+0000","last_change":"2024-01-23T08:54:49.728962+0000","last_active":"2024-01-23T08:54:51.313951+0000","last_peered":"2024-01-23T08:54:51.313951+0000","last_clean":"2024-01-23T08:54:51.313951+0000","last_became_active":"2024-01-23T08:54:49.724121+0000","last_became_peered":"2024-01-23T08:54:49.724121+0000","last_unstale":"2024-01-23T08:54:51.313951+0000","last_undegraded":"2024-01-23T08:54:51.313951+0000","last_fullsized":"2024-01-23T08:54:51.313951+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:14.188947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.315305+0000","last_change":"2024-01-23T08:54:49.735678+0000","last_active":"2024-01-23T08:54:51.315305+0000","last_peered":"2024-01-23T08:54:51.315305+0000","last_clean":"2024-01-23T08:54:51.315305+0000","last_became_active":"2024-01-23T08:54:49.732632+0000","last_became_peered":"2024-01-23T08:54:49.732632+0000","last_unstale":"2024-01-23T08:54:51.315305+0000","last_undegraded":"2024-01-23T08:54:51.315305+0000","last_fullsized":"2024-01-23T08:54:51.315305+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:54.463072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.707967+0000","last_change":"2024-01-23T08:54:42.196434+0000","last_active":"2024-01-23T08:54:49.707967+0000","last_peered":"2024-01-23T08:54:49.707967+0000","last_clean":"2024-01-23T08:54:49.707967+0000","last_became_active":"2024-01-23T08:54:42.195570+0000","last_became_peered":"2024-01-23T08:54:42.195570+0000","last_unstale":"2024-01-23T08:54:49.707967+0000","last_undegraded":"2024-01-23T08:54:49.707967+0000","last_fullsized":"2024-01-23T08:54:49.707967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:04:44.856358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"28'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:29.702675+0000","last_change":"2024-01-23T08:54:40.678920+0000","last_active":"2024-01-23T08:55:29.702675+0000","last_peered":"2024-01-23T08:55:29.702675+0000","last_clean":"2024-01-23T08:55:29.702675+0000","last_became_active":"2024-01-23T08:54:40.678527+0000","last_became_peered":"2024-01-23T08:54:40.678527+0000","last_unstale":"2024-01-23T08:55:29.702675+0000","last_undegraded":"2024-01-23T08:55:29.702675+0000","last_fullsized":"2024-01-23T08:55:29.702675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:48:02.807942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.313485+0000","last_change":"2024-01-23T08:54:49.719401+0000","last_active":"2024-01-23T08:54:51.313485+0000","last_peered":"2024-01-23T08:54:51.313485+0000","last_clean":"2024-01-23T08:54:51.313485+0000","last_became_active":"2024-01-23T08:54:49.717116+0000","last_became_peered":"2024-01-23T08:54:49.717116+0000","last_unstale":"2024-01-23T08:54:51.313485+0000","last_undegraded":"2024-01-23T08:54:51.313485+0000","last_fullsized":"2024-01-23T08:54:51.313485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:58:50.143993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.659808+0000","last_change":"2024-01-23T08:54:42.235843+0000","last_active":"2024-01-23T08:54:49.659808+0000","last_peered":"2024-01-23T08:54:49.659808+0000","last_clean":"2024-01-23T08:54:49.659808+0000","last_became_active":"2024-01-23T08:54:42.235116+0000","last_became_peered":"2024-01-23T08:54:42.235116+0000","last_unstale":"2024-01-23T08:54:49.659808+0000","last_undegraded":"2024-01-23T08:54:49.659808+0000","last_fullsized":"2024-01-23T08:54:49.659808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:43:27.674658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"28'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:26.578851+0000","last_change":"2024-01-23T08:54:40.690150+0000","last_active":"2024-01-23T08:55:26.578851+0000","last_peered":"2024-01-23T08:55:26.578851+0000","last_clean":"2024-01-23T08:55:26.578851+0000","last_became_active":"2024-01-23T08:54:40.689433+0000","last_became_peered":"2024-01-23T08:54:40.689433+0000","last_unstale":"2024-01-23T08:55:26.578851+0000","last_undegraded":"2024-01-23T08:55:26.578851+0000","last_fullsized":"2024-01-23T08:55:26.578851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:35:11.315349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'7","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:29.701675+0000","last_change":"2024-01-23T08:54:40.686731+0000","last_active":"2024-01-23T08:55:29.701675+0000","last_peered":"2024-01-23T08:55:29.701675+0000","last_clean":"2024-01-23T08:55:29.701675+0000","last_became_active":"2024-01-23T08:54:40.686371+0000","last_became_peered":"2024-01-23T08:54:40.686371+0000","last_unstale":"2024-01-23T08:55:29.701675+0000","last_undegraded":"2024-01-23T08:55:29.701675+0000","last_fullsized":"2024-01-23T08:55:29.701675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:45.362773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.707184+0000","last_change":"2024-01-23T08:54:42.200428+0000","last_active":"2024-01-23T08:54:49.707184+0000","last_peered":"2024-01-23T08:54:49.707184+0000","last_clean":"2024-01-23T08:54:49.707184+0000","last_became_active":"2024-01-23T08:54:42.198648+0000","last_became_peered":"2024-01-23T08:54:42.198648+0000","last_unstale":"2024-01-23T08:54:49.707184+0000","last_undegraded":"2024-01-23T08:54:49.707184+0000","last_fullsized":"2024-01-23T08:54:49.707184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:45:11.802421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:51.314977+0000","last_change":"2024-01-23T08:54:49.742269+0000","last_active":"2024-01-23T08:54:51.314977+0000","last_peered":"2024-01-23T08:54:51.314977+0000","last_clean":"2024-01-23T08:54:51.314977+0000","last_became_active":"2024-01-23T08:54:49.741692+0000","last_became_peered":"2024-01-23T08:54:49.741692+0000","last_unstale":"2024-01-23T08:54:51.314977+0000","last_undegraded":"2024-01-23T08:54:51.314977+0000","last_fullsized":"2024-01-23T08:54:51.314977+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:45.278144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'5","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:55:23.630537+0000","last_change":"2024-01-23T08:54:40.687352+0000","last_active":"2024-01-23T08:55:23.630537+0000","last_peered":"2024-01-23T08:55:23.630537+0000","last_clean":"2024-01-23T08:55:23.630537+0000","last_became_active":"2024-01-23T08:54:40.686125+0000","last_became_peered":"2024-01-23T08:54:40.686125+0000","last_unstale":"2024-01-23T08:55:23.630537+0000","last_undegraded":"2024-01-23T08:55:23.630537+0000","last_fullsized":"2024-01-23T08:55:23.630537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:38:41.311580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.710758+0000","last_change":"2024-01-23T08:54:42.090249+0000","last_active":"2024-01-23T08:54:49.710758+0000","last_peered":"2024-01-23T08:54:49.710758+0000","last_clean":"2024-01-23T08:54:49.710758+0000","last_became_active":"2024-01-23T08:54:42.089826+0000","last_became_peered":"2024-01-23T08:54:42.089826+0000","last_unstale":"2024-01-23T08:54:49.710758+0000","last_undegraded":"2024-01-23T08:54:49.710758+0000","last_fullsized":"2024-01-23T08:54:49.710758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:07:39.007667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-23T08:54:50.834012+0000","last_change":"2024-01-23T08:54:49.737089+0000","last_active":"2024-01-23T08:54:50.834012+0000","last_peered":"2024-01-23T08:54:50.834012+0000","last_clean":"2024-01-23T08:54:50.834012+0000","last_became_active":"2024-01-23T08:54:49.736197+0000","last_became_peered":"2024-01-23T08:54:49.736197+0000","last_unstale":"2024-01-23T08:54:50.834012+0000","last_undegraded":"2024-01-23T08:54:50.834012+0000","last_fullsized":"2024-01-23T08:54:50.834012+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:27:36.690726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.703007+0000","last_change":"2024-01-23T08:54:42.228128+0000","last_active":"2024-01-23T08:54:49.703007+0000","last_peered":"2024-01-23T08:54:49.703007+0000","last_clean":"2024-01-23T08:54:49.703007+0000","last_became_active":"2024-01-23T08:54:42.227421+0000","last_became_peered":"2024-01-23T08:54:42.227421+0000","last_unstale":"2024-01-23T08:54:49.703007+0000","last_undegraded":"2024-01-23T08:54:49.703007+0000","last_fullsized":"2024-01-23T08:54:49.703007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:47:09.171802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.713503+0000","last_change":"2024-01-23T08:54:42.112162+0000","last_active":"2024-01-23T08:54:49.713503+0000","last_peered":"2024-01-23T08:54:49.713503+0000","last_clean":"2024-01-23T08:54:49.713503+0000","last_became_active":"2024-01-23T08:54:42.111635+0000","last_became_peered":"2024-01-23T08:54:42.111635+0000","last_unstale":"2024-01-23T08:54:49.713503+0000","last_undegraded":"2024-01-23T08:54:49.713503+0000","last_fullsized":"2024-01-23T08:54:49.713503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:13:11.423278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.637930+0000","last_change":"2024-01-23T08:54:42.069982+0000","last_active":"2024-01-23T08:54:49.637930+0000","last_peered":"2024-01-23T08:54:49.637930+0000","last_clean":"2024-01-23T08:54:49.637930+0000","last_became_active":"2024-01-23T08:54:42.069262+0000","last_became_peered":"2024-01-23T08:54:42.069262+0000","last_unstale":"2024-01-23T08:54:49.637930+0000","last_undegraded":"2024-01-23T08:54:49.637930+0000","last_fullsized":"2024-01-23T08:54:49.637930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:56:44.803841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.660259+0000","last_change":"2024-01-23T08:54:42.108709+0000","last_active":"2024-01-23T08:54:49.660259+0000","last_peered":"2024-01-23T08:54:49.660259+0000","last_clean":"2024-01-23T08:54:49.660259+0000","last_became_active":"2024-01-23T08:54:42.107985+0000","last_became_peered":"2024-01-23T08:54:42.107985+0000","last_unstale":"2024-01-23T08:54:49.660259+0000","last_undegraded":"2024-01-23T08:54:49.660259+0000","last_fullsized":"2024-01-23T08:54:49.660259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:27:28.770059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.679217+0000","last_change":"2024-01-23T08:54:42.229100+0000","last_active":"2024-01-23T08:54:49.679217+0000","last_peered":"2024-01-23T08:54:49.679217+0000","last_clean":"2024-01-23T08:54:49.679217+0000","last_became_active":"2024-01-23T08:54:42.227918+0000","last_became_peered":"2024-01-23T08:54:42.227918+0000","last_unstale":"2024-01-23T08:54:49.679217+0000","last_undegraded":"2024-01-23T08:54:49.679217+0000","last_fullsized":"2024-01-23T08:54:49.679217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:54:47.705445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.677129+0000","last_change":"2024-01-23T08:54:42.231357+0000","last_active":"2024-01-23T08:54:49.677129+0000","last_peered":"2024-01-23T08:54:49.677129+0000","last_clean":"2024-01-23T08:54:49.677129+0000","last_became_active":"2024-01-23T08:54:42.230615+0000","last_became_peered":"2024-01-23T08:54:42.230615+0000","last_unstale":"2024-01-23T08:54:49.677129+0000","last_undegraded":"2024-01-23T08:54:49.677129+0000","last_fullsized":"2024-01-23T08:54:49.677129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:12:12.757498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.707876+0000","last_change":"2024-01-23T08:54:42.158739+0000","last_active":"2024-01-23T08:54:49.707876+0000","last_peered":"2024-01-23T08:54:49.707876+0000","last_clean":"2024-01-23T08:54:49.707876+0000","last_became_active":"2024-01-23T08:54:42.157106+0000","last_became_peered":"2024-01-23T08:54:42.157106+0000","last_unstale":"2024-01-23T08:54:49.707876+0000","last_undegraded":"2024-01-23T08:54:49.707876+0000","last_fullsized":"2024-01-23T08:54:49.707876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:32:37.961458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.660441+0000","last_change":"2024-01-23T08:54:42.092942+0000","last_active":"2024-01-23T08:54:49.660441+0000","last_peered":"2024-01-23T08:54:49.660441+0000","last_clean":"2024-01-23T08:54:49.660441+0000","last_became_active":"2024-01-23T08:54:42.092149+0000","last_became_peered":"2024-01-23T08:54:42.092149+0000","last_unstale":"2024-01-23T08:54:49.660441+0000","last_undegraded":"2024-01-23T08:54:49.660441+0000","last_fullsized":"2024-01-23T08:54:49.660441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:19.147334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.637829+0000","last_change":"2024-01-23T08:54:42.069948+0000","last_active":"2024-01-23T08:54:49.637829+0000","last_peered":"2024-01-23T08:54:49.637829+0000","last_clean":"2024-01-23T08:54:49.637829+0000","last_became_active":"2024-01-23T08:54:42.069305+0000","last_became_peered":"2024-01-23T08:54:42.069305+0000","last_unstale":"2024-01-23T08:54:49.637829+0000","last_undegraded":"2024-01-23T08:54:49.637829+0000","last_fullsized":"2024-01-23T08:54:49.637829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:21:50.684517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.659901+0000","last_change":"2024-01-23T08:54:42.158120+0000","last_active":"2024-01-23T08:54:49.659901+0000","last_peered":"2024-01-23T08:54:49.659901+0000","last_clean":"2024-01-23T08:54:49.659901+0000","last_became_active":"2024-01-23T08:54:42.157647+0000","last_became_peered":"2024-01-23T08:54:42.157647+0000","last_unstale":"2024-01-23T08:54:49.659901+0000","last_undegraded":"2024-01-23T08:54:49.659901+0000","last_fullsized":"2024-01-23T08:54:49.659901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:28:50.107504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.710525+0000","last_change":"2024-01-23T08:54:42.119253+0000","last_active":"2024-01-23T08:54:49.710525+0000","last_peered":"2024-01-23T08:54:49.710525+0000","last_clean":"2024-01-23T08:54:49.710525+0000","last_became_active":"2024-01-23T08:54:42.118528+0000","last_became_peered":"2024-01-23T08:54:42.118528+0000","last_unstale":"2024-01-23T08:54:49.710525+0000","last_undegraded":"2024-01-23T08:54:49.710525+0000","last_fullsized":"2024-01-23T08:54:49.710525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:47:09.171802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.706925+0000","last_change":"2024-01-23T08:54:42.197561+0000","last_active":"2024-01-23T08:54:49.706925+0000","last_peered":"2024-01-23T08:54:49.706925+0000","last_clean":"2024-01-23T08:54:49.706925+0000","last_became_active":"2024-01-23T08:54:42.196809+0000","last_became_peered":"2024-01-23T08:54:42.196809+0000","last_unstale":"2024-01-23T08:54:49.706925+0000","last_undegraded":"2024-01-23T08:54:49.706925+0000","last_fullsized":"2024-01-23T08:54:49.706925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:16:34.046447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.708919+0000","last_change":"2024-01-23T08:54:42.112093+0000","last_active":"2024-01-23T08:54:49.708919+0000","last_peered":"2024-01-23T08:54:49.708919+0000","last_clean":"2024-01-23T08:54:49.708919+0000","last_became_active":"2024-01-23T08:54:42.111207+0000","last_became_peered":"2024-01-23T08:54:42.111207+0000","last_unstale":"2024-01-23T08:54:49.708919+0000","last_undegraded":"2024-01-23T08:54:49.708919+0000","last_fullsized":"2024-01-23T08:54:49.708919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:37.410041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.639633+0000","last_change":"2024-01-23T08:54:42.195803+0000","last_active":"2024-01-23T08:54:49.639633+0000","last_peered":"2024-01-23T08:54:49.639633+0000","last_clean":"2024-01-23T08:54:49.639633+0000","last_became_active":"2024-01-23T08:54:42.194562+0000","last_became_peered":"2024-01-23T08:54:42.194562+0000","last_unstale":"2024-01-23T08:54:49.639633+0000","last_undegraded":"2024-01-23T08:54:49.639633+0000","last_fullsized":"2024-01-23T08:54:49.639633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:53:56.379892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.716004+0000","last_change":"2024-01-23T08:54:42.161219+0000","last_active":"2024-01-23T08:54:49.716004+0000","last_peered":"2024-01-23T08:54:49.716004+0000","last_clean":"2024-01-23T08:54:49.716004+0000","last_became_active":"2024-01-23T08:54:42.160570+0000","last_became_peered":"2024-01-23T08:54:42.160570+0000","last_unstale":"2024-01-23T08:54:49.716004+0000","last_undegraded":"2024-01-23T08:54:49.716004+0000","last_fullsized":"2024-01-23T08:54:49.716004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:47:09.171802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.640590+0000","last_change":"2024-01-23T08:54:42.115468+0000","last_active":"2024-01-23T08:54:49.640590+0000","last_peered":"2024-01-23T08:54:49.640590+0000","last_clean":"2024-01-23T08:54:49.640590+0000","last_became_active":"2024-01-23T08:54:42.114759+0000","last_became_peered":"2024-01-23T08:54:42.114759+0000","last_unstale":"2024-01-23T08:54:49.640590+0000","last_undegraded":"2024-01-23T08:54:49.640590+0000","last_fullsized":"2024-01-23T08:54:49.640590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:00:35.095097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.637665+0000","last_change":"2024-01-23T08:54:42.150054+0000","last_active":"2024-01-23T08:54:49.637665+0000","last_peered":"2024-01-23T08:54:49.637665+0000","last_clean":"2024-01-23T08:54:49.637665+0000","last_became_active":"2024-01-23T08:54:42.149278+0000","last_became_peered":"2024-01-23T08:54:42.149278+0000","last_unstale":"2024-01-23T08:54:49.637665+0000","last_undegraded":"2024-01-23T08:54:49.637665+0000","last_fullsized":"2024-01-23T08:54:49.637665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:16:33.710981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.659573+0000","last_change":"2024-01-23T08:54:42.110442+0000","last_active":"2024-01-23T08:54:49.659573+0000","last_peered":"2024-01-23T08:54:49.659573+0000","last_clean":"2024-01-23T08:54:49.659573+0000","last_became_active":"2024-01-23T08:54:42.109743+0000","last_became_peered":"2024-01-23T08:54:42.109743+0000","last_unstale":"2024-01-23T08:54:49.659573+0000","last_undegraded":"2024-01-23T08:54:49.659573+0000","last_fullsized":"2024-01-23T08:54:49.659573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:58:34.376942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.677729+0000","last_change":"2024-01-23T08:54:42.228264+0000","last_active":"2024-01-23T08:54:49.677729+0000","last_peered":"2024-01-23T08:54:49.677729+0000","last_clean":"2024-01-23T08:54:49.677729+0000","last_became_active":"2024-01-23T08:54:42.227537+0000","last_became_peered":"2024-01-23T08:54:42.227537+0000","last_unstale":"2024-01-23T08:54:49.677729+0000","last_undegraded":"2024-01-23T08:54:49.677729+0000","last_fullsized":"2024-01-23T08:54:49.677729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:54:25.960679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.677826+0000","last_change":"2024-01-23T08:54:42.225968+0000","last_active":"2024-01-23T08:54:49.677826+0000","last_peered":"2024-01-23T08:54:49.677826+0000","last_clean":"2024-01-23T08:54:49.677826+0000","last_became_active":"2024-01-23T08:54:42.224541+0000","last_became_peered":"2024-01-23T08:54:42.224541+0000","last_unstale":"2024-01-23T08:54:49.677826+0000","last_undegraded":"2024-01-23T08:54:49.677826+0000","last_fullsized":"2024-01-23T08:54:49.677826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:04:03.310087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.708825+0000","last_change":"2024-01-23T08:54:42.111363+0000","last_active":"2024-01-23T08:54:49.708825+0000","last_peered":"2024-01-23T08:54:49.708825+0000","last_clean":"2024-01-23T08:54:49.708825+0000","last_became_active":"2024-01-23T08:54:42.111043+0000","last_became_peered":"2024-01-23T08:54:42.111043+0000","last_unstale":"2024-01-23T08:54:49.708825+0000","last_undegraded":"2024-01-23T08:54:49.708825+0000","last_fullsized":"2024-01-23T08:54:49.708825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:22.447523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705684+0000","last_change":"2024-01-23T08:54:42.116234+0000","last_active":"2024-01-23T08:54:49.705684+0000","last_peered":"2024-01-23T08:54:49.705684+0000","last_clean":"2024-01-23T08:54:49.705684+0000","last_became_active":"2024-01-23T08:54:42.115911+0000","last_became_peered":"2024-01-23T08:54:42.115911+0000","last_unstale":"2024-01-23T08:54:49.705684+0000","last_undegraded":"2024-01-23T08:54:49.705684+0000","last_fullsized":"2024-01-23T08:54:49.705684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:06.320845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705399+0000","last_change":"2024-01-23T08:54:42.158134+0000","last_active":"2024-01-23T08:54:49.705399+0000","last_peered":"2024-01-23T08:54:49.705399+0000","last_clean":"2024-01-23T08:54:49.705399+0000","last_became_active":"2024-01-23T08:54:42.157331+0000","last_became_peered":"2024-01-23T08:54:42.157331+0000","last_unstale":"2024-01-23T08:54:49.705399+0000","last_undegraded":"2024-01-23T08:54:49.705399+0000","last_fullsized":"2024-01-23T08:54:49.705399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:46.594970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.715272+0000","last_change":"2024-01-23T08:54:42.092495+0000","last_active":"2024-01-23T08:54:49.715272+0000","last_peered":"2024-01-23T08:54:49.715272+0000","last_clean":"2024-01-23T08:54:49.715272+0000","last_became_active":"2024-01-23T08:54:42.091726+0000","last_became_peered":"2024-01-23T08:54:42.091726+0000","last_unstale":"2024-01-23T08:54:49.715272+0000","last_undegraded":"2024-01-23T08:54:49.715272+0000","last_fullsized":"2024-01-23T08:54:49.715272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:19:17.992621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.659528+0000","last_change":"2024-01-23T08:54:42.120617+0000","last_active":"2024-01-23T08:54:49.659528+0000","last_peered":"2024-01-23T08:54:49.659528+0000","last_clean":"2024-01-23T08:54:49.659528+0000","last_became_active":"2024-01-23T08:54:42.119847+0000","last_became_peered":"2024-01-23T08:54:42.119847+0000","last_unstale":"2024-01-23T08:54:49.659528+0000","last_undegraded":"2024-01-23T08:54:49.659528+0000","last_fullsized":"2024-01-23T08:54:49.659528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:29:51.323223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.699912+0000","last_change":"2024-01-23T08:54:42.197133+0000","last_active":"2024-01-23T08:54:49.699912+0000","last_peered":"2024-01-23T08:54:49.699912+0000","last_clean":"2024-01-23T08:54:49.699912+0000","last_became_active":"2024-01-23T08:54:42.195743+0000","last_became_peered":"2024-01-23T08:54:42.195743+0000","last_unstale":"2024-01-23T08:54:49.699912+0000","last_undegraded":"2024-01-23T08:54:49.699912+0000","last_fullsized":"2024-01-23T08:54:49.699912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:48:04.040139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705359+0000","last_change":"2024-01-23T08:54:42.195979+0000","last_active":"2024-01-23T08:54:49.705359+0000","last_peered":"2024-01-23T08:54:49.705359+0000","last_clean":"2024-01-23T08:54:49.705359+0000","last_became_active":"2024-01-23T08:54:42.194846+0000","last_became_peered":"2024-01-23T08:54:42.194846+0000","last_unstale":"2024-01-23T08:54:49.705359+0000","last_undegraded":"2024-01-23T08:54:49.705359+0000","last_fullsized":"2024-01-23T08:54:49.705359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:07:39.007667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705207+0000","last_change":"2024-01-23T08:54:42.118056+0000","last_active":"2024-01-23T08:54:49.705207+0000","last_peered":"2024-01-23T08:54:49.705207+0000","last_clean":"2024-01-23T08:54:49.705207+0000","last_became_active":"2024-01-23T08:54:42.117735+0000","last_became_peered":"2024-01-23T08:54:42.117735+0000","last_unstale":"2024-01-23T08:54:49.705207+0000","last_undegraded":"2024-01-23T08:54:49.705207+0000","last_fullsized":"2024-01-23T08:54:49.705207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:19.147334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.707758+0000","last_change":"2024-01-23T08:54:42.195159+0000","last_active":"2024-01-23T08:54:49.707758+0000","last_peered":"2024-01-23T08:54:49.707758+0000","last_clean":"2024-01-23T08:54:49.707758+0000","last_became_active":"2024-01-23T08:54:42.194331+0000","last_became_peered":"2024-01-23T08:54:42.194331+0000","last_unstale":"2024-01-23T08:54:49.707758+0000","last_undegraded":"2024-01-23T08:54:49.707758+0000","last_fullsized":"2024-01-23T08:54:49.707758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:19:25.718244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.662214+0000","last_change":"2024-01-23T08:54:42.197096+0000","last_active":"2024-01-23T08:54:49.662214+0000","last_peered":"2024-01-23T08:54:49.662214+0000","last_clean":"2024-01-23T08:54:49.662214+0000","last_became_active":"2024-01-23T08:54:42.196391+0000","last_became_peered":"2024-01-23T08:54:42.196391+0000","last_unstale":"2024-01-23T08:54:49.662214+0000","last_undegraded":"2024-01-23T08:54:49.662214+0000","last_fullsized":"2024-01-23T08:54:49.662214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:22.447523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.661112+0000","last_change":"2024-01-23T08:54:42.231430+0000","last_active":"2024-01-23T08:54:49.661112+0000","last_peered":"2024-01-23T08:54:49.661112+0000","last_clean":"2024-01-23T08:54:49.661112+0000","last_became_active":"2024-01-23T08:54:42.229220+0000","last_became_peered":"2024-01-23T08:54:42.229220+0000","last_unstale":"2024-01-23T08:54:49.661112+0000","last_undegraded":"2024-01-23T08:54:49.661112+0000","last_fullsized":"2024-01-23T08:54:49.661112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:48:04.040139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-23T08:54:49.705952+0000","last_change":"2024-01-23T08:54:42.118613+0000","last_active":"2024-01-23T08:54:49.705952+0000","last_peered":"2024-01-23T08:54:49.705952+0000","last_clean":"2024-01-23T08:54:49.705952+0000","last_became_active":"2024-01-23T08:54:42.118233+0000","last_became_peered":"2024-01-23T08:54:42.118233+0000","last_unstale":"2024-01-23T08:54:49.705952+0000","last_undegraded":"2024-01-23T08:54:49.705952+0000","last_fullsized":"2024-01-23T08:54:49.705952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:16:33.710981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10263,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":19938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.80500000000000005}]},{"osd":1,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.69999999999999996}]},{"osd":2,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.88600000000000001}]},{"osd":3,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.93600000000000005}]},{"osd":4,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.2530000000000001,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.46000000000000002}]},{"osd":5,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.748}]},{"osd":6,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":0.59399999999999997},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":0.61699999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":913408,"data_stored":708397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.502}]},{"osd":1,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":1.0209999999999999}]},{"osd":2,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.79900000000000004}]},{"osd":3,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.91800000000000004}]},{"osd":4,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.89900000000000002}]},{"osd":6,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.157}]},{"osd":7,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":1.218}]}]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":122882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.738,"5min":2.738,"15min":2.738},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.77800000000000002}]},{"osd":1,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.4529999999999998,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":1.081}]},{"osd":2,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":2.524,"5min":2.524,"15min":2.524},"last":0.88800000000000001}]},{"osd":3,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":1.323},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":1.0249999999999999}]},{"osd":5,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.3690000000000002,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.202},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.1439999999999999}]},{"osd":6,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.28},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.6030000000000002,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.3700000000000001}]},{"osd":7,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.53},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":1.1060000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509464,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31484,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340356,"statfs":{"total":96636764160,"available":96604524544,"internally_reserved":0,"allocated":315392,"data_stored":121112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.41699999999999998}]},{"osd":1,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.38400000000000001}]},{"osd":3,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":1.016}]},{"osd":4,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.503}]},{"osd":5,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.52700000000000002},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.99099999999999999}]},{"osd":6,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.58699999999999997}]},{"osd":7,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.56100000000000005}]}]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":905216,"data_stored":708403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.69999999999999996}]},{"osd":2,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.317},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.505}]},{"osd":3,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.77200000000000002}]},{"osd":4,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.625},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.65500000000000003}]},{"osd":5,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.747}]},{"osd":6,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.67900000000000005}]},{"osd":7,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.92500000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509463,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":327680,"data_stored":119163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.246},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.20000000000000001}]},{"osd":2,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.312},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.28999999999999998}]},{"osd":3,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.35699999999999998}]},{"osd":4,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.61399999999999999}]},{"osd":5,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.377}]},{"osd":6,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.57899999999999996}]},{"osd":7,"last update":"Tue Jan 23 08:54:59 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.71199999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":335872,"data_stored":119337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.38}]},{"osd":1,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.52300000000000002}]},{"osd":2,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.41999999999999998}]},{"osd":4,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.55800000000000005},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.69599999999999995}]},{"osd":5,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.67900000000000005}]},{"osd":6,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.77700000000000002}]},{"osd":7,"last update":"Tue Jan 23 08:54:58 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.74199999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":118995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.63900000000000001}]},{"osd":1,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.99099999999999999}]},{"osd":2,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.52900000000000003}]},{"osd":3,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.0229999999999999}]},{"osd":4,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.81000000000000005}]},{"osd":5,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.1100000000000001}]},{"osd":7,"last update":"Tue Jan 23 08:55:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.67900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":5679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-23T08:55:38.547 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-23T08:55:38.547 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-01-23T08:55:38.547 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-01-23T08:55:38.548 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-01-23T08:55:38.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.723+0000 7f9b8c745640 1 Processor -- start 2024-01-23T08:55:38.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.723+0000 7f9b8c745640 1 -- start start 2024-01-23T08:55:38.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.723+0000 7f9b8c745640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9b84151600 0x7f9b8415b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:38.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.723+0000 7f9b8c745640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b841519e0 0x7f9b840c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:38.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.723+0000 7f9b8c745640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b84158390 con 0x7f9b8406f350 2024-01-23T08:55:38.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.723+0000 7f9b8c745640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b8415b0e0 con 0x7f9b84151600 2024-01-23T08:55:38.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.723+0000 7f9b8c745640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b84157b70 con 0x7f9b841519e0 2024-01-23T08:55:38.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.727+0000 7f9b8a4e1640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9b84151600 0x7f9b8415b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:38.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.727+0000 7f9b8ace2640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9b8406f350 0x7f9b84157460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38694/0 (socket says 172.21.15.46:38694) 2024-01-23T08:55:38.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.727+0000 7f9b8ace2640 1 -- 172.21.15.46:0/44170090 learned_addr learned my addr 172.21.15.46:0/44170090 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:38.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.727+0000 7f9b89ce0640 1 --2- 172.21.15.46:0/44170090 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b841519e0 0x7f9b840c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:38.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.731+0000 7f9b8a4e1640 1 -- 172.21.15.46:0/44170090 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b841519e0 msgr2=0x7f9b840c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:38.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.731+0000 7f9b8a4e1640 1 --2- 172.21.15.46:0/44170090 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b841519e0 0x7f9b840c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:38.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.731+0000 7f9b8a4e1640 1 -- 172.21.15.46:0/44170090 >> v1:172.21.15.46:6789/0 conn(0x7f9b8406f350 legacy=0x7f9b84157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:38.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.731+0000 7f9b8a4e1640 1 -- 172.21.15.46:0/44170090 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b84157dd0 con 0x7f9b84151600 2024-01-23T08:55:38.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.735+0000 7f9b8a4e1640 1 --2- 172.21.15.46:0/44170090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b84151600 0x7f9b8415b570 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9b800097c0 tx=0x7f9b8001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=230721a6c64894db server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:38.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.739+0000 7f9b894df640 1 -- 172.21.15.46:0/44170090 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b800ab600 con 0x7f9b84151600 2024-01-23T08:55:38.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.739+0000 7f9b894df640 1 -- 172.21.15.46:0/44170090 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b800a7050 con 0x7f9b84151600 2024-01-23T08:55:38.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.739+0000 7f9b894df640 1 -- 172.21.15.46:0/44170090 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b800ab980 con 0x7f9b84151600 2024-01-23T08:55:38.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.739+0000 7f9b8c745640 1 -- 172.21.15.46:0/44170090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b84151600 msgr2=0x7f9b8415b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:38.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.739+0000 7f9b8c745640 1 --2- 172.21.15.46:0/44170090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b84151600 0x7f9b8415b570 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9b800097c0 tx=0x7f9b8001c480 comp rx=0 tx=0).stop 2024-01-23T08:55:38.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.739+0000 7f9b8c745640 1 -- 172.21.15.46:0/44170090 shutdown_connections 2024-01-23T08:55:38.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.739+0000 7f9b8c745640 1 --2- 172.21.15.46:0/44170090 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b841519e0 0x7f9b840c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:38.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.739+0000 7f9b8c745640 1 --2- 172.21.15.46:0/44170090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b84151600 0x7f9b8415b570 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:38.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.739+0000 7f9b8c745640 1 -- 172.21.15.46:0/44170090 >> 172.21.15.46:0/44170090 conn(0x7f9b8406d590 msgr2=0x7f9b84066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:38.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.739+0000 7f9b8c745640 1 -- 172.21.15.46:0/44170090 shutdown_connections 2024-01-23T08:55:38.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.739+0000 7f9b8c745640 1 -- 172.21.15.46:0/44170090 wait complete. 2024-01-23T08:55:38.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.743+0000 7f9b8c745640 1 Processor -- start 2024-01-23T08:55:38.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.743+0000 7f9b8c745640 1 -- start start 2024-01-23T08:55:38.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.743+0000 7f9b8c745640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b8406f350 0x7f9b84146170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:38.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.743+0000 7f9b8c745640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b84145490 0x7f9b840ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:38.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.743+0000 7f9b8c745640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b840ca850 0x7f9b8413f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:38.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.743+0000 7f9b8c745640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b840c8ec0 con 0x7f9b840ca850 2024-01-23T08:55:38.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.743+0000 7f9b8c745640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b84143ff0 con 0x7f9b84145490 2024-01-23T08:55:38.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.743+0000 7f9b8c745640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b84143b60 con 0x7f9b8406f350 2024-01-23T08:55:38.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.743+0000 7f9b8ace2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b840ca850 0x7f9b8413f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:38.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.743+0000 7f9b8ace2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b840ca850 0x7f9b8413f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54824/0 (socket says 172.21.15.46:54824) 2024-01-23T08:55:38.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.743+0000 7f9b8ace2640 1 -- 172.21.15.46:0/1931817870 learned_addr learned my addr 172.21.15.46:0/1931817870 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:38.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.743+0000 7f9b8a4e1640 1 --2- 172.21.15.46:0/1931817870 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b8406f350 0x7f9b84146170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:38.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.743+0000 7f9b89ce0640 1 --2- 172.21.15.46:0/1931817870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b84145490 0x7f9b840ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:38.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.747+0000 7f9b8ace2640 1 -- 172.21.15.46:0/1931817870 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b8406f350 msgr2=0x7f9b84146170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:38.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.747+0000 7f9b8ace2640 1 --2- 172.21.15.46:0/1931817870 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b8406f350 0x7f9b84146170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:38.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.747+0000 7f9b8ace2640 1 -- 172.21.15.46:0/1931817870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b84145490 msgr2=0x7f9b840ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:38.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.747+0000 7f9b8ace2640 1 --2- 172.21.15.46:0/1931817870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b84145490 0x7f9b840ca310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:38.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.747+0000 7f9b8ace2640 1 -- 172.21.15.46:0/1931817870 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b80009420 con 0x7f9b840ca850 2024-01-23T08:55:38.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.751+0000 7f9b8ace2640 1 --2- 172.21.15.46:0/1931817870 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b840ca850 0x7f9b8413f550 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00cad0 tx=0x7f9b7c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:38.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.751+0000 7f9b7affd640 1 -- 172.21.15.46:0/1931817870 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c00abd0 con 0x7f9b840ca850 2024-01-23T08:55:38.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.755+0000 7f9b7affd640 1 -- 172.21.15.46:0/1931817870 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7c00ad30 con 0x7f9b840ca850 2024-01-23T08:55:38.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.755+0000 7f9b7affd640 1 -- 172.21.15.46:0/1931817870 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c012620 con 0x7f9b840ca850 2024-01-23T08:55:38.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.755+0000 7f9b8c745640 1 -- 172.21.15.46:0/1931817870 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b84141b20 con 0x7f9b840ca850 2024-01-23T08:55:38.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.755+0000 7f9b8c745640 1 -- 172.21.15.46:0/1931817870 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b84145120 con 0x7f9b840ca850 2024-01-23T08:55:38.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:38.755+0000 7f9b8c745640 1 -- 172.21.15.46:0/1931817870 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b84071fa0 con 0x7f9b840ca850 2024-01-23T08:55:39.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.031+0000 7f9b7affd640 1 -- 172.21.15.46:0/1931817870 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f9b7c007070 con 0x7f9b840ca850 2024-01-23T08:55:39.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.035+0000 7f9b7affd640 1 --2- 172.21.15.46:0/1931817870 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9b68066550 0x7f9b68068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:39.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.035+0000 7f9b8a4e1640 1 --2- 172.21.15.46:0/1931817870 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9b68066550 0x7f9b68068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:39.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.035+0000 7f9b8a4e1640 1 --2- 172.21.15.46:0/1931817870 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9b68066550 0x7f9b68068a10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9b800ad000 tx=0x7f9b800a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:39.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.063+0000 7f9b7affd640 1 -- 172.21.15.46:0/1931817870 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9b7c055200 con 0x7f9b840ca850 2024-01-23T08:55:39.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.067+0000 7f9b7affd640 1 -- 172.21.15.46:0/1931817870 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f9b7c051540 con 0x7f9b840ca850 2024-01-23T08:55:39.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.303+0000 7f9b8c745640 1 -- 172.21.15.46:0/1931817870 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9b84074340 con 0x7f9b840ca850 2024-01-23T08:55:39.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.383+0000 7f9b7affd640 1 -- 172.21.15.46:0/1931817870 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f9b7c054b60 con 0x7f9b840ca850 2024-01-23T08:55:39.382 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:55:39.382 INFO:teuthology.orchestra.run.smithi046.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-01-23T08:55:39.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.387+0000 7f9b8c745640 1 -- 172.21.15.46:0/1931817870 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9b68066550 msgr2=0x7f9b68068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:39.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.387+0000 7f9b8c745640 1 --2- 172.21.15.46:0/1931817870 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9b68066550 0x7f9b68068a10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9b800ad000 tx=0x7f9b800a6000 comp rx=0 tx=0).stop 2024-01-23T08:55:39.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.387+0000 7f9b8c745640 1 -- 172.21.15.46:0/1931817870 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b840ca850 msgr2=0x7f9b8413f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:39.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.387+0000 7f9b8c745640 1 --2- 172.21.15.46:0/1931817870 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b840ca850 0x7f9b8413f550 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00cad0 tx=0x7f9b7c00cf90 comp rx=0 tx=0).stop 2024-01-23T08:55:39.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.387+0000 7f9b8c745640 1 -- 172.21.15.46:0/1931817870 shutdown_connections 2024-01-23T08:55:39.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.387+0000 7f9b8c745640 1 --2- 172.21.15.46:0/1931817870 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b840ca850 0x7f9b8413f550 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:39.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.387+0000 7f9b8c745640 1 --2- 172.21.15.46:0/1931817870 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9b68066550 0x7f9b68068a10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:39.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.387+0000 7f9b8c745640 1 --2- 172.21.15.46:0/1931817870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b84145490 0x7f9b840ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:39.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.387+0000 7f9b8c745640 1 --2- 172.21.15.46:0/1931817870 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b8406f350 0x7f9b84146170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:39.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.387+0000 7f9b8c745640 1 -- 172.21.15.46:0/1931817870 >> 172.21.15.46:0/1931817870 conn(0x7f9b8406d590 msgr2=0x7f9b8414d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:39.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.387+0000 7f9b8c745640 1 -- 172.21.15.46:0/1931817870 shutdown_connections 2024-01-23T08:55:39.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.387+0000 7f9b8c745640 1 -- 172.21.15.46:0/1931817870 wait complete. 2024-01-23T08:55:39.408 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-01-23T08:55:39.409 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-23T08:55:39.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.539+0000 7f0db6aa5640 1 Processor -- start 2024-01-23T08:55:39.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.539+0000 7f0db6aa5640 1 -- start start 2024-01-23T08:55:39.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.539+0000 7f0db6aa5640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0db00cb640 0x7f0db0070f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:39.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.539+0000 7f0db6aa5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0db006f450 0x7f0db015a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:39.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.539+0000 7f0db6aa5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db0159ea0 con 0x7f0db00cb260 2024-01-23T08:55:39.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.539+0000 7f0db6aa5640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db0159870 con 0x7f0db00cb640 2024-01-23T08:55:39.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.539+0000 7f0db6aa5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db015d590 con 0x7f0db006f450 2024-01-23T08:55:39.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.539+0000 7f0daffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0db00cb640 0x7f0db0070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:39.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.539+0000 7f0daffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0db00cb640 0x7f0db0070f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54832/0 (socket says 172.21.15.46:54832) 2024-01-23T08:55:39.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.539+0000 7f0daffff640 1 -- 172.21.15.46:0/267890436 learned_addr learned my addr 172.21.15.46:0/267890436 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:39.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.543+0000 7f0daffff640 1 -- 172.21.15.46:0/267890436 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0db006f450 msgr2=0x7f0db015a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:39.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.543+0000 7f0daffff640 1 --2- 172.21.15.46:0/267890436 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0db006f450 0x7f0db015a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:39.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.543+0000 7f0daffff640 1 -- 172.21.15.46:0/267890436 >> v1:172.21.15.175:6789/0 conn(0x7f0db00cb260 legacy=0x7f0db015cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:39.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.543+0000 7f0daffff640 1 -- 172.21.15.46:0/267890436 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db015d870 con 0x7f0db00cb640 2024-01-23T08:55:39.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.547+0000 7f0daffff640 1 --2- 172.21.15.46:0/267890436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0db00cb640 0x7f0db0070f20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0d98009870 tx=0x7f0d9801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d07d3b945af2e2 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:39.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.555+0000 7f0daf7fe640 1 -- 172.21.15.46:0/267890436 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d980a89b0 con 0x7f0db00cb640 2024-01-23T08:55:39.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.555+0000 7f0daf7fe640 1 -- 172.21.15.46:0/267890436 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d980a8b10 con 0x7f0db00cb640 2024-01-23T08:55:39.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.555+0000 7f0daf7fe640 1 -- 172.21.15.46:0/267890436 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d980a8ea0 con 0x7f0db00cb640 2024-01-23T08:55:39.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.555+0000 7f0db6aa5640 1 -- 172.21.15.46:0/267890436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0db00cb640 msgr2=0x7f0db0070f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:39.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.555+0000 7f0db6aa5640 1 --2- 172.21.15.46:0/267890436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0db00cb640 0x7f0db0070f20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0d98009870 tx=0x7f0d9801ecf0 comp rx=0 tx=0).stop 2024-01-23T08:55:39.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.555+0000 7f0db6aa5640 1 -- 172.21.15.46:0/267890436 shutdown_connections 2024-01-23T08:55:39.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.555+0000 7f0db6aa5640 1 --2- 172.21.15.46:0/267890436 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0db006f450 0x7f0db015a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:39.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.555+0000 7f0db6aa5640 1 --2- 172.21.15.46:0/267890436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0db00cb640 0x7f0db0070f20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:39.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.555+0000 7f0db6aa5640 1 -- 172.21.15.46:0/267890436 >> 172.21.15.46:0/267890436 conn(0x7f0db006d590 msgr2=0x7f0db0066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:39.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.555+0000 7f0db6aa5640 1 -- 172.21.15.46:0/267890436 shutdown_connections 2024-01-23T08:55:39.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.555+0000 7f0db6aa5640 1 -- 172.21.15.46:0/267890436 wait complete. 2024-01-23T08:55:39.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.555+0000 7f0db6aa5640 1 Processor -- start 2024-01-23T08:55:39.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.555+0000 7f0db6aa5640 1 -- start start 2024-01-23T08:55:39.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.555+0000 7f0db6aa5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0db006f450 0x7f0db01e33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:39.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.555+0000 7f0db6aa5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0db00cb260 0x7f0db01e3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:39.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.555+0000 7f0db6aa5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0db00cb640 0x7f0db01f16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:39.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.555+0000 7f0db6aa5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db014e010 con 0x7f0db00cb640 2024-01-23T08:55:39.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.555+0000 7f0db6aa5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db01f1210 con 0x7f0db006f450 2024-01-23T08:55:39.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.555+0000 7f0db6aa5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db01e4a90 con 0x7f0db00cb260 2024-01-23T08:55:39.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.555+0000 7f0db5042640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0db00cb640 0x7f0db01f16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:39.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.555+0000 7f0db5042640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0db00cb640 0x7f0db01f16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54846/0 (socket says 172.21.15.46:54846) 2024-01-23T08:55:39.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.555+0000 7f0db5042640 1 -- 172.21.15.46:0/872522677 learned_addr learned my addr 172.21.15.46:0/872522677 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:39.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.559+0000 7f0db5042640 1 -- 172.21.15.46:0/872522677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0db00cb260 msgr2=0x7f0db01e3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:39.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.559+0000 7f0db5042640 1 --2- 172.21.15.46:0/872522677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0db00cb260 0x7f0db01e3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:39.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.559+0000 7f0db5042640 1 -- 172.21.15.46:0/872522677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0db006f450 msgr2=0x7f0db01e33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:39.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.559+0000 7f0db5042640 1 --2- 172.21.15.46:0/872522677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0db006f450 0x7f0db01e33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:39.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.559+0000 7f0db5042640 1 -- 172.21.15.46:0/872522677 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d980094d0 con 0x7f0db00cb640 2024-01-23T08:55:39.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.563+0000 7f0db5042640 1 --2- 172.21.15.46:0/872522677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0db00cb640 0x7f0db01f16a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0da800b970 tx=0x7f0da800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:39.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.567+0000 7f0dad7fa640 1 -- 172.21.15.46:0/872522677 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da800cb40 con 0x7f0db00cb640 2024-01-23T08:55:39.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.567+0000 7f0dad7fa640 1 -- 172.21.15.46:0/872522677 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da800ccc0 con 0x7f0db00cb640 2024-01-23T08:55:39.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.567+0000 7f0db6aa5640 1 -- 172.21.15.46:0/872522677 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db01e4d50 con 0x7f0db00cb640 2024-01-23T08:55:39.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.567+0000 7f0dad7fa640 1 -- 172.21.15.46:0/872522677 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da8014680 con 0x7f0db00cb640 2024-01-23T08:55:39.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.567+0000 7f0db6aa5640 1 -- 172.21.15.46:0/872522677 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db01f0ea0 con 0x7f0db00cb640 2024-01-23T08:55:39.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.567+0000 7f0db6aa5640 1 -- 172.21.15.46:0/872522677 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db0074340 con 0x7f0db00cb640 2024-01-23T08:55:39.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.587+0000 7f0dad7fa640 1 -- 172.21.15.46:0/872522677 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f0da801d3b0 con 0x7f0db00cb640 2024-01-23T08:55:39.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.591+0000 7f0dad7fa640 1 --2- 172.21.15.46:0/872522677 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f0d94066550 0x7f0d94068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:39.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.591+0000 7f0db4841640 1 --2- 172.21.15.46:0/872522677 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f0d94066550 0x7f0d94068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:39.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.591+0000 7f0db4841640 1 --2- 172.21.15.46:0/872522677 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f0d94066550 0x7f0d94068a10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0da0007fd0 tx=0x7f0da00079a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:39.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.591+0000 7f0dad7fa640 1 -- 172.21.15.46:0/872522677 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0da800ce30 con 0x7f0db00cb640 2024-01-23T08:55:39.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:39.867+0000 7f0dad7fa640 1 -- 172.21.15.46:0/872522677 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f0da8051560 con 0x7f0db00cb640 2024-01-23T08:55:40.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.043+0000 7f0db6aa5640 1 -- 172.21.15.46:0/872522677 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0db00c1ee0 con 0x7f0db00cb640 2024-01-23T08:55:40.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.131+0000 7f0dad7fa640 1 -- 172.21.15.46:0/872522677 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f0da8019020 con 0x7f0db00cb640 2024-01-23T08:55:40.130 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:55:40.130 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":28,"fsid":"fdbdd393-f422-45ae-a488-2bbb0163e580","created":"2024-01-23T08:53:36.942515+0000","modified":"2024-01-23T08:54:50.465916+0000","last_up_change":"2024-01-23T08:53:57.198113+0000","last_in_change":"2024-01-23T08:53:47.852614+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-23T08:53:59.340853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-23T08:54:38.278770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-23T08:54:40.216521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-23T08:54:47.311079+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f32c3d7d-e32a-42d8-b55f-db874d915a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6818","nonce":2681790976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6821","nonce":2681790976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6825","nonce":2681790976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6823","nonce":2681790976}]},"public_addr":"172.21.15.46:6818/2681790976","cluster_addr":"172.21.15.46:6821/2681790976","heartbeat_back_addr":"172.21.15.46:6825/2681790976","heartbeat_front_addr":"172.21.15.46:6823/2681790976","state":["exists","up"]},{"osd":1,"uuid":"6f3b6bd2-bbea-4d08-84d5-4407363b5eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6803","nonce":3679152623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6805","nonce":3679152623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6809","nonce":3679152623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6807","nonce":3679152623}]},"public_addr":"172.21.15.46:6803/3679152623","cluster_addr":"172.21.15.46:6805/3679152623","heartbeat_back_addr":"172.21.15.46:6809/3679152623","heartbeat_front_addr":"172.21.15.46:6807/3679152623","state":["exists","up"]},{"osd":2,"uuid":"8f110727-31e7-4f69-926b-c87481d4d28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6811","nonce":3869652274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6813","nonce":3869652274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6820","nonce":3869652274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6815","nonce":3869652274}]},"public_addr":"172.21.15.46:6811/3869652274","cluster_addr":"172.21.15.46:6813/3869652274","heartbeat_back_addr":"172.21.15.46:6820/3869652274","heartbeat_front_addr":"172.21.15.46:6815/3869652274","state":["exists","up"]},{"osd":3,"uuid":"3aa7527d-0463-4373-b9c7-e6b507a7987f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6827","nonce":4168860822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6829","nonce":4168860822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6833","nonce":4168860822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6831","nonce":4168860822}]},"public_addr":"172.21.15.46:6827/4168860822","cluster_addr":"172.21.15.46:6829/4168860822","heartbeat_back_addr":"172.21.15.46:6833/4168860822","heartbeat_front_addr":"172.21.15.46:6831/4168860822","state":["exists","up"]},{"osd":4,"uuid":"eb47a1e5-9f26-465f-b188-87c6eed63c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6805","nonce":3115257412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6808","nonce":3115257412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6815","nonce":3115257412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6812","nonce":3115257412}]},"public_addr":"172.21.15.175:6805/3115257412","cluster_addr":"172.21.15.175:6808/3115257412","heartbeat_back_addr":"172.21.15.175:6815/3115257412","heartbeat_front_addr":"172.21.15.175:6812/3115257412","state":["exists","up"]},{"osd":5,"uuid":"34048409-998c-44f3-a29d-dcad7a6c917b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6818","nonce":3146473948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6822","nonce":3146473948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6831","nonce":3146473948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6826","nonce":3146473948}]},"public_addr":"172.21.15.175:6818/3146473948","cluster_addr":"172.21.15.175:6822/3146473948","heartbeat_back_addr":"172.21.15.175:6831/3146473948","heartbeat_front_addr":"172.21.15.175:6826/3146473948","state":["exists","up"]},{"osd":6,"uuid":"f5d45d3f-9af3-44a1-a730-c260ed1654b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6801","nonce":4161180058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6804","nonce":4161180058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6814","nonce":4161180058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6809","nonce":4161180058}]},"public_addr":"172.21.15.175:6801/4161180058","cluster_addr":"172.21.15.175:6804/4161180058","heartbeat_back_addr":"172.21.15.175:6814/4161180058","heartbeat_front_addr":"172.21.15.175:6809/4161180058","state":["exists","up"]},{"osd":7,"uuid":"16d12e53-2ad3-4b5c-a789-22b45056fd9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6819","nonce":2670236415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6823","nonce":2670236415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6830","nonce":2670236415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6827","nonce":2670236415}]},"public_addr":"172.21.15.175:6819/2670236415","cluster_addr":"172.21.15.175:6823/2670236415","heartbeat_back_addr":"172.21.15.175:6830/2670236415","heartbeat_front_addr":"172.21.15.175:6827/2670236415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.847037+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.765547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.716122+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.874628+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.786580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.924885+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.285635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.898130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T08:55:40.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.135+0000 7f0db6aa5640 1 -- 172.21.15.46:0/872522677 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f0d94066550 msgr2=0x7f0d94068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:40.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.135+0000 7f0db6aa5640 1 --2- 172.21.15.46:0/872522677 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f0d94066550 0x7f0d94068a10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0da0007fd0 tx=0x7f0da00079a0 comp rx=0 tx=0).stop 2024-01-23T08:55:40.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.135+0000 7f0db6aa5640 1 -- 172.21.15.46:0/872522677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0db00cb640 msgr2=0x7f0db01f16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:40.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.135+0000 7f0db6aa5640 1 --2- 172.21.15.46:0/872522677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0db00cb640 0x7f0db01f16a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0da800b970 tx=0x7f0da800be30 comp rx=0 tx=0).stop 2024-01-23T08:55:40.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.135+0000 7f0db6aa5640 1 -- 172.21.15.46:0/872522677 shutdown_connections 2024-01-23T08:55:40.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.135+0000 7f0db6aa5640 1 --2- 172.21.15.46:0/872522677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0db00cb640 0x7f0db01f16a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:40.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.135+0000 7f0db6aa5640 1 --2- 172.21.15.46:0/872522677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0db00cb260 0x7f0db01e3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:40.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.135+0000 7f0db6aa5640 1 --2- 172.21.15.46:0/872522677 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f0d94066550 0x7f0d94068a10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:40.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.135+0000 7f0db6aa5640 1 --2- 172.21.15.46:0/872522677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0db006f450 0x7f0db01e33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:40.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.135+0000 7f0db6aa5640 1 -- 172.21.15.46:0/872522677 >> 172.21.15.46:0/872522677 conn(0x7f0db006d590 msgr2=0x7f0db00c6100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:40.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.135+0000 7f0db6aa5640 1 -- 172.21.15.46:0/872522677 shutdown_connections 2024-01-23T08:55:40.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.135+0000 7f0db6aa5640 1 -- 172.21.15.46:0/872522677 wait complete. 2024-01-23T08:55:40.153 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-23T08:53:59.340853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-23T08:54:38.278770+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-23T08:54:40.216521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-23T08:54:47.311079+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-23T08:55:40.154 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-23T08:55:40.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.291+0000 7f85ae917640 1 Processor -- start 2024-01-23T08:55:40.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.291+0000 7f85ae917640 1 -- start start 2024-01-23T08:55:40.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.291+0000 7f85ae917640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f85a80c4ea0 0x7f85a806a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:40.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.291+0000 7f85ae917640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a80c8ea0 con 0x7f85a806b8b0 2024-01-23T08:55:40.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.291+0000 7f85ae917640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a806bd40 con 0x7f85a80c5280 2024-01-23T08:55:40.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.291+0000 7f85ae917640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a80c88e0 con 0x7f85a80c4ea0 2024-01-23T08:55:40.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.291+0000 7f85a77fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f85a806b8b0 0x7f85a815b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38706/0 (socket says 172.21.15.46:38706) 2024-01-23T08:55:40.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.291+0000 7f85a77fe640 1 -- 172.21.15.46:0/3926317414 learned_addr learned my addr 172.21.15.46:0/3926317414 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:40.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.291+0000 7f85a7fff640 1 --2- 172.21.15.46:0/3926317414 >> v2:172.21.15.175:3300/0 conn(0x7f85a80c4ea0 0x7f85a806a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:40.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.295+0000 7f85a6ffd640 1 -- 172.21.15.46:0/3926317414 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3571856229 0 0) 0x7f85a80c8ea0 con 0x7f85a806b8b0 2024-01-23T08:55:40.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.295+0000 7f85a6ffd640 1 -- 172.21.15.46:0/3926317414 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8594003530 con 0x7f85a806b8b0 2024-01-23T08:55:40.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.295+0000 7f85a7fff640 1 -- 172.21.15.46:0/3926317414 >> v1:172.21.15.175:6789/0 conn(0x7f85a80c5280 legacy=0x7f85a8151110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:40.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.295+0000 7f85a7fff640 1 -- 172.21.15.46:0/3926317414 >> v1:172.21.15.46:6789/0 conn(0x7f85a806b8b0 legacy=0x7f85a815b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:40.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.295+0000 7f85a7fff640 1 -- 172.21.15.46:0/3926317414 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a80c8bc0 con 0x7f85a80c4ea0 2024-01-23T08:55:40.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.303+0000 7f85a7fff640 1 --2- 172.21.15.46:0/3926317414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85a80c4ea0 0x7f85a806a660 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f85a0009d90 tx=0x7f85a001c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e34c2e492fb87763 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:40.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.307+0000 7f85a6ffd640 1 -- 172.21.15.46:0/3926317414 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a00a5980 con 0x7f85a80c4ea0 2024-01-23T08:55:40.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.307+0000 7f85a6ffd640 1 -- 172.21.15.46:0/3926317414 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a00a5ae0 con 0x7f85a80c4ea0 2024-01-23T08:55:40.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.307+0000 7f85a6ffd640 1 -- 172.21.15.46:0/3926317414 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a00a5e70 con 0x7f85a80c4ea0 2024-01-23T08:55:40.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.307+0000 7f85ae917640 1 -- 172.21.15.46:0/3926317414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85a80c4ea0 msgr2=0x7f85a806a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:40.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.307+0000 7f85ae917640 1 --2- 172.21.15.46:0/3926317414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85a80c4ea0 0x7f85a806a660 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f85a0009d90 tx=0x7f85a001c8e0 comp rx=0 tx=0).stop 2024-01-23T08:55:40.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.307+0000 7f85ae917640 1 -- 172.21.15.46:0/3926317414 shutdown_connections 2024-01-23T08:55:40.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.307+0000 7f85ae917640 1 --2- 172.21.15.46:0/3926317414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85a80c4ea0 0x7f85a806a660 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:40.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.307+0000 7f85ae917640 1 -- 172.21.15.46:0/3926317414 >> 172.21.15.46:0/3926317414 conn(0x7f85a806fa20 msgr2=0x7f85a80c8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:40.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.307+0000 7f85ae917640 1 -- 172.21.15.46:0/3926317414 shutdown_connections 2024-01-23T08:55:40.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.307+0000 7f85ae917640 1 -- 172.21.15.46:0/3926317414 wait complete. 2024-01-23T08:55:40.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.311+0000 7f85ae917640 1 Processor -- start 2024-01-23T08:55:40.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.311+0000 7f85ae917640 1 -- start start 2024-01-23T08:55:40.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.311+0000 7f85ae917640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85a80c5280 0x7f85a8145d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:40.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.311+0000 7f85ae917640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85a80cb770 0x7f85a8159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:40.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.311+0000 7f85ae917640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85a813f780 0x7f85a813fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:40.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.311+0000 7f85ae917640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a8158760 con 0x7f85a813f780 2024-01-23T08:55:40.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.311+0000 7f85ae917640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a8142040 con 0x7f85a80cb770 2024-01-23T08:55:40.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.311+0000 7f85ae917640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a8142320 con 0x7f85a80c5280 2024-01-23T08:55:40.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.311+0000 7f85aceb4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85a813f780 0x7f85a813fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:40.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.311+0000 7f85aceb4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85a813f780 0x7f85a813fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54862/0 (socket says 172.21.15.46:54862) 2024-01-23T08:55:40.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.311+0000 7f85aceb4640 1 -- 172.21.15.46:0/3437256072 learned_addr learned my addr 172.21.15.46:0/3437256072 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:40.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.311+0000 7f85a77fe640 1 --2- 172.21.15.46:0/3437256072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85a80cb770 0x7f85a8159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:40.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.311+0000 7f85a7fff640 1 --2- 172.21.15.46:0/3437256072 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85a80c5280 0x7f85a8145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:40.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.315+0000 7f85aceb4640 1 -- 172.21.15.46:0/3437256072 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85a80c5280 msgr2=0x7f85a8145d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:40.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.315+0000 7f85aceb4640 1 --2- 172.21.15.46:0/3437256072 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85a80c5280 0x7f85a8145d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:40.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.315+0000 7f85aceb4640 1 -- 172.21.15.46:0/3437256072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85a80cb770 msgr2=0x7f85a8159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:40.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.315+0000 7f85aceb4640 1 --2- 172.21.15.46:0/3437256072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85a80cb770 0x7f85a8159490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:40.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.315+0000 7f85aceb4640 1 -- 172.21.15.46:0/3437256072 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a0009a70 con 0x7f85a813f780 2024-01-23T08:55:40.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.319+0000 7f85aceb4640 1 --2- 172.21.15.46:0/3437256072 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85a813f780 0x7f85a813fbe0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f859800b410 tx=0x7f859800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:40.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.323+0000 7f85a4ff9640 1 -- 172.21.15.46:0/3437256072 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8598011830 con 0x7f85a813f780 2024-01-23T08:55:40.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.323+0000 7f85a4ff9640 1 -- 172.21.15.46:0/3437256072 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85980119d0 con 0x7f85a813f780 2024-01-23T08:55:40.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.327+0000 7f85ae917640 1 -- 172.21.15.46:0/3437256072 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a81589b0 con 0x7f85a813f780 2024-01-23T08:55:40.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.327+0000 7f85a4ff9640 1 -- 172.21.15.46:0/3437256072 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8598011d80 con 0x7f85a813f780 2024-01-23T08:55:40.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.327+0000 7f85ae917640 1 -- 172.21.15.46:0/3437256072 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a8158f70 con 0x7f85a813f780 2024-01-23T08:55:40.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.327+0000 7f85ae917640 1 -- 172.21.15.46:0/3437256072 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a8074340 con 0x7f85a813f780 2024-01-23T08:55:40.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.347+0000 7f85a4ff9640 1 -- 172.21.15.46:0/3437256072 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f859801a400 con 0x7f85a813f780 2024-01-23T08:55:40.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.347+0000 7f85a4ff9640 1 --2- 172.21.15.46:0/3437256072 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8588066550 0x7f8588068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:40.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.347+0000 7f85a7fff640 1 --2- 172.21.15.46:0/3437256072 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8588066550 0x7f8588068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:40.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.347+0000 7f85a7fff640 1 --2- 172.21.15.46:0/3437256072 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8588066550 0x7f8588068a10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f85a00af000 tx=0x7f85a00a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:40.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.623+0000 7f85a4ff9640 1 -- 172.21.15.46:0/3437256072 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f85980554b0 con 0x7f85a813f780 2024-01-23T08:55:40.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.627+0000 7f85a4ff9640 1 -- 172.21.15.46:0/3437256072 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f85980517f0 con 0x7f85a813f780 2024-01-23T08:55:40.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.803+0000 7f85ae917640 1 -- 172.21.15.46:0/3437256072 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f85a8150960 con 0x7f85a813f780 2024-01-23T08:55:40.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.827+0000 7f85a4ff9640 1 -- 172.21.15.46:0/3437256072 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8598054e10 con 0x7f85a813f780 2024-01-23T08:55:40.826 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-01-23T08:55:40.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.831+0000 7f85ae917640 1 -- 172.21.15.46:0/3437256072 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8588066550 msgr2=0x7f8588068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:40.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.831+0000 7f85ae917640 1 --2- 172.21.15.46:0/3437256072 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8588066550 0x7f8588068a10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f85a00af000 tx=0x7f85a00a7070 comp rx=0 tx=0).stop 2024-01-23T08:55:40.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.831+0000 7f85ae917640 1 -- 172.21.15.46:0/3437256072 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85a813f780 msgr2=0x7f85a813fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:40.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.831+0000 7f85ae917640 1 --2- 172.21.15.46:0/3437256072 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85a813f780 0x7f85a813fbe0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f859800b410 tx=0x7f859800b8d0 comp rx=0 tx=0).stop 2024-01-23T08:55:40.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.831+0000 7f85ae917640 1 -- 172.21.15.46:0/3437256072 shutdown_connections 2024-01-23T08:55:40.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.831+0000 7f85ae917640 1 --2- 172.21.15.46:0/3437256072 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85a813f780 0x7f85a813fbe0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:40.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.831+0000 7f85ae917640 1 --2- 172.21.15.46:0/3437256072 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8588066550 0x7f8588068a10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:40.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.831+0000 7f85ae917640 1 --2- 172.21.15.46:0/3437256072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85a80cb770 0x7f85a8159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:40.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.831+0000 7f85ae917640 1 --2- 172.21.15.46:0/3437256072 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85a80c5280 0x7f85a8145d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:40.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.831+0000 7f85ae917640 1 -- 172.21.15.46:0/3437256072 >> 172.21.15.46:0/3437256072 conn(0x7f85a806fa20 msgr2=0x7f85a8162760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:40.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.831+0000 7f85ae917640 1 -- 172.21.15.46:0/3437256072 shutdown_connections 2024-01-23T08:55:40.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.831+0000 7f85ae917640 1 -- 172.21.15.46:0/3437256072 wait complete. 2024-01-23T08:55:40.847 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-23T08:55:40.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.983+0000 7f3c9a9ed640 1 Processor -- start 2024-01-23T08:55:40.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.983+0000 7f3c9a9ed640 1 -- start start 2024-01-23T08:55:40.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.983+0000 7f3c9a9ed640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3c94153a90 0x7f3c940c7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:40.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.983+0000 7f3c9a9ed640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c940c2bc0 0x7f3c940c8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:40.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.983+0000 7f3c9a9ed640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c940c6a90 con 0x7f3c941536b0 2024-01-23T08:55:40.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.983+0000 7f3c9a9ed640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c940c1330 con 0x7f3c94153a90 2024-01-23T08:55:40.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.983+0000 7f3c9a9ed640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9406e000 con 0x7f3c940c2bc0 2024-01-23T08:55:40.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.983+0000 7f3c93fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3c941536b0 0x7f3c9406ebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38722/0 (socket says 172.21.15.46:38722) 2024-01-23T08:55:40.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.983+0000 7f3c93fff640 1 -- 172.21.15.46:0/3600146469 learned_addr learned my addr 172.21.15.46:0/3600146469 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:40.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.983+0000 7f3c937fe640 1 --2- 172.21.15.46:0/3600146469 >> v2:172.21.15.175:3300/0 conn(0x7f3c94153a90 0x7f3c940c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:40.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.987+0000 7f3c98f8a640 1 --2- 172.21.15.46:0/3600146469 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c940c2bc0 0x7f3c940c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:40.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.987+0000 7f3c92ffd640 1 -- 172.21.15.46:0/3600146469 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 987857792 0 0) 0x7f3c940c6a90 con 0x7f3c941536b0 2024-01-23T08:55:40.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.987+0000 7f3c92ffd640 1 -- 172.21.15.46:0/3600146469 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c7c003530 con 0x7f3c941536b0 2024-01-23T08:55:40.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.991+0000 7f3c92ffd640 1 -- 172.21.15.46:0/3600146469 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2176689350 0 0) 0x7f3c7c003530 con 0x7f3c941536b0 2024-01-23T08:55:40.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.991+0000 7f3c92ffd640 1 -- 172.21.15.46:0/3600146469 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c940c2bc0 msgr2=0x7f3c940c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:40.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.991+0000 7f3c92ffd640 1 --2- 172.21.15.46:0/3600146469 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c940c2bc0 0x7f3c940c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:40.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.991+0000 7f3c92ffd640 1 -- 172.21.15.46:0/3600146469 >> v2:172.21.15.175:3300/0 conn(0x7f3c94153a90 msgr2=0x7f3c940c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:40.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.991+0000 7f3c92ffd640 1 --2- 172.21.15.46:0/3600146469 >> v2:172.21.15.175:3300/0 conn(0x7f3c94153a90 0x7f3c940c7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:40.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.991+0000 7f3c92ffd640 1 -- 172.21.15.46:0/3600146469 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9406e2e0 con 0x7f3c941536b0 2024-01-23T08:55:40.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.991+0000 7f3c92ffd640 1 -- 172.21.15.46:0/3600146469 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466917103 0 0) 0x7f3c84001680 con 0x7f3c941536b0 2024-01-23T08:55:40.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.991+0000 7f3c92ffd640 1 -- 172.21.15.46:0/3600146469 >> v1:172.21.15.46:6789/0 conn(0x7f3c941536b0 legacy=0x7f3c9406ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:40.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.991+0000 7f3c92ffd640 1 --2- 172.21.15.46:0/3600146469 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c940c2bc0 0x7f3c7c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:40.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.991+0000 7f3c92ffd640 1 --2- 172.21.15.46:0/3600146469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c7c003fc0 0x7f3c7c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:40.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.991+0000 7f3c92ffd640 1 --2- 172.21.15.46:0/3600146469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c7c004d10 0x7f3c7c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:40.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.991+0000 7f3c92ffd640 1 -- 172.21.15.46:0/3600146469 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9406e000 con 0x7f3c7c004d10 2024-01-23T08:55:40.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.991+0000 7f3c92ffd640 1 -- 172.21.15.46:0/3600146469 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7c00ba20 con 0x7f3c7c003fc0 2024-01-23T08:55:40.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.991+0000 7f3c92ffd640 1 -- 172.21.15.46:0/3600146469 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7c00bbe0 con 0x7f3c940c2bc0 2024-01-23T08:55:40.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.995+0000 7f3c98f8a640 1 --2- 172.21.15.46:0/3600146469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c7c004d10 0x7f3c7c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:40.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.995+0000 7f3c93fff640 1 --2- 172.21.15.46:0/3600146469 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c940c2bc0 0x7f3c7c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:40.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.999+0000 7f3c98f8a640 1 -- 172.21.15.46:0/3600146469 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c940c2bc0 msgr2=0x7f3c7c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:40.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.999+0000 7f3c98f8a640 1 --2- 172.21.15.46:0/3600146469 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c940c2bc0 0x7f3c7c0039f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:40.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.999+0000 7f3c98f8a640 1 -- 172.21.15.46:0/3600146469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c7c003fc0 msgr2=0x7f3c7c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:40.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.999+0000 7f3c98f8a640 1 --2- 172.21.15.46:0/3600146469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c7c003fc0 0x7f3c7c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:40.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.999+0000 7f3c98f8a640 1 -- 172.21.15.46:0/3600146469 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7c003530 con 0x7f3c7c004d10 2024-01-23T08:55:40.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:40.999+0000 7f3c98f8a640 1 --2- 172.21.15.46:0/3600146469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c7c004d10 0x7f3c7c005190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c009f90 tx=0x7f3c8c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223467a7343111a8 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:41.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.003+0000 7f3c92ffd640 1 -- 172.21.15.46:0/3600146469 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c0a5c30 con 0x7f3c7c004d10 2024-01-23T08:55:41.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.007+0000 7f3c92ffd640 1 -- 172.21.15.46:0/3600146469 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8c00f040 con 0x7f3c7c004d10 2024-01-23T08:55:41.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.007+0000 7f3c92ffd640 1 -- 172.21.15.46:0/3600146469 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c0ad640 con 0x7f3c7c004d10 2024-01-23T08:55:41.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.007+0000 7f3c9a9ed640 1 -- 172.21.15.46:0/3600146469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c7c004d10 msgr2=0x7f3c7c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:41.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.007+0000 7f3c9a9ed640 1 --2- 172.21.15.46:0/3600146469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c7c004d10 0x7f3c7c005190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c009f90 tx=0x7f3c8c01cc20 comp rx=0 tx=0).stop 2024-01-23T08:55:41.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.007+0000 7f3c98f8a640 1 -- 172.21.15.46:0/3600146469 reap_dead start 2024-01-23T08:55:41.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.007+0000 7f3c9a9ed640 1 -- 172.21.15.46:0/3600146469 shutdown_connections 2024-01-23T08:55:41.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.007+0000 7f3c9a9ed640 1 -- 172.21.15.46:0/3600146469 >> 172.21.15.46:0/3600146469 conn(0x7f3c9406b770 msgr2=0x7f3c9406bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:41.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.007+0000 7f3c9a9ed640 1 -- 172.21.15.46:0/3600146469 shutdown_connections 2024-01-23T08:55:41.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.007+0000 7f3c9a9ed640 1 -- 172.21.15.46:0/3600146469 wait complete. 2024-01-23T08:55:41.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.007+0000 7f3c9a9ed640 1 Processor -- start 2024-01-23T08:55:41.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.007+0000 7f3c9a9ed640 1 -- start start 2024-01-23T08:55:41.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.007+0000 7f3c9a9ed640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c941476a0 0x7f3c9415a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:41.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.007+0000 7f3c9a9ed640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c941efd80 0x7f3c941ee8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:41.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.007+0000 7f3c9a9ed640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c941eee10 0x7f3c941ef290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:41.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.007+0000 7f3c9a9ed640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c940c3790 con 0x7f3c941eee10 2024-01-23T08:55:41.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.007+0000 7f3c9a9ed640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c94159d00 con 0x7f3c941efd80 2024-01-23T08:55:41.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.007+0000 7f3c9a9ed640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c940c3230 con 0x7f3c941476a0 2024-01-23T08:55:41.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.007+0000 7f3c98f8a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c941eee10 0x7f3c941ef290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:41.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.007+0000 7f3c98f8a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c941eee10 0x7f3c941ef290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54872/0 (socket says 172.21.15.46:54872) 2024-01-23T08:55:41.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.007+0000 7f3c98f8a640 1 -- 172.21.15.46:0/1520130892 learned_addr learned my addr 172.21.15.46:0/1520130892 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:41.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.011+0000 7f3c93fff640 1 --2- 172.21.15.46:0/1520130892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c941476a0 0x7f3c9415a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:41.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.011+0000 7f3c937fe640 1 --2- 172.21.15.46:0/1520130892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c941efd80 0x7f3c941ee8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:41.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.015+0000 7f3c98f8a640 1 -- 172.21.15.46:0/1520130892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c941476a0 msgr2=0x7f3c9415a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:41.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.015+0000 7f3c98f8a640 1 --2- 172.21.15.46:0/1520130892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c941476a0 0x7f3c9415a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:41.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.015+0000 7f3c98f8a640 1 -- 172.21.15.46:0/1520130892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c941efd80 msgr2=0x7f3c941ee8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:41.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.015+0000 7f3c98f8a640 1 --2- 172.21.15.46:0/1520130892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c941efd80 0x7f3c941ee8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:41.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.015+0000 7f3c98f8a640 1 -- 172.21.15.46:0/1520130892 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c94148480 con 0x7f3c941eee10 2024-01-23T08:55:41.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.015+0000 7f3c98f8a640 1 --2- 172.21.15.46:0/1520130892 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c941eee10 0x7f3c941ef290 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c01c690 tx=0x7f3c8c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:41.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.019+0000 7f3c90ff9640 1 -- 172.21.15.46:0/1520130892 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c0bd070 con 0x7f3c941eee10 2024-01-23T08:55:41.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.019+0000 7f3c90ff9640 1 -- 172.21.15.46:0/1520130892 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8c0ae890 con 0x7f3c941eee10 2024-01-23T08:55:41.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.019+0000 7f3c9a9ed640 1 -- 172.21.15.46:0/1520130892 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c941f01e0 con 0x7f3c941eee10 2024-01-23T08:55:41.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.019+0000 7f3c90ff9640 1 -- 172.21.15.46:0/1520130892 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c0aea20 con 0x7f3c941eee10 2024-01-23T08:55:41.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.019+0000 7f3c9a9ed640 1 -- 172.21.15.46:0/1520130892 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c941596b0 con 0x7f3c941eee10 2024-01-23T08:55:41.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.023+0000 7f3c9a9ed640 1 -- 172.21.15.46:0/1520130892 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c941594e0 con 0x7f3c941eee10 2024-01-23T08:55:41.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.291+0000 7f3c90ff9640 1 -- 172.21.15.46:0/1520130892 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f3c8c0b4040 con 0x7f3c941eee10 2024-01-23T08:55:41.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.291+0000 7f3c90ff9640 1 --2- 172.21.15.46:0/1520130892 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3c80066580 0x7f3c80068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:41.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.291+0000 7f3c93fff640 1 --2- 172.21.15.46:0/1520130892 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3c80066580 0x7f3c80068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:41.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.291+0000 7f3c93fff640 1 --2- 172.21.15.46:0/1520130892 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3c80066580 0x7f3c80068a40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3c84001ec0 tx=0x7f3c84009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:41.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.307+0000 7f3c90ff9640 1 -- 172.21.15.46:0/1520130892 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3c8c0eef30 con 0x7f3c941eee10 2024-01-23T08:55:41.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.307+0000 7f3c90ff9640 1 -- 172.21.15.46:0/1520130892 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f3c8c0eb270 con 0x7f3c941eee10 2024-01-23T08:55:41.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.499+0000 7f3c9a9ed640 1 -- 172.21.15.46:0/1520130892 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3c94074340 con 0x7f3c941eee10 2024-01-23T08:55:41.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.515+0000 7f3c90ff9640 1 -- 172.21.15.46:0/1520130892 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3c8c0b20a0 con 0x7f3c941eee10 2024-01-23T08:55:41.512 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-23T08:55:41.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.515+0000 7f3c9a9ed640 1 -- 172.21.15.46:0/1520130892 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3c80066580 msgr2=0x7f3c80068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:41.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.515+0000 7f3c9a9ed640 1 --2- 172.21.15.46:0/1520130892 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3c80066580 0x7f3c80068a40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3c84001ec0 tx=0x7f3c84009040 comp rx=0 tx=0).stop 2024-01-23T08:55:41.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.515+0000 7f3c9a9ed640 1 -- 172.21.15.46:0/1520130892 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c941eee10 msgr2=0x7f3c941ef290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:41.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.515+0000 7f3c9a9ed640 1 --2- 172.21.15.46:0/1520130892 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c941eee10 0x7f3c941ef290 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c01c690 tx=0x7f3c8c009750 comp rx=0 tx=0).stop 2024-01-23T08:55:41.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.515+0000 7f3c9a9ed640 1 -- 172.21.15.46:0/1520130892 shutdown_connections 2024-01-23T08:55:41.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.515+0000 7f3c9a9ed640 1 --2- 172.21.15.46:0/1520130892 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c941eee10 0x7f3c941ef290 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:41.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.515+0000 7f3c9a9ed640 1 --2- 172.21.15.46:0/1520130892 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3c80066580 0x7f3c80068a40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:41.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.515+0000 7f3c9a9ed640 1 --2- 172.21.15.46:0/1520130892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c941efd80 0x7f3c941ee8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:41.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.515+0000 7f3c9a9ed640 1 --2- 172.21.15.46:0/1520130892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c941476a0 0x7f3c9415a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:41.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.515+0000 7f3c9a9ed640 1 -- 172.21.15.46:0/1520130892 >> 172.21.15.46:0/1520130892 conn(0x7f3c9406b770 msgr2=0x7f3c940c2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:41.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.515+0000 7f3c9a9ed640 1 -- 172.21.15.46:0/1520130892 shutdown_connections 2024-01-23T08:55:41.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.515+0000 7f3c9a9ed640 1 -- 172.21.15.46:0/1520130892 wait complete. 2024-01-23T08:55:41.533 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-23T08:55:41.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.663+0000 7f723367e640 1 Processor -- start 2024-01-23T08:55:41.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.663+0000 7f723367e640 1 -- start start 2024-01-23T08:55:41.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.663+0000 7f723367e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f722c156bc0 0x7f722c0c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:41.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.663+0000 7f723367e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f722c15d310 0x7f722c0c8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:41.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.663+0000 7f723367e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f722c06de40 con 0x7f722c0c1770 2024-01-23T08:55:41.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.663+0000 7f723367e640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f722c072130 con 0x7f722c156bc0 2024-01-23T08:55:41.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.663+0000 7f723367e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f722c0bff60 con 0x7f722c15d310 2024-01-23T08:55:41.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.663+0000 7f723141a640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f722c156bc0 0x7f722c0c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:41.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.663+0000 7f723141a640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f722c156bc0 0x7f722c0c7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54884/0 (socket says 172.21.15.46:54884) 2024-01-23T08:55:41.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.663+0000 7f723141a640 1 -- 172.21.15.46:0/2887604711 learned_addr learned my addr 172.21.15.46:0/2887604711 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:41.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.667+0000 7f7231c1b640 1 --2- 172.21.15.46:0/2887604711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f722c15d310 0x7f722c0c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:41.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.667+0000 7f723141a640 1 -- 172.21.15.46:0/2887604711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f722c15d310 msgr2=0x7f722c0c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:41.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.667+0000 7f723141a640 1 --2- 172.21.15.46:0/2887604711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f722c15d310 0x7f722c0c8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:41.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.667+0000 7f723141a640 1 -- 172.21.15.46:0/2887604711 >> v1:172.21.15.175:6789/0 conn(0x7f722c0c1770 legacy=0x7f722c15cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:41.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.667+0000 7f723141a640 1 -- 172.21.15.46:0/2887604711 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f722c06e0e0 con 0x7f722c156bc0 2024-01-23T08:55:41.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.671+0000 7f723141a640 1 --2- 172.21.15.46:0/2887604711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f722c156bc0 0x7f722c0c7cd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7228009870 tx=0x7f722801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a6869fa106bfa31 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:41.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.675+0000 7f7223fff640 1 -- 172.21.15.46:0/2887604711 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72280aa670 con 0x7f722c156bc0 2024-01-23T08:55:41.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.675+0000 7f7223fff640 1 -- 172.21.15.46:0/2887604711 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72280aa7d0 con 0x7f722c156bc0 2024-01-23T08:55:41.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.675+0000 7f7223fff640 1 -- 172.21.15.46:0/2887604711 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72280aab60 con 0x7f722c156bc0 2024-01-23T08:55:41.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.675+0000 7f723367e640 1 -- 172.21.15.46:0/2887604711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f722c156bc0 msgr2=0x7f722c0c7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:41.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.675+0000 7f723367e640 1 --2- 172.21.15.46:0/2887604711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f722c156bc0 0x7f722c0c7cd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7228009870 tx=0x7f722801c510 comp rx=0 tx=0).stop 2024-01-23T08:55:41.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.675+0000 7f723367e640 1 -- 172.21.15.46:0/2887604711 shutdown_connections 2024-01-23T08:55:41.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.675+0000 7f723367e640 1 --2- 172.21.15.46:0/2887604711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f722c15d310 0x7f722c0c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:41.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.675+0000 7f723367e640 1 --2- 172.21.15.46:0/2887604711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f722c156bc0 0x7f722c0c7cd0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:41.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.675+0000 7f723367e640 1 -- 172.21.15.46:0/2887604711 >> 172.21.15.46:0/2887604711 conn(0x7f722c06aa60 msgr2=0x7f722c06ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:41.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.675+0000 7f723367e640 1 -- 172.21.15.46:0/2887604711 shutdown_connections 2024-01-23T08:55:41.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.675+0000 7f723367e640 1 -- 172.21.15.46:0/2887604711 wait complete. 2024-01-23T08:55:41.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.675+0000 7f723367e640 1 Processor -- start 2024-01-23T08:55:41.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.675+0000 7f723367e640 1 -- start start 2024-01-23T08:55:41.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.675+0000 7f723367e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f722c0c1770 0x7f722c14d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:41.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.675+0000 7f723367e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f722c156bc0 0x7f722c0af200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:41.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.675+0000 7f723367e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f722c15d310 0x7f722c0ad970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:41.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.675+0000 7f723367e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f722c0aead0 con 0x7f722c15d310 2024-01-23T08:55:41.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.675+0000 7f723367e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f722c152350 con 0x7f722c0c1770 2024-01-23T08:55:41.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.675+0000 7f723367e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f722c0ae590 con 0x7f722c156bc0 2024-01-23T08:55:41.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.679+0000 7f7231c1b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f722c15d310 0x7f722c0ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:41.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.679+0000 7f7231c1b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f722c15d310 0x7f722c0ad970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54900/0 (socket says 172.21.15.46:54900) 2024-01-23T08:55:41.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.679+0000 7f7231c1b640 1 -- 172.21.15.46:0/3731926187 learned_addr learned my addr 172.21.15.46:0/3731926187 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:41.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.679+0000 7f7230c19640 1 --2- 172.21.15.46:0/3731926187 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f722c156bc0 0x7f722c0af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:41.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.679+0000 7f723141a640 1 --2- 172.21.15.46:0/3731926187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f722c0c1770 0x7f722c14d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:41.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.683+0000 7f7231c1b640 1 -- 172.21.15.46:0/3731926187 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f722c156bc0 msgr2=0x7f722c0af200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:41.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.683+0000 7f7231c1b640 1 --2- 172.21.15.46:0/3731926187 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f722c156bc0 0x7f722c0af200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:41.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.683+0000 7f7231c1b640 1 -- 172.21.15.46:0/3731926187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f722c0c1770 msgr2=0x7f722c14d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:41.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.683+0000 7f7231c1b640 1 --2- 172.21.15.46:0/3731926187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f722c0c1770 0x7f722c14d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:41.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.683+0000 7f7231c1b640 1 -- 172.21.15.46:0/3731926187 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72280094d0 con 0x7f722c15d310 2024-01-23T08:55:41.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.683+0000 7f7231c1b640 1 --2- 172.21.15.46:0/3731926187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f722c15d310 0x7f722c0ad970 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7224007e60 tx=0x7f722400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:41.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.687+0000 7f7221ffb640 1 -- 172.21.15.46:0/3731926187 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7224014620 con 0x7f722c15d310 2024-01-23T08:55:41.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.687+0000 7f7221ffb640 1 -- 172.21.15.46:0/3731926187 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7224014780 con 0x7f722c15d310 2024-01-23T08:55:41.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.687+0000 7f7221ffb640 1 -- 172.21.15.46:0/3731926187 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7224014b30 con 0x7f722c15d310 2024-01-23T08:55:41.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.687+0000 7f723367e640 1 -- 172.21.15.46:0/3731926187 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f722c0ac920 con 0x7f722c15d310 2024-01-23T08:55:41.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.687+0000 7f723367e640 1 -- 172.21.15.46:0/3731926187 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f722c0acee0 con 0x7f722c15d310 2024-01-23T08:55:41.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.691+0000 7f723367e640 1 -- 172.21.15.46:0/3731926187 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f722c074340 con 0x7f722c15d310 2024-01-23T08:55:41.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.991+0000 7f7221ffb640 1 -- 172.21.15.46:0/3731926187 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f7224014c90 con 0x7f722c15d310 2024-01-23T08:55:41.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.991+0000 7f7221ffb640 1 --2- 172.21.15.46:0/3731926187 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7210066550 0x7f7210068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:41.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.991+0000 7f723141a640 1 --2- 172.21.15.46:0/3731926187 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7210066550 0x7f7210068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:41.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:41.991+0000 7f723141a640 1 --2- 172.21.15.46:0/3731926187 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7210066550 0x7f7210068a10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f72280ae000 tx=0x7f72280b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:42.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.023+0000 7f7221ffb640 1 -- 172.21.15.46:0/3731926187 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f72240561d0 con 0x7f722c15d310 2024-01-23T08:55:42.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.023+0000 7f7221ffb640 1 -- 172.21.15.46:0/3731926187 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f7224052510 con 0x7f722c15d310 2024-01-23T08:55:42.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.199+0000 7f723367e640 1 -- 172.21.15.46:0/3731926187 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f722c06d6e0 con 0x7f722c15d310 2024-01-23T08:55:42.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.203+0000 7f7221ffb640 1 -- 172.21.15.46:0/3731926187 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7224055b30 con 0x7f722c15d310 2024-01-23T08:55:42.202 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-01-23T08:55:42.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.207+0000 7f723367e640 1 -- 172.21.15.46:0/3731926187 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7210066550 msgr2=0x7f7210068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:42.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.207+0000 7f723367e640 1 --2- 172.21.15.46:0/3731926187 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7210066550 0x7f7210068a10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f72280ae000 tx=0x7f72280b5040 comp rx=0 tx=0).stop 2024-01-23T08:55:42.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.207+0000 7f723367e640 1 -- 172.21.15.46:0/3731926187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f722c15d310 msgr2=0x7f722c0ad970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:42.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.207+0000 7f723367e640 1 --2- 172.21.15.46:0/3731926187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f722c15d310 0x7f722c0ad970 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7224007e60 tx=0x7f722400e4b0 comp rx=0 tx=0).stop 2024-01-23T08:55:42.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.207+0000 7f723367e640 1 -- 172.21.15.46:0/3731926187 shutdown_connections 2024-01-23T08:55:42.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.207+0000 7f723367e640 1 --2- 172.21.15.46:0/3731926187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f722c15d310 0x7f722c0ad970 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:42.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.207+0000 7f723367e640 1 --2- 172.21.15.46:0/3731926187 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f722c156bc0 0x7f722c0af200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:42.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.207+0000 7f723367e640 1 --2- 172.21.15.46:0/3731926187 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7210066550 0x7f7210068a10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:42.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.207+0000 7f723367e640 1 --2- 172.21.15.46:0/3731926187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f722c0c1770 0x7f722c14d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:42.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.207+0000 7f723367e640 1 -- 172.21.15.46:0/3731926187 >> 172.21.15.46:0/3731926187 conn(0x7f722c06aa60 msgr2=0x7f722c0c7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:42.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.207+0000 7f723367e640 1 -- 172.21.15.46:0/3731926187 shutdown_connections 2024-01-23T08:55:42.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.207+0000 7f723367e640 1 -- 172.21.15.46:0/3731926187 wait complete. 2024-01-23T08:55:42.223 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-23T08:55:42.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.355+0000 7f5437f19640 1 Processor -- start 2024-01-23T08:55:42.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.355+0000 7f5437f19640 1 -- start start 2024-01-23T08:55:42.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.359+0000 7f5437f19640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54300c7f30 0x7f543006da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:42.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.359+0000 7f5437f19640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f543015a9d0 con 0x7f543006dfd0 2024-01-23T08:55:42.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.359+0000 7f5437f19640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54301573e0 con 0x7f54301518a0 2024-01-23T08:55:42.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.359+0000 7f5437f19640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54301576a0 con 0x7f54300c7f30 2024-01-23T08:55:42.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.359+0000 7f54354b4640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f543006dfd0 0x7f5430151190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38736/0 (socket says 172.21.15.46:38736) 2024-01-23T08:55:42.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.359+0000 7f54354b4640 1 -- 172.21.15.46:0/1354022382 learned_addr learned my addr 172.21.15.46:0/1354022382 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:42.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.359+0000 7f5435cb5640 1 --2- 172.21.15.46:0/1354022382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54300c7f30 0x7f543006da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:42.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.363+0000 7f5434cb3640 1 -- 172.21.15.46:0/1354022382 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 318136502 0 0) 0x7f543015a9d0 con 0x7f543006dfd0 2024-01-23T08:55:42.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.363+0000 7f5434cb3640 1 -- 172.21.15.46:0/1354022382 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f541c003530 con 0x7f543006dfd0 2024-01-23T08:55:42.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.367+0000 7f5434cb3640 1 -- 172.21.15.46:0/1354022382 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3791153433 0 0) 0x7f54301573e0 con 0x7f54301518a0 2024-01-23T08:55:42.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.367+0000 7f5434cb3640 1 -- 172.21.15.46:0/1354022382 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f543015a9d0 con 0x7f54301518a0 2024-01-23T08:55:42.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.367+0000 7f5434cb3640 1 -- 172.21.15.46:0/1354022382 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 437742247 0 0) 0x7f541c003530 con 0x7f543006dfd0 2024-01-23T08:55:42.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.367+0000 7f5434cb3640 1 -- 172.21.15.46:0/1354022382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54300c7f30 msgr2=0x7f543006da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:42.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.367+0000 7f5434cb3640 1 --2- 172.21.15.46:0/1354022382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54300c7f30 0x7f543006da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:42.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.367+0000 7f5434cb3640 1 -- 172.21.15.46:0/1354022382 >> v1:172.21.15.175:6789/0 conn(0x7f54301518a0 legacy=0x7f543015ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:42.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.367+0000 7f5434cb3640 1 -- 172.21.15.46:0/1354022382 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5430157980 con 0x7f543006dfd0 2024-01-23T08:55:42.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.367+0000 7f5434cb3640 1 -- 172.21.15.46:0/1354022382 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466917103 0 0) 0x7f5424001680 con 0x7f543006dfd0 2024-01-23T08:55:42.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.367+0000 7f5434cb3640 1 -- 172.21.15.46:0/1354022382 >> v1:172.21.15.46:6789/0 conn(0x7f543006dfd0 legacy=0x7f5430151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:42.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.367+0000 7f5434cb3640 1 --2- 172.21.15.46:0/1354022382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f541c003bb0 0x7f541c003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:42.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.367+0000 7f5434cb3640 1 --2- 172.21.15.46:0/1354022382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f541c0047d0 0x7f541c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:42.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.367+0000 7f5434cb3640 1 --2- 172.21.15.46:0/1354022382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54300c7f30 0x7f541c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:42.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.367+0000 7f5434cb3640 1 -- 172.21.15.46:0/1354022382 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54301576a0 con 0x7f541c0047d0 2024-01-23T08:55:42.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.367+0000 7f5434cb3640 1 -- 172.21.15.46:0/1354022382 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541c00bac0 con 0x7f541c003bb0 2024-01-23T08:55:42.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.367+0000 7f5434cb3640 1 -- 172.21.15.46:0/1354022382 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541c00bc80 con 0x7f54300c7f30 2024-01-23T08:55:42.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.371+0000 7f54354b4640 1 --2- 172.21.15.46:0/1354022382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f541c0047d0 0x7f541c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:42.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.371+0000 7f54364b6640 1 --2- 172.21.15.46:0/1354022382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54300c7f30 0x7f541c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:42.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.371+0000 7f54354b4640 1 -- 172.21.15.46:0/1354022382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54300c7f30 msgr2=0x7f541c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:42.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.371+0000 7f54354b4640 1 --2- 172.21.15.46:0/1354022382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54300c7f30 0x7f541c0051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:42.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.371+0000 7f54354b4640 1 -- 172.21.15.46:0/1354022382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f541c003bb0 msgr2=0x7f541c003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:42.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.371+0000 7f54354b4640 1 --2- 172.21.15.46:0/1354022382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f541c003bb0 0x7f541c003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:42.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.371+0000 7f54354b4640 1 -- 172.21.15.46:0/1354022382 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541c003530 con 0x7f541c0047d0 2024-01-23T08:55:42.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.379+0000 7f54354b4640 1 --2- 172.21.15.46:0/1354022382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f541c0047d0 0x7f541c004c50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5424007fa0 tx=0x7f542401f290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b40f771ff6b449 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:42.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.383+0000 7f5434cb3640 1 -- 172.21.15.46:0/1354022382 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54240058e0 con 0x7f541c0047d0 2024-01-23T08:55:42.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.383+0000 7f5434cb3640 1 -- 172.21.15.46:0/1354022382 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5424005a40 con 0x7f541c0047d0 2024-01-23T08:55:42.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.383+0000 7f5434cb3640 1 -- 172.21.15.46:0/1354022382 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5424005e90 con 0x7f541c0047d0 2024-01-23T08:55:42.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.383+0000 7f5437f19640 1 -- 172.21.15.46:0/1354022382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f541c0047d0 msgr2=0x7f541c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:42.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.383+0000 7f5437f19640 1 --2- 172.21.15.46:0/1354022382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f541c0047d0 0x7f541c004c50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5424007fa0 tx=0x7f542401f290 comp rx=0 tx=0).stop 2024-01-23T08:55:42.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.383+0000 7f54364b6640 1 -- 172.21.15.46:0/1354022382 reap_dead start 2024-01-23T08:55:42.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.383+0000 7f5437f19640 1 -- 172.21.15.46:0/1354022382 shutdown_connections 2024-01-23T08:55:42.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.383+0000 7f5437f19640 1 -- 172.21.15.46:0/1354022382 >> 172.21.15.46:0/1354022382 conn(0x7f543006aa60 msgr2=0x7f543006ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:42.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.383+0000 7f5437f19640 1 -- 172.21.15.46:0/1354022382 shutdown_connections 2024-01-23T08:55:42.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.383+0000 7f5437f19640 1 -- 172.21.15.46:0/1354022382 wait complete. 2024-01-23T08:55:42.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.383+0000 7f5437f19640 1 Processor -- start 2024-01-23T08:55:42.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.383+0000 7f5437f19640 1 -- start start 2024-01-23T08:55:42.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.383+0000 7f5437f19640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f541c0047d0 0x7f54300c3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:42.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.383+0000 7f5437f19640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54300c3eb0 0x7f54300c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:42.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.383+0000 7f5437f19640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54300c2d10 0x7f54300c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:42.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.383+0000 7f5437f19640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54300c9300 con 0x7f54300c2d10 2024-01-23T08:55:42.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.383+0000 7f5437f19640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54301ebd60 con 0x7f541c0047d0 2024-01-23T08:55:42.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.383+0000 7f5437f19640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54300c43f0 con 0x7f54300c3eb0 2024-01-23T08:55:42.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.387+0000 7f54364b6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54300c2d10 0x7f54300c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:42.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.387+0000 7f54364b6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54300c2d10 0x7f54300c9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54908/0 (socket says 172.21.15.46:54908) 2024-01-23T08:55:42.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.387+0000 7f54364b6640 1 -- 172.21.15.46:0/1978174114 learned_addr learned my addr 172.21.15.46:0/1978174114 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:42.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.387+0000 7f54354b4640 1 --2- 172.21.15.46:0/1978174114 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54300c3eb0 0x7f54300c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:42.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.387+0000 7f5435cb5640 1 --2- 172.21.15.46:0/1978174114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f541c0047d0 0x7f54300c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:42.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.391+0000 7f54364b6640 1 -- 172.21.15.46:0/1978174114 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54300c3eb0 msgr2=0x7f54300c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:42.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.391+0000 7f54364b6640 1 --2- 172.21.15.46:0/1978174114 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54300c3eb0 0x7f54300c9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:42.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.391+0000 7f54364b6640 1 -- 172.21.15.46:0/1978174114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f541c0047d0 msgr2=0x7f54300c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:42.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.391+0000 7f54364b6640 1 --2- 172.21.15.46:0/1978174114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f541c0047d0 0x7f54300c3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:42.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.391+0000 7f54364b6640 1 -- 172.21.15.46:0/1978174114 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54300c8f90 con 0x7f54300c2d10 2024-01-23T08:55:42.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.391+0000 7f54364b6640 1 --2- 172.21.15.46:0/1978174114 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54300c2d10 0x7f54300c9cd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f541c004750 tx=0x7f542800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:42.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.395+0000 7f54227fc640 1 -- 172.21.15.46:0/1978174114 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5428003b80 con 0x7f54300c2d10 2024-01-23T08:55:42.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.395+0000 7f54227fc640 1 -- 172.21.15.46:0/1978174114 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5428003ce0 con 0x7f54300c2d10 2024-01-23T08:55:42.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.395+0000 7f54227fc640 1 -- 172.21.15.46:0/1978174114 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5428005290 con 0x7f54300c2d10 2024-01-23T08:55:42.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.395+0000 7f5437f19640 1 -- 172.21.15.46:0/1978174114 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f543014fee0 con 0x7f54300c2d10 2024-01-23T08:55:42.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.395+0000 7f5437f19640 1 -- 172.21.15.46:0/1978174114 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54301465a0 con 0x7f54300c2d10 2024-01-23T08:55:42.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.395+0000 7f5437f19640 1 -- 172.21.15.46:0/1978174114 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54300c94b0 con 0x7f54300c2d10 2024-01-23T08:55:42.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.703+0000 7f54227fc640 1 -- 172.21.15.46:0/1978174114 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f54280053f0 con 0x7f54300c2d10 2024-01-23T08:55:42.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.703+0000 7f54227fc640 1 --2- 172.21.15.46:0/1978174114 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5414066520 0x7f54140689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:42.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.703+0000 7f5435cb5640 1 --2- 172.21.15.46:0/1978174114 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5414066520 0x7f54140689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:42.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.703+0000 7f5435cb5640 1 --2- 172.21.15.46:0/1978174114 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5414066520 0x7f54140689e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f542c0093f0 tx=0x7f542c0094c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.735+0000 7f54227fc640 1 -- 172.21.15.46:0/1978174114 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5428054bb0 con 0x7f54300c2d10 2024-01-23T08:55:42.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.735+0000 7f54227fc640 1 -- 172.21.15.46:0/1978174114 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5428050ef0 con 0x7f54300c2d10 2024-01-23T08:55:42.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.899+0000 7f5437f19640 1 -- 172.21.15.46:0/1978174114 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f54300c94b0 con 0x7f54300c2d10 2024-01-23T08:55:42.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.915+0000 7f54227fc640 1 -- 172.21.15.46:0/1978174114 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f54300c94b0 con 0x7f54300c2d10 2024-01-23T08:55:42.914 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-23T08:55:42.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.919+0000 7f5437f19640 1 -- 172.21.15.46:0/1978174114 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5414066520 msgr2=0x7f54140689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:42.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.919+0000 7f5437f19640 1 --2- 172.21.15.46:0/1978174114 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5414066520 0x7f54140689e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f542c0093f0 tx=0x7f542c0094c0 comp rx=0 tx=0).stop 2024-01-23T08:55:42.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.919+0000 7f5437f19640 1 -- 172.21.15.46:0/1978174114 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54300c2d10 msgr2=0x7f54300c9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:42.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.919+0000 7f5437f19640 1 --2- 172.21.15.46:0/1978174114 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54300c2d10 0x7f54300c9cd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f541c004750 tx=0x7f542800dc00 comp rx=0 tx=0).stop 2024-01-23T08:55:42.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.919+0000 7f5437f19640 1 -- 172.21.15.46:0/1978174114 shutdown_connections 2024-01-23T08:55:42.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.919+0000 7f5437f19640 1 --2- 172.21.15.46:0/1978174114 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54300c2d10 0x7f54300c9cd0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:42.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.919+0000 7f5437f19640 1 --2- 172.21.15.46:0/1978174114 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54300c3eb0 0x7f54300c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:42.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.919+0000 7f5437f19640 1 --2- 172.21.15.46:0/1978174114 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5414066520 0x7f54140689e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:42.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.919+0000 7f5437f19640 1 --2- 172.21.15.46:0/1978174114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f541c0047d0 0x7f54300c3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:42.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.919+0000 7f5437f19640 1 -- 172.21.15.46:0/1978174114 >> 172.21.15.46:0/1978174114 conn(0x7f543006aa60 msgr2=0x7f543014f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:42.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.919+0000 7f5437f19640 1 -- 172.21.15.46:0/1978174114 shutdown_connections 2024-01-23T08:55:42.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:42.919+0000 7f5437f19640 1 -- 172.21.15.46:0/1978174114 wait complete. 2024-01-23T08:55:42.936 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-23T08:55:43.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.063+0000 7f3e6150d640 1 Processor -- start 2024-01-23T08:55:43.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.063+0000 7f3e6150d640 1 -- start start 2024-01-23T08:55:43.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.063+0000 7f3e6150d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3e5c153b50 0x7f3e5c15d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:43.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.063+0000 7f3e6150d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e5c0ca2b0 0x7f3e5c1641d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:43.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.063+0000 7f3e6150d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e5c15a860 con 0x7f3e5c15a370 2024-01-23T08:55:43.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.063+0000 7f3e6150d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e5c15d2e0 con 0x7f3e5c153b50 2024-01-23T08:55:43.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.063+0000 7f3e6150d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c0c8cc0 con 0x7f3e5c0ca2b0 2024-01-23T08:55:43.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.063+0000 7f3e5affd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3e5c153b50 0x7f3e5c15d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:43.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.063+0000 7f3e53fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3e5c15a370 0x7f3e5c070ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43842/0 (socket says 172.21.15.46:43842) 2024-01-23T08:55:43.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.063+0000 7f3e53fff640 1 -- 172.21.15.46:0/4086514544 learned_addr learned my addr 172.21.15.46:0/4086514544 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:43.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.063+0000 7f3e5b7fe640 1 --2- 172.21.15.46:0/4086514544 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e5c0ca2b0 0x7f3e5c1641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:43.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.071+0000 7f3e5b7fe640 1 -- 172.21.15.46:0/4086514544 >> v2:172.21.15.46:3300/0 conn(0x7f3e5c153b50 msgr2=0x7f3e5c15d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:43.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.071+0000 7f3e5b7fe640 1 --2- 172.21.15.46:0/4086514544 >> v2:172.21.15.46:3300/0 conn(0x7f3e5c153b50 0x7f3e5c15d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:43.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.071+0000 7f3e5b7fe640 1 -- 172.21.15.46:0/4086514544 >> v1:172.21.15.46:6789/0 conn(0x7f3e5c15a370 legacy=0x7f3e5c070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:43.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.071+0000 7f3e5b7fe640 1 -- 172.21.15.46:0/4086514544 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5c0c8f60 con 0x7f3e5c0ca2b0 2024-01-23T08:55:43.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.075+0000 7f3e5b7fe640 1 --2- 172.21.15.46:0/4086514544 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e5c0ca2b0 0x7f3e5c1641d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3e54009d90 tx=0x7f3e5401c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5addbf083cdbf5c3 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:43.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.095+0000 7f3e5a7fc640 1 -- 172.21.15.46:0/4086514544 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e540a59e0 con 0x7f3e5c0ca2b0 2024-01-23T08:55:43.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.095+0000 7f3e5a7fc640 1 -- 172.21.15.46:0/4086514544 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e540a5b40 con 0x7f3e5c0ca2b0 2024-01-23T08:55:43.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.095+0000 7f3e5a7fc640 1 -- 172.21.15.46:0/4086514544 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e540ad440 con 0x7f3e5c0ca2b0 2024-01-23T08:55:43.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.099+0000 7f3e6150d640 1 -- 172.21.15.46:0/4086514544 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e5c0ca2b0 msgr2=0x7f3e5c1641d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:43.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.099+0000 7f3e6150d640 1 --2- 172.21.15.46:0/4086514544 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e5c0ca2b0 0x7f3e5c1641d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3e54009d90 tx=0x7f3e5401c920 comp rx=0 tx=0).stop 2024-01-23T08:55:43.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.099+0000 7f3e6150d640 1 -- 172.21.15.46:0/4086514544 shutdown_connections 2024-01-23T08:55:43.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.099+0000 7f3e6150d640 1 --2- 172.21.15.46:0/4086514544 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e5c0ca2b0 0x7f3e5c1641d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:43.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.099+0000 7f3e6150d640 1 --2- 172.21.15.46:0/4086514544 >> v2:172.21.15.46:3300/0 conn(0x7f3e5c153b50 0x7f3e5c15d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:43.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.099+0000 7f3e6150d640 1 -- 172.21.15.46:0/4086514544 >> 172.21.15.46:0/4086514544 conn(0x7f3e5c06ef50 msgr2=0x7f3e5c06f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:43.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.099+0000 7f3e6150d640 1 -- 172.21.15.46:0/4086514544 shutdown_connections 2024-01-23T08:55:43.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.099+0000 7f3e6150d640 1 -- 172.21.15.46:0/4086514544 wait complete. 2024-01-23T08:55:43.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.099+0000 7f3e6150d640 1 Processor -- start 2024-01-23T08:55:43.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.099+0000 7f3e6150d640 1 -- start start 2024-01-23T08:55:43.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.099+0000 7f3e6150d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e5c0ca2b0 0x7f3e5c148720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:43.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.099+0000 7f3e6150d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e5c153b50 0x7f3e5c14c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:43.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.099+0000 7f3e6150d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e5c15a370 0x7f3e5c0cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:43.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.099+0000 7f3e6150d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c14d040 con 0x7f3e5c15a370 2024-01-23T08:55:43.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.099+0000 7f3e6150d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c1492c0 con 0x7f3e5c153b50 2024-01-23T08:55:43.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.099+0000 7f3e6150d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c14b430 con 0x7f3e5c0ca2b0 2024-01-23T08:55:43.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.099+0000 7f3e5b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e5c15a370 0x7f3e5c0cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:43.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.099+0000 7f3e5b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e5c15a370 0x7f3e5c0cabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35964/0 (socket says 172.21.15.46:35964) 2024-01-23T08:55:43.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.099+0000 7f3e5b7fe640 1 -- 172.21.15.46:0/558392751 learned_addr learned my addr 172.21.15.46:0/558392751 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:43.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.103+0000 7f3e5affd640 1 --2- 172.21.15.46:0/558392751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e5c0ca2b0 0x7f3e5c148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:43.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.103+0000 7f3e5b7fe640 1 -- 172.21.15.46:0/558392751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e5c0ca2b0 msgr2=0x7f3e5c148720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:43.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.103+0000 7f3e5b7fe640 1 --2- 172.21.15.46:0/558392751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e5c0ca2b0 0x7f3e5c148720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:43.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.103+0000 7f3e5b7fe640 1 -- 172.21.15.46:0/558392751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e5c153b50 msgr2=0x7f3e5c14c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:43.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.103+0000 7f3e5b7fe640 1 --2- 172.21.15.46:0/558392751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e5c153b50 0x7f3e5c14c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:43.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.103+0000 7f3e5b7fe640 1 -- 172.21.15.46:0/558392751 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e54009a70 con 0x7f3e5c15a370 2024-01-23T08:55:43.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.107+0000 7f3e5b7fe640 1 --2- 172.21.15.46:0/558392751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e5c15a370 0x7f3e5c0cabc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3e5401a550 tx=0x7f3e540196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:43.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.115+0000 7f3e537fe640 1 -- 172.21.15.46:0/558392751 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e540aece0 con 0x7f3e5c15a370 2024-01-23T08:55:43.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.115+0000 7f3e537fe640 1 -- 172.21.15.46:0/558392751 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e540aee40 con 0x7f3e5c15a370 2024-01-23T08:55:43.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.115+0000 7f3e537fe640 1 -- 172.21.15.46:0/558392751 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e540b7650 con 0x7f3e5c15a370 2024-01-23T08:55:43.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.115+0000 7f3e6150d640 1 -- 172.21.15.46:0/558392751 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e5c14b710 con 0x7f3e5c15a370 2024-01-23T08:55:43.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.115+0000 7f3e6150d640 1 -- 172.21.15.46:0/558392751 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e5c14bcd0 con 0x7f3e5c15a370 2024-01-23T08:55:43.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.115+0000 7f3e6150d640 1 -- 172.21.15.46:0/558392751 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e5c074340 con 0x7f3e5c15a370 2024-01-23T08:55:43.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.439+0000 7f3e537fe640 1 -- 172.21.15.46:0/558392751 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f3e540b4050 con 0x7f3e5c15a370 2024-01-23T08:55:43.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.439+0000 7f3e537fe640 1 --2- 172.21.15.46:0/558392751 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3e3c066580 0x7f3e3c068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:43.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.439+0000 7f3e5affd640 1 --2- 172.21.15.46:0/558392751 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3e3c066580 0x7f3e3c068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:43.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.439+0000 7f3e5affd640 1 --2- 172.21.15.46:0/558392751 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3e3c066580 0x7f3e3c068a40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c009990 tx=0x7f3e4c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:43.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.471+0000 7f3e537fe640 1 -- 172.21.15.46:0/558392751 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3e540f13f0 con 0x7f3e5c15a370 2024-01-23T08:55:43.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.471+0000 7f3e537fe640 1 -- 172.21.15.46:0/558392751 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f3e540ed030 con 0x7f3e5c15a370 2024-01-23T08:55:43.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.683+0000 7f3e6150d640 1 -- 172.21.15.46:0/558392751 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e5c153380 con 0x7f3e5c15a370 2024-01-23T08:55:43.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.727+0000 7f3e537fe640 1 -- 172.21.15.46:0/558392751 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6584 (secure 0 0 0) 0x7f3e540b2020 con 0x7f3e5c15a370 2024-01-23T08:55:43.724 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:55:43.724 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4208,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/397511399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":397511399},{"type":"v1","addr":"172.21.15.175:6835","nonce":397511399}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-23T08:54:42.028655+0000","modified":"2024-01-23T08:55:33.028425+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4242,"mds_1":4239,"mds_2":4234,"mds_3":4228,"mds_4":4214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4214":{"gid":4214,"name":"c","rank":4,"incarnation":17,"state":"up:active","state_seq":21,"addr":"172.21.15.46:6835/1620040020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1620040020},{"type":"v1","addr":"172.21.15.46:6835","nonce":1620040020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4228":{"gid":4228,"name":"b","rank":3,"incarnation":15,"state":"up:active","state_seq":20,"addr":"172.21.15.175:6833/2714415350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2714415350},{"type":"v1","addr":"172.21.15.175:6833","nonce":2714415350}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4234":{"gid":4234,"name":"f","rank":2,"incarnation":13,"state":"up:active","state_seq":19,"addr":"172.21.15.175:6837/3103300888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3103300888},{"type":"v1","addr":"172.21.15.175:6837","nonce":3103300888}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4239":{"gid":4239,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6837/338965660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":338965660},{"type":"v1","addr":"172.21.15.46:6837","nonce":338965660}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4242":{"gid":4242,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":9,"addr":"172.21.15.46:6839/1889172114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1889172114},{"type":"v1","addr":"172.21.15.46:6839","nonce":1889172114}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-23T08:55:43.725 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 18 2024-01-23T08:55:43.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.731+0000 7f3e6150d640 1 -- 172.21.15.46:0/558392751 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3e3c066580 msgr2=0x7f3e3c068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:43.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.731+0000 7f3e6150d640 1 --2- 172.21.15.46:0/558392751 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3e3c066580 0x7f3e3c068a40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c009990 tx=0x7f3e4c008040 comp rx=0 tx=0).stop 2024-01-23T08:55:43.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.731+0000 7f3e6150d640 1 -- 172.21.15.46:0/558392751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e5c15a370 msgr2=0x7f3e5c0cabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:43.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.731+0000 7f3e6150d640 1 --2- 172.21.15.46:0/558392751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e5c15a370 0x7f3e5c0cabc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3e5401a550 tx=0x7f3e540196c0 comp rx=0 tx=0).stop 2024-01-23T08:55:43.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.731+0000 7f3e6150d640 1 -- 172.21.15.46:0/558392751 shutdown_connections 2024-01-23T08:55:43.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.731+0000 7f3e6150d640 1 --2- 172.21.15.46:0/558392751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e5c15a370 0x7f3e5c0cabc0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:43.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.731+0000 7f3e6150d640 1 --2- 172.21.15.46:0/558392751 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3e3c066580 0x7f3e3c068a40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:43.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.731+0000 7f3e6150d640 1 --2- 172.21.15.46:0/558392751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e5c153b50 0x7f3e5c14c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:43.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.731+0000 7f3e6150d640 1 --2- 172.21.15.46:0/558392751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e5c0ca2b0 0x7f3e5c148720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:43.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.731+0000 7f3e6150d640 1 -- 172.21.15.46:0/558392751 >> 172.21.15.46:0/558392751 conn(0x7f3e5c06ef50 msgr2=0x7f3e5c070950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:43.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.731+0000 7f3e6150d640 1 -- 172.21.15.46:0/558392751 shutdown_connections 2024-01-23T08:55:43.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.731+0000 7f3e6150d640 1 -- 172.21.15.46:0/558392751 wait complete. 2024-01-23T08:55:43.747 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-23T08:55:43.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.879+0000 7f6640e25640 1 Processor -- start 2024-01-23T08:55:43.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.879+0000 7f6640e25640 1 -- start start 2024-01-23T08:55:43.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.883+0000 7f6640e25640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f663c153750 0x7f663c072170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:43.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.883+0000 7f6640e25640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f663c15cba0 0x7f663c15d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:43.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.883+0000 7f6640e25640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f663c0c75d0 con 0x7f663c0c7a60 2024-01-23T08:55:43.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.883+0000 7f6640e25640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f663c0c67b0 con 0x7f663c15cba0 2024-01-23T08:55:43.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.883+0000 7f6640e25640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663c0c69c0 con 0x7f663c153750 2024-01-23T08:55:43.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.887+0000 7f663ad9d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f663c15cba0 0x7f663c15d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:43.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.887+0000 7f663ad9d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f663c15cba0 0x7f663c15d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35970/0 (socket says 172.21.15.46:35970) 2024-01-23T08:55:43.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.887+0000 7f663ad9d640 1 -- 172.21.15.46:0/3166972214 learned_addr learned my addr 172.21.15.46:0/3166972214 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:43.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.891+0000 7f663ad9d640 1 -- 172.21.15.46:0/3166972214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f663c153750 msgr2=0x7f663c072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:43.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.891+0000 7f663ad9d640 1 --2- 172.21.15.46:0/3166972214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f663c153750 0x7f663c072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:43.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.891+0000 7f663ad9d640 1 -- 172.21.15.46:0/3166972214 >> v1:172.21.15.175:6789/0 conn(0x7f663c0c7a60 legacy=0x7f663c06a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:43.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.891+0000 7f663ad9d640 1 -- 172.21.15.46:0/3166972214 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c0c6ca0 con 0x7f663c15cba0 2024-01-23T08:55:43.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.895+0000 7f663ad9d640 1 --2- 172.21.15.46:0/3166972214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f663c15cba0 0x7f663c15d050 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6634009e50 tx=0x7f663401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334b9bfd84ae87b1 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:43.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.903+0000 7f663959a640 1 -- 172.21.15.46:0/3166972214 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66340af400 con 0x7f663c15cba0 2024-01-23T08:55:43.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.903+0000 7f663959a640 1 -- 172.21.15.46:0/3166972214 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66340ab050 con 0x7f663c15cba0 2024-01-23T08:55:43.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.903+0000 7f663959a640 1 -- 172.21.15.46:0/3166972214 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66340af780 con 0x7f663c15cba0 2024-01-23T08:55:43.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.903+0000 7f6640e25640 1 -- 172.21.15.46:0/3166972214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f663c15cba0 msgr2=0x7f663c15d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:43.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.903+0000 7f6640e25640 1 --2- 172.21.15.46:0/3166972214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f663c15cba0 0x7f663c15d050 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6634009e50 tx=0x7f663401f1c0 comp rx=0 tx=0).stop 2024-01-23T08:55:43.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.903+0000 7f6640e25640 1 -- 172.21.15.46:0/3166972214 shutdown_connections 2024-01-23T08:55:43.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.903+0000 7f6640e25640 1 --2- 172.21.15.46:0/3166972214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f663c15cba0 0x7f663c15d050 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:43.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.903+0000 7f6640e25640 1 --2- 172.21.15.46:0/3166972214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f663c153750 0x7f663c072170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:43.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.903+0000 7f6640e25640 1 -- 172.21.15.46:0/3166972214 >> 172.21.15.46:0/3166972214 conn(0x7f663c0cbb60 msgr2=0x7f663c0c7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:43.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.903+0000 7f6640e25640 1 -- 172.21.15.46:0/3166972214 shutdown_connections 2024-01-23T08:55:43.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.903+0000 7f6640e25640 1 -- 172.21.15.46:0/3166972214 wait complete. 2024-01-23T08:55:43.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.903+0000 7f6640e25640 1 Processor -- start 2024-01-23T08:55:43.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.903+0000 7f6640e25640 1 -- start start 2024-01-23T08:55:43.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.903+0000 7f6640e25640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f663c0c7a60 0x7f663c152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:43.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.903+0000 7f6640e25640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f663c153750 0x7f663c14bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:43.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.903+0000 7f6640e25640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f663c15cba0 0x7f663c1f2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:43.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.903+0000 7f6640e25640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c154c90 con 0x7f663c15cba0 2024-01-23T08:55:43.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.903+0000 7f6640e25640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c152eb0 con 0x7f663c153750 2024-01-23T08:55:43.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.903+0000 7f6640e25640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663c1556e0 con 0x7f663c0c7a60 2024-01-23T08:55:43.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.907+0000 7f663ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f663c15cba0 0x7f663c1f2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:43.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.907+0000 7f663ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f663c15cba0 0x7f663c1f2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35986/0 (socket says 172.21.15.46:35986) 2024-01-23T08:55:43.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.907+0000 7f663ad9d640 1 -- 172.21.15.46:0/4027330178 learned_addr learned my addr 172.21.15.46:0/4027330178 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:43.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.911+0000 7f663a59c640 1 --2- 172.21.15.46:0/4027330178 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f663c0c7a60 0x7f663c152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:43.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.911+0000 7f663ad9d640 1 -- 172.21.15.46:0/4027330178 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f663c0c7a60 msgr2=0x7f663c152970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:43.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.911+0000 7f663ad9d640 1 --2- 172.21.15.46:0/4027330178 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f663c0c7a60 0x7f663c152970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:43.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.911+0000 7f663ad9d640 1 -- 172.21.15.46:0/4027330178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f663c153750 msgr2=0x7f663c14bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:43.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.911+0000 7f663ad9d640 1 --2- 172.21.15.46:0/4027330178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f663c153750 0x7f663c14bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:43.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.911+0000 7f663ad9d640 1 -- 172.21.15.46:0/4027330178 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6634009b30 con 0x7f663c15cba0 2024-01-23T08:55:43.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.911+0000 7f663ad9d640 1 --2- 172.21.15.46:0/4027330178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f663c15cba0 0x7f663c1f2880 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6634009e50 tx=0x7f663401bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:43.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.919+0000 7f662affd640 1 -- 172.21.15.46:0/4027330178 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66340c1070 con 0x7f663c15cba0 2024-01-23T08:55:43.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.919+0000 7f662affd640 1 -- 172.21.15.46:0/4027330178 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66340afb40 con 0x7f663c15cba0 2024-01-23T08:55:43.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.919+0000 7f662affd640 1 -- 172.21.15.46:0/4027330178 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66340b9410 con 0x7f663c15cba0 2024-01-23T08:55:43.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.919+0000 7f6640e25640 1 -- 172.21.15.46:0/4027330178 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663c0ca8b0 con 0x7f663c15cba0 2024-01-23T08:55:43.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.919+0000 7f6640e25640 1 -- 172.21.15.46:0/4027330178 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663c1541a0 con 0x7f663c15cba0 2024-01-23T08:55:43.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.919+0000 7f6640e25640 1 -- 172.21.15.46:0/4027330178 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f663c074340 con 0x7f663c15cba0 2024-01-23T08:55:43.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.943+0000 7f662affd640 1 -- 172.21.15.46:0/4027330178 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f66340b6050 con 0x7f663c15cba0 2024-01-23T08:55:43.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.943+0000 7f662affd640 1 --2- 172.21.15.46:0/4027330178 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f661c066550 0x7f661c068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:43.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.943+0000 7f663a59c640 1 --2- 172.21.15.46:0/4027330178 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f661c066550 0x7f661c068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:43.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.943+0000 7f663a59c640 1 --2- 172.21.15.46:0/4027330178 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f661c066550 0x7f661c068a10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6630006fd0 tx=0x7f6630008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:43.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:43.943+0000 7f662affd640 1 -- 172.21.15.46:0/4027330178 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f66340f37e0 con 0x7f663c15cba0 2024-01-23T08:55:44.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.239+0000 7f662affd640 1 -- 172.21.15.46:0/4027330178 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f66340ef420 con 0x7f663c15cba0 2024-01-23T08:55:44.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.399+0000 7f6640e25640 1 -- 172.21.15.46:0/4027330178 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f663c0c2b80 con 0x7f663c15cba0 2024-01-23T08:55:44.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.463+0000 7f662affd640 1 -- 172.21.15.46:0/4027330178 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f66340b4030 con 0x7f663c15cba0 2024-01-23T08:55:44.461 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:55:44.461 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":28,"fsid":"fdbdd393-f422-45ae-a488-2bbb0163e580","created":"2024-01-23T08:53:36.942515+0000","modified":"2024-01-23T08:54:50.465916+0000","last_up_change":"2024-01-23T08:53:57.198113+0000","last_in_change":"2024-01-23T08:53:47.852614+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-23T08:53:59.340853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-23T08:54:38.278770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-23T08:54:40.216521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-23T08:54:47.311079+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f32c3d7d-e32a-42d8-b55f-db874d915a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6818","nonce":2681790976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6821","nonce":2681790976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6825","nonce":2681790976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6823","nonce":2681790976}]},"public_addr":"172.21.15.46:6818/2681790976","cluster_addr":"172.21.15.46:6821/2681790976","heartbeat_back_addr":"172.21.15.46:6825/2681790976","heartbeat_front_addr":"172.21.15.46:6823/2681790976","state":["exists","up"]},{"osd":1,"uuid":"6f3b6bd2-bbea-4d08-84d5-4407363b5eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6803","nonce":3679152623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6805","nonce":3679152623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6809","nonce":3679152623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6807","nonce":3679152623}]},"public_addr":"172.21.15.46:6803/3679152623","cluster_addr":"172.21.15.46:6805/3679152623","heartbeat_back_addr":"172.21.15.46:6809/3679152623","heartbeat_front_addr":"172.21.15.46:6807/3679152623","state":["exists","up"]},{"osd":2,"uuid":"8f110727-31e7-4f69-926b-c87481d4d28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6811","nonce":3869652274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6813","nonce":3869652274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6820","nonce":3869652274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6815","nonce":3869652274}]},"public_addr":"172.21.15.46:6811/3869652274","cluster_addr":"172.21.15.46:6813/3869652274","heartbeat_back_addr":"172.21.15.46:6820/3869652274","heartbeat_front_addr":"172.21.15.46:6815/3869652274","state":["exists","up"]},{"osd":3,"uuid":"3aa7527d-0463-4373-b9c7-e6b507a7987f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6827","nonce":4168860822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6829","nonce":4168860822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6833","nonce":4168860822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6831","nonce":4168860822}]},"public_addr":"172.21.15.46:6827/4168860822","cluster_addr":"172.21.15.46:6829/4168860822","heartbeat_back_addr":"172.21.15.46:6833/4168860822","heartbeat_front_addr":"172.21.15.46:6831/4168860822","state":["exists","up"]},{"osd":4,"uuid":"eb47a1e5-9f26-465f-b188-87c6eed63c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6805","nonce":3115257412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6808","nonce":3115257412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6815","nonce":3115257412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6812","nonce":3115257412}]},"public_addr":"172.21.15.175:6805/3115257412","cluster_addr":"172.21.15.175:6808/3115257412","heartbeat_back_addr":"172.21.15.175:6815/3115257412","heartbeat_front_addr":"172.21.15.175:6812/3115257412","state":["exists","up"]},{"osd":5,"uuid":"34048409-998c-44f3-a29d-dcad7a6c917b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6818","nonce":3146473948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6822","nonce":3146473948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6831","nonce":3146473948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6826","nonce":3146473948}]},"public_addr":"172.21.15.175:6818/3146473948","cluster_addr":"172.21.15.175:6822/3146473948","heartbeat_back_addr":"172.21.15.175:6831/3146473948","heartbeat_front_addr":"172.21.15.175:6826/3146473948","state":["exists","up"]},{"osd":6,"uuid":"f5d45d3f-9af3-44a1-a730-c260ed1654b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6801","nonce":4161180058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6804","nonce":4161180058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6814","nonce":4161180058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6809","nonce":4161180058}]},"public_addr":"172.21.15.175:6801/4161180058","cluster_addr":"172.21.15.175:6804/4161180058","heartbeat_back_addr":"172.21.15.175:6814/4161180058","heartbeat_front_addr":"172.21.15.175:6809/4161180058","state":["exists","up"]},{"osd":7,"uuid":"16d12e53-2ad3-4b5c-a789-22b45056fd9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6819","nonce":2670236415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6823","nonce":2670236415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6830","nonce":2670236415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6827","nonce":2670236415}]},"public_addr":"172.21.15.175:6819/2670236415","cluster_addr":"172.21.15.175:6823/2670236415","heartbeat_back_addr":"172.21.15.175:6830/2670236415","heartbeat_front_addr":"172.21.15.175:6827/2670236415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.847037+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.765547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.716122+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.874628+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.786580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.924885+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.285635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.898130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T08:55:44.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.463+0000 7f6640e25640 1 -- 172.21.15.46:0/4027330178 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f661c066550 msgr2=0x7f661c068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:44.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.463+0000 7f6640e25640 1 --2- 172.21.15.46:0/4027330178 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f661c066550 0x7f661c068a10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6630006fd0 tx=0x7f6630008040 comp rx=0 tx=0).stop 2024-01-23T08:55:44.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.463+0000 7f6640e25640 1 -- 172.21.15.46:0/4027330178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f663c15cba0 msgr2=0x7f663c1f2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:44.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.463+0000 7f6640e25640 1 --2- 172.21.15.46:0/4027330178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f663c15cba0 0x7f663c1f2880 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6634009e50 tx=0x7f663401bf60 comp rx=0 tx=0).stop 2024-01-23T08:55:44.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.467+0000 7f6640e25640 1 -- 172.21.15.46:0/4027330178 shutdown_connections 2024-01-23T08:55:44.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.467+0000 7f6640e25640 1 --2- 172.21.15.46:0/4027330178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f663c15cba0 0x7f663c1f2880 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:44.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.467+0000 7f6640e25640 1 --2- 172.21.15.46:0/4027330178 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f661c066550 0x7f661c068a10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:44.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.467+0000 7f6640e25640 1 --2- 172.21.15.46:0/4027330178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f663c153750 0x7f663c14bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:44.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.467+0000 7f6640e25640 1 --2- 172.21.15.46:0/4027330178 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f663c0c7a60 0x7f663c152970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:44.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.467+0000 7f6640e25640 1 -- 172.21.15.46:0/4027330178 >> 172.21.15.46:0/4027330178 conn(0x7f663c0cbb60 msgr2=0x7f663c06f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:44.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.467+0000 7f6640e25640 1 -- 172.21.15.46:0/4027330178 shutdown_connections 2024-01-23T08:55:44.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.467+0000 7f6640e25640 1 -- 172.21.15.46:0/4027330178 wait complete. 2024-01-23T08:55:44.485 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-23T08:53:59.340853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-23T08:54:38.278770+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-23T08:54:40.216521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-23T08:54:47.311079+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-23T08:55:44.485 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-23T08:55:44.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.619+0000 7f522eada640 1 Processor -- start 2024-01-23T08:55:44.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.619+0000 7f522eada640 1 -- start start 2024-01-23T08:55:44.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.619+0000 7f522eada640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5228150500 0x7f52280c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:44.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.619+0000 7f522eada640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52280c2e00 0x7f5228156250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:44.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.619+0000 7f522eada640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f522806e460 0x7f522815a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:44.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.619+0000 7f522eada640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5228156790 con 0x7f522806e460 2024-01-23T08:55:44.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.619+0000 7f522eada640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5228156a20 con 0x7f5228150500 2024-01-23T08:55:44.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.619+0000 7f522eada640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5228156d00 con 0x7f52280c2e00 2024-01-23T08:55:44.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.619+0000 7f5227fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52280c2e00 0x7f5228156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:44.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.619+0000 7f522c876640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5228150500 0x7f52280c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:44.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.623+0000 7f522c876640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5228150500 0x7f52280c5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:42332/0 (socket says 172.21.15.46:42332) 2024-01-23T08:55:44.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.623+0000 7f522c876640 1 -- 172.21.15.46:0/2168688030 learned_addr learned my addr 172.21.15.46:0/2168688030 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:44.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.627+0000 7f5227fff640 1 -- 172.21.15.46:0/2168688030 >> v2:172.21.15.175:3300/0 conn(0x7f5228150500 msgr2=0x7f52280c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:44.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.627+0000 7f5227fff640 1 --2- 172.21.15.46:0/2168688030 >> v2:172.21.15.175:3300/0 conn(0x7f5228150500 0x7f52280c5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:44.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.627+0000 7f5227fff640 1 -- 172.21.15.46:0/2168688030 >> v2:172.21.15.46:3300/0 conn(0x7f522806e460 msgr2=0x7f522815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:44.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.627+0000 7f5227fff640 1 --2- 172.21.15.46:0/2168688030 >> v2:172.21.15.46:3300/0 conn(0x7f522806e460 0x7f522815a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:44.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.627+0000 7f5227fff640 1 -- 172.21.15.46:0/2168688030 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5228156fe0 con 0x7f52280c2e00 2024-01-23T08:55:44.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.631+0000 7f5227fff640 1 --2- 172.21.15.46:0/2168688030 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52280c2e00 0x7f5228156250 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f52280c9a30 tx=0x7f521001ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7960a13b8871d272 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:44.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.643+0000 7f52277fe640 1 -- 172.21.15.46:0/2168688030 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52100a8910 con 0x7f52280c2e00 2024-01-23T08:55:44.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.643+0000 7f52277fe640 1 -- 172.21.15.46:0/2168688030 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52100a8a70 con 0x7f52280c2e00 2024-01-23T08:55:44.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.643+0000 7f52277fe640 1 -- 172.21.15.46:0/2168688030 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52100a8e00 con 0x7f52280c2e00 2024-01-23T08:55:44.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.643+0000 7f522eada640 1 -- 172.21.15.46:0/2168688030 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52280c2e00 msgr2=0x7f5228156250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:44.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.643+0000 7f522eada640 1 --2- 172.21.15.46:0/2168688030 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52280c2e00 0x7f5228156250 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f52280c9a30 tx=0x7f521001ec50 comp rx=0 tx=0).stop 2024-01-23T08:55:44.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.643+0000 7f522eada640 1 -- 172.21.15.46:0/2168688030 shutdown_connections 2024-01-23T08:55:44.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.643+0000 7f522eada640 1 --2- 172.21.15.46:0/2168688030 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52280c2e00 0x7f5228156250 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:44.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.643+0000 7f522eada640 1 --2- 172.21.15.46:0/2168688030 >> v2:172.21.15.46:3300/0 conn(0x7f522806e460 0x7f522815a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:44.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.643+0000 7f522eada640 1 --2- 172.21.15.46:0/2168688030 >> v2:172.21.15.175:3300/0 conn(0x7f5228150500 0x7f52280c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:44.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.643+0000 7f522eada640 1 -- 172.21.15.46:0/2168688030 >> 172.21.15.46:0/2168688030 conn(0x7f522806b770 msgr2=0x7f522806bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:44.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.643+0000 7f522eada640 1 -- 172.21.15.46:0/2168688030 shutdown_connections 2024-01-23T08:55:44.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.643+0000 7f522eada640 1 -- 172.21.15.46:0/2168688030 wait complete. 2024-01-23T08:55:44.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.647+0000 7f522eada640 1 Processor -- start 2024-01-23T08:55:44.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.647+0000 7f522eada640 1 -- start start 2024-01-23T08:55:44.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.647+0000 7f522eada640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f522806e460 0x7f522814c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:44.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.647+0000 7f522eada640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52280c2e00 0x7f52280c4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:44.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.647+0000 7f522eada640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5228150500 0x7f52281dfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:44.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.647+0000 7f522eada640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52281e4570 con 0x7f522806e460 2024-01-23T08:55:44.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.647+0000 7f522eada640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52280c3bc0 con 0x7f5228150500 2024-01-23T08:55:44.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.647+0000 7f522eada640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52281f0e30 con 0x7f52280c2e00 2024-01-23T08:55:44.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.647+0000 7f522c876640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f522806e460 0x7f522814c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:44.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.647+0000 7f522c876640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f522806e460 0x7f522814c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35992/0 (socket says 172.21.15.46:35992) 2024-01-23T08:55:44.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.647+0000 7f522c876640 1 -- 172.21.15.46:0/2967491516 learned_addr learned my addr 172.21.15.46:0/2967491516 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:44.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.651+0000 7f5227fff640 1 --2- 172.21.15.46:0/2967491516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52280c2e00 0x7f52280c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:44.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.651+0000 7f522d077640 1 --2- 172.21.15.46:0/2967491516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5228150500 0x7f52281dfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:44.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.651+0000 7f522c876640 1 -- 172.21.15.46:0/2967491516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52280c2e00 msgr2=0x7f52280c4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:44.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.651+0000 7f522c876640 1 --2- 172.21.15.46:0/2967491516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52280c2e00 0x7f52280c4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:44.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.651+0000 7f522c876640 1 -- 172.21.15.46:0/2967491516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5228150500 msgr2=0x7f52281dfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:44.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.651+0000 7f522c876640 1 --2- 172.21.15.46:0/2967491516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5228150500 0x7f52281dfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:44.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.651+0000 7f522c876640 1 -- 172.21.15.46:0/2967491516 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5210009420 con 0x7f522806e460 2024-01-23T08:55:44.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.655+0000 7f522c876640 1 --2- 172.21.15.46:0/2967491516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f522806e460 0x7f522814c4c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f522000e7f0 tx=0x7f522000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:44.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.659+0000 7f52257fa640 1 -- 172.21.15.46:0/2967491516 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220009580 con 0x7f522806e460 2024-01-23T08:55:44.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.659+0000 7f52257fa640 1 -- 172.21.15.46:0/2967491516 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522000c940 con 0x7f522806e460 2024-01-23T08:55:44.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.659+0000 7f52257fa640 1 -- 172.21.15.46:0/2967491516 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522000ccf0 con 0x7f522806e460 2024-01-23T08:55:44.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.659+0000 7f522eada640 1 -- 172.21.15.46:0/2967491516 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52281eac70 con 0x7f522806e460 2024-01-23T08:55:44.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.659+0000 7f522eada640 1 -- 172.21.15.46:0/2967491516 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52280c5290 con 0x7f522806e460 2024-01-23T08:55:44.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.659+0000 7f522eada640 1 -- 172.21.15.46:0/2967491516 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5228074340 con 0x7f522806e460 2024-01-23T08:55:44.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.683+0000 7f52257fa640 1 -- 172.21.15.46:0/2967491516 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5220013470 con 0x7f522806e460 2024-01-23T08:55:44.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.683+0000 7f52257fa640 1 --2- 172.21.15.46:0/2967491516 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5208066550 0x7f5208068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:44.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.683+0000 7f5227fff640 1 --2- 172.21.15.46:0/2967491516 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5208066550 0x7f5208068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:44.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.687+0000 7f5227fff640 1 --2- 172.21.15.46:0/2967491516 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5208066550 0x7f5208068a10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f52100b2000 tx=0x7f52100aa070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:44.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:44.687+0000 7f52257fa640 1 -- 172.21.15.46:0/2967491516 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5220055e20 con 0x7f522806e460 2024-01-23T08:55:45.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.011+0000 7f52257fa640 1 -- 172.21.15.46:0/2967491516 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5220051a60 con 0x7f522806e460 2024-01-23T08:55:45.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.183+0000 7f522eada640 1 -- 172.21.15.46:0/2967491516 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f52280c1950 con 0x7f522806e460 2024-01-23T08:55:45.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.267+0000 7f52257fa640 1 -- 172.21.15.46:0/2967491516 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5220021020 con 0x7f522806e460 2024-01-23T08:55:45.266 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-01-23T08:55:45.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.271+0000 7f522eada640 1 -- 172.21.15.46:0/2967491516 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5208066550 msgr2=0x7f5208068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:45.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.271+0000 7f522eada640 1 --2- 172.21.15.46:0/2967491516 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5208066550 0x7f5208068a10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f52100b2000 tx=0x7f52100aa070 comp rx=0 tx=0).stop 2024-01-23T08:55:45.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.271+0000 7f522eada640 1 -- 172.21.15.46:0/2967491516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f522806e460 msgr2=0x7f522814c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:45.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.271+0000 7f522eada640 1 --2- 172.21.15.46:0/2967491516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f522806e460 0x7f522814c4c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f522000e7f0 tx=0x7f522000ecb0 comp rx=0 tx=0).stop 2024-01-23T08:55:45.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.271+0000 7f522eada640 1 -- 172.21.15.46:0/2967491516 shutdown_connections 2024-01-23T08:55:45.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.271+0000 7f522eada640 1 --2- 172.21.15.46:0/2967491516 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5208066550 0x7f5208068a10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:45.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.271+0000 7f522eada640 1 --2- 172.21.15.46:0/2967491516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5228150500 0x7f52281dfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:45.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.271+0000 7f522eada640 1 --2- 172.21.15.46:0/2967491516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52280c2e00 0x7f52280c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:45.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.271+0000 7f522eada640 1 --2- 172.21.15.46:0/2967491516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f522806e460 0x7f522814c4c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:45.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.271+0000 7f522eada640 1 -- 172.21.15.46:0/2967491516 >> 172.21.15.46:0/2967491516 conn(0x7f522806b770 msgr2=0x7f52280c8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:45.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.271+0000 7f522eada640 1 -- 172.21.15.46:0/2967491516 shutdown_connections 2024-01-23T08:55:45.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.271+0000 7f522eada640 1 -- 172.21.15.46:0/2967491516 wait complete. 2024-01-23T08:55:45.292 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-23T08:55:45.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.423+0000 7f32aac83640 1 Processor -- start 2024-01-23T08:55:45.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.423+0000 7f32aac83640 1 -- start start 2024-01-23T08:55:45.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.423+0000 7f32aac83640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f32a415cf30 0x7f32a40c4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:45.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.423+0000 7f32aac83640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32a415d310 0x7f32a4153470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:45.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.423+0000 7f32aac83640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32a40c6790 con 0x7f32a40c7ad0 2024-01-23T08:55:45.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.423+0000 7f32aac83640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32a40c4680 con 0x7f32a415cf30 2024-01-23T08:55:45.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.423+0000 7f32aac83640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a40c6a30 con 0x7f32a415d310 2024-01-23T08:55:45.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.423+0000 7f32a3fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f32a40c7ad0 0x7f32a4072200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43856/0 (socket says 172.21.15.46:43856) 2024-01-23T08:55:45.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.423+0000 7f32a3fff640 1 -- 172.21.15.46:0/3734038618 learned_addr learned my addr 172.21.15.46:0/3734038618 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:45.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.423+0000 7f32a9220640 1 --2- 172.21.15.46:0/3734038618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32a415d310 0x7f32a4153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:45.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.427+0000 7f32a37fe640 1 -- 172.21.15.46:0/3734038618 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2264785490 0 0) 0x7f32a40c6790 con 0x7f32a40c7ad0 2024-01-23T08:55:45.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.427+0000 7f32a37fe640 1 -- 172.21.15.46:0/3734038618 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3290003530 con 0x7f32a40c7ad0 2024-01-23T08:55:45.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.431+0000 7f32a37fe640 1 -- 172.21.15.46:0/3734038618 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2688166920 0 0) 0x7f3290003530 con 0x7f32a40c7ad0 2024-01-23T08:55:45.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.431+0000 7f32a37fe640 1 -- 172.21.15.46:0/3734038618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32a415d310 msgr2=0x7f32a4153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:45.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.431+0000 7f32a37fe640 1 --2- 172.21.15.46:0/3734038618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32a415d310 0x7f32a4153470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:45.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.431+0000 7f32a37fe640 1 -- 172.21.15.46:0/3734038618 >> v2:172.21.15.175:3300/0 conn(0x7f32a415cf30 msgr2=0x7f32a40c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:45.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.431+0000 7f32a37fe640 1 --2- 172.21.15.46:0/3734038618 >> v2:172.21.15.175:3300/0 conn(0x7f32a415cf30 0x7f32a40c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:45.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.431+0000 7f32a37fe640 1 -- 172.21.15.46:0/3734038618 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a40c6d10 con 0x7f32a40c7ad0 2024-01-23T08:55:45.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.431+0000 7f32a37fe640 1 -- 172.21.15.46:0/3734038618 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466917103 0 0) 0x7f3294001a20 con 0x7f32a40c7ad0 2024-01-23T08:55:45.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.431+0000 7f32a37fe640 1 -- 172.21.15.46:0/3734038618 >> v1:172.21.15.46:6789/0 conn(0x7f32a40c7ad0 legacy=0x7f32a4072200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:45.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.431+0000 7f32a37fe640 1 --2- 172.21.15.46:0/3734038618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32a415d310 0x7f32900039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:45.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.431+0000 7f32a37fe640 1 --2- 172.21.15.46:0/3734038618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3290003fc0 0x7f32900047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:45.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.431+0000 7f32a37fe640 1 --2- 172.21.15.46:0/3734038618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3290004d10 0x7f3290005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:45.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.431+0000 7f32a37fe640 1 -- 172.21.15.46:0/3734038618 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a40c4680 con 0x7f3290003fc0 2024-01-23T08:55:45.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.431+0000 7f32a37fe640 1 -- 172.21.15.46:0/3734038618 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a40c6a30 con 0x7f3290004d10 2024-01-23T08:55:45.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.431+0000 7f32a37fe640 1 -- 172.21.15.46:0/3734038618 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329000bc20 con 0x7f32a415d310 2024-01-23T08:55:45.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.435+0000 7f32a3fff640 1 --2- 172.21.15.46:0/3734038618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3290003fc0 0x7f32900047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:45.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.435+0000 7f32a8a1f640 1 --2- 172.21.15.46:0/3734038618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32a415d310 0x7f32900039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:45.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.439+0000 7f32a3fff640 1 -- 172.21.15.46:0/3734038618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32a415d310 msgr2=0x7f32900039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:45.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.439+0000 7f32a3fff640 1 --2- 172.21.15.46:0/3734038618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32a415d310 0x7f32900039f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:45.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.439+0000 7f32a3fff640 1 -- 172.21.15.46:0/3734038618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3290004d10 msgr2=0x7f3290005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:45.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.439+0000 7f32a3fff640 1 --2- 172.21.15.46:0/3734038618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3290004d10 0x7f3290005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:45.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.439+0000 7f32a3fff640 1 -- 172.21.15.46:0/3734038618 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3290003530 con 0x7f3290003fc0 2024-01-23T08:55:45.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.439+0000 7f32a3fff640 1 --2- 172.21.15.46:0/3734038618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3290003fc0 0x7f32900047d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f329400a780 tx=0x7f329401d260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ca4af52ed5a68c server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:45.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.443+0000 7f32a37fe640 1 -- 172.21.15.46:0/3734038618 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32940a5c80 con 0x7f3290003fc0 2024-01-23T08:55:45.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.443+0000 7f32a37fe640 1 -- 172.21.15.46:0/3734038618 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32940a5e00 con 0x7f3290003fc0 2024-01-23T08:55:45.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.443+0000 7f32a37fe640 1 -- 172.21.15.46:0/3734038618 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32940ae6b0 con 0x7f3290003fc0 2024-01-23T08:55:45.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.447+0000 7f32aac83640 1 -- 172.21.15.46:0/3734038618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3290003fc0 msgr2=0x7f32900047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:45.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.447+0000 7f32aac83640 1 --2- 172.21.15.46:0/3734038618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3290003fc0 0x7f32900047d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f329400a780 tx=0x7f329401d260 comp rx=0 tx=0).stop 2024-01-23T08:55:45.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.447+0000 7f32a9220640 1 -- 172.21.15.46:0/3734038618 reap_dead start 2024-01-23T08:55:45.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.447+0000 7f32aac83640 1 -- 172.21.15.46:0/3734038618 shutdown_connections 2024-01-23T08:55:45.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.447+0000 7f32aac83640 1 -- 172.21.15.46:0/3734038618 >> 172.21.15.46:0/3734038618 conn(0x7f32a406fa20 msgr2=0x7f32a40c8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:45.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.447+0000 7f32aac83640 1 -- 172.21.15.46:0/3734038618 shutdown_connections 2024-01-23T08:55:45.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.447+0000 7f32aac83640 1 -- 172.21.15.46:0/3734038618 wait complete. 2024-01-23T08:55:45.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.447+0000 7f32aac83640 1 Processor -- start 2024-01-23T08:55:45.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.447+0000 7f32aac83640 1 -- start start 2024-01-23T08:55:45.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.447+0000 7f32aac83640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3290003fc0 0x7f32a413dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:45.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.447+0000 7f32aac83640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32a413ea60 0x7f32a40ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:45.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.447+0000 7f32aac83640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32a40ca5e0 0x7f32a41453c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:45.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.447+0000 7f32aac83640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a40c9db0 con 0x7f32a413ea60 2024-01-23T08:55:45.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.447+0000 7f32aac83640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a4144690 con 0x7f32a40ca5e0 2024-01-23T08:55:45.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.447+0000 7f32aac83640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a4144f30 con 0x7f3290003fc0 2024-01-23T08:55:45.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.447+0000 7f32a3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32a413ea60 0x7f32a40ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:45.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.447+0000 7f32a3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32a413ea60 0x7f32a40ca0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36004/0 (socket says 172.21.15.46:36004) 2024-01-23T08:55:45.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.447+0000 7f32a3fff640 1 -- 172.21.15.46:0/3813438395 learned_addr learned my addr 172.21.15.46:0/3813438395 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:45.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.451+0000 7f32a8a1f640 1 --2- 172.21.15.46:0/3813438395 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3290003fc0 0x7f32a413dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:45.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.451+0000 7f32a3fff640 1 -- 172.21.15.46:0/3813438395 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3290003fc0 msgr2=0x7f32a413dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:45.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.451+0000 7f32a3fff640 1 --2- 172.21.15.46:0/3813438395 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3290003fc0 0x7f32a413dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:45.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.451+0000 7f32a3fff640 1 -- 172.21.15.46:0/3813438395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32a40ca5e0 msgr2=0x7f32a41453c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:45.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.451+0000 7f32a3fff640 1 --2- 172.21.15.46:0/3813438395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32a40ca5e0 0x7f32a41453c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:45.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.451+0000 7f32a3fff640 1 -- 172.21.15.46:0/3813438395 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a4144950 con 0x7f32a413ea60 2024-01-23T08:55:45.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.603+0000 7f32a3fff640 1 --2- 172.21.15.46:0/3813438395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32a413ea60 0x7f32a40ca0a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f329401d090 tx=0x7f3290005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:45.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.647+0000 7f32a17fa640 1 -- 172.21.15.46:0/3813438395 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32940b2070 con 0x7f32a413ea60 2024-01-23T08:55:45.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.647+0000 7f32a17fa640 1 -- 172.21.15.46:0/3813438395 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32940b3040 con 0x7f32a413ea60 2024-01-23T08:55:45.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.647+0000 7f32aac83640 1 -- 172.21.15.46:0/3813438395 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a40caae0 con 0x7f32a413ea60 2024-01-23T08:55:45.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.647+0000 7f32a17fa640 1 -- 172.21.15.46:0/3813438395 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32940ae6b0 con 0x7f32a413ea60 2024-01-23T08:55:45.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.647+0000 7f32aac83640 1 -- 172.21.15.46:0/3813438395 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a40cb0a0 con 0x7f32a413ea60 2024-01-23T08:55:45.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.651+0000 7f32aac83640 1 -- 172.21.15.46:0/3813438395 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32a4074340 con 0x7f32a413ea60 2024-01-23T08:55:45.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.679+0000 7f32a17fa640 1 -- 172.21.15.46:0/3813438395 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f32940ab070 con 0x7f32a413ea60 2024-01-23T08:55:45.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.679+0000 7f32a17fa640 1 --2- 172.21.15.46:0/3813438395 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3284066550 0x7f3284068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:45.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.679+0000 7f32a8a1f640 1 --2- 172.21.15.46:0/3813438395 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3284066550 0x7f3284068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:45.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.683+0000 7f32a8a1f640 1 --2- 172.21.15.46:0/3813438395 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3284066550 0x7f3284068a10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f328c00aa80 tx=0x7f328c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:45.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.683+0000 7f32a17fa640 1 -- 172.21.15.46:0/3813438395 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f32940ef1c0 con 0x7f32a413ea60 2024-01-23T08:55:45.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:45.939+0000 7f32a17fa640 1 -- 172.21.15.46:0/3813438395 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f32940eb500 con 0x7f32a413ea60 2024-01-23T08:55:46.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.115+0000 7f32aac83640 1 -- 172.21.15.46:0/3813438395 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f32a4152b90 con 0x7f32a413ea60 2024-01-23T08:55:46.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.135+0000 7f32a17fa640 1 -- 172.21.15.46:0/3813438395 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f32940bd020 con 0x7f32a413ea60 2024-01-23T08:55:46.133 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-23T08:55:46.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.135+0000 7f32aac83640 1 -- 172.21.15.46:0/3813438395 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3284066550 msgr2=0x7f3284068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:46.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.135+0000 7f32aac83640 1 --2- 172.21.15.46:0/3813438395 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3284066550 0x7f3284068a10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f328c00aa80 tx=0x7f328c008040 comp rx=0 tx=0).stop 2024-01-23T08:55:46.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.135+0000 7f32aac83640 1 -- 172.21.15.46:0/3813438395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32a413ea60 msgr2=0x7f32a40ca0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:46.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.135+0000 7f32aac83640 1 --2- 172.21.15.46:0/3813438395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32a413ea60 0x7f32a40ca0a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f329401d090 tx=0x7f3290005800 comp rx=0 tx=0).stop 2024-01-23T08:55:46.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.139+0000 7f32aac83640 1 -- 172.21.15.46:0/3813438395 shutdown_connections 2024-01-23T08:55:46.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.139+0000 7f32aac83640 1 --2- 172.21.15.46:0/3813438395 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3284066550 0x7f3284068a10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:46.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.139+0000 7f32aac83640 1 --2- 172.21.15.46:0/3813438395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32a40ca5e0 0x7f32a41453c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:46.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.139+0000 7f32aac83640 1 --2- 172.21.15.46:0/3813438395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32a413ea60 0x7f32a40ca0a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:46.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.139+0000 7f32aac83640 1 --2- 172.21.15.46:0/3813438395 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3290003fc0 0x7f32a413dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:46.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.139+0000 7f32aac83640 1 -- 172.21.15.46:0/3813438395 >> 172.21.15.46:0/3813438395 conn(0x7f32a406fa20 msgr2=0x7f32a4071ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:46.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.139+0000 7f32aac83640 1 -- 172.21.15.46:0/3813438395 shutdown_connections 2024-01-23T08:55:46.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.139+0000 7f32aac83640 1 -- 172.21.15.46:0/3813438395 wait complete. 2024-01-23T08:55:46.153 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-23T08:55:46.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.287+0000 7f1276cd3640 1 Processor -- start 2024-01-23T08:55:46.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.287+0000 7f1276cd3640 1 -- start start 2024-01-23T08:55:46.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.287+0000 7f1276cd3640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f12700c57d0 0x7f1270156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:46.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.287+0000 7f1276cd3640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12700c5c40 con 0x7f12701503c0 2024-01-23T08:55:46.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.287+0000 7f1276cd3640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1270156760 con 0x7f12700c7cd0 2024-01-23T08:55:46.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.287+0000 7f1276cd3640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12701507a0 con 0x7f12700c57d0 2024-01-23T08:55:46.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.287+0000 7f126ffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f12700c57d0 0x7f1270156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:46.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.287+0000 7f1274a6f640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f12701503c0 0x7f1270072760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43866/0 (socket says 172.21.15.46:43866) 2024-01-23T08:55:46.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.287+0000 7f1274a6f640 1 -- 172.21.15.46:0/1977068576 learned_addr learned my addr 172.21.15.46:0/1977068576 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:46.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.295+0000 7f126ffff640 1 -- 172.21.15.46:0/1977068576 >> v1:172.21.15.175:6789/0 conn(0x7f12700c7cd0 legacy=0x7f1270160c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:46.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.295+0000 7f126ffff640 1 -- 172.21.15.46:0/1977068576 >> v1:172.21.15.46:6789/0 conn(0x7f12701503c0 legacy=0x7f1270072760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:46.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.295+0000 7f126ffff640 1 -- 172.21.15.46:0/1977068576 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1270071a10 con 0x7f12700c57d0 2024-01-23T08:55:46.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.299+0000 7f126ffff640 1 --2- 172.21.15.46:0/1977068576 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12700c57d0 0x7f1270156bf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f12640097c0 tx=0x7f126401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e19884df42183f00 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:46.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.303+0000 7f126f7fe640 1 -- 172.21.15.46:0/1977068576 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12640a8970 con 0x7f12700c57d0 2024-01-23T08:55:46.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.307+0000 7f126f7fe640 1 -- 172.21.15.46:0/1977068576 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12640a8ad0 con 0x7f12700c57d0 2024-01-23T08:55:46.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.307+0000 7f126f7fe640 1 -- 172.21.15.46:0/1977068576 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12640a8e60 con 0x7f12700c57d0 2024-01-23T08:55:46.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.307+0000 7f1276cd3640 1 -- 172.21.15.46:0/1977068576 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12700c57d0 msgr2=0x7f1270156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:46.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.307+0000 7f1276cd3640 1 --2- 172.21.15.46:0/1977068576 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12700c57d0 0x7f1270156bf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f12640097c0 tx=0x7f126401ec70 comp rx=0 tx=0).stop 2024-01-23T08:55:46.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.307+0000 7f1276cd3640 1 -- 172.21.15.46:0/1977068576 shutdown_connections 2024-01-23T08:55:46.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.307+0000 7f1276cd3640 1 --2- 172.21.15.46:0/1977068576 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12700c57d0 0x7f1270156bf0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:46.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.307+0000 7f1276cd3640 1 -- 172.21.15.46:0/1977068576 >> 172.21.15.46:0/1977068576 conn(0x7f127006aa60 msgr2=0x7f127006ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:46.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.307+0000 7f1276cd3640 1 -- 172.21.15.46:0/1977068576 shutdown_connections 2024-01-23T08:55:46.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.307+0000 7f1276cd3640 1 -- 172.21.15.46:0/1977068576 wait complete. 2024-01-23T08:55:46.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.311+0000 7f1276cd3640 1 Processor -- start 2024-01-23T08:55:46.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.311+0000 7f1276cd3640 1 -- start start 2024-01-23T08:55:46.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.311+0000 7f1276cd3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12700c57d0 0x7f127014f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:46.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.311+0000 7f1276cd3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12700c7cd0 0x7f1270158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:46.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.311+0000 7f1276cd3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12701503c0 0x7f127014b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:46.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.311+0000 7f1276cd3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12701460e0 con 0x7f12700c7cd0 2024-01-23T08:55:46.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.311+0000 7f1276cd3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12700c7690 con 0x7f12700c57d0 2024-01-23T08:55:46.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.311+0000 7f1276cd3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12701574a0 con 0x7f12701503c0 2024-01-23T08:55:46.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.311+0000 7f1274a6f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12700c57d0 0x7f127014f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:46.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.311+0000 7f1275270640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12701503c0 0x7f127014b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:46.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.315+0000 7f1274a6f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12700c57d0 0x7f127014f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:42392/0 (socket says 172.21.15.46:42392) 2024-01-23T08:55:46.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.315+0000 7f1275270640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12701503c0 0x7f127014b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:35564/0 (socket says 172.21.15.46:35564) 2024-01-23T08:55:46.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.315+0000 7f1274a6f640 1 -- 172.21.15.46:0/2224955646 learned_addr learned my addr 172.21.15.46:0/2224955646 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:46.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.323+0000 7f126ffff640 1 --2- 172.21.15.46:0/2224955646 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12700c7cd0 0x7f1270158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:46.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.327+0000 7f1274a6f640 1 -- 172.21.15.46:0/2224955646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12701503c0 msgr2=0x7f127014b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:46.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.327+0000 7f1274a6f640 1 --2- 172.21.15.46:0/2224955646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12701503c0 0x7f127014b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:46.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.327+0000 7f1274a6f640 1 -- 172.21.15.46:0/2224955646 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12700c7cd0 msgr2=0x7f1270158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:46.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.327+0000 7f1274a6f640 1 --2- 172.21.15.46:0/2224955646 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12700c7cd0 0x7f1270158fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:46.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.327+0000 7f1274a6f640 1 -- 172.21.15.46:0/2224955646 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1264009420 con 0x7f12700c57d0 2024-01-23T08:55:46.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.327+0000 7f1275270640 1 --2- 172.21.15.46:0/2224955646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12701503c0 0x7f127014b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-23T08:55:46.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.339+0000 7f1274a6f640 1 --2- 172.21.15.46:0/2224955646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12700c57d0 0x7f127014f500 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f126000c430 tx=0x7f126000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:46.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.363+0000 7f126d7fa640 1 -- 172.21.15.46:0/2224955646 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260005cf0 con 0x7f12700c57d0 2024-01-23T08:55:46.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.363+0000 7f1276cd3640 1 -- 172.21.15.46:0/2224955646 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1270157740 con 0x7f12700c57d0 2024-01-23T08:55:46.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.363+0000 7f1276cd3640 1 -- 172.21.15.46:0/2224955646 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1270157d00 con 0x7f12700c57d0 2024-01-23T08:55:46.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.363+0000 7f1276cd3640 1 -- 172.21.15.46:0/2224955646 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1270074340 con 0x7f12700c57d0 2024-01-23T08:55:46.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.751+0000 7f126d7fa640 1 -- 172.21.15.46:0/2224955646 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1260001150 con 0x7f12700c57d0 2024-01-23T08:55:46.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.751+0000 7f126d7fa640 1 -- 172.21.15.46:0/2224955646 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260007270 con 0x7f12700c57d0 2024-01-23T08:55:46.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.755+0000 7f126d7fa640 1 -- 172.21.15.46:0/2224955646 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f1260007490 con 0x7f12700c57d0 2024-01-23T08:55:46.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.755+0000 7f126d7fa640 1 --2- 172.21.15.46:0/2224955646 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f125c066500 0x7f125c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:46.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.755+0000 7f126ffff640 1 --2- 172.21.15.46:0/2224955646 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f125c066500 0x7f125c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:46.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.755+0000 7f126ffff640 1 --2- 172.21.15.46:0/2224955646 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f125c066500 0x7f125c0689c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f12640b2000 tx=0x7f1264008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:46.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.763+0000 7f126d7fa640 1 -- 172.21.15.46:0/2224955646 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f1260007740 con 0x7f12700c57d0 2024-01-23T08:55:46.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.803+0000 7f126d7fa640 1 -- 172.21.15.46:0/2224955646 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f1260050eb0 con 0x7f12700c57d0 2024-01-23T08:55:46.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:46.995+0000 7f1276cd3640 1 -- 172.21.15.46:0/2224955646 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f12700c6320 con 0x7f12700c57d0 2024-01-23T08:55:47.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.019+0000 7f126d7fa640 1 -- 172.21.15.46:0/2224955646 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1260021020 con 0x7f12700c57d0 2024-01-23T08:55:47.018 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-01-23T08:55:47.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.023+0000 7f1276cd3640 1 -- 172.21.15.46:0/2224955646 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f125c066500 msgr2=0x7f125c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:47.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.023+0000 7f1276cd3640 1 --2- 172.21.15.46:0/2224955646 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f125c066500 0x7f125c0689c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f12640b2000 tx=0x7f1264008040 comp rx=0 tx=0).stop 2024-01-23T08:55:47.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.023+0000 7f1276cd3640 1 -- 172.21.15.46:0/2224955646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12700c57d0 msgr2=0x7f127014f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:47.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.023+0000 7f1276cd3640 1 --2- 172.21.15.46:0/2224955646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12700c57d0 0x7f127014f500 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f126000c430 tx=0x7f126000c8f0 comp rx=0 tx=0).stop 2024-01-23T08:55:47.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.023+0000 7f1276cd3640 1 -- 172.21.15.46:0/2224955646 shutdown_connections 2024-01-23T08:55:47.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.023+0000 7f1276cd3640 1 --2- 172.21.15.46:0/2224955646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12701503c0 0x7f127014b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:47.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.023+0000 7f1276cd3640 1 --2- 172.21.15.46:0/2224955646 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12700c7cd0 0x7f1270158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:47.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.023+0000 7f1276cd3640 1 --2- 172.21.15.46:0/2224955646 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f125c066500 0x7f125c0689c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:47.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.023+0000 7f1276cd3640 1 --2- 172.21.15.46:0/2224955646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12700c57d0 0x7f127014f500 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:47.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.023+0000 7f1276cd3640 1 -- 172.21.15.46:0/2224955646 >> 172.21.15.46:0/2224955646 conn(0x7f127006aa60 msgr2=0x7f12700c6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:47.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.023+0000 7f1276cd3640 1 -- 172.21.15.46:0/2224955646 shutdown_connections 2024-01-23T08:55:47.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.023+0000 7f1276cd3640 1 -- 172.21.15.46:0/2224955646 wait complete. 2024-01-23T08:55:47.040 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-23T08:55:47.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.163+0000 7fed2a044640 1 Processor -- start 2024-01-23T08:55:47.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.163+0000 7fed2a044640 1 -- start start 2024-01-23T08:55:47.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.167+0000 7fed2a044640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fed240c7ad0 0x7fed240c4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:47.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.167+0000 7fed2a044640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed2415d310 0x7fed24153470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:47.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.167+0000 7fed2a044640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed240c6790 con 0x7fed2415cf30 2024-01-23T08:55:47.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.167+0000 7fed2a044640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed240c4680 con 0x7fed240c7ad0 2024-01-23T08:55:47.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.167+0000 7fed2a044640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed240c6a30 con 0x7fed2415d310 2024-01-23T08:55:47.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.167+0000 7fed23fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed2415d310 0x7fed24153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:47.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.167+0000 7fed23fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed2415d310 0x7fed24153470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:35570/0 (socket says 172.21.15.46:35570) 2024-01-23T08:55:47.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.167+0000 7fed23fff640 1 -- 172.21.15.46:0/2184431949 learned_addr learned my addr 172.21.15.46:0/2184431949 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:47.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.175+0000 7fed23fff640 1 -- 172.21.15.46:0/2184431949 >> v2:172.21.15.46:3300/0 conn(0x7fed240c7ad0 msgr2=0x7fed240c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:47.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.175+0000 7fed23fff640 1 --2- 172.21.15.46:0/2184431949 >> v2:172.21.15.46:3300/0 conn(0x7fed240c7ad0 0x7fed240c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:47.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.175+0000 7fed23fff640 1 -- 172.21.15.46:0/2184431949 >> v1:172.21.15.175:6789/0 conn(0x7fed2415cf30 legacy=0x7fed24072200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:47.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.175+0000 7fed23fff640 1 -- 172.21.15.46:0/2184431949 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed240c6d10 con 0x7fed2415d310 2024-01-23T08:55:47.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.179+0000 7fed23fff640 1 --2- 172.21.15.46:0/2184431949 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed2415d310 0x7fed24153470 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fed24066540 tx=0x7fed1c01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ac6a17a020dd109 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:47.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.191+0000 7fed227fc640 1 -- 172.21.15.46:0/2184431949 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c0a56b0 con 0x7fed2415d310 2024-01-23T08:55:47.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.195+0000 7fed227fc640 1 -- 172.21.15.46:0/2184431949 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1c0a5810 con 0x7fed2415d310 2024-01-23T08:55:47.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.195+0000 7fed227fc640 1 -- 172.21.15.46:0/2184431949 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c0a5ba0 con 0x7fed2415d310 2024-01-23T08:55:47.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.195+0000 7fed2a044640 1 -- 172.21.15.46:0/2184431949 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed2415d310 msgr2=0x7fed24153470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:47.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.195+0000 7fed2a044640 1 --2- 172.21.15.46:0/2184431949 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed2415d310 0x7fed24153470 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fed24066540 tx=0x7fed1c01c920 comp rx=0 tx=0).stop 2024-01-23T08:55:47.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.195+0000 7fed2a044640 1 -- 172.21.15.46:0/2184431949 shutdown_connections 2024-01-23T08:55:47.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.195+0000 7fed2a044640 1 --2- 172.21.15.46:0/2184431949 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed2415d310 0x7fed24153470 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:47.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.195+0000 7fed2a044640 1 --2- 172.21.15.46:0/2184431949 >> v2:172.21.15.46:3300/0 conn(0x7fed240c7ad0 0x7fed240c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:47.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.195+0000 7fed2a044640 1 -- 172.21.15.46:0/2184431949 >> 172.21.15.46:0/2184431949 conn(0x7fed2406fa20 msgr2=0x7fed240c8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:47.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.195+0000 7fed2a044640 1 -- 172.21.15.46:0/2184431949 shutdown_connections 2024-01-23T08:55:47.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.195+0000 7fed2a044640 1 -- 172.21.15.46:0/2184431949 wait complete. 2024-01-23T08:55:47.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.195+0000 7fed2a044640 1 Processor -- start 2024-01-23T08:55:47.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.195+0000 7fed2a044640 1 -- start start 2024-01-23T08:55:47.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.195+0000 7fed2a044640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed240c7ad0 0x7fed2415bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:47.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.195+0000 7fed2a044640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed2415cf30 0x7fed240cab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:47.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.195+0000 7fed2a044640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed2415d310 0x7fed2414ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:47.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.195+0000 7fed2a044640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2415c2b0 con 0x7fed2415cf30 2024-01-23T08:55:47.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.195+0000 7fed2a044640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed241426c0 con 0x7fed240c7ad0 2024-01-23T08:55:47.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.195+0000 7fed2a044640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed2415cb10 con 0x7fed2415d310 2024-01-23T08:55:47.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.199+0000 7fed22ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed2415cf30 0x7fed240cab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:47.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.199+0000 7fed22ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed2415cf30 0x7fed240cab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36048/0 (socket says 172.21.15.46:36048) 2024-01-23T08:55:47.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.199+0000 7fed22ffd640 1 -- 172.21.15.46:0/270709109 learned_addr learned my addr 172.21.15.46:0/270709109 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:47.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.199+0000 7fed23fff640 1 --2- 172.21.15.46:0/270709109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed2415d310 0x7fed2414ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:47.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.203+0000 7fed22ffd640 1 -- 172.21.15.46:0/270709109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed2415d310 msgr2=0x7fed2414ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:47.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.203+0000 7fed22ffd640 1 --2- 172.21.15.46:0/270709109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed2415d310 0x7fed2414ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:47.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.203+0000 7fed22ffd640 1 -- 172.21.15.46:0/270709109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed240c7ad0 msgr2=0x7fed2415bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:47.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.203+0000 7fed22ffd640 1 --2- 172.21.15.46:0/270709109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed240c7ad0 0x7fed2415bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:47.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.203+0000 7fed22ffd640 1 -- 172.21.15.46:0/270709109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1c009b30 con 0x7fed2415cf30 2024-01-23T08:55:47.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.203+0000 7fed22ffd640 1 --2- 172.21.15.46:0/270709109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed2415cf30 0x7fed240cab80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fed1400b550 tx=0x7fed1400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:47.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.211+0000 7fed0bfff640 1 -- 172.21.15.46:0/270709109 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed14010870 con 0x7fed2415cf30 2024-01-23T08:55:47.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.211+0000 7fed0bfff640 1 -- 172.21.15.46:0/270709109 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed140109f0 con 0x7fed2415cf30 2024-01-23T08:55:47.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.211+0000 7fed0bfff640 1 -- 172.21.15.46:0/270709109 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed14010da0 con 0x7fed2415cf30 2024-01-23T08:55:47.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.211+0000 7fed2a044640 1 -- 172.21.15.46:0/270709109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed2415ba70 con 0x7fed2415cf30 2024-01-23T08:55:47.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.211+0000 7fed2a044640 1 -- 172.21.15.46:0/270709109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed2415acb0 con 0x7fed2415cf30 2024-01-23T08:55:47.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.211+0000 7fed2a044640 1 -- 172.21.15.46:0/270709109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed24074340 con 0x7fed2415cf30 2024-01-23T08:55:47.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.231+0000 7fed0bfff640 1 -- 172.21.15.46:0/270709109 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fed14023480 con 0x7fed2415cf30 2024-01-23T08:55:47.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.231+0000 7fed0bfff640 1 --2- 172.21.15.46:0/270709109 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fed10066550 0x7fed10068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:47.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.235+0000 7fed237fe640 1 --2- 172.21.15.46:0/270709109 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fed10066550 0x7fed10068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:47.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.235+0000 7fed237fe640 1 --2- 172.21.15.46:0/270709109 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fed10066550 0x7fed10068a10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fed18007fd0 tx=0x7fed180079a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:47.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.571+0000 7fed0bfff640 1 -- 172.21.15.46:0/270709109 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fed140552d0 con 0x7fed2415cf30 2024-01-23T08:55:47.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.571+0000 7fed0bfff640 1 -- 172.21.15.46:0/270709109 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fed14051610 con 0x7fed2415cf30 2024-01-23T08:55:47.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.747+0000 7fed2a044640 1 -- 172.21.15.46:0/270709109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fed24072190 con 0x7fed2415cf30 2024-01-23T08:55:47.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.763+0000 7fed0bfff640 1 -- 172.21.15.46:0/270709109 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fed1401e0a0 con 0x7fed2415cf30 2024-01-23T08:55:47.762 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-23T08:55:47.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.767+0000 7fed2a044640 1 -- 172.21.15.46:0/270709109 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fed10066550 msgr2=0x7fed10068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:47.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.767+0000 7fed2a044640 1 --2- 172.21.15.46:0/270709109 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fed10066550 0x7fed10068a10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fed18007fd0 tx=0x7fed180079a0 comp rx=0 tx=0).stop 2024-01-23T08:55:47.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.767+0000 7fed2a044640 1 -- 172.21.15.46:0/270709109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed2415cf30 msgr2=0x7fed240cab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:47.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.767+0000 7fed2a044640 1 --2- 172.21.15.46:0/270709109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed2415cf30 0x7fed240cab80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fed1400b550 tx=0x7fed1400ba10 comp rx=0 tx=0).stop 2024-01-23T08:55:47.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.767+0000 7fed2a044640 1 -- 172.21.15.46:0/270709109 shutdown_connections 2024-01-23T08:55:47.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.767+0000 7fed2a044640 1 --2- 172.21.15.46:0/270709109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed2415d310 0x7fed2414ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:47.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.767+0000 7fed2a044640 1 --2- 172.21.15.46:0/270709109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed2415cf30 0x7fed240cab80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:47.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.767+0000 7fed2a044640 1 --2- 172.21.15.46:0/270709109 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fed10066550 0x7fed10068a10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:47.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.767+0000 7fed2a044640 1 --2- 172.21.15.46:0/270709109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed240c7ad0 0x7fed2415bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:47.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.767+0000 7fed2a044640 1 -- 172.21.15.46:0/270709109 >> 172.21.15.46:0/270709109 conn(0x7fed2406fa20 msgr2=0x7fed240c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:47.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.767+0000 7fed2a044640 1 -- 172.21.15.46:0/270709109 shutdown_connections 2024-01-23T08:55:47.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.767+0000 7fed2a044640 1 -- 172.21.15.46:0/270709109 wait complete. 2024-01-23T08:55:47.783 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-23T08:55:47.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.907+0000 7fda9703a640 1 Processor -- start 2024-01-23T08:55:47.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.907+0000 7fda9703a640 1 -- start start 2024-01-23T08:55:47.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.907+0000 7fda9703a640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fda900c51e0 0x7fda900c6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:47.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.907+0000 7fda9703a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda900c55c0 0x7fda900c2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:47.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.907+0000 7fda9703a640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda90156310 con 0x7fda900c5e50 2024-01-23T08:55:47.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.907+0000 7fda9703a640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda90156f90 con 0x7fda900c51e0 2024-01-23T08:55:47.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.907+0000 7fda9703a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda901565f0 con 0x7fda900c55c0 2024-01-23T08:55:47.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.907+0000 7fda955d7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda900c55c0 0x7fda900c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:47.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.911+0000 7fda955d7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda900c55c0 0x7fda900c2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:35590/0 (socket says 172.21.15.46:35590) 2024-01-23T08:55:47.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.911+0000 7fda955d7640 1 -- 172.21.15.46:0/302636780 learned_addr learned my addr 172.21.15.46:0/302636780 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:47.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.915+0000 7fda955d7640 1 -- 172.21.15.46:0/302636780 >> v2:172.21.15.46:3300/0 conn(0x7fda900c51e0 msgr2=0x7fda900c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:47.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.915+0000 7fda955d7640 1 --2- 172.21.15.46:0/302636780 >> v2:172.21.15.46:3300/0 conn(0x7fda900c51e0 0x7fda900c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:47.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.915+0000 7fda955d7640 1 -- 172.21.15.46:0/302636780 >> v1:172.21.15.175:6789/0 conn(0x7fda900c5e50 legacy=0x7fda9014fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:47.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.915+0000 7fda955d7640 1 -- 172.21.15.46:0/302636780 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda901568d0 con 0x7fda900c55c0 2024-01-23T08:55:47.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.923+0000 7fda955d7640 1 --2- 172.21.15.46:0/302636780 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda900c55c0 0x7fda900c2950 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fda88009e50 tx=0x7fda880213d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f75c3c65b395775a server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:47.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.935+0000 7fda8f7fe640 1 -- 172.21.15.46:0/302636780 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda880b1400 con 0x7fda900c55c0 2024-01-23T08:55:47.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.935+0000 7fda8f7fe640 1 -- 172.21.15.46:0/302636780 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda880ad050 con 0x7fda900c55c0 2024-01-23T08:55:47.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.935+0000 7fda8f7fe640 1 -- 172.21.15.46:0/302636780 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda880b1780 con 0x7fda900c55c0 2024-01-23T08:55:47.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.935+0000 7fda9703a640 1 -- 172.21.15.46:0/302636780 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda900c55c0 msgr2=0x7fda900c2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:47.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.935+0000 7fda9703a640 1 --2- 172.21.15.46:0/302636780 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda900c55c0 0x7fda900c2950 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fda88009e50 tx=0x7fda880213d0 comp rx=0 tx=0).stop 2024-01-23T08:55:47.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.935+0000 7fda9703a640 1 -- 172.21.15.46:0/302636780 shutdown_connections 2024-01-23T08:55:47.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.935+0000 7fda9703a640 1 --2- 172.21.15.46:0/302636780 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda900c55c0 0x7fda900c2950 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:47.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.935+0000 7fda9703a640 1 --2- 172.21.15.46:0/302636780 >> v2:172.21.15.46:3300/0 conn(0x7fda900c51e0 0x7fda900c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:47.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.935+0000 7fda9703a640 1 -- 172.21.15.46:0/302636780 >> 172.21.15.46:0/302636780 conn(0x7fda900cbb60 msgr2=0x7fda900c7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:47.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.935+0000 7fda9703a640 1 -- 172.21.15.46:0/302636780 shutdown_connections 2024-01-23T08:55:47.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.935+0000 7fda9703a640 1 -- 172.21.15.46:0/302636780 wait complete. 2024-01-23T08:55:47.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.939+0000 7fda9703a640 1 Processor -- start 2024-01-23T08:55:47.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.939+0000 7fda9703a640 1 -- start start 2024-01-23T08:55:47.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.939+0000 7fda9703a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda900c51e0 0x7fda901eed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:47.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.939+0000 7fda9703a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda900c55c0 0x7fda9014e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:47.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.939+0000 7fda9703a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda900c5e50 0x7fda90140ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:47.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.939+0000 7fda9703a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9014cb00 con 0x7fda900c55c0 2024-01-23T08:55:47.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.939+0000 7fda9703a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda901ef2a0 con 0x7fda900c5e50 2024-01-23T08:55:47.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.939+0000 7fda9703a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda900ca1a0 con 0x7fda900c51e0 2024-01-23T08:55:47.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.939+0000 7fda94dd6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda900c51e0 0x7fda901eed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:47.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.943+0000 7fda94dd6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda900c51e0 0x7fda901eed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:35602/0 (socket says 172.21.15.46:35602) 2024-01-23T08:55:47.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.943+0000 7fda94dd6640 1 -- 172.21.15.46:0/223153982 learned_addr learned my addr 172.21.15.46:0/223153982 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:47.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.951+0000 7fda94dd6640 1 -- 172.21.15.46:0/223153982 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda900c5e50 msgr2=0x7fda90140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:47.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.951+0000 7fda94dd6640 1 --2- 172.21.15.46:0/223153982 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda900c5e50 0x7fda90140ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:47.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.951+0000 7fda94dd6640 1 -- 172.21.15.46:0/223153982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda900c55c0 msgr2=0x7fda9014e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:47.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.951+0000 7fda94dd6640 1 --2- 172.21.15.46:0/223153982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda900c55c0 0x7fda9014e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:47.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.951+0000 7fda94dd6640 1 -- 172.21.15.46:0/223153982 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda88009b30 con 0x7fda900c51e0 2024-01-23T08:55:47.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.955+0000 7fda94dd6640 1 --2- 172.21.15.46:0/223153982 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda900c51e0 0x7fda901eed60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fda8000b550 tx=0x7fda8000ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:47.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.979+0000 7fda8d7fa640 1 -- 172.21.15.46:0/223153982 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda80011890 con 0x7fda900c51e0 2024-01-23T08:55:47.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.979+0000 7fda8d7fa640 1 -- 172.21.15.46:0/223153982 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda80011a10 con 0x7fda900c51e0 2024-01-23T08:55:47.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.979+0000 7fda8d7fa640 1 -- 172.21.15.46:0/223153982 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda80011dc0 con 0x7fda900c51e0 2024-01-23T08:55:47.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.979+0000 7fda9703a640 1 -- 172.21.15.46:0/223153982 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda900ca480 con 0x7fda900c51e0 2024-01-23T08:55:47.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.979+0000 7fda9703a640 1 -- 172.21.15.46:0/223153982 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda900caa40 con 0x7fda900c51e0 2024-01-23T08:55:47.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:47.979+0000 7fda9703a640 1 -- 172.21.15.46:0/223153982 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda90074340 con 0x7fda900c51e0 2024-01-23T08:55:48.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.375+0000 7fda8d7fa640 1 -- 172.21.15.46:0/223153982 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fda8001a400 con 0x7fda900c51e0 2024-01-23T08:55:48.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.375+0000 7fda8d7fa640 1 --2- 172.21.15.46:0/223153982 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fda7c066500 0x7fda7c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:48.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.379+0000 7fda8ffff640 1 --2- 172.21.15.46:0/223153982 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fda7c066500 0x7fda7c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:48.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.379+0000 7fda8ffff640 1 --2- 172.21.15.46:0/223153982 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fda7c066500 0x7fda7c0689c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fda90153f50 tx=0x7fda84006bb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:48.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.383+0000 7fda8d7fa640 1 -- 172.21.15.46:0/223153982 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fda80055e40 con 0x7fda900c51e0 2024-01-23T08:55:48.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.399+0000 7fda8d7fa640 1 -- 172.21.15.46:0/223153982 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fda80051a80 con 0x7fda900c51e0 2024-01-23T08:55:48.448 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T08:55:48.450 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T08:55:48.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.611+0000 7fda9703a640 1 -- 172.21.15.46:0/223153982 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda90155170 con 0x7fda900c51e0 2024-01-23T08:55:48.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.647+0000 7fda8d7fa640 1 -- 172.21.15.46:0/223153982 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6584 (secure 0 0 0) 0x7fda80015070 con 0x7fda900c51e0 2024-01-23T08:55:48.644 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:55:48.644 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4208,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/397511399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":397511399},{"type":"v1","addr":"172.21.15.175:6835","nonce":397511399}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-23T08:54:42.028655+0000","modified":"2024-01-23T08:55:33.028425+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4242,"mds_1":4239,"mds_2":4234,"mds_3":4228,"mds_4":4214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4214":{"gid":4214,"name":"c","rank":4,"incarnation":17,"state":"up:active","state_seq":21,"addr":"172.21.15.46:6835/1620040020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1620040020},{"type":"v1","addr":"172.21.15.46:6835","nonce":1620040020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4228":{"gid":4228,"name":"b","rank":3,"incarnation":15,"state":"up:active","state_seq":20,"addr":"172.21.15.175:6833/2714415350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2714415350},{"type":"v1","addr":"172.21.15.175:6833","nonce":2714415350}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4234":{"gid":4234,"name":"f","rank":2,"incarnation":13,"state":"up:active","state_seq":19,"addr":"172.21.15.175:6837/3103300888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3103300888},{"type":"v1","addr":"172.21.15.175:6837","nonce":3103300888}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4239":{"gid":4239,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6837/338965660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":338965660},{"type":"v1","addr":"172.21.15.46:6837","nonce":338965660}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4242":{"gid":4242,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":9,"addr":"172.21.15.46:6839/1889172114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1889172114},{"type":"v1","addr":"172.21.15.46:6839","nonce":1889172114}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-23T08:55:48.644 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 18 2024-01-23T08:55:48.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.647+0000 7fda9703a640 1 -- 172.21.15.46:0/223153982 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fda7c066500 msgr2=0x7fda7c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:48.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.647+0000 7fda9703a640 1 --2- 172.21.15.46:0/223153982 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fda7c066500 0x7fda7c0689c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fda90153f50 tx=0x7fda84006bb0 comp rx=0 tx=0).stop 2024-01-23T08:55:48.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.647+0000 7fda9703a640 1 -- 172.21.15.46:0/223153982 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda900c51e0 msgr2=0x7fda901eed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:48.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.647+0000 7fda9703a640 1 --2- 172.21.15.46:0/223153982 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda900c51e0 0x7fda901eed60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fda8000b550 tx=0x7fda8000ba10 comp rx=0 tx=0).stop 2024-01-23T08:55:48.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.651+0000 7fda9703a640 1 -- 172.21.15.46:0/223153982 shutdown_connections 2024-01-23T08:55:48.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.651+0000 7fda9703a640 1 --2- 172.21.15.46:0/223153982 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fda7c066500 0x7fda7c0689c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:48.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.651+0000 7fda9703a640 1 --2- 172.21.15.46:0/223153982 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda900c5e50 0x7fda90140ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:48.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.651+0000 7fda9703a640 1 --2- 172.21.15.46:0/223153982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda900c55c0 0x7fda9014e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:48.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.651+0000 7fda9703a640 1 --2- 172.21.15.46:0/223153982 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda900c51e0 0x7fda901eed60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:48.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.651+0000 7fda9703a640 1 -- 172.21.15.46:0/223153982 >> 172.21.15.46:0/223153982 conn(0x7fda900cbb60 msgr2=0x7fda9006ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:48.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.651+0000 7fda9703a640 1 -- 172.21.15.46:0/223153982 shutdown_connections 2024-01-23T08:55:48.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.651+0000 7fda9703a640 1 -- 172.21.15.46:0/223153982 wait complete. 2024-01-23T08:55:48.666 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-23T08:55:48.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.787+0000 7fde08c86640 1 Processor -- start 2024-01-23T08:55:48.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.787+0000 7fde08c86640 1 -- start start 2024-01-23T08:55:48.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.787+0000 7fde08c86640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde040bfe80 0x7fde04159970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:48.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.787+0000 7fde08c86640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde04071920 con 0x7fde040c57d0 2024-01-23T08:55:48.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.787+0000 7fde08c86640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde04156aa0 con 0x7fde04150450 2024-01-23T08:55:48.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.787+0000 7fde08c86640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde04156490 con 0x7fde040bfe80 2024-01-23T08:55:48.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.787+0000 7fde02d9d640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fde040c57d0 0x7fde04160d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43878/0 (socket says 172.21.15.46:43878) 2024-01-23T08:55:48.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.787+0000 7fde02d9d640 1 -- 172.21.15.46:0/1072815402 learned_addr learned my addr 172.21.15.46:0/1072815402 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:48.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.787+0000 7fde01d9b640 1 --2- 172.21.15.46:0/1072815402 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde040bfe80 0x7fde04159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:48.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.791+0000 7fde0159a640 1 -- 172.21.15.46:0/1072815402 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1916402180 0 0) 0x7fde04071920 con 0x7fde040c57d0 2024-01-23T08:55:48.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.791+0000 7fde0159a640 1 -- 172.21.15.46:0/1072815402 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddf0003530 con 0x7fde040c57d0 2024-01-23T08:55:48.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.795+0000 7fde0159a640 1 -- 172.21.15.46:0/1072815402 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511561606 0 0) 0x7fde04156aa0 con 0x7fde04150450 2024-01-23T08:55:48.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.795+0000 7fde0159a640 1 -- 172.21.15.46:0/1072815402 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde04071920 con 0x7fde04150450 2024-01-23T08:55:48.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.795+0000 7fde0159a640 1 -- 172.21.15.46:0/1072815402 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3185943808 0 0) 0x7fddf0003530 con 0x7fde040c57d0 2024-01-23T08:55:48.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.795+0000 7fde0159a640 1 -- 172.21.15.46:0/1072815402 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde040bfe80 msgr2=0x7fde04159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:48.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.795+0000 7fde0159a640 1 --2- 172.21.15.46:0/1072815402 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde040bfe80 0x7fde04159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:48.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.795+0000 7fde0159a640 1 -- 172.21.15.46:0/1072815402 >> v1:172.21.15.175:6789/0 conn(0x7fde04150450 legacy=0x7fde040cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:48.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.795+0000 7fde0159a640 1 -- 172.21.15.46:0/1072815402 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde04150830 con 0x7fde040c57d0 2024-01-23T08:55:48.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.795+0000 7fde0159a640 1 -- 172.21.15.46:0/1072815402 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466917103 0 0) 0x7fddfc001680 con 0x7fde040c57d0 2024-01-23T08:55:48.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.795+0000 7fde0159a640 1 -- 172.21.15.46:0/1072815402 >> v1:172.21.15.46:6789/0 conn(0x7fde040c57d0 legacy=0x7fde04160d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:48.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.795+0000 7fde0159a640 1 --2- 172.21.15.46:0/1072815402 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf0003b40 0x7fddf0003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:48.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.795+0000 7fde0159a640 1 --2- 172.21.15.46:0/1072815402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fddf00047d0 0x7fddf0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:48.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.795+0000 7fde0159a640 1 --2- 172.21.15.46:0/1072815402 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde040bfe80 0x7fddf0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:48.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.795+0000 7fde0159a640 1 -- 172.21.15.46:0/1072815402 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde04156490 con 0x7fddf0003b40 2024-01-23T08:55:48.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.795+0000 7fde0159a640 1 -- 172.21.15.46:0/1072815402 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf000ba40 con 0x7fddf00047d0 2024-01-23T08:55:48.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.795+0000 7fde0159a640 1 -- 172.21.15.46:0/1072815402 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf000bc00 con 0x7fde040bfe80 2024-01-23T08:55:48.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.799+0000 7fde0259c640 1 --2- 172.21.15.46:0/1072815402 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf0003b40 0x7fddf0003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:48.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.799+0000 7fde01d9b640 1 --2- 172.21.15.46:0/1072815402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fddf00047d0 0x7fddf0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:48.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.803+0000 7fde02d9d640 1 --2- 172.21.15.46:0/1072815402 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde040bfe80 0x7fddf0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:48.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.803+0000 7fde0259c640 1 -- 172.21.15.46:0/1072815402 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde040bfe80 msgr2=0x7fddf0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:48.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.803+0000 7fde0259c640 1 --2- 172.21.15.46:0/1072815402 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde040bfe80 0x7fddf0005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:48.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.803+0000 7fde0259c640 1 -- 172.21.15.46:0/1072815402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fddf00047d0 msgr2=0x7fddf0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:48.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.803+0000 7fde0259c640 1 --2- 172.21.15.46:0/1072815402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fddf00047d0 0x7fddf0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:48.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.803+0000 7fde0259c640 1 -- 172.21.15.46:0/1072815402 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf0003530 con 0x7fddf0003b40 2024-01-23T08:55:48.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.803+0000 7fde01d9b640 1 --2- 172.21.15.46:0/1072815402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fddf00047d0 0x7fddf0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-23T08:55:48.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.807+0000 7fde0259c640 1 --2- 172.21.15.46:0/1072815402 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf0003b40 0x7fddf0003f40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fddec0018d0 tx=0x7fddec01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575450a2e3a4184b server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:48.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.811+0000 7fde0159a640 1 -- 172.21.15.46:0/1072815402 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec0052d0 con 0x7fddf0003b40 2024-01-23T08:55:48.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.811+0000 7fde0159a640 1 -- 172.21.15.46:0/1072815402 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddec005450 con 0x7fddf0003b40 2024-01-23T08:55:48.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.811+0000 7fde0159a640 1 -- 172.21.15.46:0/1072815402 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec003840 con 0x7fddf0003b40 2024-01-23T08:55:48.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.811+0000 7fde08c86640 1 -- 172.21.15.46:0/1072815402 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf0003b40 msgr2=0x7fddf0003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:48.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.811+0000 7fde08c86640 1 --2- 172.21.15.46:0/1072815402 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf0003b40 0x7fddf0003f40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fddec0018d0 tx=0x7fddec01c530 comp rx=0 tx=0).stop 2024-01-23T08:55:48.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.811+0000 7fde02d9d640 1 -- 172.21.15.46:0/1072815402 reap_dead start 2024-01-23T08:55:48.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.811+0000 7fde08c86640 1 -- 172.21.15.46:0/1072815402 shutdown_connections 2024-01-23T08:55:48.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.811+0000 7fde08c86640 1 -- 172.21.15.46:0/1072815402 >> 172.21.15.46:0/1072815402 conn(0x7fde0406d590 msgr2=0x7fde04066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:48.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.811+0000 7fde08c86640 1 -- 172.21.15.46:0/1072815402 shutdown_connections 2024-01-23T08:55:48.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.811+0000 7fde08c86640 1 -- 172.21.15.46:0/1072815402 wait complete. 2024-01-23T08:55:48.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.811+0000 7fde08c86640 1 Processor -- start 2024-01-23T08:55:48.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.811+0000 7fde08c86640 1 -- start start 2024-01-23T08:55:48.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.815+0000 7fde08c86640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf0003b40 0x7fde041429a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:48.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.815+0000 7fde08c86640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde040c4f40 0x7fde040ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:48.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.815+0000 7fde08c86640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde041588d0 0x7fde04158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:48.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.815+0000 7fde08c86640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde040c3c80 con 0x7fddf0003b40 2024-01-23T08:55:48.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.815+0000 7fde08c86640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde040c3090 con 0x7fde041588d0 2024-01-23T08:55:48.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.815+0000 7fde08c86640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde040c8bd0 con 0x7fde040c4f40 2024-01-23T08:55:48.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.815+0000 7fde0259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf0003b40 0x7fde041429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:48.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.815+0000 7fde02d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde041588d0 0x7fde04158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:48.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.815+0000 7fde0259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf0003b40 0x7fde041429a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36072/0 (socket says 172.21.15.46:36072) 2024-01-23T08:55:48.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.815+0000 7fde0259c640 1 -- 172.21.15.46:0/418258602 learned_addr learned my addr 172.21.15.46:0/418258602 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:48.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.819+0000 7fde0259c640 1 -- 172.21.15.46:0/418258602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde040c4f40 msgr2=0x7fde040ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:48.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.819+0000 7fde0259c640 1 --2- 172.21.15.46:0/418258602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde040c4f40 0x7fde040ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:48.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.819+0000 7fde0259c640 1 -- 172.21.15.46:0/418258602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde041588d0 msgr2=0x7fde04158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:48.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.819+0000 7fde0259c640 1 --2- 172.21.15.46:0/418258602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde041588d0 0x7fde04158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:48.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.819+0000 7fde0259c640 1 -- 172.21.15.46:0/418258602 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde040c4280 con 0x7fddf0003b40 2024-01-23T08:55:48.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.823+0000 7fde0259c640 1 --2- 172.21.15.46:0/418258602 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf0003b40 0x7fde041429a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fddec005040 tx=0x7fddf0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:48.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.827+0000 7fddfaffd640 1 -- 172.21.15.46:0/418258602 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec003ca0 con 0x7fddf0003b40 2024-01-23T08:55:48.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.827+0000 7fddfaffd640 1 -- 172.21.15.46:0/418258602 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddec003e00 con 0x7fddf0003b40 2024-01-23T08:55:48.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.827+0000 7fddfaffd640 1 -- 172.21.15.46:0/418258602 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec0052f0 con 0x7fddf0003b40 2024-01-23T08:55:48.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.827+0000 7fde08c86640 1 -- 172.21.15.46:0/418258602 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde040c2510 con 0x7fddf0003b40 2024-01-23T08:55:48.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.827+0000 7fde08c86640 1 -- 172.21.15.46:0/418258602 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde040c2ad0 con 0x7fddf0003b40 2024-01-23T08:55:48.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.827+0000 7fde08c86640 1 -- 172.21.15.46:0/418258602 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde04074340 con 0x7fddf0003b40 2024-01-23T08:55:48.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.847+0000 7fddfaffd640 1 -- 172.21.15.46:0/418258602 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fddec0067e0 con 0x7fddf0003b40 2024-01-23T08:55:48.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.847+0000 7fddfaffd640 1 --2- 172.21.15.46:0/418258602 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fdde4066550 0x7fdde4068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:48.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.847+0000 7fde01d9b640 1 --2- 172.21.15.46:0/418258602 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fdde4066550 0x7fdde4068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:48.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:48.851+0000 7fde01d9b640 1 --2- 172.21.15.46:0/418258602 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fdde4066550 0x7fdde4068a10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fde041598b0 tx=0x7fddf4009750 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:49.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.147+0000 7fddfaffd640 1 -- 172.21.15.46:0/418258602 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fddec0eecc0 con 0x7fddf0003b40 2024-01-23T08:55:49.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.147+0000 7fddfaffd640 1 -- 172.21.15.46:0/418258602 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fddec0eb000 con 0x7fddf0003b40 2024-01-23T08:55:49.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.355+0000 7fde08c86640 1 -- 172.21.15.46:0/418258602 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde040c4280 con 0x7fddf0003b40 2024-01-23T08:55:49.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.515+0000 7fddfaffd640 1 -- 172.21.15.46:0/418258602 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18552 (secure 0 0 0) 0x7fde040c4280 con 0x7fddf0003b40 2024-01-23T08:55:49.515 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:55:49.515 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":30,"fsid":"fdbdd393-f422-45ae-a488-2bbb0163e580","created":"2024-01-23T08:53:36.942515+0000","modified":"2024-01-23T08:55:46.483867+0000","last_up_change":"2024-01-23T08:53:57.198113+0000","last_in_change":"2024-01-23T08:53:47.852614+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-23T08:53:59.340853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-23T08:54:38.278770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-23T08:54:40.216521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-23T08:54:47.311079+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f32c3d7d-e32a-42d8-b55f-db874d915a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6818","nonce":2681790976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6821","nonce":2681790976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6825","nonce":2681790976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6823","nonce":2681790976}]},"public_addr":"172.21.15.46:6818/2681790976","cluster_addr":"172.21.15.46:6821/2681790976","heartbeat_back_addr":"172.21.15.46:6825/2681790976","heartbeat_front_addr":"172.21.15.46:6823/2681790976","state":["exists","up"]},{"osd":1,"uuid":"6f3b6bd2-bbea-4d08-84d5-4407363b5eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6803","nonce":3679152623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6805","nonce":3679152623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6809","nonce":3679152623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6807","nonce":3679152623}]},"public_addr":"172.21.15.46:6803/3679152623","cluster_addr":"172.21.15.46:6805/3679152623","heartbeat_back_addr":"172.21.15.46:6809/3679152623","heartbeat_front_addr":"172.21.15.46:6807/3679152623","state":["exists","up"]},{"osd":2,"uuid":"8f110727-31e7-4f69-926b-c87481d4d28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6811","nonce":3869652274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6813","nonce":3869652274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6820","nonce":3869652274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6815","nonce":3869652274}]},"public_addr":"172.21.15.46:6811/3869652274","cluster_addr":"172.21.15.46:6813/3869652274","heartbeat_back_addr":"172.21.15.46:6820/3869652274","heartbeat_front_addr":"172.21.15.46:6815/3869652274","state":["exists","up"]},{"osd":3,"uuid":"3aa7527d-0463-4373-b9c7-e6b507a7987f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6827","nonce":4168860822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6829","nonce":4168860822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6833","nonce":4168860822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6831","nonce":4168860822}]},"public_addr":"172.21.15.46:6827/4168860822","cluster_addr":"172.21.15.46:6829/4168860822","heartbeat_back_addr":"172.21.15.46:6833/4168860822","heartbeat_front_addr":"172.21.15.46:6831/4168860822","state":["exists","up"]},{"osd":4,"uuid":"eb47a1e5-9f26-465f-b188-87c6eed63c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6805","nonce":3115257412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6808","nonce":3115257412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6815","nonce":3115257412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6812","nonce":3115257412}]},"public_addr":"172.21.15.175:6805/3115257412","cluster_addr":"172.21.15.175:6808/3115257412","heartbeat_back_addr":"172.21.15.175:6815/3115257412","heartbeat_front_addr":"172.21.15.175:6812/3115257412","state":["exists","up"]},{"osd":5,"uuid":"34048409-998c-44f3-a29d-dcad7a6c917b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6818","nonce":3146473948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6822","nonce":3146473948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6831","nonce":3146473948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6826","nonce":3146473948}]},"public_addr":"172.21.15.175:6818/3146473948","cluster_addr":"172.21.15.175:6822/3146473948","heartbeat_back_addr":"172.21.15.175:6831/3146473948","heartbeat_front_addr":"172.21.15.175:6826/3146473948","state":["exists","up"]},{"osd":6,"uuid":"f5d45d3f-9af3-44a1-a730-c260ed1654b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6801","nonce":4161180058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6804","nonce":4161180058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6814","nonce":4161180058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6809","nonce":4161180058}]},"public_addr":"172.21.15.175:6801/4161180058","cluster_addr":"172.21.15.175:6804/4161180058","heartbeat_back_addr":"172.21.15.175:6814/4161180058","heartbeat_front_addr":"172.21.15.175:6809/4161180058","state":["exists","up"]},{"osd":7,"uuid":"16d12e53-2ad3-4b5c-a789-22b45056fd9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6819","nonce":2670236415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6823","nonce":2670236415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6830","nonce":2670236415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6827","nonce":2670236415}]},"public_addr":"172.21.15.175:6819/2670236415","cluster_addr":"172.21.15.175:6823/2670236415","heartbeat_back_addr":"172.21.15.175:6830/2670236415","heartbeat_front_addr":"172.21.15.175:6827/2670236415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.847037+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.765547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.716122+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.874628+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.786580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.924885+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.285635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.898130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":0,"to":7}]},{"pgid":"4.4","mappings":[{"from":3,"to":5}]},{"pgid":"4.17","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T08:55:49.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.519+0000 7fde08c86640 1 -- 172.21.15.46:0/418258602 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fdde4066550 msgr2=0x7fdde4068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:49.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.519+0000 7fde08c86640 1 --2- 172.21.15.46:0/418258602 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fdde4066550 0x7fdde4068a10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fde041598b0 tx=0x7fddf4009750 comp rx=0 tx=0).stop 2024-01-23T08:55:49.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.519+0000 7fde08c86640 1 -- 172.21.15.46:0/418258602 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf0003b40 msgr2=0x7fde041429a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:49.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.519+0000 7fde08c86640 1 --2- 172.21.15.46:0/418258602 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf0003b40 0x7fde041429a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fddec005040 tx=0x7fddf0005800 comp rx=0 tx=0).stop 2024-01-23T08:55:49.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.519+0000 7fde08c86640 1 -- 172.21.15.46:0/418258602 shutdown_connections 2024-01-23T08:55:49.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.519+0000 7fde08c86640 1 --2- 172.21.15.46:0/418258602 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fdde4066550 0x7fdde4068a10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:49.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.519+0000 7fde08c86640 1 --2- 172.21.15.46:0/418258602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde041588d0 0x7fde04158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:49.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.519+0000 7fde08c86640 1 --2- 172.21.15.46:0/418258602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde040c4f40 0x7fde040ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:49.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.519+0000 7fde08c86640 1 --2- 172.21.15.46:0/418258602 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf0003b40 0x7fde041429a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:49.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.519+0000 7fde08c86640 1 -- 172.21.15.46:0/418258602 >> 172.21.15.46:0/418258602 conn(0x7fde0406d590 msgr2=0x7fde04159f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:49.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.519+0000 7fde08c86640 1 -- 172.21.15.46:0/418258602 shutdown_connections 2024-01-23T08:55:49.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.519+0000 7fde08c86640 1 -- 172.21.15.46:0/418258602 wait complete. 2024-01-23T08:55:49.539 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-23T08:55:49.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.663+0000 7f4af582f640 1 Processor -- start 2024-01-23T08:55:49.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.663+0000 7f4af582f640 1 -- start start 2024-01-23T08:55:49.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.663+0000 7f4af582f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4af0158070 0x7f4af00c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:49.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.663+0000 7f4af582f640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af00c75b0 con 0x7f4af00c6ad0 2024-01-23T08:55:49.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.663+0000 7f4af582f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af00c7850 con 0x7f4af00c6eb0 2024-01-23T08:55:49.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.663+0000 7f4af582f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af01573c0 con 0x7f4af0158070 2024-01-23T08:55:49.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.663+0000 7f4aeeffd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4af00c6ad0 0x7f4af00c80f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43892/0 (socket says 172.21.15.46:43892) 2024-01-23T08:55:49.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.663+0000 7f4aeeffd640 1 -- 172.21.15.46:0/109343117 learned_addr learned my addr 172.21.15.46:0/109343117 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:49.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.667+0000 7f4aedffb640 1 -- 172.21.15.46:0/109343117 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237701832 0 0) 0x7f4af00c75b0 con 0x7f4af00c6ad0 2024-01-23T08:55:49.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.667+0000 7f4aedffb640 1 -- 172.21.15.46:0/109343117 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4adc003530 con 0x7f4af00c6ad0 2024-01-23T08:55:49.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.671+0000 7f4aedffb640 1 -- 172.21.15.46:0/109343117 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2836898900 0 0) 0x7f4adc003530 con 0x7f4af00c6ad0 2024-01-23T08:55:49.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.671+0000 7f4aedffb640 1 -- 172.21.15.46:0/109343117 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4af0158070 msgr2=0x7f4af00c5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:49.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.671+0000 7f4aedffb640 1 --2- 172.21.15.46:0/109343117 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4af0158070 0x7f4af00c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:49.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.671+0000 7f4aedffb640 1 -- 172.21.15.46:0/109343117 >> v1:172.21.15.175:6789/0 conn(0x7f4af00c6eb0 legacy=0x7f4af0151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:49.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.671+0000 7f4aedffb640 1 -- 172.21.15.46:0/109343117 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af01575d0 con 0x7f4af00c6ad0 2024-01-23T08:55:49.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.671+0000 7f4aedffb640 1 -- 172.21.15.46:0/109343117 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466917103 0 0) 0x7f4ae8001680 con 0x7f4af00c6ad0 2024-01-23T08:55:49.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.671+0000 7f4aedffb640 1 -- 172.21.15.46:0/109343117 >> v1:172.21.15.46:6789/0 conn(0x7f4af00c6ad0 legacy=0x7f4af00c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:49.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.671+0000 7f4aedffb640 1 --2- 172.21.15.46:0/109343117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4adc0039b0 0x7f4adc003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:49.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.671+0000 7f4aedffb640 1 --2- 172.21.15.46:0/109343117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4adc0047d0 0x7f4adc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:49.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.671+0000 7f4aedffb640 1 --2- 172.21.15.46:0/109343117 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4af0158070 0x7f4adc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:49.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.671+0000 7f4aedffb640 1 -- 172.21.15.46:0/109343117 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af01573c0 con 0x7f4adc0039b0 2024-01-23T08:55:49.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.671+0000 7f4aedffb640 1 -- 172.21.15.46:0/109343117 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc005580 con 0x7f4adc0047d0 2024-01-23T08:55:49.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.671+0000 7f4aedffb640 1 -- 172.21.15.46:0/109343117 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc00bed0 con 0x7f4af0158070 2024-01-23T08:55:49.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.675+0000 7f4aeeffd640 1 --2- 172.21.15.46:0/109343117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4adc0039b0 0x7f4adc003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:49.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.679+0000 7f4aeeffd640 1 -- 172.21.15.46:0/109343117 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4af0158070 msgr2=0x7f4adc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:49.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.679+0000 7f4aeeffd640 1 --2- 172.21.15.46:0/109343117 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4af0158070 0x7f4adc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:49.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.679+0000 7f4aeeffd640 1 -- 172.21.15.46:0/109343117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4adc0047d0 msgr2=0x7f4adc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:49.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.679+0000 7f4aeeffd640 1 --2- 172.21.15.46:0/109343117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4adc0047d0 0x7f4adc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:49.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.679+0000 7f4aeeffd640 1 -- 172.21.15.46:0/109343117 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4adc003530 con 0x7f4adc0039b0 2024-01-23T08:55:49.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.679+0000 7f4aeeffd640 1 --2- 172.21.15.46:0/109343117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4adc0039b0 0x7f4adc003db0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4ae800c110 tx=0x7f4ae801f2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c923349928316f2 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:49.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.683+0000 7f4aedffb640 1 -- 172.21.15.46:0/109343117 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae80058e0 con 0x7f4adc0039b0 2024-01-23T08:55:49.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.683+0000 7f4aedffb640 1 -- 172.21.15.46:0/109343117 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae8005a40 con 0x7f4adc0039b0 2024-01-23T08:55:49.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.683+0000 7f4aedffb640 1 -- 172.21.15.46:0/109343117 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8005df0 con 0x7f4adc0039b0 2024-01-23T08:55:49.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.687+0000 7f4af582f640 1 -- 172.21.15.46:0/109343117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4adc0039b0 msgr2=0x7f4adc003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:49.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.687+0000 7f4af582f640 1 --2- 172.21.15.46:0/109343117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4adc0039b0 0x7f4adc003db0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4ae800c110 tx=0x7f4ae801f2d0 comp rx=0 tx=0).stop 2024-01-23T08:55:49.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.687+0000 7f4aef7fe640 1 -- 172.21.15.46:0/109343117 reap_dead start 2024-01-23T08:55:49.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.687+0000 7f4af582f640 1 -- 172.21.15.46:0/109343117 shutdown_connections 2024-01-23T08:55:49.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.687+0000 7f4af582f640 1 -- 172.21.15.46:0/109343117 >> 172.21.15.46:0/109343117 conn(0x7f4af00cbe70 msgr2=0x7f4af00cc280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:49.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.687+0000 7f4af582f640 1 -- 172.21.15.46:0/109343117 shutdown_connections 2024-01-23T08:55:49.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.687+0000 7f4af582f640 1 -- 172.21.15.46:0/109343117 wait complete. 2024-01-23T08:55:49.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.687+0000 7f4af582f640 1 Processor -- start 2024-01-23T08:55:49.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.687+0000 7f4af582f640 1 -- start start 2024-01-23T08:55:49.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.687+0000 7f4af582f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4adc0039b0 0x7f4af0146ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:49.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.687+0000 7f4af582f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4af014aed0 0x7f4af0155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:49.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.687+0000 7f4af582f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4af01598b0 0x7f4af014c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:49.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.687+0000 7f4af582f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af01595f0 con 0x7f4adc0039b0 2024-01-23T08:55:49.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.687+0000 7f4af582f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af0155f50 con 0x7f4af014aed0 2024-01-23T08:55:49.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.687+0000 7f4af582f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af0156a90 con 0x7f4af01598b0 2024-01-23T08:55:49.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.687+0000 7f4aeeffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4adc0039b0 0x7f4af0146ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:49.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.691+0000 7f4aeeffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4adc0039b0 0x7f4af0146ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36082/0 (socket says 172.21.15.46:36082) 2024-01-23T08:55:49.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.691+0000 7f4aeeffd640 1 -- 172.21.15.46:0/1801600649 learned_addr learned my addr 172.21.15.46:0/1801600649 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:49.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.691+0000 7f4aeeffd640 1 -- 172.21.15.46:0/1801600649 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4af01598b0 msgr2=0x7f4af014c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:49.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.691+0000 7f4aeeffd640 1 --2- 172.21.15.46:0/1801600649 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4af01598b0 0x7f4af014c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:49.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.691+0000 7f4aeeffd640 1 -- 172.21.15.46:0/1801600649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4af014aed0 msgr2=0x7f4af0155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:49.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.691+0000 7f4aeeffd640 1 --2- 172.21.15.46:0/1801600649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4af014aed0 0x7f4af0155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:49.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.691+0000 7f4aeeffd640 1 -- 172.21.15.46:0/1801600649 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af0156d70 con 0x7f4adc0039b0 2024-01-23T08:55:49.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.695+0000 7f4aeeffd640 1 --2- 172.21.15.46:0/1801600649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4adc0039b0 0x7f4af0146ad0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4ae800c110 tx=0x7f4adc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:49.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.699+0000 7f4ae7fff640 1 -- 172.21.15.46:0/1801600649 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae80b7070 con 0x7f4adc0039b0 2024-01-23T08:55:49.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.699+0000 7f4ae7fff640 1 -- 172.21.15.46:0/1801600649 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae8005bb0 con 0x7f4adc0039b0 2024-01-23T08:55:49.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.699+0000 7f4ae7fff640 1 -- 172.21.15.46:0/1801600649 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8007090 con 0x7f4adc0039b0 2024-01-23T08:55:49.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.699+0000 7f4af582f640 1 -- 172.21.15.46:0/1801600649 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af0157050 con 0x7f4adc0039b0 2024-01-23T08:55:49.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.699+0000 7f4af582f640 1 -- 172.21.15.46:0/1801600649 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af01462d0 con 0x7f4adc0039b0 2024-01-23T08:55:49.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.699+0000 7f4af582f640 1 -- 172.21.15.46:0/1801600649 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af0074340 con 0x7f4adc0039b0 2024-01-23T08:55:49.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:49.999+0000 7f4ae7fff640 1 -- 172.21.15.46:0/1801600649 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f4ae80071f0 con 0x7f4adc0039b0 2024-01-23T08:55:49.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:50.003+0000 7f4ae7fff640 1 --2- 172.21.15.46:0/1801600649 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4ad0066530 0x7f4ad00689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:50.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:50.003+0000 7f4aee7fc640 1 --2- 172.21.15.46:0/1801600649 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4ad0066530 0x7f4ad00689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:50.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:50.003+0000 7f4aee7fc640 1 --2- 172.21.15.46:0/1801600649 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4ad0066530 0x7f4ad00689f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8007fd0 tx=0x7f4ad80079a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:50.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:50.035+0000 7f4ae7fff640 1 -- 172.21.15.46:0/1801600649 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f4ae80f29c0 con 0x7f4adc0039b0 2024-01-23T08:55:50.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:50.035+0000 7f4ae7fff640 1 -- 172.21.15.46:0/1801600649 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f4ae80ee600 con 0x7f4adc0039b0 2024-01-23T08:55:50.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:50.247+0000 7f4af582f640 1 -- 172.21.15.46:0/1801600649 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4af00c7390 con 0x7f4adc0039b0 2024-01-23T08:55:50.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:50.283+0000 7f4ae7fff640 1 -- 172.21.15.46:0/1801600649 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6584 (secure 0 0 0) 0x7f4ae80f1c20 con 0x7f4adc0039b0 2024-01-23T08:55:50.282 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T08:55:50.283 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4208,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/397511399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":397511399},{"type":"v1","addr":"172.21.15.175:6835","nonce":397511399}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-23T08:54:42.028655+0000","modified":"2024-01-23T08:55:33.028425+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4242,"mds_1":4239,"mds_2":4234,"mds_3":4228,"mds_4":4214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4214":{"gid":4214,"name":"c","rank":4,"incarnation":17,"state":"up:active","state_seq":21,"addr":"172.21.15.46:6835/1620040020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1620040020},{"type":"v1","addr":"172.21.15.46:6835","nonce":1620040020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4228":{"gid":4228,"name":"b","rank":3,"incarnation":15,"state":"up:active","state_seq":20,"addr":"172.21.15.175:6833/2714415350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2714415350},{"type":"v1","addr":"172.21.15.175:6833","nonce":2714415350}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4234":{"gid":4234,"name":"f","rank":2,"incarnation":13,"state":"up:active","state_seq":19,"addr":"172.21.15.175:6837/3103300888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3103300888},{"type":"v1","addr":"172.21.15.175:6837","nonce":3103300888}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4239":{"gid":4239,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6837/338965660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":338965660},{"type":"v1","addr":"172.21.15.46:6837","nonce":338965660}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4242":{"gid":4242,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":9,"addr":"172.21.15.46:6839/1889172114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1889172114},{"type":"v1","addr":"172.21.15.46:6839","nonce":1889172114}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-23T08:55:50.283 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 18 2024-01-23T08:55:50.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:50.287+0000 7f4af582f640 1 -- 172.21.15.46:0/1801600649 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4ad0066530 msgr2=0x7f4ad00689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:50.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:50.287+0000 7f4af582f640 1 --2- 172.21.15.46:0/1801600649 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4ad0066530 0x7f4ad00689f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8007fd0 tx=0x7f4ad80079a0 comp rx=0 tx=0).stop 2024-01-23T08:55:50.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:50.287+0000 7f4af582f640 1 -- 172.21.15.46:0/1801600649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4adc0039b0 msgr2=0x7f4af0146ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:50.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:50.287+0000 7f4af582f640 1 --2- 172.21.15.46:0/1801600649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4adc0039b0 0x7f4af0146ad0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4ae800c110 tx=0x7f4adc005800 comp rx=0 tx=0).stop 2024-01-23T08:55:50.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:50.287+0000 7f4af582f640 1 -- 172.21.15.46:0/1801600649 shutdown_connections 2024-01-23T08:55:50.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:50.287+0000 7f4af582f640 1 --2- 172.21.15.46:0/1801600649 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4af01598b0 0x7f4af014c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:50.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:50.287+0000 7f4af582f640 1 --2- 172.21.15.46:0/1801600649 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4ad0066530 0x7f4ad00689f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:50.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:50.287+0000 7f4af582f640 1 --2- 172.21.15.46:0/1801600649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4af014aed0 0x7f4af0155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:50.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:50.287+0000 7f4af582f640 1 --2- 172.21.15.46:0/1801600649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4adc0039b0 0x7f4af0146ad0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:50.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:50.287+0000 7f4af582f640 1 -- 172.21.15.46:0/1801600649 >> 172.21.15.46:0/1801600649 conn(0x7f4af00cbe70 msgr2=0x7f4af006abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:50.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:50.287+0000 7f4af582f640 1 -- 172.21.15.46:0/1801600649 shutdown_connections 2024-01-23T08:55:50.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:50.287+0000 7f4af582f640 1 -- 172.21.15.46:0/1801600649 wait complete. 2024-01-23T08:55:50.909 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-23T08:54:42.028655+0000', 'modified': '2024-01-23T08:55:33.028425+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4242, 'mds_1': 4239, 'mds_2': 4234, 'mds_3': 4228, 'mds_4': 4214}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4214': {'gid': 4214, 'name': 'c', 'rank': 4, 'incarnation': 17, 'state': 'up:active', 'state_seq': 21, 'addr': '172.21.15.46:6835/1620040020', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6834', 'nonce': 1620040020}, {'type': 'v1', 'addr': '172.21.15.46:6835', 'nonce': 1620040020}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4228': {'gid': 4228, 'name': 'b', 'rank': 3, 'incarnation': 15, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.175:6833/2714415350', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6832', 'nonce': 2714415350}, {'type': 'v1', 'addr': '172.21.15.175:6833', 'nonce': 2714415350}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4234': {'gid': 4234, 'name': 'f', 'rank': 2, 'incarnation': 13, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.175:6837/3103300888', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6836', 'nonce': 3103300888}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 3103300888}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4239': {'gid': 4239, 'name': 'a', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.46:6837/338965660', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6836', 'nonce': 338965660}, {'type': 'v1', 'addr': '172.21.15.46:6837', 'nonce': 338965660}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4242': {'gid': 4242, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.46:6839/1889172114', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6838', 'nonce': 1889172114}, {'type': 'v1', 'addr': '172.21.15.46:6839', 'nonce': 1889172114}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-23T08:55:50.909 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-01-23T08:55:50.909 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-01-23T08:55:51.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.051+0000 7f9d96c55640 1 Processor -- start 2024-01-23T08:55:51.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.051+0000 7f9d96c55640 1 -- start start 2024-01-23T08:55:51.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.051+0000 7f9d96c55640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9d901536b0 0x7f9d900c7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:51.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.051+0000 7f9d96c55640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d90153a90 0x7f9d9006ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:51.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.051+0000 7f9d96c55640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9d900c2bc0 0x7f9d900c8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:51.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.051+0000 7f9d96c55640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d900c1330 con 0x7f9d900c2bc0 2024-01-23T08:55:51.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.051+0000 7f9d96c55640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d900c6a90 con 0x7f9d901536b0 2024-01-23T08:55:51.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.051+0000 7f9d96c55640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9006e000 con 0x7f9d90153a90 2024-01-23T08:55:51.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.055+0000 7f9d949f1640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9d901536b0 0x7f9d900c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:51.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.055+0000 7f9d8ffff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d90153a90 0x7f9d9006ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:51.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.055+0000 7f9d8ffff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d90153a90 0x7f9d9006ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:35660/0 (socket says 172.21.15.46:35660) 2024-01-23T08:55:51.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.055+0000 7f9d8ffff640 1 -- 172.21.15.46:0/87633725 learned_addr learned my addr 172.21.15.46:0/87633725 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:51.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.063+0000 7f9d8ffff640 1 -- 172.21.15.46:0/87633725 >> v2:172.21.15.175:3300/0 conn(0x7f9d901536b0 msgr2=0x7f9d900c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:51.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.063+0000 7f9d8ffff640 1 --2- 172.21.15.46:0/87633725 >> v2:172.21.15.175:3300/0 conn(0x7f9d901536b0 0x7f9d900c7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.063+0000 7f9d8ffff640 1 -- 172.21.15.46:0/87633725 >> v2:172.21.15.46:3300/0 conn(0x7f9d900c2bc0 msgr2=0x7f9d900c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:51.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.063+0000 7f9d8ffff640 1 --2- 172.21.15.46:0/87633725 >> v2:172.21.15.46:3300/0 conn(0x7f9d900c2bc0 0x7f9d900c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.063+0000 7f9d8ffff640 1 -- 172.21.15.46:0/87633725 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d9006e2e0 con 0x7f9d90153a90 2024-01-23T08:55:51.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.067+0000 7f9d8ffff640 1 --2- 172.21.15.46:0/87633725 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d90153a90 0x7f9d9006ebe0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9d900717f0 tx=0x7f9d7801ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47cf57d5dbe2f478 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:51.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.075+0000 7f9d8f7fe640 1 -- 172.21.15.46:0/87633725 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d780a89b0 con 0x7f9d90153a90 2024-01-23T08:55:51.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.075+0000 7f9d8f7fe640 1 -- 172.21.15.46:0/87633725 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d780a8b10 con 0x7f9d90153a90 2024-01-23T08:55:51.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.075+0000 7f9d8f7fe640 1 -- 172.21.15.46:0/87633725 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d780a8ea0 con 0x7f9d90153a90 2024-01-23T08:55:51.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.079+0000 7f9d96c55640 1 -- 172.21.15.46:0/87633725 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d90153a90 msgr2=0x7f9d9006ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:51.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.079+0000 7f9d96c55640 1 --2- 172.21.15.46:0/87633725 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d90153a90 0x7f9d9006ebe0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9d900717f0 tx=0x7f9d7801ecf0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.079+0000 7f9d96c55640 1 -- 172.21.15.46:0/87633725 shutdown_connections 2024-01-23T08:55:51.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.079+0000 7f9d96c55640 1 --2- 172.21.15.46:0/87633725 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d90153a90 0x7f9d9006ebe0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.079+0000 7f9d96c55640 1 --2- 172.21.15.46:0/87633725 >> v2:172.21.15.46:3300/0 conn(0x7f9d900c2bc0 0x7f9d900c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.079+0000 7f9d96c55640 1 --2- 172.21.15.46:0/87633725 >> v2:172.21.15.175:3300/0 conn(0x7f9d901536b0 0x7f9d900c7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.079+0000 7f9d96c55640 1 -- 172.21.15.46:0/87633725 >> 172.21.15.46:0/87633725 conn(0x7f9d9006b770 msgr2=0x7f9d9006bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:51.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.079+0000 7f9d96c55640 1 -- 172.21.15.46:0/87633725 shutdown_connections 2024-01-23T08:55:51.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.079+0000 7f9d96c55640 1 -- 172.21.15.46:0/87633725 wait complete. 2024-01-23T08:55:51.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.079+0000 7f9d96c55640 1 Processor -- start 2024-01-23T08:55:51.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.079+0000 7f9d96c55640 1 -- start start 2024-01-23T08:55:51.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.079+0000 7f9d96c55640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d900c2bc0 0x7f9d901593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:51.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.079+0000 7f9d96c55640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d901536b0 0x7f9d901f0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:51.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.079+0000 7f9d96c55640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d90156600 0x7f9d90154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:51.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.079+0000 7f9d96c55640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d90154040 con 0x7f9d900c2bc0 2024-01-23T08:55:51.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.079+0000 7f9d96c55640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d901f0560 con 0x7f9d901536b0 2024-01-23T08:55:51.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.079+0000 7f9d96c55640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d90159f20 con 0x7f9d90156600 2024-01-23T08:55:51.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.083+0000 7f9d949f1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d900c2bc0 0x7f9d901593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:51.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.083+0000 7f9d949f1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d900c2bc0 0x7f9d901593e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36098/0 (socket says 172.21.15.46:36098) 2024-01-23T08:55:51.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.083+0000 7f9d949f1640 1 -- 172.21.15.46:0/934802710 learned_addr learned my addr 172.21.15.46:0/934802710 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:51.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.091+0000 7f9d949f1640 1 -- 172.21.15.46:0/934802710 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d90156600 msgr2=0x7f9d90154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:51.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.091+0000 7f9d949f1640 1 --2- 172.21.15.46:0/934802710 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d90156600 0x7f9d90154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.091+0000 7f9d949f1640 1 -- 172.21.15.46:0/934802710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d901536b0 msgr2=0x7f9d901f0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:51.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.091+0000 7f9d949f1640 1 --2- 172.21.15.46:0/934802710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d901536b0 0x7f9d901f0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.091+0000 7f9d949f1640 1 -- 172.21.15.46:0/934802710 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d780094d0 con 0x7f9d900c2bc0 2024-01-23T08:55:51.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.095+0000 7f9d949f1640 1 --2- 172.21.15.46:0/934802710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d900c2bc0 0x7f9d901593e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800e930 tx=0x7f9d8800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:51.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.103+0000 7f9d8d7fa640 1 -- 172.21.15.46:0/934802710 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d88009690 con 0x7f9d900c2bc0 2024-01-23T08:55:51.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.103+0000 7f9d8d7fa640 1 -- 172.21.15.46:0/934802710 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8800ca00 con 0x7f9d900c2bc0 2024-01-23T08:55:51.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.103+0000 7f9d8d7fa640 1 -- 172.21.15.46:0/934802710 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8800cd70 con 0x7f9d900c2bc0 2024-01-23T08:55:51.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.103+0000 7f9d96c55640 1 -- 172.21.15.46:0/934802710 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d90158190 con 0x7f9d900c2bc0 2024-01-23T08:55:51.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.103+0000 7f9d96c55640 1 -- 172.21.15.46:0/934802710 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d90157bf0 con 0x7f9d900c2bc0 2024-01-23T08:55:51.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.103+0000 7f9d99db2000 1 Processor -- start 2024-01-23T08:55:51.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.103+0000 7f9d99db2000 1 -- start start 2024-01-23T08:55:51.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.107+0000 7f9d99db2000 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ae5298b730 0x55ae5298bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:51.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.107+0000 7f9d99db2000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae529c67d0 0x55ae529c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:51.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.107+0000 7f9d99db2000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ae529c70f0 0x55ae529d1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:51.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.107+0000 7f9d99db2000 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae527e1d70 con 0x55ae5298b730 2024-01-23T08:55:51.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.107+0000 7f9d99db2000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae527ddba0 con 0x55ae529c67d0 2024-01-23T08:55:51.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.107+0000 7f9d99db2000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ae527db0d0 con 0x55ae529c70f0 2024-01-23T08:55:51.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.111+0000 7f9d951f2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ae5298b730 0x55ae5298bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:51.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.127+0000 7f9d8d7fa640 1 -- 172.21.15.46:0/934802710 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f9d88013470 con 0x7f9d900c2bc0 2024-01-23T08:55:51.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.127+0000 7f9d8d7fa640 1 --2- 172.21.15.46:0/934802710 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9d70066580 0x7f9d70068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:51.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.127+0000 7f9d951f2640 1 --2- 172.21.15.46:0/934802710 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9d70066580 0x7f9d70068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:51.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.127+0000 7f9d951f2640 1 --2- 172.21.15.46:0/934802710 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9d70066580 0x7f9d70068a40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9d900c3070 tx=0x7f9d8000a570 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:51.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.131+0000 7f9d8d7fa640 1 -- 172.21.15.46:0/934802710 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f9d880578f0 con 0x7f9d900c2bc0 2024-01-23T08:55:51.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.131+0000 7f9d951f2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ae5298b730 0x55ae5298bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36106/0 (socket says 172.21.15.46:36106) 2024-01-23T08:55:51.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.131+0000 7f9d951f2640 1 -- 172.21.15.46:0/755519526 learned_addr learned my addr 172.21.15.46:0/755519526 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:51.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.131+0000 7f9d951f2640 1 -- 172.21.15.46:0/755519526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ae529c70f0 msgr2=0x55ae529d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:51.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.131+0000 7f9d951f2640 1 --2- 172.21.15.46:0/755519526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ae529c70f0 0x55ae529d1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.131+0000 7f9d951f2640 1 -- 172.21.15.46:0/755519526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae529c67d0 msgr2=0x55ae529c6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:51.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.131+0000 7f9d951f2640 1 --2- 172.21.15.46:0/755519526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae529c67d0 0x55ae529c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.131+0000 7f9d951f2640 1 -- 172.21.15.46:0/755519526 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ae524cd890 con 0x55ae5298b730 2024-01-23T08:55:51.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.135+0000 7f9d951f2640 1 --2- 172.21.15.46:0/755519526 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ae5298b730 0x55ae5298bb10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000a7b0 tx=0x7f9d80015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39cfaa4efa2e666f server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:51.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.139+0000 7f9d867fc640 1 -- 172.21.15.46:0/755519526 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8001b070 con 0x55ae5298b730 2024-01-23T08:55:51.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.139+0000 7f9d867fc640 1 -- 172.21.15.46:0/755519526 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d80015450 con 0x55ae5298b730 2024-01-23T08:55:51.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.139+0000 7f9d867fc640 1 -- 172.21.15.46:0/755519526 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d80012070 con 0x55ae5298b730 2024-01-23T08:55:51.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.139+0000 7f9d99db2000 1 -- 172.21.15.46:0/755519526 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ae5298b730 msgr2=0x55ae5298bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:51.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.143+0000 7f9d99db2000 1 --2- 172.21.15.46:0/755519526 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ae5298b730 0x55ae5298bb10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000a7b0 tx=0x7f9d80015000 comp rx=0 tx=0).stop 2024-01-23T08:55:51.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.143+0000 7f9d99db2000 1 -- 172.21.15.46:0/755519526 shutdown_connections 2024-01-23T08:55:51.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.143+0000 7f9d99db2000 1 --2- 172.21.15.46:0/755519526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ae529c70f0 0x55ae529d1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.143+0000 7f9d99db2000 1 --2- 172.21.15.46:0/755519526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae529c67d0 0x55ae529c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.143+0000 7f9d99db2000 1 --2- 172.21.15.46:0/755519526 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ae5298b730 0x55ae5298bb10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.143+0000 7f9d99db2000 1 -- 172.21.15.46:0/755519526 >> 172.21.15.46:0/755519526 conn(0x55ae529c2580 msgr2=0x55ae529c4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:51.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.143+0000 7f9d99db2000 1 -- 172.21.15.46:0/755519526 shutdown_connections 2024-01-23T08:55:51.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.143+0000 7f9d99db2000 1 -- 172.21.15.46:0/755519526 wait complete. 2024-01-23T08:55:51.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.143+0000 7f9d99db2000 1 -- start start 2024-01-23T08:55:51.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.143+0000 7f9d99db2000 1 Processor -- start 2024-01-23T08:55:51.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.143+0000 7f9d99db2000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ae5298b730 0x55ae529c0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:51.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.143+0000 7f9d99db2000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae529c67d0 0x55ae529c1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:51.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.143+0000 7f9d99db2000 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ae529c70f0 0x55ae529cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:51.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.143+0000 7f9d99db2000 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae527d69c0 con 0x55ae529c70f0 2024-01-23T08:55:51.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.143+0000 7f9d99db2000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae5278e040 con 0x55ae529c67d0 2024-01-23T08:55:51.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.143+0000 7f9d99db2000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ae52793ee0 con 0x55ae5298b730 2024-01-23T08:55:51.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.143+0000 7f9d99db2000 10 client.0 _ll_register_callbacks cb 0x55ae527911b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-23T08:55:51.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.143+0000 7f9d951f2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ae529c70f0 0x55ae529cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:51.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.143+0000 7f9d951f2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ae529c70f0 0x55ae529cd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36110/0 (socket says 172.21.15.46:36110) 2024-01-23T08:55:51.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.143+0000 7f9d951f2640 1 -- 172.21.15.46:0/621469475 learned_addr learned my addr 172.21.15.46:0/621469475 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:51.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.147+0000 7f9d951f2640 1 -- 172.21.15.46:0/621469475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ae5298b730 msgr2=0x55ae529c0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:51.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.147+0000 7f9d951f2640 1 --2- 172.21.15.46:0/621469475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ae5298b730 0x55ae529c0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.147+0000 7f9d951f2640 1 -- 172.21.15.46:0/621469475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae529c67d0 msgr2=0x55ae529c1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:51.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.147+0000 7f9d951f2640 1 --2- 172.21.15.46:0/621469475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae529c67d0 0x55ae529c1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.147+0000 7f9d951f2640 1 -- 172.21.15.46:0/621469475 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d80016430 con 0x55ae529c70f0 2024-01-23T08:55:51.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.151+0000 7f9d951f2640 1 --2- 172.21.15.46:0/621469475 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ae529c70f0 0x55ae529cd950 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000a7b0 tx=0x7f9d80012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcdb44d2cb9d304 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:51.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.151+0000 7f9d6f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-01-23T08:55:51.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.155+0000 7f9d6f7fe640 1 -- 172.21.15.46:0/621469475 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8001b040 con 0x55ae529c70f0 2024-01-23T08:55:51.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.155+0000 7f9d6f7fe640 1 -- 172.21.15.46:0/621469475 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f9d8002c480 con 0x55ae529c70f0 2024-01-23T08:55:51.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.155+0000 7f9d99db2000 1 -- 172.21.15.46:0/621469475 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ae5275ce30 con 0x55ae529c70f0 2024-01-23T08:55:51.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.155+0000 7f9d6f7fe640 1 -- 172.21.15.46:0/621469475 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d8002c640 con 0x55ae529c70f0 2024-01-23T08:55:51.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.155+0000 7f9d99db2000 10 client.4674 fetch_fsmap learned FSMap version 18 2024-01-23T08:55:51.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.155+0000 7f9d99db2000 1 -- 172.21.15.46:0/621469475 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55ae527965e0 con 0x55ae529c70f0 2024-01-23T08:55:51.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.163+0000 7f9d6f7fe640 1 -- 172.21.15.46:0/621469475 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ae5275ce30 con 0x55ae529c70f0 2024-01-23T08:55:51.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.163+0000 7f9d6f7fe640 1 -- 172.21.15.46:0/621469475 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f9d80028030 con 0x55ae529c70f0 2024-01-23T08:55:51.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.163+0000 7f9d99db2000 10 client.4674 fetch_fsmap finished waiting for FSMap version 18 2024-01-23T08:55:51.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.163+0000 7f9d99db2000 10 client.4674 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-23T08:55:51.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.163+0000 7f9d99db2000 20 client.4674 populate_metadata read hostname 'smithi046' 2024-01-23T08:55:51.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.163+0000 7f9d99db2000 1 --2- 172.21.15.46:0/621469475 >> [v2:172.21.15.46:6834/1620040020,v1:172.21.15.46:6835/1620040020] conn(0x55ae529ce690 0x55ae529cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:51.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.163+0000 7f9d99db2000 4 client.4674 mds_command: new command op to 4214 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:55:51.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.163+0000 7f9d99db2000 1 -- 172.21.15.46:0/621469475 --> [v2:172.21.15.46:6834/1620040020,v1:172.21.15.46:6835/1620040020] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ae52793870 con 0x55ae529ce690 2024-01-23T08:55:51.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.163+0000 7f9d949f1640 1 --2- 172.21.15.46:0/621469475 >> [v2:172.21.15.46:6834/1620040020,v1:172.21.15.46:6835/1620040020] conn(0x55ae529ce690 0x55ae529cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:51.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.223+0000 7f9d6f7fe640 10 client.4674 ms_handle_connect on v2:172.21.15.46:6834/1620040020 2024-01-23T08:55:51.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.223+0000 7f9d949f1640 1 --2- 172.21.15.46:0/621469475 >> [v2:172.21.15.46:6834/1620040020,v1:172.21.15.46:6835/1620040020] conn(0x55ae529ce690 0x55ae529cea70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c9f8d7c7b85cd5d4 server_cookie=a48f20874f073202 in_seq=0 out_seq=0 2024-01-23T08:55:51.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.447+0000 7f9d6f7fe640 1 -- 172.21.15.46:0/621469475 <== mds.4 v2:172.21.15.46:6834/1620040020 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ae52793870 con 0x55ae529ce690 2024-01-23T08:55:51.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.447+0000 7f9d6f7fe640 10 client.4674 handle_command_reply: tid=0 2024-01-23T08:55:51.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.447+0000 7f9d99db2000 1 client.4674 shutdown 2024-01-23T08:55:51.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.451+0000 7f9d99db2000 1 -- 172.21.15.46:0/621469475 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ae529c70f0 msgr2=0x55ae529cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:51.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.451+0000 7f9d99db2000 1 --2- 172.21.15.46:0/621469475 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ae529c70f0 0x55ae529cd950 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000a7b0 tx=0x7f9d80012000 comp rx=0 tx=0).stop 2024-01-23T08:55:51.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.451+0000 7f9d99db2000 1 -- 172.21.15.46:0/621469475 shutdown_connections 2024-01-23T08:55:51.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.451+0000 7f9d99db2000 1 --2- 172.21.15.46:0/621469475 >> [v2:172.21.15.46:6834/1620040020,v1:172.21.15.46:6835/1620040020] conn(0x55ae529ce690 0x55ae529cea70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.451+0000 7f9d99db2000 1 --2- 172.21.15.46:0/621469475 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ae529c70f0 0x55ae529cd950 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.451+0000 7f9d6f7fe640 0 client.4674 ms_handle_reset on v2:172.21.15.46:6834/1620040020 2024-01-23T08:55:51.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.451+0000 7f9d99db2000 1 --2- 172.21.15.46:0/621469475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae529c67d0 0x55ae529c1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.451+0000 7f9d99db2000 1 --2- 172.21.15.46:0/621469475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ae5298b730 0x55ae529c0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.451+0000 7f9d99db2000 1 -- 172.21.15.46:0/621469475 >> 172.21.15.46:0/621469475 conn(0x55ae529c2580 msgr2=0x55ae529c1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:51.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.451+0000 7f9d99db2000 1 -- 172.21.15.46:0/621469475 shutdown_connections 2024-01-23T08:55:51.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.451+0000 7f9d99db2000 1 -- 172.21.15.46:0/621469475 wait complete. 2024-01-23T08:55:51.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.451+0000 7f9d99db2000 20 client.4674 trim_cache size 0 max 16384 2024-01-23T08:55:51.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.487+0000 7f9d99db2000 1 Processor -- start 2024-01-23T08:55:51.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.487+0000 7f9d99db2000 1 -- start start 2024-01-23T08:55:51.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.487+0000 7f9d99db2000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ae5298b730 0x55ae529c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:51.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.487+0000 7f9d99db2000 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ae529c67d0 0x55ae529d91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:51.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.491+0000 7f9d99db2000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae529c70f0 0x55ae529d9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:51.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.491+0000 7f9d99db2000 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae5248e940 con 0x55ae529c67d0 2024-01-23T08:55:51.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.491+0000 7f9d99db2000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae52759e30 con 0x55ae529c70f0 2024-01-23T08:55:51.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.491+0000 7f9d99db2000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ae527d0810 con 0x55ae5298b730 2024-01-23T08:55:51.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.535+0000 7f9d951f2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae529c70f0 0x55ae529d9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:51.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.535+0000 7f9d951f2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae529c70f0 0x55ae529d9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:42466/0 (socket says 172.21.15.46:42466) 2024-01-23T08:55:51.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.535+0000 7f9d951f2640 1 -- 172.21.15.46:0/3441376675 learned_addr learned my addr 172.21.15.46:0/3441376675 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:51.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.543+0000 7f9d8ffff640 1 --2- 172.21.15.46:0/3441376675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ae529c67d0 0x55ae529d91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:51.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.547+0000 7f9d951f2640 1 -- 172.21.15.46:0/3441376675 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ae5298b730 msgr2=0x55ae529c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:51.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.547+0000 7f9d951f2640 1 --2- 172.21.15.46:0/3441376675 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ae5298b730 0x55ae529c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.547+0000 7f9d951f2640 1 -- 172.21.15.46:0/3441376675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ae529c67d0 msgr2=0x55ae529d91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:51.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.547+0000 7f9d951f2640 1 --2- 172.21.15.46:0/3441376675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ae529c67d0 0x55ae529d91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.547+0000 7f9d951f2640 1 -- 172.21.15.46:0/3441376675 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ae5277c8e0 con 0x55ae529c70f0 2024-01-23T08:55:51.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.551+0000 7f9d951f2640 1 --2- 172.21.15.46:0/3441376675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae529c70f0 0x55ae529d9730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000aee0 tx=0x7f9d80004bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=daa57cc762b398ef server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:51.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.563+0000 7f9d85ffb640 1 -- 172.21.15.46:0/3441376675 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8001b050 con 0x55ae529c70f0 2024-01-23T08:55:51.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.563+0000 7f9d85ffb640 1 -- 172.21.15.46:0/3441376675 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d80015dd0 con 0x55ae529c70f0 2024-01-23T08:55:51.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.563+0000 7f9d85ffb640 1 -- 172.21.15.46:0/3441376675 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d80012070 con 0x55ae529c70f0 2024-01-23T08:55:51.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.563+0000 7f9d99db2000 1 -- 172.21.15.46:0/3441376675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae529c70f0 msgr2=0x55ae529d9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:51.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.563+0000 7f9d99db2000 1 --2- 172.21.15.46:0/3441376675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae529c70f0 0x55ae529d9730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000aee0 tx=0x7f9d80004bd0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.563+0000 7f9d99db2000 1 -- 172.21.15.46:0/3441376675 shutdown_connections 2024-01-23T08:55:51.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.563+0000 7f9d99db2000 1 --2- 172.21.15.46:0/3441376675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae529c70f0 0x55ae529d9730 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.563+0000 7f9d99db2000 1 --2- 172.21.15.46:0/3441376675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ae529c67d0 0x55ae529d91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.563+0000 7f9d99db2000 1 --2- 172.21.15.46:0/3441376675 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ae5298b730 0x55ae529c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.563+0000 7f9d99db2000 1 -- 172.21.15.46:0/3441376675 >> 172.21.15.46:0/3441376675 conn(0x55ae529c2580 msgr2=0x55ae529d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:51.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.563+0000 7f9d99db2000 1 -- 172.21.15.46:0/3441376675 shutdown_connections 2024-01-23T08:55:51.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.563+0000 7f9d99db2000 1 -- 172.21.15.46:0/3441376675 wait complete. 2024-01-23T08:55:51.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.567+0000 7f9d99db2000 1 -- start start 2024-01-23T08:55:51.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.567+0000 7f9d99db2000 1 Processor -- start 2024-01-23T08:55:51.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.567+0000 7f9d99db2000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae5298b730 0x55ae52a2c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:51.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.567+0000 7f9d99db2000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ae529c67d0 0x55ae52a2c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:51.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.567+0000 7f9d99db2000 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ae529c70f0 0x55ae529895b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:51.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.567+0000 7f9d99db2000 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae527d0cc0 con 0x55ae529c70f0 2024-01-23T08:55:51.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.567+0000 7f9d99db2000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae5282be40 con 0x55ae5298b730 2024-01-23T08:55:51.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.567+0000 7f9d99db2000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ae524ce1b0 con 0x55ae529c67d0 2024-01-23T08:55:51.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.567+0000 7f9d99db2000 10 client.0 _ll_register_callbacks cb 0x55ae52803a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-23T08:55:51.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.571+0000 7f9d8ffff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ae529c67d0 0x55ae52a2c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:51.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.571+0000 7f9d949f1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae5298b730 0x55ae52a2c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:51.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.571+0000 7f9d8ffff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ae529c67d0 0x55ae52a2c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:35714/0 (socket says 172.21.15.46:35714) 2024-01-23T08:55:51.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.571+0000 7f9d8ffff640 1 -- 172.21.15.46:0/2235597443 learned_addr learned my addr 172.21.15.46:0/2235597443 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:51.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.579+0000 7f9d949f1640 1 -- 172.21.15.46:0/2235597443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ae529c67d0 msgr2=0x55ae52a2c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:51.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.579+0000 7f9d949f1640 1 --2- 172.21.15.46:0/2235597443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ae529c67d0 0x55ae52a2c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.579+0000 7f9d949f1640 1 -- 172.21.15.46:0/2235597443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ae529c70f0 msgr2=0x55ae529895b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:51.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.579+0000 7f9d949f1640 1 --2- 172.21.15.46:0/2235597443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ae529c70f0 0x55ae529895b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.579+0000 7f9d949f1640 1 -- 172.21.15.46:0/2235597443 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ae527965e0 con 0x55ae5298b730 2024-01-23T08:55:51.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.579+0000 7f9d8ffff640 1 --2- 172.21.15.46:0/2235597443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ae529c67d0 0x55ae52a2c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-23T08:55:51.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.587+0000 7f9d949f1640 1 --2- 172.21.15.46:0/2235597443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae5298b730 0x55ae52a2c060 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800e900 tx=0x7f9d880572b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae8240bc98c9ec2e server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:51.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.587+0000 7f9d6f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-01-23T08:55:51.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.595+0000 7f9d6f7fe640 1 -- 172.21.15.46:0/2235597443 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8805f260 con 0x55ae5298b730 2024-01-23T08:55:51.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.595+0000 7f9d6f7fe640 1 -- 172.21.15.46:0/2235597443 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f9d88055650 con 0x55ae5298b730 2024-01-23T08:55:51.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.595+0000 7f9d99db2000 1 -- 172.21.15.46:0/2235597443 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ae527884f0 con 0x55ae5298b730 2024-01-23T08:55:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.755+0000 7f9d6f7fe640 1 -- 172.21.15.46:0/2235597443 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d8806eb70 con 0x55ae5298b730 2024-01-23T08:55:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.755+0000 7f9d99db2000 10 client.4558 fetch_fsmap learned FSMap version 18 2024-01-23T08:55:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.755+0000 7f9d99db2000 1 -- 172.21.15.46:0/2235597443 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55ae524cdcc0 con 0x55ae5298b730 2024-01-23T08:55:51.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.767+0000 7f9d6f7fe640 1 -- 172.21.15.46:0/2235597443 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ae527884f0 con 0x55ae5298b730 2024-01-23T08:55:51.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.767+0000 7f9d6f7fe640 1 -- 172.21.15.46:0/2235597443 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f9d88011070 con 0x55ae5298b730 2024-01-23T08:55:51.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.767+0000 7f9d99db2000 10 client.4558 fetch_fsmap finished waiting for FSMap version 18 2024-01-23T08:55:51.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.767+0000 7f9d99db2000 10 client.4558 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-23T08:55:51.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.767+0000 7f9d99db2000 20 client.4558 populate_metadata read hostname 'smithi046' 2024-01-23T08:55:51.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.767+0000 7f9d99db2000 1 --2- 172.21.15.46:0/2235597443 >> [v2:172.21.15.46:6834/1620040020,v1:172.21.15.46:6835/1620040020] conn(0x55ae52a32ec0 0x55ae5298a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:51.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.767+0000 7f9d99db2000 4 client.4558 mds_command: new command op to 4214 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-23T08:55:51.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.767+0000 7f9d99db2000 1 -- 172.21.15.46:0/2235597443 --> [v2:172.21.15.46:6834/1620040020,v1:172.21.15.46:6835/1620040020] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ae527d5310 con 0x55ae52a32ec0 2024-01-23T08:55:51.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.767+0000 7f9d8ffff640 1 --2- 172.21.15.46:0/2235597443 >> [v2:172.21.15.46:6834/1620040020,v1:172.21.15.46:6835/1620040020] conn(0x55ae52a32ec0 0x55ae5298a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:51.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.775+0000 7f9d8ffff640 1 --2- 172.21.15.46:0/2235597443 >> [v2:172.21.15.46:6834/1620040020,v1:172.21.15.46:6835/1620040020] conn(0x55ae52a32ec0 0x55ae5298a270 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9b905703d4429e45 server_cookie=46e4751165f31ae0 in_seq=0 out_seq=0 2024-01-23T08:55:51.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.775+0000 7f9d6f7fe640 10 client.4558 ms_handle_connect on v2:172.21.15.46:6834/1620040020 2024-01-23T08:55:51.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.803+0000 7f9d6f7fe640 1 -- 172.21.15.46:0/2235597443 <== mds.4 v2:172.21.15.46:6834/1620040020 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55ae527d5310 con 0x55ae52a32ec0 2024-01-23T08:55:51.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.803+0000 7f9d6f7fe640 10 client.4558 handle_command_reply: tid=0 2024-01-23T08:55:51.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.803+0000 7f9d99db2000 1 client.4558 shutdown 2024-01-23T08:55:51.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.807+0000 7f9d99db2000 1 -- 172.21.15.46:0/2235597443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae5298b730 msgr2=0x55ae52a2c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:51.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.807+0000 7f9d99db2000 1 --2- 172.21.15.46:0/2235597443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae5298b730 0x55ae52a2c060 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800e900 tx=0x7f9d880572b0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.807+0000 7f9d99db2000 1 -- 172.21.15.46:0/2235597443 shutdown_connections 2024-01-23T08:55:51.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.807+0000 7f9d99db2000 1 --2- 172.21.15.46:0/2235597443 >> [v2:172.21.15.46:6834/1620040020,v1:172.21.15.46:6835/1620040020] conn(0x55ae52a32ec0 0x55ae5298a270 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.807+0000 7f9d99db2000 1 --2- 172.21.15.46:0/2235597443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ae529c70f0 0x55ae529895b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.807+0000 7f9d99db2000 1 --2- 172.21.15.46:0/2235597443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ae529c67d0 0x55ae52a2c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.807+0000 7f9d99db2000 1 --2- 172.21.15.46:0/2235597443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ae5298b730 0x55ae52a2c060 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.807+0000 7f9d6f7fe640 0 client.4558 ms_handle_reset on v2:172.21.15.46:6834/1620040020 2024-01-23T08:55:51.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.807+0000 7f9d99db2000 1 -- 172.21.15.46:0/2235597443 >> 172.21.15.46:0/2235597443 conn(0x55ae529c2580 msgr2=0x55ae529cf300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:51.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.807+0000 7f9d99db2000 1 -- 172.21.15.46:0/2235597443 shutdown_connections 2024-01-23T08:55:51.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.807+0000 7f9d99db2000 1 -- 172.21.15.46:0/2235597443 wait complete. 2024-01-23T08:55:51.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.807+0000 7f9d99db2000 20 client.4558 trim_cache size 0 max 16384 2024-01-23T08:55:51.805 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-23T08:55:51.805 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "fdbdd393-f422-45ae-a488-2bbb0163e580", 2024-01-23T08:55:51.805 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 4, 2024-01-23T08:55:51.805 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4214, 2024-01-23T08:55:51.806 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-01-23T08:55:51.806 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-01-23T08:55:51.806 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-01-23T08:55:51.806 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 19.961837379999999, 2024-01-23T08:55:51.806 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 18, 2024-01-23T08:55:51.806 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 30, 2024-01-23T08:55:51.806 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 28, 2024-01-23T08:55:51.806 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 105.46510236100001 2024-01-23T08:55:51.806 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-23T08:55:51.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.807+0000 7f9d96c55640 1 -- 172.21.15.46:0/934802710 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9d70066580 msgr2=0x7f9d70068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:51.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.807+0000 7f9d96c55640 1 --2- 172.21.15.46:0/934802710 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9d70066580 0x7f9d70068a40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9d900c3070 tx=0x7f9d8000a570 comp rx=0 tx=0).stop 2024-01-23T08:55:51.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.807+0000 7f9d96c55640 1 -- 172.21.15.46:0/934802710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d900c2bc0 msgr2=0x7f9d901593e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:51.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.807+0000 7f9d96c55640 1 --2- 172.21.15.46:0/934802710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d900c2bc0 0x7f9d901593e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800e930 tx=0x7f9d8800edf0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.807+0000 7f9d96c55640 1 -- 172.21.15.46:0/934802710 shutdown_connections 2024-01-23T08:55:51.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.807+0000 7f9d96c55640 1 --2- 172.21.15.46:0/934802710 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d90156600 0x7f9d90154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.807+0000 7f9d96c55640 1 --2- 172.21.15.46:0/934802710 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9d70066580 0x7f9d70068a40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.807+0000 7f9d96c55640 1 --2- 172.21.15.46:0/934802710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d901536b0 0x7f9d901f0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.807+0000 7f9d96c55640 1 --2- 172.21.15.46:0/934802710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d900c2bc0 0x7f9d901593e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:51.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.807+0000 7f9d96c55640 1 -- 172.21.15.46:0/934802710 >> 172.21.15.46:0/934802710 conn(0x7f9d9006b770 msgr2=0x7f9d90152870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:51.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.807+0000 7f9d96c55640 1 -- 172.21.15.46:0/934802710 shutdown_connections 2024-01-23T08:55:51.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.807+0000 7f9d96c55640 1 -- 172.21.15.46:0/934802710 wait complete. 2024-01-23T08:55:51.842 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-01-23T08:55:51.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.975+0000 7f9497530640 1 Processor -- start 2024-01-23T08:55:51.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.975+0000 7f9497530640 1 -- start start 2024-01-23T08:55:51.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.975+0000 7f9497530640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94900c1770 0x7f9490164f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.975+0000 7f9497530640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f949006de40 con 0x7f94900c83e0 2024-01-23T08:55:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.975+0000 7f9497530640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9490072130 con 0x7f9490156bc0 2024-01-23T08:55:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.975+0000 7f9497530640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94900bff60 con 0x7f94900c1770 2024-01-23T08:55:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.979+0000 7f9494acb640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f94900c83e0 0x7f949015cc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43902/0 (socket says 172.21.15.46:43902) 2024-01-23T08:55:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.979+0000 7f9494acb640 1 -- 172.21.15.46:0/2347801821 learned_addr learned my addr 172.21.15.46:0/2347801821 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:51.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.979+0000 7f9495acd640 1 --2- 172.21.15.46:0/2347801821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94900c1770 0x7f9490164f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:51.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.983+0000 7f9487fff640 1 -- 172.21.15.46:0/2347801821 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1831178573 0 0) 0x7f949006de40 con 0x7f94900c83e0 2024-01-23T08:55:51.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.983+0000 7f9487fff640 1 -- 172.21.15.46:0/2347801821 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f947c003530 con 0x7f94900c83e0 2024-01-23T08:55:51.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.987+0000 7f9495acd640 1 -- 172.21.15.46:0/2347801821 >> v1:172.21.15.175:6789/0 conn(0x7f9490156bc0 legacy=0x7f94900c7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:51.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.987+0000 7f9495acd640 1 -- 172.21.15.46:0/2347801821 >> v1:172.21.15.46:6789/0 conn(0x7f94900c83e0 legacy=0x7f949015cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:51.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.987+0000 7f9495acd640 1 -- 172.21.15.46:0/2347801821 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949006e0e0 con 0x7f94900c1770 2024-01-23T08:55:51.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:51.991+0000 7f9495acd640 1 --2- 172.21.15.46:0/2347801821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94900c1770 0x7f9490164f40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9488009dc0 tx=0x7f948801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3ad0514d9a0b119 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:52.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.007+0000 7f9487fff640 1 -- 172.21.15.46:0/2347801821 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94880a5a00 con 0x7f94900c1770 2024-01-23T08:55:52.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.007+0000 7f9487fff640 1 -- 172.21.15.46:0/2347801821 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94880a5b60 con 0x7f94900c1770 2024-01-23T08:55:52.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.007+0000 7f9487fff640 1 -- 172.21.15.46:0/2347801821 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94880ad440 con 0x7f94900c1770 2024-01-23T08:55:52.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.007+0000 7f9497530640 1 -- 172.21.15.46:0/2347801821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94900c1770 msgr2=0x7f9490164f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:52.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.007+0000 7f9497530640 1 --2- 172.21.15.46:0/2347801821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94900c1770 0x7f9490164f40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9488009dc0 tx=0x7f948801c940 comp rx=0 tx=0).stop 2024-01-23T08:55:52.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.007+0000 7f9497530640 1 -- 172.21.15.46:0/2347801821 shutdown_connections 2024-01-23T08:55:52.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.007+0000 7f9497530640 1 --2- 172.21.15.46:0/2347801821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94900c1770 0x7f9490164f40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.007+0000 7f9497530640 1 -- 172.21.15.46:0/2347801821 >> 172.21.15.46:0/2347801821 conn(0x7f949006aa60 msgr2=0x7f949006ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:52.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.007+0000 7f9497530640 1 -- 172.21.15.46:0/2347801821 shutdown_connections 2024-01-23T08:55:52.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.007+0000 7f9497530640 1 -- 172.21.15.46:0/2347801821 wait complete. 2024-01-23T08:55:52.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.011+0000 7f9497530640 1 Processor -- start 2024-01-23T08:55:52.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.011+0000 7f9497530640 1 -- start start 2024-01-23T08:55:52.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.011+0000 7f9497530640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94900c1770 0x7f94900ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.011+0000 7f9497530640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94900c83e0 0x7f949013e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.011+0000 7f9497530640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9490156bc0 0x7f9490146b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.011+0000 7f9497530640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94900aea00 con 0x7f94900c1770 2024-01-23T08:55:52.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.011+0000 7f9497530640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949013e890 con 0x7f94900c83e0 2024-01-23T08:55:52.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.011+0000 7f9497530640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f949014d4f0 con 0x7f9490156bc0 2024-01-23T08:55:52.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.015+0000 7f94952cc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94900c1770 0x7f94900ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:52.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.015+0000 7f94952cc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94900c1770 0x7f94900ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36146/0 (socket says 172.21.15.46:36146) 2024-01-23T08:55:52.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.015+0000 7f94952cc640 1 -- 172.21.15.46:0/2802446001 learned_addr learned my addr 172.21.15.46:0/2802446001 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:52.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.015+0000 7f9495acd640 1 --2- 172.21.15.46:0/2802446001 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9490156bc0 0x7f9490146b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:52.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.015+0000 7f9494acb640 1 --2- 172.21.15.46:0/2802446001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94900c83e0 0x7f949013e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:52.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.019+0000 7f94952cc640 1 -- 172.21.15.46:0/2802446001 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9490156bc0 msgr2=0x7f9490146b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:52.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.019+0000 7f94952cc640 1 --2- 172.21.15.46:0/2802446001 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9490156bc0 0x7f9490146b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.019+0000 7f94952cc640 1 -- 172.21.15.46:0/2802446001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94900c83e0 msgr2=0x7f949013e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:52.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.019+0000 7f94952cc640 1 --2- 172.21.15.46:0/2802446001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94900c83e0 0x7f949013e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.019+0000 7f94952cc640 1 -- 172.21.15.46:0/2802446001 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9488009a70 con 0x7f94900c1770 2024-01-23T08:55:52.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.023+0000 7f94952cc640 1 --2- 172.21.15.46:0/2802446001 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94900c1770 0x7f94900ca330 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f948c00c370 tx=0x7f948c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:52.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.027+0000 7f9485ffb640 1 -- 172.21.15.46:0/2802446001 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c0052d0 con 0x7f94900c1770 2024-01-23T08:55:52.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.027+0000 7f9485ffb640 1 -- 172.21.15.46:0/2802446001 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948c005430 con 0x7f94900c1770 2024-01-23T08:55:52.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.027+0000 7f9485ffb640 1 -- 172.21.15.46:0/2802446001 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c007260 con 0x7f94900c1770 2024-01-23T08:55:52.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.027+0000 7f9497530640 1 -- 172.21.15.46:0/2802446001 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94900af560 con 0x7f94900c1770 2024-01-23T08:55:52.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.027+0000 7f9497530640 1 -- 172.21.15.46:0/2802446001 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94901477f0 con 0x7f94900c1770 2024-01-23T08:55:52.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.031+0000 7f949a68d000 1 Processor -- start 2024-01-23T08:55:52.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.031+0000 7f949a68d000 1 -- start start 2024-01-23T08:55:52.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.031+0000 7f949a68d000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55560a49fb30 0x55560a468880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.031+0000 7f949a68d000 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55560a49ff10 0x55560a468dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.031+0000 7f949a68d000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55560a4a47d0 0x55560a4a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.031+0000 7f949a68d000 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55560a2bfd70 con 0x55560a49ff10 2024-01-23T08:55:52.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.031+0000 7f949a68d000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55560a2bbba0 con 0x55560a4a47d0 2024-01-23T08:55:52.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.031+0000 7f949a68d000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55560a2b90d0 con 0x55560a49fb30 2024-01-23T08:55:52.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.035+0000 7f9495acd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55560a49fb30 0x55560a468880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:52.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.035+0000 7f9494acb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55560a4a47d0 0x55560a4a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:52.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.035+0000 7f9495acd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55560a49fb30 0x55560a468880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:35728/0 (socket says 172.21.15.46:35728) 2024-01-23T08:55:52.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.035+0000 7f9495acd640 1 -- 172.21.15.46:0/3356278345 learned_addr learned my addr 172.21.15.46:0/3356278345 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:52.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.039+0000 7f9495acd640 1 -- 172.21.15.46:0/3356278345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55560a4a47d0 msgr2=0x55560a4a4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:52.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.039+0000 7f9495acd640 1 --2- 172.21.15.46:0/3356278345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55560a4a47d0 0x55560a4a4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.039+0000 7f9495acd640 1 -- 172.21.15.46:0/3356278345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55560a49ff10 msgr2=0x55560a468dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:52.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.039+0000 7f9495acd640 1 --2- 172.21.15.46:0/3356278345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55560a49ff10 0x55560a468dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.039+0000 7f9495acd640 1 -- 172.21.15.46:0/3356278345 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555609fab890 con 0x55560a49fb30 2024-01-23T08:55:52.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.039+0000 7f9494acb640 1 --2- 172.21.15.46:0/3356278345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55560a4a47d0 0x55560a4a4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-23T08:55:52.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.047+0000 7f9495acd640 1 --2- 172.21.15.46:0/3356278345 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55560a49fb30 0x55560a468880 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f948801ce20 tx=0x7f9488004ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=888ee9c09aef6ac3 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:52.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.055+0000 7f9485ffb640 1 -- 172.21.15.46:0/2802446001 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f948c0073c0 con 0x7f94900c1770 2024-01-23T08:55:52.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.055+0000 7f9485ffb640 1 --2- 172.21.15.46:0/2802446001 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9474066550 0x7f9474068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.055+0000 7f94952cc640 1 --2- 172.21.15.46:0/2802446001 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9474066550 0x7f9474068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:52.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.055+0000 7f94952cc640 1 --2- 172.21.15.46:0/2802446001 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9474066550 0x7f9474068a10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f948c00cd30 tx=0x7f948c000bd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:52.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.055+0000 7f9472ffd640 1 -- 172.21.15.46:0/3356278345 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94880ad640 con 0x55560a49fb30 2024-01-23T08:55:52.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.055+0000 7f9472ffd640 1 -- 172.21.15.46:0/3356278345 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94880bc070 con 0x55560a49fb30 2024-01-23T08:55:52.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.055+0000 7f9472ffd640 1 -- 172.21.15.46:0/3356278345 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94880ad9e0 con 0x55560a49fb30 2024-01-23T08:55:52.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.059+0000 7f9485ffb640 1 -- 172.21.15.46:0/2802446001 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f948c007670 con 0x7f94900c1770 2024-01-23T08:55:52.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.059+0000 7f949a68d000 1 -- 172.21.15.46:0/3356278345 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55560a49fb30 msgr2=0x55560a468880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:52.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.059+0000 7f949a68d000 1 --2- 172.21.15.46:0/3356278345 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55560a49fb30 0x55560a468880 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f948801ce20 tx=0x7f9488004ac0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.059+0000 7f949a68d000 1 -- 172.21.15.46:0/3356278345 shutdown_connections 2024-01-23T08:55:52.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.059+0000 7f949a68d000 1 --2- 172.21.15.46:0/3356278345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55560a4a47d0 0x55560a4a4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.059+0000 7f949a68d000 1 --2- 172.21.15.46:0/3356278345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55560a49ff10 0x55560a468dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.059+0000 7f949a68d000 1 --2- 172.21.15.46:0/3356278345 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55560a49fb30 0x55560a468880 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.059+0000 7f949a68d000 1 -- 172.21.15.46:0/3356278345 >> 172.21.15.46:0/3356278345 conn(0x55560a4a0580 msgr2=0x55560a4a2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:52.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.059+0000 7f949a68d000 1 -- 172.21.15.46:0/3356278345 shutdown_connections 2024-01-23T08:55:52.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.059+0000 7f949a68d000 1 -- 172.21.15.46:0/3356278345 wait complete. 2024-01-23T08:55:52.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.059+0000 7f949a68d000 1 -- start start 2024-01-23T08:55:52.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.059+0000 7f949a68d000 1 Processor -- start 2024-01-23T08:55:52.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.059+0000 7f949a68d000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55560a49fb30 0x55560a49ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.059+0000 7f949a68d000 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55560a49ff10 0x55560a49f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.059+0000 7f949a68d000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55560a4a47d0 0x55560a4b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.059+0000 7f949a68d000 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55560a2b49c0 con 0x55560a49ff10 2024-01-23T08:55:52.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.059+0000 7f949a68d000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55560a26c040 con 0x55560a4a47d0 2024-01-23T08:55:52.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.059+0000 7f949a68d000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55560a271ee0 con 0x55560a49fb30 2024-01-23T08:55:52.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.059+0000 7f949a68d000 10 client.0 _ll_register_callbacks cb 0x55560a26f1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-23T08:55:52.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.059+0000 7f9494acb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55560a49ff10 0x55560a49f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:52.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.063+0000 7f9494acb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55560a49ff10 0x55560a49f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36168/0 (socket says 172.21.15.46:36168) 2024-01-23T08:55:52.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.063+0000 7f9494acb640 1 -- 172.21.15.46:0/392289486 learned_addr learned my addr 172.21.15.46:0/392289486 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:52.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.063+0000 7f9495acd640 1 --2- 172.21.15.46:0/392289486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55560a4a47d0 0x55560a4b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:52.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.063+0000 7f9495acd640 1 --2- 172.21.15.46:0/392289486 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55560a49fb30 0x55560a49ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:52.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.067+0000 7f9494acb640 1 -- 172.21.15.46:0/392289486 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55560a49fb30 msgr2=0x55560a49ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:52.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.067+0000 7f9494acb640 1 --2- 172.21.15.46:0/392289486 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55560a49fb30 0x55560a49ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.067+0000 7f9494acb640 1 -- 172.21.15.46:0/392289486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55560a4a47d0 msgr2=0x55560a4b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:52.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.067+0000 7f9494acb640 1 --2- 172.21.15.46:0/392289486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55560a4a47d0 0x55560a4b2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.067+0000 7f9494acb640 1 -- 172.21.15.46:0/392289486 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947c003530 con 0x55560a49ff10 2024-01-23T08:55:52.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.067+0000 7f9494acb640 1 --2- 172.21.15.46:0/392289486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55560a49ff10 0x55560a49f3a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9480000f70 tx=0x7f9480012770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b5002c9368efcf3 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:52.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.067+0000 7f946bfff640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-01-23T08:55:52.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.071+0000 7f946bfff640 1 -- 172.21.15.46:0/392289486 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9480005ad0 con 0x55560a49ff10 2024-01-23T08:55:52.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.071+0000 7f946bfff640 1 -- 172.21.15.46:0/392289486 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f9480005c30 con 0x55560a49ff10 2024-01-23T08:55:52.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.071+0000 7f949a68d000 1 -- 172.21.15.46:0/392289486 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55560a23ae30 con 0x55560a49ff10 2024-01-23T08:55:52.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.075+0000 7f946bfff640 1 -- 172.21.15.46:0/392289486 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9480005e30 con 0x55560a49ff10 2024-01-23T08:55:52.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.075+0000 7f949a68d000 10 client.4686 fetch_fsmap learned FSMap version 18 2024-01-23T08:55:52.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.075+0000 7f949a68d000 1 -- 172.21.15.46:0/392289486 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x7f949006e0e0 con 0x55560a49ff10 2024-01-23T08:55:52.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.083+0000 7f946bfff640 1 -- 172.21.15.46:0/392289486 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55560a23ae30 con 0x55560a49ff10 2024-01-23T08:55:52.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.083+0000 7f946bfff640 1 -- 172.21.15.46:0/392289486 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f94800070d0 con 0x55560a49ff10 2024-01-23T08:55:52.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.083+0000 7f949a68d000 10 client.4686 fetch_fsmap finished waiting for FSMap version 18 2024-01-23T08:55:52.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.083+0000 7f949a68d000 10 client.4686 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-23T08:55:52.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.083+0000 7f949a68d000 20 client.4686 populate_metadata read hostname 'smithi046' 2024-01-23T08:55:52.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.083+0000 7f949a68d000 1 --2- 172.21.15.46:0/392289486 >> [v2:172.21.15.175:6832/2714415350,v1:172.21.15.175:6833/2714415350] conn(0x55560a4b3c40 0x55560a4b4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.083+0000 7f949a68d000 4 client.4686 mds_command: new command op to 4228 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:55:52.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.083+0000 7f949a68d000 1 -- 172.21.15.46:0/392289486 --> [v2:172.21.15.175:6832/2714415350,v1:172.21.15.175:6833/2714415350] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55560a271870 con 0x55560a4b3c40 2024-01-23T08:55:52.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.083+0000 7f9495acd640 1 --2- 172.21.15.46:0/392289486 >> [v2:172.21.15.175:6832/2714415350,v1:172.21.15.175:6833/2714415350] conn(0x55560a4b3c40 0x55560a4b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:52.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.171+0000 7f9495acd640 1 --2- 172.21.15.46:0/392289486 >> [v2:172.21.15.175:6832/2714415350,v1:172.21.15.175:6833/2714415350] conn(0x55560a4b3c40 0x55560a4b4020 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5421a1158727ed9c server_cookie=4b770f54bd43ffee in_seq=0 out_seq=0 2024-01-23T08:55:52.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.171+0000 7f946bfff640 10 client.4686 ms_handle_connect on v2:172.21.15.175:6832/2714415350 2024-01-23T08:55:52.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.379+0000 7f946bfff640 1 -- 172.21.15.46:0/392289486 <== mds.3 v2:172.21.15.175:6832/2714415350 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55560a271870 con 0x55560a4b3c40 2024-01-23T08:55:52.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.379+0000 7f946bfff640 10 client.4686 handle_command_reply: tid=0 2024-01-23T08:55:52.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.379+0000 7f949a68d000 1 client.4686 shutdown 2024-01-23T08:55:52.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.379+0000 7f949a68d000 1 -- 172.21.15.46:0/392289486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55560a49ff10 msgr2=0x55560a49f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:52.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.379+0000 7f949a68d000 1 --2- 172.21.15.46:0/392289486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55560a49ff10 0x55560a49f3a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9480000f70 tx=0x7f9480012770 comp rx=0 tx=0).stop 2024-01-23T08:55:52.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.379+0000 7f949a68d000 1 -- 172.21.15.46:0/392289486 shutdown_connections 2024-01-23T08:55:52.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.379+0000 7f949a68d000 1 --2- 172.21.15.46:0/392289486 >> [v2:172.21.15.175:6832/2714415350,v1:172.21.15.175:6833/2714415350] conn(0x55560a4b3c40 0x55560a4b4020 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.379+0000 7f949a68d000 1 --2- 172.21.15.46:0/392289486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55560a4a47d0 0x55560a4b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.379+0000 7f949a68d000 1 --2- 172.21.15.46:0/392289486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55560a49ff10 0x55560a49f3a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.379+0000 7f949a68d000 1 --2- 172.21.15.46:0/392289486 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55560a49fb30 0x55560a49ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.379+0000 7f949a68d000 1 -- 172.21.15.46:0/392289486 >> 172.21.15.46:0/392289486 conn(0x55560a4a0580 msgr2=0x55560a4a37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:52.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.379+0000 7f946bfff640 0 client.4686 ms_handle_reset on v2:172.21.15.175:6832/2714415350 2024-01-23T08:55:52.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.379+0000 7f949a68d000 1 -- 172.21.15.46:0/392289486 shutdown_connections 2024-01-23T08:55:52.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.379+0000 7f949a68d000 1 -- 172.21.15.46:0/392289486 wait complete. 2024-01-23T08:55:52.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.383+0000 7f949a68d000 20 client.4686 trim_cache size 0 max 16384 2024-01-23T08:55:52.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.427+0000 7f949a68d000 1 Processor -- start 2024-01-23T08:55:52.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.427+0000 7f949a68d000 1 -- start start 2024-01-23T08:55:52.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.427+0000 7f949a68d000 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55560a49fb30 0x55560a4c3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.427+0000 7f949a68d000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55560a49ff10 0x55560a4c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.427+0000 7f949a68d000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55560a4a47d0 0x55560a4c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.427+0000 7f949a68d000 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x555609f6c940 con 0x55560a49fb30 2024-01-23T08:55:52.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.427+0000 7f949a68d000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55560a2896b0 con 0x55560a49ff10 2024-01-23T08:55:52.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.427+0000 7f949a68d000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55560a309e40 con 0x55560a4a47d0 2024-01-23T08:55:52.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.427+0000 7f9495acd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55560a49fb30 0x55560a4c3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:52.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.431+0000 7f9495acd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55560a49fb30 0x55560a4c3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36184/0 (socket says 172.21.15.46:36184) 2024-01-23T08:55:52.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.431+0000 7f9495acd640 1 -- 172.21.15.46:0/1898975695 learned_addr learned my addr 172.21.15.46:0/1898975695 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:52.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.431+0000 7f9495acd640 1 --2- 172.21.15.46:0/1898975695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55560a4a47d0 0x55560a4c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:52.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.431+0000 7f9494acb640 1 --2- 172.21.15.46:0/1898975695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55560a49ff10 0x55560a4c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:52.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.431+0000 7f9495acd640 1 -- 172.21.15.46:0/1898975695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55560a4a47d0 msgr2=0x55560a4c42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:52.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.431+0000 7f9495acd640 1 --2- 172.21.15.46:0/1898975695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55560a4a47d0 0x55560a4c42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.431+0000 7f9495acd640 1 -- 172.21.15.46:0/1898975695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55560a49ff10 msgr2=0x55560a4c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:52.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.431+0000 7f9495acd640 1 --2- 172.21.15.46:0/1898975695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55560a49ff10 0x55560a4c3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.431+0000 7f9495acd640 1 -- 172.21.15.46:0/1898975695 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55560a2745e0 con 0x55560a49fb30 2024-01-23T08:55:52.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.435+0000 7f9495acd640 1 --2- 172.21.15.46:0/1898975695 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55560a49fb30 0x55560a4c3870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f948801a570 tx=0x7f94880c3040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=236653b19868ad6b server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:52.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.443+0000 7f94727fc640 1 -- 172.21.15.46:0/1898975695 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94880aea10 con 0x55560a49fb30 2024-01-23T08:55:52.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.443+0000 7f94727fc640 1 -- 172.21.15.46:0/1898975695 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94880d2e90 con 0x55560a49fb30 2024-01-23T08:55:52.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.443+0000 7f94727fc640 1 -- 172.21.15.46:0/1898975695 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94880aed70 con 0x55560a49fb30 2024-01-23T08:55:52.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.443+0000 7f949a68d000 1 -- 172.21.15.46:0/1898975695 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55560a49fb30 msgr2=0x55560a4c3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:52.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.443+0000 7f949a68d000 1 --2- 172.21.15.46:0/1898975695 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55560a49fb30 0x55560a4c3870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f948801a570 tx=0x7f94880c3040 comp rx=0 tx=0).stop 2024-01-23T08:55:52.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.443+0000 7f949a68d000 1 -- 172.21.15.46:0/1898975695 shutdown_connections 2024-01-23T08:55:52.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.443+0000 7f949a68d000 1 --2- 172.21.15.46:0/1898975695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55560a4a47d0 0x55560a4c42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.443+0000 7f949a68d000 1 --2- 172.21.15.46:0/1898975695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55560a49ff10 0x55560a4c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.443+0000 7f949a68d000 1 --2- 172.21.15.46:0/1898975695 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55560a49fb30 0x55560a4c3870 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.443+0000 7f949a68d000 1 -- 172.21.15.46:0/1898975695 >> 172.21.15.46:0/1898975695 conn(0x55560a4a0580 msgr2=0x55560a4be900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:52.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.443+0000 7f949a68d000 1 -- 172.21.15.46:0/1898975695 shutdown_connections 2024-01-23T08:55:52.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.443+0000 7f949a68d000 1 -- 172.21.15.46:0/1898975695 wait complete. 2024-01-23T08:55:52.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.443+0000 7f949a68d000 1 -- start start 2024-01-23T08:55:52.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.443+0000 7f949a68d000 1 Processor -- start 2024-01-23T08:55:52.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.447+0000 7f949a68d000 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55560a49fb30 0x55560a4d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.447+0000 7f949a68d000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55560a49ff10 0x55560a4d3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.447+0000 7f949a68d000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55560a4a47d0 0x55560a4d3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.447+0000 7f949a68d000 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55560a2b7520 con 0x55560a49fb30 2024-01-23T08:55:52.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.447+0000 7f949a68d000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55560a2b3850 con 0x55560a4a47d0 2024-01-23T08:55:52.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.447+0000 7f949a68d000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55560a49f1e0 con 0x55560a49ff10 2024-01-23T08:55:52.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.447+0000 7f949a68d000 10 client.0 _ll_register_callbacks cb 0x55560a2e1a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-23T08:55:52.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.447+0000 7f9495acd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55560a49fb30 0x55560a4d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:52.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.447+0000 7f9495acd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55560a4a47d0 0x55560a4d3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:52.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.447+0000 7f9495acd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55560a49fb30 0x55560a4d2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36200/0 (socket says 172.21.15.46:36200) 2024-01-23T08:55:52.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.447+0000 7f9495acd640 1 -- 172.21.15.46:0/1276026585 learned_addr learned my addr 172.21.15.46:0/1276026585 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:52.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.447+0000 7f9494acb640 1 --2- 172.21.15.46:0/1276026585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55560a49ff10 0x55560a4d3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:52.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.451+0000 7f9495acd640 1 -- 172.21.15.46:0/1276026585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55560a49ff10 msgr2=0x55560a4d3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:52.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.451+0000 7f9495acd640 1 --2- 172.21.15.46:0/1276026585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55560a49ff10 0x55560a4d3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.451+0000 7f9495acd640 1 -- 172.21.15.46:0/1276026585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55560a4a47d0 msgr2=0x55560a4d3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:52.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.451+0000 7f9495acd640 1 --2- 172.21.15.46:0/1276026585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55560a4a47d0 0x55560a4d3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.451+0000 7f9495acd640 1 -- 172.21.15.46:0/1276026585 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94880c5040 con 0x55560a49fb30 2024-01-23T08:55:52.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.455+0000 7f9495acd640 1 --2- 172.21.15.46:0/1276026585 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55560a49fb30 0x55560a4d2de0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9488009830 tx=0x7f94880ba070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea12ec435882e80 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:52.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.455+0000 7f946bfff640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-01-23T08:55:52.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.459+0000 7f946bfff640 1 -- 172.21.15.46:0/1276026585 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94880d7070 con 0x55560a49fb30 2024-01-23T08:55:52.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.459+0000 7f946bfff640 1 -- 172.21.15.46:0/1276026585 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f94880cfe50 con 0x55560a49fb30 2024-01-23T08:55:52.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.459+0000 7f949a68d000 1 -- 172.21.15.46:0/1276026585 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55560a2664f0 con 0x55560a49fb30 2024-01-23T08:55:52.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.463+0000 7f946bfff640 1 -- 172.21.15.46:0/1276026585 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94880aec00 con 0x55560a49fb30 2024-01-23T08:55:52.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.463+0000 7f949a68d000 10 client.4692 fetch_fsmap learned FSMap version 18 2024-01-23T08:55:52.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.463+0000 7f949a68d000 1 -- 172.21.15.46:0/1276026585 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55560a25a8e0 con 0x55560a49fb30 2024-01-23T08:55:52.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.467+0000 7f946bfff640 1 -- 172.21.15.46:0/1276026585 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55560a2664f0 con 0x55560a49fb30 2024-01-23T08:55:52.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.467+0000 7f946bfff640 1 -- 172.21.15.46:0/1276026585 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f9488005d20 con 0x55560a49fb30 2024-01-23T08:55:52.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.467+0000 7f949a68d000 10 client.4692 fetch_fsmap finished waiting for FSMap version 18 2024-01-23T08:55:52.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.467+0000 7f949a68d000 10 client.4692 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-23T08:55:52.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.467+0000 7f949a68d000 20 client.4692 populate_metadata read hostname 'smithi046' 2024-01-23T08:55:52.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.467+0000 7f949a68d000 1 --2- 172.21.15.46:0/1276026585 >> [v2:172.21.15.175:6832/2714415350,v1:172.21.15.175:6833/2714415350] conn(0x55560a4d41f0 0x55560a51aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.467+0000 7f949a68d000 4 client.4692 mds_command: new command op to 4228 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-23T08:55:52.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.467+0000 7f949a68d000 1 -- 172.21.15.46:0/1276026585 --> [v2:172.21.15.175:6832/2714415350,v1:172.21.15.175:6833/2714415350] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55560a2b3310 con 0x55560a4d41f0 2024-01-23T08:55:52.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.471+0000 7f9494acb640 1 --2- 172.21.15.46:0/1276026585 >> [v2:172.21.15.175:6832/2714415350,v1:172.21.15.175:6833/2714415350] conn(0x55560a4d41f0 0x55560a51aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:52.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.479+0000 7f9494acb640 1 --2- 172.21.15.46:0/1276026585 >> [v2:172.21.15.175:6832/2714415350,v1:172.21.15.175:6833/2714415350] conn(0x55560a4d41f0 0x55560a51aca0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f24dd7ae5fe26e9f server_cookie=161533f2bbb6b58c in_seq=0 out_seq=0 2024-01-23T08:55:52.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.479+0000 7f946bfff640 10 client.4692 ms_handle_connect on v2:172.21.15.175:6832/2714415350 2024-01-23T08:55:52.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.507+0000 7f946bfff640 1 -- 172.21.15.46:0/1276026585 <== mds.3 v2:172.21.15.175:6832/2714415350 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55560a2b3310 con 0x55560a4d41f0 2024-01-23T08:55:52.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.507+0000 7f946bfff640 10 client.4692 handle_command_reply: tid=0 2024-01-23T08:55:52.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.507+0000 7f949a68d000 1 client.4692 shutdown 2024-01-23T08:55:52.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.507+0000 7f949a68d000 1 -- 172.21.15.46:0/1276026585 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55560a49fb30 msgr2=0x55560a4d2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:52.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.507+0000 7f949a68d000 1 --2- 172.21.15.46:0/1276026585 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55560a49fb30 0x55560a4d2de0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9488009830 tx=0x7f94880ba070 comp rx=0 tx=0).stop 2024-01-23T08:55:52.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.507+0000 7f949a68d000 1 -- 172.21.15.46:0/1276026585 shutdown_connections 2024-01-23T08:55:52.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.507+0000 7f949a68d000 1 --2- 172.21.15.46:0/1276026585 >> [v2:172.21.15.175:6832/2714415350,v1:172.21.15.175:6833/2714415350] conn(0x55560a4d41f0 0x55560a51aca0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.507+0000 7f949a68d000 1 --2- 172.21.15.46:0/1276026585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55560a4a47d0 0x55560a4d3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.507+0000 7f949a68d000 1 --2- 172.21.15.46:0/1276026585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55560a49ff10 0x55560a4d3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.507+0000 7f949a68d000 1 --2- 172.21.15.46:0/1276026585 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55560a49fb30 0x55560a4d2de0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.507+0000 7f946bfff640 0 client.4692 ms_handle_reset on v2:172.21.15.175:6832/2714415350 2024-01-23T08:55:52.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.507+0000 7f949a68d000 1 -- 172.21.15.46:0/1276026585 >> 172.21.15.46:0/1276026585 conn(0x55560a4a0580 msgr2=0x55560a49d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:52.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.507+0000 7f949a68d000 1 -- 172.21.15.46:0/1276026585 shutdown_connections 2024-01-23T08:55:52.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.507+0000 7f949a68d000 1 -- 172.21.15.46:0/1276026585 wait complete. 2024-01-23T08:55:52.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.507+0000 7f949a68d000 20 client.4692 trim_cache size 0 max 16384 2024-01-23T08:55:52.507 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-23T08:55:52.508 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "fdbdd393-f422-45ae-a488-2bbb0163e580", 2024-01-23T08:55:52.508 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 3, 2024-01-23T08:55:52.508 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4228, 2024-01-23T08:55:52.508 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-01-23T08:55:52.508 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-01-23T08:55:52.508 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-01-23T08:55:52.508 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 23.968188164000001, 2024-01-23T08:55:52.508 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 18, 2024-01-23T08:55:52.508 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 30, 2024-01-23T08:55:52.508 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 28, 2024-01-23T08:55:52.508 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 106.33262793999999 2024-01-23T08:55:52.508 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-23T08:55:52.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.511+0000 7f9497530640 1 -- 172.21.15.46:0/2802446001 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9474066550 msgr2=0x7f9474068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:52.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.511+0000 7f9497530640 1 --2- 172.21.15.46:0/2802446001 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9474066550 0x7f9474068a10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f948c00cd30 tx=0x7f948c000bd0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.511+0000 7f9497530640 1 -- 172.21.15.46:0/2802446001 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94900c1770 msgr2=0x7f94900ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:52.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.511+0000 7f9497530640 1 --2- 172.21.15.46:0/2802446001 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94900c1770 0x7f94900ca330 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f948c00c370 tx=0x7f948c00c830 comp rx=0 tx=0).stop 2024-01-23T08:55:52.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.511+0000 7f9497530640 1 -- 172.21.15.46:0/2802446001 shutdown_connections 2024-01-23T08:55:52.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.511+0000 7f9497530640 1 --2- 172.21.15.46:0/2802446001 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9490156bc0 0x7f9490146b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.511+0000 7f9497530640 1 --2- 172.21.15.46:0/2802446001 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9474066550 0x7f9474068a10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.511+0000 7f9497530640 1 --2- 172.21.15.46:0/2802446001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94900c83e0 0x7f949013e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.511+0000 7f9497530640 1 --2- 172.21.15.46:0/2802446001 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94900c1770 0x7f94900ca330 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.511+0000 7f9497530640 1 -- 172.21.15.46:0/2802446001 >> 172.21.15.46:0/2802446001 conn(0x7f949006aa60 msgr2=0x7f94901543d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:52.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.511+0000 7f9497530640 1 -- 172.21.15.46:0/2802446001 shutdown_connections 2024-01-23T08:55:52.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.511+0000 7f9497530640 1 -- 172.21.15.46:0/2802446001 wait complete. 2024-01-23T08:55:52.534 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-01-23T08:55:52.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.663+0000 7fd563d17640 1 Processor -- start 2024-01-23T08:55:52.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.663+0000 7fd563d17640 1 -- start start 2024-01-23T08:55:52.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.667+0000 7fd563d17640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd55c06feb0 0x7fd55c159a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.667+0000 7fd563d17640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd55c0c65a0 0x7fd55c0c18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.667+0000 7fd563d17640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd55c0c0e90 con 0x7fd55c070290 2024-01-23T08:55:52.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.667+0000 7fd563d17640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd55c156d20 con 0x7fd55c06feb0 2024-01-23T08:55:52.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.667+0000 7fd563d17640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd55c156fc0 con 0x7fd55c0c65a0 2024-01-23T08:55:52.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.667+0000 7fd561ab3640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd55c06feb0 0x7fd55c159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:52.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.667+0000 7fd561ab3640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd55c06feb0 0x7fd55c159a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36214/0 (socket says 172.21.15.46:36214) 2024-01-23T08:55:52.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.667+0000 7fd561ab3640 1 -- 172.21.15.46:0/3814086016 learned_addr learned my addr 172.21.15.46:0/3814086016 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:52.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.667+0000 7fd5622b4640 1 --2- 172.21.15.46:0/3814086016 >> v2:172.21.15.175:3300/0 conn(0x7fd55c0c65a0 0x7fd55c0c18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:52.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.671+0000 7fd561ab3640 1 -- 172.21.15.46:0/3814086016 >> v2:172.21.15.175:3300/0 conn(0x7fd55c0c65a0 msgr2=0x7fd55c0c18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:52.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.671+0000 7fd561ab3640 1 --2- 172.21.15.46:0/3814086016 >> v2:172.21.15.175:3300/0 conn(0x7fd55c0c65a0 0x7fd55c0c18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.671+0000 7fd561ab3640 1 -- 172.21.15.46:0/3814086016 >> v1:172.21.15.175:6789/0 conn(0x7fd55c070290 legacy=0x7fd55c156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:52.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.671+0000 7fd561ab3640 1 -- 172.21.15.46:0/3814086016 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55c157280 con 0x7fd55c06feb0 2024-01-23T08:55:52.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.675+0000 7fd561ab3640 1 --2- 172.21.15.46:0/3814086016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd55c06feb0 0x7fd55c159a20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd55c0b18c0 tx=0x7fd54c01ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c5a6efd192dc89 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:52.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.679+0000 7fd560ab1640 1 -- 172.21.15.46:0/3814086016 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c00b2d0 con 0x7fd55c06feb0 2024-01-23T08:55:52.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.679+0000 7fd560ab1640 1 -- 172.21.15.46:0/3814086016 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c00b430 con 0x7fd55c06feb0 2024-01-23T08:55:52.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.679+0000 7fd560ab1640 1 -- 172.21.15.46:0/3814086016 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c0a7bc0 con 0x7fd55c06feb0 2024-01-23T08:55:52.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.683+0000 7fd563d17640 1 -- 172.21.15.46:0/3814086016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd55c06feb0 msgr2=0x7fd55c159a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:52.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.683+0000 7fd563d17640 1 --2- 172.21.15.46:0/3814086016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd55c06feb0 0x7fd55c159a20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd55c0b18c0 tx=0x7fd54c01ead0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.683+0000 7fd563d17640 1 -- 172.21.15.46:0/3814086016 shutdown_connections 2024-01-23T08:55:52.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.683+0000 7fd563d17640 1 --2- 172.21.15.46:0/3814086016 >> v2:172.21.15.175:3300/0 conn(0x7fd55c0c65a0 0x7fd55c0c18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.683+0000 7fd563d17640 1 --2- 172.21.15.46:0/3814086016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd55c06feb0 0x7fd55c159a20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.683+0000 7fd563d17640 1 -- 172.21.15.46:0/3814086016 >> 172.21.15.46:0/3814086016 conn(0x7fd55c072890 msgr2=0x7fd55c06e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:52.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.683+0000 7fd563d17640 1 -- 172.21.15.46:0/3814086016 shutdown_connections 2024-01-23T08:55:52.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.683+0000 7fd563d17640 1 -- 172.21.15.46:0/3814086016 wait complete. 2024-01-23T08:55:52.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.683+0000 7fd563d17640 1 Processor -- start 2024-01-23T08:55:52.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.683+0000 7fd563d17640 1 -- start start 2024-01-23T08:55:52.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.683+0000 7fd563d17640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd55c06feb0 0x7fd55c1efc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.683+0000 7fd563d17640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd55c070290 0x7fd55c14ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.683+0000 7fd563d17640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd55c0c65a0 0x7fd55c0c4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.683+0000 7fd563d17640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55c14b250 con 0x7fd55c0c65a0 2024-01-23T08:55:52.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.683+0000 7fd563d17640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55c14a880 con 0x7fd55c06feb0 2024-01-23T08:55:52.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.683+0000 7fd563d17640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd55c0c5250 con 0x7fd55c070290 2024-01-23T08:55:52.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.683+0000 7fd5622b4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd55c0c65a0 0x7fd55c0c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:52.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.687+0000 7fd5622b4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd55c0c65a0 0x7fd55c0c4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36230/0 (socket says 172.21.15.46:36230) 2024-01-23T08:55:52.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.687+0000 7fd5622b4640 1 -- 172.21.15.46:0/3624076479 learned_addr learned my addr 172.21.15.46:0/3624076479 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:52.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.687+0000 7fd5622b4640 1 -- 172.21.15.46:0/3624076479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd55c070290 msgr2=0x7fd55c14ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:52.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.687+0000 7fd5622b4640 1 --2- 172.21.15.46:0/3624076479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd55c070290 0x7fd55c14ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.687+0000 7fd5622b4640 1 -- 172.21.15.46:0/3624076479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd55c06feb0 msgr2=0x7fd55c1efc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:52.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.687+0000 7fd5622b4640 1 --2- 172.21.15.46:0/3624076479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd55c06feb0 0x7fd55c1efc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.687+0000 7fd5622b4640 1 -- 172.21.15.46:0/3624076479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c00bd40 con 0x7fd55c0c65a0 2024-01-23T08:55:52.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.691+0000 7fd5622b4640 1 --2- 172.21.15.46:0/3624076479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd55c0c65a0 0x7fd55c0c4770 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd55400e7f0 tx=0x7fd55400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:52.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.699+0000 7fd55a7fc640 1 -- 172.21.15.46:0/3624076479 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd554009530 con 0x7fd55c0c65a0 2024-01-23T08:55:52.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.699+0000 7fd55a7fc640 1 -- 172.21.15.46:0/3624076479 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55400eea0 con 0x7fd55c0c65a0 2024-01-23T08:55:52.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.699+0000 7fd563d17640 1 -- 172.21.15.46:0/3624076479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd55c0c9660 con 0x7fd55c0c65a0 2024-01-23T08:55:52.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.699+0000 7fd55a7fc640 1 -- 172.21.15.46:0/3624076479 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55400cb60 con 0x7fd55c0c65a0 2024-01-23T08:55:52.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.699+0000 7fd563d17640 1 -- 172.21.15.46:0/3624076479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd55c14fc60 con 0x7fd55c0c65a0 2024-01-23T08:55:52.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.699+0000 7fd566e74000 1 Processor -- start 2024-01-23T08:55:52.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.699+0000 7fd566e74000 1 -- start start 2024-01-23T08:55:52.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.699+0000 7fd566e74000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611b0b90920 0x5611b0b90d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.699+0000 7fd566e74000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611b0b957d0 0x5611b0b95bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.699+0000 7fd566e74000 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5611b0b960f0 0x5611b0b964d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.699+0000 7fd566e74000 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b09b0d70 con 0x5611b0b960f0 2024-01-23T08:55:52.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.699+0000 7fd566e74000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b09acba0 con 0x5611b0b957d0 2024-01-23T08:55:52.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.699+0000 7fd566e74000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611b09aa0d0 con 0x5611b0b90920 2024-01-23T08:55:52.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.703+0000 7fd5612b2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611b0b90920 0x5611b0b90d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:52.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.703+0000 7fd561ab3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611b0b957d0 0x5611b0b95bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:52.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.703+0000 7fd5612b2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611b0b90920 0x5611b0b90d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:35774/0 (socket says 172.21.15.46:35774) 2024-01-23T08:55:52.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.703+0000 7fd5612b2640 1 -- 172.21.15.46:0/2685446108 learned_addr learned my addr 172.21.15.46:0/2685446108 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:52.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.711+0000 7fd5612b2640 1 -- 172.21.15.46:0/2685446108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611b0b957d0 msgr2=0x5611b0b95bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:52.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.711+0000 7fd5612b2640 1 --2- 172.21.15.46:0/2685446108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611b0b957d0 0x5611b0b95bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.711+0000 7fd5612b2640 1 -- 172.21.15.46:0/2685446108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5611b0b960f0 msgr2=0x5611b0b964d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:52.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.711+0000 7fd5612b2640 1 --2- 172.21.15.46:0/2685446108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5611b0b960f0 0x5611b0b964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.711+0000 7fd5612b2640 1 -- 172.21.15.46:0/2685446108 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611b069c890 con 0x5611b0b90920 2024-01-23T08:55:52.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.715+0000 7fd5612b2640 1 --2- 172.21.15.46:0/2685446108 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611b0b90920 0x5611b0b90d00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd550003e70 tx=0x7fd550004330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f00bbd17652b77a8 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:52.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.723+0000 7fd5437fe640 1 -- 172.21.15.46:0/2685446108 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5500072d0 con 0x5611b0b90920 2024-01-23T08:55:52.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.723+0000 7fd5437fe640 1 -- 172.21.15.46:0/2685446108 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd550007450 con 0x5611b0b90920 2024-01-23T08:55:52.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.723+0000 7fd5437fe640 1 -- 172.21.15.46:0/2685446108 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55000eb10 con 0x5611b0b90920 2024-01-23T08:55:52.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.723+0000 7fd566e74000 1 -- 172.21.15.46:0/2685446108 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611b0b90920 msgr2=0x5611b0b90d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:52.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.723+0000 7fd566e74000 1 --2- 172.21.15.46:0/2685446108 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611b0b90920 0x5611b0b90d00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd550003e70 tx=0x7fd550004330 comp rx=0 tx=0).stop 2024-01-23T08:55:52.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.723+0000 7fd566e74000 1 -- 172.21.15.46:0/2685446108 shutdown_connections 2024-01-23T08:55:52.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.727+0000 7fd566e74000 1 --2- 172.21.15.46:0/2685446108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5611b0b960f0 0x5611b0b964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.727+0000 7fd566e74000 1 --2- 172.21.15.46:0/2685446108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611b0b957d0 0x5611b0b95bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.727+0000 7fd566e74000 1 --2- 172.21.15.46:0/2685446108 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611b0b90920 0x5611b0b90d00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.727+0000 7fd566e74000 1 -- 172.21.15.46:0/2685446108 >> 172.21.15.46:0/2685446108 conn(0x5611b0b91580 msgr2=0x5611b0b93970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:52.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.727+0000 7fd566e74000 1 -- 172.21.15.46:0/2685446108 shutdown_connections 2024-01-23T08:55:52.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.727+0000 7fd566e74000 1 -- 172.21.15.46:0/2685446108 wait complete. 2024-01-23T08:55:52.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.727+0000 7fd566e74000 1 -- start start 2024-01-23T08:55:52.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.727+0000 7fd566e74000 1 Processor -- start 2024-01-23T08:55:52.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.727+0000 7fd566e74000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611b0b90920 0x5611b0b8fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.727+0000 7fd566e74000 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5611b0b957d0 0x5611b0b90240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.727+0000 7fd566e74000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611b0b960f0 0x5611b0ba0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.727+0000 7fd566e74000 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b09a59c0 con 0x5611b0b957d0 2024-01-23T08:55:52.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.727+0000 7fd566e74000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b095d040 con 0x5611b0b960f0 2024-01-23T08:55:52.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.727+0000 7fd566e74000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611b0962ee0 con 0x5611b0b90920 2024-01-23T08:55:52.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.727+0000 7fd566e74000 10 client.0 _ll_register_callbacks cb 0x5611b09601b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-23T08:55:52.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.731+0000 7fd5612b2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611b0b960f0 0x5611b0ba0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:52.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.731+0000 7fd5612b2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611b0b90920 0x5611b0b8fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:52.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.731+0000 7fd5612b2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611b0b960f0 0x5611b0ba0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:42552/0 (socket says 172.21.15.46:42552) 2024-01-23T08:55:52.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.731+0000 7fd5612b2640 1 -- 172.21.15.46:0/2971045228 learned_addr learned my addr 172.21.15.46:0/2971045228 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:52.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.739+0000 7fd5612b2640 1 -- 172.21.15.46:0/2971045228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611b0b90920 msgr2=0x5611b0b8fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:52.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.739+0000 7fd5612b2640 1 --2- 172.21.15.46:0/2971045228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611b0b90920 0x5611b0b8fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.739+0000 7fd5612b2640 1 -- 172.21.15.46:0/2971045228 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5611b0b957d0 msgr2=0x5611b0b90240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:52.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.739+0000 7fd5612b2640 1 --2- 172.21.15.46:0/2971045228 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5611b0b957d0 0x5611b0b90240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:52.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.739+0000 7fd5612b2640 1 -- 172.21.15.46:0/2971045228 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd550003b20 con 0x5611b0b960f0 2024-01-23T08:55:52.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.743+0000 7fd5612b2640 1 --2- 172.21.15.46:0/2971045228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611b0b960f0 0x5611b0ba0780 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd550003880 tx=0x7fd550006000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e61c38dcf569f0d server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:52.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.743+0000 7fd540ff9640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-01-23T08:55:52.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.755+0000 7fd540ff9640 1 -- 172.21.15.46:0/2971045228 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd550019070 con 0x5611b0b960f0 2024-01-23T08:55:52.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.755+0000 7fd540ff9640 1 -- 172.21.15.46:0/2971045228 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fd55000ed10 con 0x5611b0b960f0 2024-01-23T08:55:52.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.755+0000 7fd566e74000 1 -- 172.21.15.46:0/2971045228 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5611b092be30 con 0x5611b0b960f0 2024-01-23T08:55:52.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.771+0000 7fd55a7fc640 1 -- 172.21.15.46:0/3624076479 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd55400ccc0 con 0x7fd55c0c65a0 2024-01-23T08:55:52.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.775+0000 7fd55a7fc640 1 --2- 172.21.15.46:0/3624076479 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd5480664a0 0x7fd548068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.775+0000 7fd561ab3640 1 --2- 172.21.15.46:0/3624076479 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd5480664a0 0x7fd548068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:52.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.775+0000 7fd55a7fc640 1 -- 172.21.15.46:0/3624076479 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fd554055960 con 0x7fd55c0c65a0 2024-01-23T08:55:52.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.775+0000 7fd561ab3640 1 --2- 172.21.15.46:0/3624076479 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd5480664a0 0x7fd548068960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0b0000 tx=0x7fd54c004a50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:52.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.887+0000 7fd540ff9640 1 -- 172.21.15.46:0/2971045228 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd550008800 con 0x5611b0b960f0 2024-01-23T08:55:52.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.887+0000 7fd566e74000 10 client.4585 fetch_fsmap learned FSMap version 18 2024-01-23T08:55:52.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.887+0000 7fd566e74000 1 -- 172.21.15.46:0/2971045228 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x5611b09655e0 con 0x5611b0b960f0 2024-01-23T08:55:52.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.895+0000 7fd540ff9640 1 -- 172.21.15.46:0/2971045228 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5611b092be30 con 0x5611b0b960f0 2024-01-23T08:55:52.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.895+0000 7fd540ff9640 1 -- 172.21.15.46:0/2971045228 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7fd550008960 con 0x5611b0b960f0 2024-01-23T08:55:52.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.895+0000 7fd566e74000 10 client.4585 fetch_fsmap finished waiting for FSMap version 18 2024-01-23T08:55:52.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.895+0000 7fd566e74000 10 client.4585 resolve_mds: resolved name 'f' to daemon mds.f 2024-01-23T08:55:52.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.895+0000 7fd566e74000 20 client.4585 populate_metadata read hostname 'smithi046' 2024-01-23T08:55:52.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.895+0000 7fd566e74000 1 --2- 172.21.15.46:0/2971045228 >> [v2:172.21.15.175:6836/3103300888,v1:172.21.15.175:6837/3103300888] conn(0x5611b0ba14f0 0x5611b0ba18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:52.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.895+0000 7fd566e74000 4 client.4585 mds_command: new command op to 4234 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:55:52.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.895+0000 7fd566e74000 1 -- 172.21.15.46:0/2971045228 --> [v2:172.21.15.175:6836/3103300888,v1:172.21.15.175:6837/3103300888] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5611b0962870 con 0x5611b0ba14f0 2024-01-23T08:55:52.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.899+0000 7fd5612b2640 1 --2- 172.21.15.46:0/2971045228 >> [v2:172.21.15.175:6836/3103300888,v1:172.21.15.175:6837/3103300888] conn(0x5611b0ba14f0 0x5611b0ba18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:52.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.991+0000 7fd5612b2640 1 --2- 172.21.15.46:0/2971045228 >> [v2:172.21.15.175:6836/3103300888,v1:172.21.15.175:6837/3103300888] conn(0x5611b0ba14f0 0x5611b0ba18d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c4f3a0a299a2f0fc server_cookie=97637a61aa63ed29 in_seq=0 out_seq=0 2024-01-23T08:55:52.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:52.991+0000 7fd540ff9640 10 client.4585 ms_handle_connect on v2:172.21.15.175:6836/3103300888 2024-01-23T08:55:53.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.143+0000 7fd540ff9640 1 -- 172.21.15.46:0/2971045228 <== mds.2 v2:172.21.15.175:6836/3103300888 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5611b0962870 con 0x5611b0ba14f0 2024-01-23T08:55:53.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.143+0000 7fd540ff9640 10 client.4585 handle_command_reply: tid=0 2024-01-23T08:55:53.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.143+0000 7fd566e74000 1 client.4585 shutdown 2024-01-23T08:55:53.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.143+0000 7fd566e74000 1 -- 172.21.15.46:0/2971045228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611b0b960f0 msgr2=0x5611b0ba0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:53.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.143+0000 7fd566e74000 1 --2- 172.21.15.46:0/2971045228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611b0b960f0 0x5611b0ba0780 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd550003880 tx=0x7fd550006000 comp rx=0 tx=0).stop 2024-01-23T08:55:53.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.143+0000 7fd566e74000 1 -- 172.21.15.46:0/2971045228 shutdown_connections 2024-01-23T08:55:53.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.143+0000 7fd566e74000 1 --2- 172.21.15.46:0/2971045228 >> [v2:172.21.15.175:6836/3103300888,v1:172.21.15.175:6837/3103300888] conn(0x5611b0ba14f0 0x5611b0ba18d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.143+0000 7fd566e74000 1 --2- 172.21.15.46:0/2971045228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611b0b960f0 0x5611b0ba0780 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.143+0000 7fd566e74000 1 --2- 172.21.15.46:0/2971045228 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5611b0b957d0 0x5611b0b90240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.143+0000 7fd540ff9640 0 client.4585 ms_handle_reset on v2:172.21.15.175:6836/3103300888 2024-01-23T08:55:53.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.143+0000 7fd566e74000 1 --2- 172.21.15.46:0/2971045228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611b0b90920 0x5611b0b8fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.143+0000 7fd566e74000 1 -- 172.21.15.46:0/2971045228 >> 172.21.15.46:0/2971045228 conn(0x5611b0b91580 msgr2=0x5611b0b93b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:53.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.143+0000 7fd566e74000 1 -- 172.21.15.46:0/2971045228 shutdown_connections 2024-01-23T08:55:53.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.143+0000 7fd566e74000 1 -- 172.21.15.46:0/2971045228 wait complete. 2024-01-23T08:55:53.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.147+0000 7fd566e74000 20 client.4585 trim_cache size 0 max 16384 2024-01-23T08:55:53.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.191+0000 7fd566e74000 1 Processor -- start 2024-01-23T08:55:53.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.191+0000 7fd566e74000 1 -- start start 2024-01-23T08:55:53.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.191+0000 7fd566e74000 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5611b0b50b50 0x5611b0bab790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.191+0000 7fd566e74000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611b0b91580 0x5611b0babcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.191+0000 7fd566e74000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611b0b90920 0x5611b0ba28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.191+0000 7fd566e74000 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b0b50f30 con 0x5611b0b50b50 2024-01-23T08:55:53.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.191+0000 7fd566e74000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b065d940 con 0x5611b0b91580 2024-01-23T08:55:53.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.191+0000 7fd566e74000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611b09a8520 con 0x5611b0b90920 2024-01-23T08:55:53.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.191+0000 7fd561ab3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5611b0b50b50 0x5611b0bab790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:53.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.195+0000 7fd561ab3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5611b0b50b50 0x5611b0bab790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52650/0 (socket says 172.21.15.46:52650) 2024-01-23T08:55:53.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.195+0000 7fd561ab3640 1 -- 172.21.15.46:0/2191498603 learned_addr learned my addr 172.21.15.46:0/2191498603 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:53.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.195+0000 7fd5622b4640 1 --2- 172.21.15.46:0/2191498603 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611b0b90920 0x5611b0ba28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:53.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.195+0000 7fd561ab3640 1 -- 172.21.15.46:0/2191498603 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611b0b90920 msgr2=0x5611b0ba28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:53.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.195+0000 7fd561ab3640 1 --2- 172.21.15.46:0/2191498603 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611b0b90920 0x5611b0ba28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.195+0000 7fd561ab3640 1 -- 172.21.15.46:0/2191498603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611b0b91580 msgr2=0x5611b0babcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:53.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.195+0000 7fd561ab3640 1 --2- 172.21.15.46:0/2191498603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611b0b91580 0x5611b0babcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.195+0000 7fd561ab3640 1 -- 172.21.15.46:0/2191498603 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611b094b8e0 con 0x5611b0b50b50 2024-01-23T08:55:53.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.199+0000 7fd561ab3640 1 --2- 172.21.15.46:0/2191498603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5611b0b50b50 0x5611b0bab790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd54c09a6c0 tx=0x7fd54c004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74306b0edcc95ec3 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:53.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.207+0000 7fd542ffd640 1 -- 172.21.15.46:0/2191498603 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c0bb650 con 0x5611b0b50b50 2024-01-23T08:55:53.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.207+0000 7fd542ffd640 1 -- 172.21.15.46:0/2191498603 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c0bb7b0 con 0x5611b0b50b50 2024-01-23T08:55:53.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.207+0000 7fd542ffd640 1 -- 172.21.15.46:0/2191498603 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c0bbb20 con 0x5611b0b50b50 2024-01-23T08:55:53.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.207+0000 7fd566e74000 1 -- 172.21.15.46:0/2191498603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5611b0b50b50 msgr2=0x5611b0bab790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:53.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.207+0000 7fd566e74000 1 --2- 172.21.15.46:0/2191498603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5611b0b50b50 0x5611b0bab790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd54c09a6c0 tx=0x7fd54c004ac0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.207+0000 7fd566e74000 1 -- 172.21.15.46:0/2191498603 shutdown_connections 2024-01-23T08:55:53.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.207+0000 7fd566e74000 1 --2- 172.21.15.46:0/2191498603 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611b0b90920 0x5611b0ba28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.207+0000 7fd566e74000 1 --2- 172.21.15.46:0/2191498603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611b0b91580 0x5611b0babcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.207+0000 7fd566e74000 1 --2- 172.21.15.46:0/2191498603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5611b0b50b50 0x5611b0bab790 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.207+0000 7fd566e74000 1 -- 172.21.15.46:0/2191498603 >> 172.21.15.46:0/2191498603 conn(0x5611b0b900e0 msgr2=0x5611b0bac430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:53.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.207+0000 7fd566e74000 1 -- 172.21.15.46:0/2191498603 shutdown_connections 2024-01-23T08:55:53.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.207+0000 7fd566e74000 1 -- 172.21.15.46:0/2191498603 wait complete. 2024-01-23T08:55:53.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.207+0000 7fd566e74000 1 -- start start 2024-01-23T08:55:53.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.207+0000 7fd566e74000 1 Processor -- start 2024-01-23T08:55:53.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.211+0000 7fd566e74000 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5611b0b50b50 0x5611b0ba2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.211+0000 7fd566e74000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611b0b90920 0x5611b0bfda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.211+0000 7fd566e74000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611b0b91580 0x5611b0bfdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.211+0000 7fd566e74000 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b09a4850 con 0x5611b0b50b50 2024-01-23T08:55:53.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.211+0000 7fd566e74000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611b096ee30 con 0x5611b0b90920 2024-01-23T08:55:53.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.211+0000 7fd566e74000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611b09a99c0 con 0x5611b0b91580 2024-01-23T08:55:53.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.211+0000 7fd566e74000 10 client.0 _ll_register_callbacks cb 0x5611b09d2a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-23T08:55:53.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.211+0000 7fd561ab3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5611b0b50b50 0x5611b0ba2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:53.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.211+0000 7fd561ab3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5611b0b50b50 0x5611b0ba2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52664/0 (socket says 172.21.15.46:52664) 2024-01-23T08:55:53.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.211+0000 7fd561ab3640 1 -- 172.21.15.46:0/3694837876 learned_addr learned my addr 172.21.15.46:0/3694837876 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:53.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.211+0000 7fd5622b4640 1 --2- 172.21.15.46:0/3694837876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611b0b91580 0x5611b0bfdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:53.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.215+0000 7fd561ab3640 1 -- 172.21.15.46:0/3694837876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611b0b91580 msgr2=0x5611b0bfdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:53.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.215+0000 7fd561ab3640 1 --2- 172.21.15.46:0/3694837876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611b0b91580 0x5611b0bfdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.215+0000 7fd561ab3640 1 -- 172.21.15.46:0/3694837876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611b0b90920 msgr2=0x5611b0bfda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:53.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.215+0000 7fd561ab3640 1 --2- 172.21.15.46:0/3694837876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611b0b90920 0x5611b0bfda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.215+0000 7fd561ab3640 1 -- 172.21.15.46:0/3694837876 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd55c157280 con 0x5611b0b50b50 2024-01-23T08:55:53.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.219+0000 7fd561ab3640 1 --2- 172.21.15.46:0/3694837876 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5611b0b50b50 0x5611b0ba2d10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd54c09a6c0 tx=0x7fd54c01d310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f255c8777264e3c1 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:53.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.219+0000 7fd540ff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-01-23T08:55:53.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.223+0000 7fd540ff9640 1 -- 172.21.15.46:0/3694837876 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c0bb650 con 0x5611b0b50b50 2024-01-23T08:55:53.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.223+0000 7fd540ff9640 1 -- 172.21.15.46:0/3694837876 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fd54c0039a0 con 0x5611b0b50b50 2024-01-23T08:55:53.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.223+0000 7fd566e74000 1 -- 172.21.15.46:0/3694837876 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5611b09574f0 con 0x5611b0b50b50 2024-01-23T08:55:53.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.247+0000 7fd540ff9640 1 -- 172.21.15.46:0/3694837876 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd54c003b60 con 0x5611b0b50b50 2024-01-23T08:55:53.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.247+0000 7fd566e74000 10 client.4704 fetch_fsmap learned FSMap version 18 2024-01-23T08:55:53.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.247+0000 7fd566e74000 1 -- 172.21.15.46:0/3694837876 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x5611b069ccc0 con 0x5611b0b50b50 2024-01-23T08:55:53.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.251+0000 7fd540ff9640 1 -- 172.21.15.46:0/3694837876 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5611b09574f0 con 0x5611b0b50b50 2024-01-23T08:55:53.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.251+0000 7fd540ff9640 1 -- 172.21.15.46:0/3694837876 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7fd54c0d5030 con 0x5611b0b50b50 2024-01-23T08:55:53.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.251+0000 7fd566e74000 10 client.4704 fetch_fsmap finished waiting for FSMap version 18 2024-01-23T08:55:53.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.251+0000 7fd566e74000 10 client.4704 resolve_mds: resolved name 'f' to daemon mds.f 2024-01-23T08:55:53.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.251+0000 7fd566e74000 20 client.4704 populate_metadata read hostname 'smithi046' 2024-01-23T08:55:53.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.251+0000 7fd566e74000 1 --2- 172.21.15.46:0/3694837876 >> [v2:172.21.15.175:6836/3103300888,v1:172.21.15.175:6837/3103300888] conn(0x5611b0b957d0 0x5611b0bfc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.251+0000 7fd566e74000 4 client.4704 mds_command: new command op to 4234 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-23T08:55:53.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.251+0000 7fd566e74000 1 -- 172.21.15.46:0/3694837876 --> [v2:172.21.15.175:6836/3103300888,v1:172.21.15.175:6837/3103300888] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5611b09a4310 con 0x5611b0b957d0 2024-01-23T08:55:53.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.255+0000 7fd5612b2640 1 --2- 172.21.15.46:0/3694837876 >> [v2:172.21.15.175:6836/3103300888,v1:172.21.15.175:6837/3103300888] conn(0x5611b0b957d0 0x5611b0bfc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:53.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.267+0000 7fd5612b2640 1 --2- 172.21.15.46:0/3694837876 >> [v2:172.21.15.175:6836/3103300888,v1:172.21.15.175:6837/3103300888] conn(0x5611b0b957d0 0x5611b0bfc850 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=928cbe83e22f0006 server_cookie=2a814a7c727dec63 in_seq=0 out_seq=0 2024-01-23T08:55:53.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.267+0000 7fd540ff9640 10 client.4704 ms_handle_connect on v2:172.21.15.175:6836/3103300888 2024-01-23T08:55:53.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.299+0000 7fd540ff9640 1 -- 172.21.15.46:0/3694837876 <== mds.2 v2:172.21.15.175:6836/3103300888 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x5611b09a4310 con 0x5611b0b957d0 2024-01-23T08:55:53.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.299+0000 7fd540ff9640 10 client.4704 handle_command_reply: tid=0 2024-01-23T08:55:53.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.303+0000 7fd566e74000 1 client.4704 shutdown 2024-01-23T08:55:53.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.303+0000 7fd566e74000 1 -- 172.21.15.46:0/3694837876 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5611b0b50b50 msgr2=0x5611b0ba2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:53.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.303+0000 7fd566e74000 1 --2- 172.21.15.46:0/3694837876 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5611b0b50b50 0x5611b0ba2d10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd54c09a6c0 tx=0x7fd54c01d310 comp rx=0 tx=0).stop 2024-01-23T08:55:53.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.303+0000 7fd566e74000 1 -- 172.21.15.46:0/3694837876 shutdown_connections 2024-01-23T08:55:53.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.303+0000 7fd566e74000 1 --2- 172.21.15.46:0/3694837876 >> [v2:172.21.15.175:6836/3103300888,v1:172.21.15.175:6837/3103300888] conn(0x5611b0b957d0 0x5611b0bfc850 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.303+0000 7fd566e74000 1 --2- 172.21.15.46:0/3694837876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5611b0b91580 0x5611b0bfdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.303+0000 7fd566e74000 1 --2- 172.21.15.46:0/3694837876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5611b0b90920 0x5611b0bfda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.303+0000 7fd540ff9640 0 client.4704 ms_handle_reset on v2:172.21.15.175:6836/3103300888 2024-01-23T08:55:53.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.303+0000 7fd566e74000 1 --2- 172.21.15.46:0/3694837876 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5611b0b50b50 0x5611b0ba2d10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.303+0000 7fd566e74000 1 -- 172.21.15.46:0/3694837876 >> 172.21.15.46:0/3694837876 conn(0x5611b0b900e0 msgr2=0x5611b0bb51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:53.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.303+0000 7fd566e74000 1 -- 172.21.15.46:0/3694837876 shutdown_connections 2024-01-23T08:55:53.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.303+0000 7fd566e74000 1 -- 172.21.15.46:0/3694837876 wait complete. 2024-01-23T08:55:53.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.303+0000 7fd566e74000 20 client.4704 trim_cache size 0 max 16384 2024-01-23T08:55:53.302 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-23T08:55:53.302 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "fdbdd393-f422-45ae-a488-2bbb0163e580", 2024-01-23T08:55:53.302 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 2, 2024-01-23T08:55:53.302 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4234, 2024-01-23T08:55:53.302 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-01-23T08:55:53.302 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-01-23T08:55:53.302 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-01-23T08:55:53.302 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 28.066640061000001, 2024-01-23T08:55:53.303 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 18, 2024-01-23T08:55:53.303 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 30, 2024-01-23T08:55:53.303 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 28, 2024-01-23T08:55:53.303 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 107.007982282 2024-01-23T08:55:53.303 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-23T08:55:53.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.303+0000 7fd563d17640 1 -- 172.21.15.46:0/3624076479 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd5480664a0 msgr2=0x7fd548068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:53.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.303+0000 7fd563d17640 1 --2- 172.21.15.46:0/3624076479 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd5480664a0 0x7fd548068960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0b0000 tx=0x7fd54c004a50 comp rx=0 tx=0).stop 2024-01-23T08:55:53.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.303+0000 7fd563d17640 1 -- 172.21.15.46:0/3624076479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd55c0c65a0 msgr2=0x7fd55c0c4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:53.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.303+0000 7fd563d17640 1 --2- 172.21.15.46:0/3624076479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd55c0c65a0 0x7fd55c0c4770 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd55400e7f0 tx=0x7fd55400ecb0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.303+0000 7fd563d17640 1 -- 172.21.15.46:0/3624076479 shutdown_connections 2024-01-23T08:55:53.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.303+0000 7fd563d17640 1 --2- 172.21.15.46:0/3624076479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd55c0c65a0 0x7fd55c0c4770 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.303+0000 7fd563d17640 1 --2- 172.21.15.46:0/3624076479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd55c070290 0x7fd55c14ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.303+0000 7fd563d17640 1 --2- 172.21.15.46:0/3624076479 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd5480664a0 0x7fd548068960 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.303+0000 7fd563d17640 1 --2- 172.21.15.46:0/3624076479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd55c06feb0 0x7fd55c1efc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.303+0000 7fd563d17640 1 -- 172.21.15.46:0/3624076479 >> 172.21.15.46:0/3624076479 conn(0x7fd55c072890 msgr2=0x7fd55c0c7620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:53.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.303+0000 7fd563d17640 1 -- 172.21.15.46:0/3624076479 shutdown_connections 2024-01-23T08:55:53.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.303+0000 7fd563d17640 1 -- 172.21.15.46:0/3624076479 wait complete. 2024-01-23T08:55:53.338 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-01-23T08:55:53.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.475+0000 7fa875923640 1 Processor -- start 2024-01-23T08:55:53.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.475+0000 7fa875923640 1 -- start start 2024-01-23T08:55:53.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.475+0000 7fa875923640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8700c8310 0x7fa870151190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.475+0000 7fa875923640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa870071970 0x7fa8701516d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.475+0000 7fa875923640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa87015a9d0 con 0x7fa8700c7f30 2024-01-23T08:55:53.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.475+0000 7fa875923640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8701573e0 con 0x7fa870071970 2024-01-23T08:55:53.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.475+0000 7fa875923640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87006e1a0 con 0x7fa8700c8310 2024-01-23T08:55:53.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.475+0000 7fa86effd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa8700c7f30 0x7fa87006da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44880/0 (socket says 172.21.15.46:44880) 2024-01-23T08:55:53.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.475+0000 7fa86effd640 1 -- 172.21.15.46:0/777371149 learned_addr learned my addr 172.21.15.46:0/777371149 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:53.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.475+0000 7fa867fff640 1 --2- 172.21.15.46:0/777371149 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8700c8310 0x7fa870151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:53.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.475+0000 7fa86f7fe640 1 --2- 172.21.15.46:0/777371149 >> v2:172.21.15.175:3300/0 conn(0x7fa870071970 0x7fa8701516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:53.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.479+0000 7fa86e7fc640 1 -- 172.21.15.46:0/777371149 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3222291432 0 0) 0x7fa87015a9d0 con 0x7fa8700c7f30 2024-01-23T08:55:53.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.479+0000 7fa86e7fc640 1 -- 172.21.15.46:0/777371149 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa85c003530 con 0x7fa8700c7f30 2024-01-23T08:55:53.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.483+0000 7fa86e7fc640 1 -- 172.21.15.46:0/777371149 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2941040599 0 0) 0x7fa85c003530 con 0x7fa8700c7f30 2024-01-23T08:55:53.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.483+0000 7fa86e7fc640 1 -- 172.21.15.46:0/777371149 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8700c8310 msgr2=0x7fa870151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:53.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.483+0000 7fa86e7fc640 1 --2- 172.21.15.46:0/777371149 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8700c8310 0x7fa870151190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.483+0000 7fa86e7fc640 1 -- 172.21.15.46:0/777371149 >> v2:172.21.15.175:3300/0 conn(0x7fa870071970 msgr2=0x7fa8701516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:53.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.483+0000 7fa86e7fc640 1 --2- 172.21.15.46:0/777371149 >> v2:172.21.15.175:3300/0 conn(0x7fa870071970 0x7fa8701516d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.483+0000 7fa86e7fc640 1 -- 172.21.15.46:0/777371149 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8701576a0 con 0x7fa8700c7f30 2024-01-23T08:55:53.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.483+0000 7fa86e7fc640 1 -- 172.21.15.46:0/777371149 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466917103 0 0) 0x7fa860001680 con 0x7fa8700c7f30 2024-01-23T08:55:53.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.483+0000 7fa86e7fc640 1 -- 172.21.15.46:0/777371149 >> v1:172.21.15.46:6789/0 conn(0x7fa8700c7f30 legacy=0x7fa87006da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:53.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.483+0000 7fa86e7fc640 1 --2- 172.21.15.46:0/777371149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa85c0039f0 0x7fa85c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.483+0000 7fa86e7fc640 1 --2- 172.21.15.46:0/777371149 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8700c8310 0x7fa85c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.483+0000 7fa86e7fc640 1 --2- 172.21.15.46:0/777371149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa85c004d10 0x7fa85c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.483+0000 7fa86e7fc640 1 -- 172.21.15.46:0/777371149 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8701573e0 con 0x7fa85c004d10 2024-01-23T08:55:53.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.483+0000 7fa86e7fc640 1 -- 172.21.15.46:0/777371149 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87006e1a0 con 0x7fa85c0039f0 2024-01-23T08:55:53.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.483+0000 7fa86e7fc640 1 -- 172.21.15.46:0/777371149 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c00ba70 con 0x7fa8700c8310 2024-01-23T08:55:53.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.487+0000 7fa86f7fe640 1 --2- 172.21.15.46:0/777371149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa85c004d10 0x7fa85c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:53.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.487+0000 7fa86f7fe640 1 -- 172.21.15.46:0/777371149 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8700c8310 msgr2=0x7fa85c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:53.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.487+0000 7fa86f7fe640 1 --2- 172.21.15.46:0/777371149 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8700c8310 0x7fa85c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.487+0000 7fa86f7fe640 1 -- 172.21.15.46:0/777371149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa85c0039f0 msgr2=0x7fa85c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:53.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.487+0000 7fa86f7fe640 1 --2- 172.21.15.46:0/777371149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa85c0039f0 0x7fa85c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.487+0000 7fa86f7fe640 1 -- 172.21.15.46:0/777371149 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa85c003530 con 0x7fa85c004d10 2024-01-23T08:55:53.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.491+0000 7fa86f7fe640 1 --2- 172.21.15.46:0/777371149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa85c004d10 0x7fa85c005190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa868009fc0 tx=0x7fa86801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4512a6b702b52359 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:53.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.495+0000 7fa86e7fc640 1 -- 172.21.15.46:0/777371149 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8680a5cb0 con 0x7fa85c004d10 2024-01-23T08:55:53.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.495+0000 7fa86e7fc640 1 -- 172.21.15.46:0/777371149 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86800f040 con 0x7fa85c004d10 2024-01-23T08:55:53.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.495+0000 7fa86e7fc640 1 -- 172.21.15.46:0/777371149 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8680ad680 con 0x7fa85c004d10 2024-01-23T08:55:53.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.495+0000 7fa875923640 1 -- 172.21.15.46:0/777371149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa85c004d10 msgr2=0x7fa85c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:53.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.495+0000 7fa875923640 1 --2- 172.21.15.46:0/777371149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa85c004d10 0x7fa85c005190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa868009fc0 tx=0x7fa86801cca0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.495+0000 7fa86f7fe640 1 -- 172.21.15.46:0/777371149 reap_dead start 2024-01-23T08:55:53.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.495+0000 7fa875923640 1 -- 172.21.15.46:0/777371149 shutdown_connections 2024-01-23T08:55:53.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.495+0000 7fa875923640 1 -- 172.21.15.46:0/777371149 >> 172.21.15.46:0/777371149 conn(0x7fa87006aa60 msgr2=0x7fa87006ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:53.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.495+0000 7fa875923640 1 -- 172.21.15.46:0/777371149 shutdown_connections 2024-01-23T08:55:53.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.495+0000 7fa875923640 1 -- 172.21.15.46:0/777371149 wait complete. 2024-01-23T08:55:53.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.499+0000 7fa875923640 1 Processor -- start 2024-01-23T08:55:53.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.499+0000 7fa875923640 1 -- start start 2024-01-23T08:55:53.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.499+0000 7fa875923640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa87013b850 0x7fa870158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.499+0000 7fa875923640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa87013d130 0x7fa8701466b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.499+0000 7fa875923640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa87013bc30 0x7fa870144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.499+0000 7fa875923640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87013e150 con 0x7fa87013b850 2024-01-23T08:55:53.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.499+0000 7fa875923640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87015a5c0 con 0x7fa87013d130 2024-01-23T08:55:53.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.499+0000 7fa875923640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87013cca0 con 0x7fa87013bc30 2024-01-23T08:55:53.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.499+0000 7fa86effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa87013b850 0x7fa870158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:53.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.499+0000 7fa86effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa87013b850 0x7fa870158f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52678/0 (socket says 172.21.15.46:52678) 2024-01-23T08:55:53.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.499+0000 7fa86effd640 1 -- 172.21.15.46:0/3612924341 learned_addr learned my addr 172.21.15.46:0/3612924341 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:53.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.499+0000 7fa86f7fe640 1 --2- 172.21.15.46:0/3612924341 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa87013bc30 0x7fa870144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:53.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.499+0000 7fa867fff640 1 --2- 172.21.15.46:0/3612924341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa87013d130 0x7fa8701466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:53.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.503+0000 7fa86effd640 1 -- 172.21.15.46:0/3612924341 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa87013bc30 msgr2=0x7fa870144cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:53.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.503+0000 7fa86effd640 1 --2- 172.21.15.46:0/3612924341 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa87013bc30 0x7fa870144cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.503+0000 7fa86effd640 1 -- 172.21.15.46:0/3612924341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa87013d130 msgr2=0x7fa8701466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:53.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.503+0000 7fa86effd640 1 --2- 172.21.15.46:0/3612924341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa87013d130 0x7fa8701466b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.503+0000 7fa86effd640 1 -- 172.21.15.46:0/3612924341 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8701451f0 con 0x7fa87013b850 2024-01-23T08:55:53.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.507+0000 7fa86effd640 1 --2- 172.21.15.46:0/3612924341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa87013b850 0x7fa870158f60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa86000c6b0 tx=0x7fa86000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:53.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.511+0000 7fa86cff9640 1 -- 172.21.15.46:0/3612924341 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa860004ab0 con 0x7fa87013b850 2024-01-23T08:55:53.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.511+0000 7fa86cff9640 1 -- 172.21.15.46:0/3612924341 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa860004c30 con 0x7fa87013b850 2024-01-23T08:55:53.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.511+0000 7fa86cff9640 1 -- 172.21.15.46:0/3612924341 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8600070d0 con 0x7fa87013b850 2024-01-23T08:55:53.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.511+0000 7fa875923640 1 -- 172.21.15.46:0/3612924341 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa87013de70 con 0x7fa87013b850 2024-01-23T08:55:53.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.511+0000 7fa875923640 1 -- 172.21.15.46:0/3612924341 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87013c650 con 0x7fa87013b850 2024-01-23T08:55:53.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.511+0000 7fa878a80000 1 Processor -- start 2024-01-23T08:55:53.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.511+0000 7fa878a80000 1 -- start start 2024-01-23T08:55:53.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.511+0000 7fa878a80000 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558b9e0a5730 0x558b9e0a5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.511+0000 7fa878a80000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558b9e0e07d0 0x558b9e0e0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.511+0000 7fa878a80000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558b9e0e10f0 0x558b9e0eba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.511+0000 7fa878a80000 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b9defbd70 con 0x558b9e0a5730 2024-01-23T08:55:53.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.511+0000 7fa878a80000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b9def7ba0 con 0x558b9e0e10f0 2024-01-23T08:55:53.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.511+0000 7fa878a80000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x558b9def50d0 con 0x558b9e0e07d0 2024-01-23T08:55:53.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.515+0000 7fa867fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558b9e0e10f0 0x558b9e0eba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:53.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.519+0000 7fa867fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558b9e0e10f0 0x558b9e0eba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:53902/0 (socket says 172.21.15.46:53902) 2024-01-23T08:55:53.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.519+0000 7fa867fff640 1 -- 172.21.15.46:0/3515601867 learned_addr learned my addr 172.21.15.46:0/3515601867 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:53.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.519+0000 7fa86effd640 1 --2- 172.21.15.46:0/3515601867 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558b9e0e07d0 0x558b9e0e0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:53.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.523+0000 7fa867fff640 1 -- 172.21.15.46:0/3515601867 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558b9e0e07d0 msgr2=0x558b9e0e0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:53.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.523+0000 7fa867fff640 1 --2- 172.21.15.46:0/3515601867 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558b9e0e07d0 0x558b9e0e0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.523+0000 7fa867fff640 1 -- 172.21.15.46:0/3515601867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558b9e0a5730 msgr2=0x558b9e0a5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:53.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.523+0000 7fa867fff640 1 --2- 172.21.15.46:0/3515601867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558b9e0a5730 0x558b9e0a5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.523+0000 7fa867fff640 1 -- 172.21.15.46:0/3515601867 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b9dbe7890 con 0x558b9e0e10f0 2024-01-23T08:55:53.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.527+0000 7fa867fff640 1 --2- 172.21.15.46:0/3515601867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558b9e0e10f0 0x558b9e0eba60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa858009ae0 tx=0x7fa8580112c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f495c107d514b155 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:53.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.531+0000 7fa86cff9640 1 -- 172.21.15.46:0/3612924341 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa860007430 con 0x7fa87013b850 2024-01-23T08:55:53.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.531+0000 7fa86cff9640 1 --2- 172.21.15.46:0/3612924341 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa850066550 0x7fa850068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.531+0000 7fa86f7fe640 1 --2- 172.21.15.46:0/3612924341 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa850066550 0x7fa850068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:53.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.531+0000 7fa86f7fe640 1 --2- 172.21.15.46:0/3612924341 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa850066550 0x7fa850068a10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa8680af000 tx=0x7fa86801b4e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:53.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.535+0000 7fa8657fa640 1 -- 172.21.15.46:0/3515601867 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa858011ce0 con 0x558b9e0e10f0 2024-01-23T08:55:53.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.535+0000 7fa86cff9640 1 -- 172.21.15.46:0/3612924341 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fa860054af0 con 0x7fa87013b850 2024-01-23T08:55:53.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.539+0000 7fa8657fa640 1 -- 172.21.15.46:0/3515601867 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa858011e40 con 0x558b9e0e10f0 2024-01-23T08:55:53.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.539+0000 7fa8657fa640 1 -- 172.21.15.46:0/3515601867 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa858014640 con 0x558b9e0e10f0 2024-01-23T08:55:53.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.539+0000 7fa878a80000 1 -- 172.21.15.46:0/3515601867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558b9e0e10f0 msgr2=0x558b9e0eba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:53.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.539+0000 7fa878a80000 1 --2- 172.21.15.46:0/3515601867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558b9e0e10f0 0x558b9e0eba60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa858009ae0 tx=0x7fa8580112c0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.539+0000 7fa878a80000 1 -- 172.21.15.46:0/3515601867 shutdown_connections 2024-01-23T08:55:53.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.539+0000 7fa878a80000 1 --2- 172.21.15.46:0/3515601867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558b9e0e10f0 0x558b9e0eba60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.539+0000 7fa878a80000 1 --2- 172.21.15.46:0/3515601867 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558b9e0e07d0 0x558b9e0e0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.539+0000 7fa878a80000 1 --2- 172.21.15.46:0/3515601867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558b9e0a5730 0x558b9e0a5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.539+0000 7fa878a80000 1 -- 172.21.15.46:0/3515601867 >> 172.21.15.46:0/3515601867 conn(0x558b9e0dc580 msgr2=0x558b9e0de970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:53.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.539+0000 7fa878a80000 1 -- 172.21.15.46:0/3515601867 shutdown_connections 2024-01-23T08:55:53.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.539+0000 7fa878a80000 1 -- 172.21.15.46:0/3515601867 wait complete. 2024-01-23T08:55:53.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.539+0000 7fa878a80000 1 -- start start 2024-01-23T08:55:53.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.539+0000 7fa878a80000 1 Processor -- start 2024-01-23T08:55:53.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.543+0000 7fa878a80000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558b9e0a5730 0x558b9e0dad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.543+0000 7fa878a80000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558b9e0e07d0 0x558b9e0db240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.543+0000 7fa878a80000 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558b9e0e10f0 0x558b9e0e7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.543+0000 7fa878a80000 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b9def09c0 con 0x558b9e0e10f0 2024-01-23T08:55:53.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.543+0000 7fa878a80000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b9dea8040 con 0x558b9e0e07d0 2024-01-23T08:55:53.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.543+0000 7fa878a80000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x558b9deadee0 con 0x558b9e0a5730 2024-01-23T08:55:53.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.543+0000 7fa878a80000 10 client.0 _ll_register_callbacks cb 0x558b9deab1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-23T08:55:53.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.543+0000 7fa86f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558b9e0e10f0 0x558b9e0e7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:53.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.543+0000 7fa86f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558b9e0e10f0 0x558b9e0e7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52708/0 (socket says 172.21.15.46:52708) 2024-01-23T08:55:53.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.543+0000 7fa86f7fe640 1 -- 172.21.15.46:0/1912040887 learned_addr learned my addr 172.21.15.46:0/1912040887 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:53.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.543+0000 7fa86effd640 1 --2- 172.21.15.46:0/1912040887 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558b9e0a5730 0x558b9e0dad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:53.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.543+0000 7fa867fff640 1 --2- 172.21.15.46:0/1912040887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558b9e0e07d0 0x558b9e0db240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:53.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.547+0000 7fa86f7fe640 1 -- 172.21.15.46:0/1912040887 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558b9e0a5730 msgr2=0x558b9e0dad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:53.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.547+0000 7fa86f7fe640 1 --2- 172.21.15.46:0/1912040887 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558b9e0a5730 0x558b9e0dad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.547+0000 7fa86f7fe640 1 -- 172.21.15.46:0/1912040887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558b9e0e07d0 msgr2=0x558b9e0db240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:53.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.547+0000 7fa86f7fe640 1 --2- 172.21.15.46:0/1912040887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558b9e0e07d0 0x558b9e0db240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.547+0000 7fa86f7fe640 1 -- 172.21.15.46:0/1912040887 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa858009790 con 0x558b9e0e10f0 2024-01-23T08:55:53.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.547+0000 7fa86f7fe640 1 --2- 172.21.15.46:0/1912040887 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558b9e0e10f0 0x558b9e0e7950 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa868009540 tx=0x7fa85c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba86dac76cf220b0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:53.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.547+0000 7fa84e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-01-23T08:55:53.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.551+0000 7fa84e7fc640 1 -- 172.21.15.46:0/1912040887 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8680b9d30 con 0x558b9e0e10f0 2024-01-23T08:55:53.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.551+0000 7fa84e7fc640 1 -- 172.21.15.46:0/1912040887 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fa8680c6e10 con 0x558b9e0e10f0 2024-01-23T08:55:53.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.551+0000 7fa878a80000 1 -- 172.21.15.46:0/1912040887 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558b9de76e30 con 0x558b9e0e10f0 2024-01-23T08:55:53.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.555+0000 7fa84e7fc640 1 -- 172.21.15.46:0/1912040887 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8680b9e90 con 0x558b9e0e10f0 2024-01-23T08:55:53.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.555+0000 7fa878a80000 10 client.4713 fetch_fsmap learned FSMap version 18 2024-01-23T08:55:53.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.555+0000 7fa878a80000 1 -- 172.21.15.46:0/1912040887 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x558b9deb05e0 con 0x558b9e0e10f0 2024-01-23T08:55:53.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.559+0000 7fa84e7fc640 1 -- 172.21.15.46:0/1912040887 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558b9de76e30 con 0x558b9e0e10f0 2024-01-23T08:55:53.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.559+0000 7fa84e7fc640 1 -- 172.21.15.46:0/1912040887 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7fa8680c3030 con 0x558b9e0e10f0 2024-01-23T08:55:53.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.559+0000 7fa878a80000 10 client.4713 fetch_fsmap finished waiting for FSMap version 18 2024-01-23T08:55:53.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.559+0000 7fa878a80000 10 client.4713 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-23T08:55:53.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.559+0000 7fa878a80000 20 client.4713 populate_metadata read hostname 'smithi046' 2024-01-23T08:55:53.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.559+0000 7fa878a80000 1 --2- 172.21.15.46:0/1912040887 >> [v2:172.21.15.46:6836/338965660,v1:172.21.15.46:6837/338965660] conn(0x558b9e0e8600 0x558b9e0e89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.559+0000 7fa878a80000 4 client.4713 mds_command: new command op to 4239 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:55:53.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.559+0000 7fa878a80000 1 -- 172.21.15.46:0/1912040887 --> [v2:172.21.15.46:6836/338965660,v1:172.21.15.46:6837/338965660] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558b9dead870 con 0x558b9e0e8600 2024-01-23T08:55:53.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.559+0000 7fa86effd640 1 --2- 172.21.15.46:0/1912040887 >> [v2:172.21.15.46:6836/338965660,v1:172.21.15.46:6837/338965660] conn(0x558b9e0e8600 0x558b9e0e89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:53.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.603+0000 7fa84e7fc640 10 client.4713 ms_handle_connect on v2:172.21.15.46:6836/338965660 2024-01-23T08:55:53.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.603+0000 7fa86effd640 1 --2- 172.21.15.46:0/1912040887 >> [v2:172.21.15.46:6836/338965660,v1:172.21.15.46:6837/338965660] conn(0x558b9e0e8600 0x558b9e0e89e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=56d736f6bb57a813 server_cookie=ade820730db6f9d1 in_seq=0 out_seq=0 2024-01-23T08:55:53.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.787+0000 7fa84e7fc640 1 -- 172.21.15.46:0/1912040887 <== mds.1 v2:172.21.15.46:6836/338965660 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558b9dead870 con 0x558b9e0e8600 2024-01-23T08:55:53.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.787+0000 7fa84e7fc640 10 client.4713 handle_command_reply: tid=0 2024-01-23T08:55:53.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.787+0000 7fa878a80000 1 client.4713 shutdown 2024-01-23T08:55:53.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.787+0000 7fa878a80000 1 -- 172.21.15.46:0/1912040887 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558b9e0e10f0 msgr2=0x558b9e0e7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:53.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.787+0000 7fa878a80000 1 --2- 172.21.15.46:0/1912040887 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558b9e0e10f0 0x558b9e0e7950 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa868009540 tx=0x7fa85c005800 comp rx=0 tx=0).stop 2024-01-23T08:55:53.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.787+0000 7fa878a80000 1 -- 172.21.15.46:0/1912040887 shutdown_connections 2024-01-23T08:55:53.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.787+0000 7fa878a80000 1 --2- 172.21.15.46:0/1912040887 >> [v2:172.21.15.46:6836/338965660,v1:172.21.15.46:6837/338965660] conn(0x558b9e0e8600 0x558b9e0e89e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.787+0000 7fa878a80000 1 --2- 172.21.15.46:0/1912040887 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558b9e0e10f0 0x558b9e0e7950 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.787+0000 7fa878a80000 1 --2- 172.21.15.46:0/1912040887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558b9e0e07d0 0x558b9e0db240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.787+0000 7fa84e7fc640 0 client.4713 ms_handle_reset on v2:172.21.15.46:6836/338965660 2024-01-23T08:55:53.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.787+0000 7fa878a80000 1 --2- 172.21.15.46:0/1912040887 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558b9e0a5730 0x558b9e0dad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.787+0000 7fa878a80000 1 -- 172.21.15.46:0/1912040887 >> 172.21.15.46:0/1912040887 conn(0x558b9e0dc580 msgr2=0x558b9e0dbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:53.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.787+0000 7fa878a80000 1 -- 172.21.15.46:0/1912040887 shutdown_connections 2024-01-23T08:55:53.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.787+0000 7fa878a80000 1 -- 172.21.15.46:0/1912040887 wait complete. 2024-01-23T08:55:53.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.787+0000 7fa878a80000 20 client.4713 trim_cache size 0 max 16384 2024-01-23T08:55:53.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.839+0000 7fa878a80000 1 Processor -- start 2024-01-23T08:55:53.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.839+0000 7fa878a80000 1 -- start start 2024-01-23T08:55:53.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.839+0000 7fa878a80000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558b9e0a5730 0x558b9e0a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.839+0000 7fa878a80000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558b9e0e07d0 0x558b9e0a20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.839+0000 7fa878a80000 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558b9e0e10f0 0x558b9e0a2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.839+0000 7fa878a80000 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b9dba8940 con 0x558b9e0e10f0 2024-01-23T08:55:53.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.839+0000 7fa878a80000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b9def95c0 con 0x558b9e0e07d0 2024-01-23T08:55:53.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.839+0000 7fa878a80000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x558b9deed5d0 con 0x558b9e0a5730 2024-01-23T08:55:53.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.839+0000 7fa86f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558b9e0e10f0 0x558b9e0a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:53.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.839+0000 7fa86f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558b9e0e10f0 0x558b9e0a2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52716/0 (socket says 172.21.15.46:52716) 2024-01-23T08:55:53.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.839+0000 7fa86f7fe640 1 -- 172.21.15.46:0/4161995508 learned_addr learned my addr 172.21.15.46:0/4161995508 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:53.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.843+0000 7fa86f7fe640 1 -- 172.21.15.46:0/4161995508 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558b9e0a5730 msgr2=0x558b9e0a4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:53.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.843+0000 7fa86f7fe640 1 --2- 172.21.15.46:0/4161995508 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558b9e0a5730 0x558b9e0a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.843+0000 7fa86f7fe640 1 -- 172.21.15.46:0/4161995508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558b9e0e07d0 msgr2=0x558b9e0a20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:53.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.843+0000 7fa86f7fe640 1 --2- 172.21.15.46:0/4161995508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558b9e0e07d0 0x558b9e0a20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.843+0000 7fa86f7fe640 1 -- 172.21.15.46:0/4161995508 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b9de968e0 con 0x558b9e0e10f0 2024-01-23T08:55:53.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.847+0000 7fa86f7fe640 1 --2- 172.21.15.46:0/4161995508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558b9e0e10f0 0x558b9e0a2600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa8680b0040 tx=0x7fa8680bf000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db48b6f518a7f4e3 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:53.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.851+0000 7fa864ff9640 1 -- 172.21.15.46:0/4161995508 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8680b9d30 con 0x558b9e0e10f0 2024-01-23T08:55:53.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.851+0000 7fa864ff9640 1 -- 172.21.15.46:0/4161995508 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8680b9e90 con 0x558b9e0e10f0 2024-01-23T08:55:53.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.851+0000 7fa864ff9640 1 -- 172.21.15.46:0/4161995508 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8680c5de0 con 0x558b9e0e10f0 2024-01-23T08:55:53.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.851+0000 7fa878a80000 1 -- 172.21.15.46:0/4161995508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558b9e0e10f0 msgr2=0x558b9e0a2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:53.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.851+0000 7fa878a80000 1 --2- 172.21.15.46:0/4161995508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558b9e0e10f0 0x558b9e0a2600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa8680b0040 tx=0x7fa8680bf000 comp rx=0 tx=0).stop 2024-01-23T08:55:53.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.851+0000 7fa878a80000 1 -- 172.21.15.46:0/4161995508 shutdown_connections 2024-01-23T08:55:53.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.851+0000 7fa878a80000 1 --2- 172.21.15.46:0/4161995508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558b9e0e10f0 0x558b9e0a2600 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.851+0000 7fa878a80000 1 --2- 172.21.15.46:0/4161995508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558b9e0e07d0 0x558b9e0a20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.851+0000 7fa878a80000 1 --2- 172.21.15.46:0/4161995508 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558b9e0a5730 0x558b9e0a4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.851+0000 7fa878a80000 1 -- 172.21.15.46:0/4161995508 >> 172.21.15.46:0/4161995508 conn(0x558b9e0dc580 msgr2=0x558b9e0f32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:53.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.851+0000 7fa878a80000 1 -- 172.21.15.46:0/4161995508 shutdown_connections 2024-01-23T08:55:53.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.851+0000 7fa878a80000 1 -- 172.21.15.46:0/4161995508 wait complete. 2024-01-23T08:55:53.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.851+0000 7fa878a80000 1 -- start start 2024-01-23T08:55:53.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.851+0000 7fa878a80000 1 Processor -- start 2024-01-23T08:55:53.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.855+0000 7fa878a80000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558b9e0a5730 0x558b9e142c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.855+0000 7fa878a80000 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558b9e0e07d0 0x558b9e143190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.855+0000 7fa878a80000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558b9e0e10f0 0x558b9e1438f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.855+0000 7fa878a80000 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b9e0e0070 con 0x558b9e0e07d0 2024-01-23T08:55:53.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.855+0000 7fa878a80000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b9deabb40 con 0x558b9e0a5730 2024-01-23T08:55:53.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.855+0000 7fa878a80000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x558b9e08aca0 con 0x558b9e0e10f0 2024-01-23T08:55:53.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.855+0000 7fa878a80000 10 client.0 _ll_register_callbacks cb 0x558b9df1da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-23T08:55:53.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.859+0000 7fa867fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558b9e0e07d0 0x558b9e143190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:53.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.859+0000 7fa86effd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558b9e0a5730 0x558b9e142c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:53.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.859+0000 7fa86effd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558b9e0a5730 0x558b9e142c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:53940/0 (socket says 172.21.15.46:53940) 2024-01-23T08:55:53.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.859+0000 7fa86effd640 1 -- 172.21.15.46:0/1137747633 learned_addr learned my addr 172.21.15.46:0/1137747633 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:53.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.863+0000 7fa86f7fe640 1 --2- 172.21.15.46:0/1137747633 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558b9e0e10f0 0x558b9e1438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:53.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.867+0000 7fa867fff640 1 -- 172.21.15.46:0/1137747633 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558b9e0e10f0 msgr2=0x558b9e1438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:53.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.867+0000 7fa867fff640 1 --2- 172.21.15.46:0/1137747633 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558b9e0e10f0 0x558b9e1438f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.867+0000 7fa867fff640 1 -- 172.21.15.46:0/1137747633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558b9e0a5730 msgr2=0x558b9e142c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:53.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.867+0000 7fa867fff640 1 --2- 172.21.15.46:0/1137747633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558b9e0a5730 0x558b9e142c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.867+0000 7fa867fff640 1 -- 172.21.15.46:0/1137747633 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558b9deb05e0 con 0x558b9e0e07d0 2024-01-23T08:55:53.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.867+0000 7fa867fff640 1 --2- 172.21.15.46:0/1137747633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558b9e0e07d0 0x558b9e143190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa85801c000 tx=0x7fa858009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51432cd6dd5e551a server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:53.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.867+0000 7fa84e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-01-23T08:55:53.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.871+0000 7fa84e7fc640 1 -- 172.21.15.46:0/1137747633 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa858003820 con 0x558b9e0e07d0 2024-01-23T08:55:53.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.871+0000 7fa84e7fc640 1 -- 172.21.15.46:0/1137747633 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fa858029e20 con 0x558b9e0e07d0 2024-01-23T08:55:53.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.871+0000 7fa878a80000 1 -- 172.21.15.46:0/1137747633 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558b9dea24f0 con 0x558b9e0e07d0 2024-01-23T08:55:53.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.875+0000 7fa84e7fc640 1 -- 172.21.15.46:0/1137747633 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa858004500 con 0x558b9e0e07d0 2024-01-23T08:55:53.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.875+0000 7fa878a80000 10 client.4719 fetch_fsmap learned FSMap version 18 2024-01-23T08:55:53.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.875+0000 7fa878a80000 1 -- 172.21.15.46:0/1137747633 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x558b9dbe7cc0 con 0x558b9e0e07d0 2024-01-23T08:55:53.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.879+0000 7fa84e7fc640 1 -- 172.21.15.46:0/1137747633 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558b9dea24f0 con 0x558b9e0e07d0 2024-01-23T08:55:53.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.879+0000 7fa84e7fc640 1 -- 172.21.15.46:0/1137747633 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7fa85801b020 con 0x558b9e0e07d0 2024-01-23T08:55:53.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.879+0000 7fa878a80000 10 client.4719 fetch_fsmap finished waiting for FSMap version 18 2024-01-23T08:55:53.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.879+0000 7fa878a80000 10 client.4719 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-23T08:55:53.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.879+0000 7fa878a80000 20 client.4719 populate_metadata read hostname 'smithi046' 2024-01-23T08:55:53.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.879+0000 7fa878a80000 1 --2- 172.21.15.46:0/1137747633 >> [v2:172.21.15.46:6836/338965660,v1:172.21.15.46:6837/338965660] conn(0x558b9e0e8600 0x558b9e144340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:53.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.879+0000 7fa878a80000 4 client.4719 mds_command: new command op to 4239 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-23T08:55:53.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.879+0000 7fa878a80000 1 -- 172.21.15.46:0/1137747633 --> [v2:172.21.15.46:6836/338965660,v1:172.21.15.46:6837/338965660] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558b9deef310 con 0x558b9e0e8600 2024-01-23T08:55:53.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.879+0000 7fa86effd640 1 --2- 172.21.15.46:0/1137747633 >> [v2:172.21.15.46:6836/338965660,v1:172.21.15.46:6837/338965660] conn(0x558b9e0e8600 0x558b9e144340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:53.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.883+0000 7fa86effd640 1 --2- 172.21.15.46:0/1137747633 >> [v2:172.21.15.46:6836/338965660,v1:172.21.15.46:6837/338965660] conn(0x558b9e0e8600 0x558b9e144340 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=35ccb711cedbdbb0 server_cookie=ae836ad7b1abe8fd in_seq=0 out_seq=0 2024-01-23T08:55:53.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.883+0000 7fa84e7fc640 10 client.4719 ms_handle_connect on v2:172.21.15.46:6836/338965660 2024-01-23T08:55:53.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.903+0000 7fa84e7fc640 1 -- 172.21.15.46:0/1137747633 <== mds.1 v2:172.21.15.46:6836/338965660 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x558b9deef310 con 0x558b9e0e8600 2024-01-23T08:55:53.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.903+0000 7fa84e7fc640 10 client.4719 handle_command_reply: tid=0 2024-01-23T08:55:53.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.903+0000 7fa878a80000 1 client.4719 shutdown 2024-01-23T08:55:53.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.903+0000 7fa878a80000 1 -- 172.21.15.46:0/1137747633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558b9e0e07d0 msgr2=0x558b9e143190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:53.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.903+0000 7fa878a80000 1 --2- 172.21.15.46:0/1137747633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558b9e0e07d0 0x558b9e143190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa85801c000 tx=0x7fa858009190 comp rx=0 tx=0).stop 2024-01-23T08:55:53.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.903+0000 7fa878a80000 1 -- 172.21.15.46:0/1137747633 shutdown_connections 2024-01-23T08:55:53.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.903+0000 7fa878a80000 1 --2- 172.21.15.46:0/1137747633 >> [v2:172.21.15.46:6836/338965660,v1:172.21.15.46:6837/338965660] conn(0x558b9e0e8600 0x558b9e144340 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.907+0000 7fa878a80000 1 --2- 172.21.15.46:0/1137747633 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x558b9e0e10f0 0x558b9e1438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.907+0000 7fa84e7fc640 0 client.4719 ms_handle_reset on v2:172.21.15.46:6836/338965660 2024-01-23T08:55:53.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.907+0000 7fa878a80000 1 --2- 172.21.15.46:0/1137747633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558b9e0e07d0 0x558b9e143190 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.907+0000 7fa878a80000 1 --2- 172.21.15.46:0/1137747633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558b9e0a5730 0x558b9e142c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.907+0000 7fa878a80000 1 -- 172.21.15.46:0/1137747633 >> 172.21.15.46:0/1137747633 conn(0x558b9e0dc580 msgr2=0x558b9e0db3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:53.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.907+0000 7fa878a80000 1 -- 172.21.15.46:0/1137747633 shutdown_connections 2024-01-23T08:55:53.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.907+0000 7fa878a80000 1 -- 172.21.15.46:0/1137747633 wait complete. 2024-01-23T08:55:53.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.907+0000 7fa878a80000 20 client.4719 trim_cache size 0 max 16384 2024-01-23T08:55:53.906 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-23T08:55:53.906 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "fdbdd393-f422-45ae-a488-2bbb0163e580", 2024-01-23T08:55:53.906 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 1, 2024-01-23T08:55:53.906 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4239, 2024-01-23T08:55:53.906 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-01-23T08:55:53.907 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-01-23T08:55:53.907 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-01-23T08:55:53.907 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 31.699739134000001, 2024-01-23T08:55:53.907 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 18, 2024-01-23T08:55:53.907 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 30, 2024-01-23T08:55:53.907 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 28, 2024-01-23T08:55:53.907 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 104.34418259 2024-01-23T08:55:53.907 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-23T08:55:53.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.907+0000 7fa875923640 1 -- 172.21.15.46:0/3612924341 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa850066550 msgr2=0x7fa850068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:53.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.907+0000 7fa875923640 1 --2- 172.21.15.46:0/3612924341 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa850066550 0x7fa850068a10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa8680af000 tx=0x7fa86801b4e0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.907+0000 7fa875923640 1 -- 172.21.15.46:0/3612924341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa87013b850 msgr2=0x7fa870158f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:53.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.907+0000 7fa875923640 1 --2- 172.21.15.46:0/3612924341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa87013b850 0x7fa870158f60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa86000c6b0 tx=0x7fa86000cb70 comp rx=0 tx=0).stop 2024-01-23T08:55:53.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.907+0000 7fa875923640 1 -- 172.21.15.46:0/3612924341 shutdown_connections 2024-01-23T08:55:53.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.907+0000 7fa875923640 1 --2- 172.21.15.46:0/3612924341 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa87013bc30 0x7fa870144cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.907+0000 7fa875923640 1 --2- 172.21.15.46:0/3612924341 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa850066550 0x7fa850068a10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.907+0000 7fa875923640 1 --2- 172.21.15.46:0/3612924341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa87013d130 0x7fa8701466b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.907+0000 7fa875923640 1 --2- 172.21.15.46:0/3612924341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa87013b850 0x7fa870158f60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:53.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.907+0000 7fa875923640 1 -- 172.21.15.46:0/3612924341 >> 172.21.15.46:0/3612924341 conn(0x7fa87006aa60 msgr2=0x7fa8700c5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:53.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.907+0000 7fa875923640 1 -- 172.21.15.46:0/3612924341 shutdown_connections 2024-01-23T08:55:53.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:53.907+0000 7fa875923640 1 -- 172.21.15.46:0/3612924341 wait complete. 2024-01-23T08:55:53.928 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-01-23T08:55:54.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.055+0000 7f9a72dc4640 1 Processor -- start 2024-01-23T08:55:54.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.055+0000 7f9a72dc4640 1 -- start start 2024-01-23T08:55:54.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.055+0000 7f9a72dc4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a6c1503c0 0x7f9a6c0c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:54.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.055+0000 7f9a72dc4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9a6c0c7cd0 0x7f9a6c0c8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:54.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.055+0000 7f9a72dc4640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a6c156760 con 0x7f9a6c072760 2024-01-23T08:55:54.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.055+0000 7f9a72dc4640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a6c157300 con 0x7f9a6c0c7cd0 2024-01-23T08:55:54.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.055+0000 7f9a72dc4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c1507a0 con 0x7f9a6c1503c0 2024-01-23T08:55:54.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.059+0000 7f9a6bfff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9a6c072760 0x7f9a6c156bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44890/0 (socket says 172.21.15.46:44890) 2024-01-23T08:55:54.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.059+0000 7f9a6bfff640 1 -- 172.21.15.46:0/2522554678 learned_addr learned my addr 172.21.15.46:0/2522554678 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T08:55:54.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.059+0000 7f9a71361640 1 --2- 172.21.15.46:0/2522554678 >> v2:172.21.15.175:3300/0 conn(0x7f9a6c0c7cd0 0x7f9a6c0c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:54.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.059+0000 7f9a70b60640 1 --2- 172.21.15.46:0/2522554678 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a6c1503c0 0x7f9a6c0c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:54.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.059+0000 7f9a6b7fe640 1 -- 172.21.15.46:0/2522554678 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3021862844 0 0) 0x7f9a6c156760 con 0x7f9a6c072760 2024-01-23T08:55:54.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.059+0000 7f9a6b7fe640 1 -- 172.21.15.46:0/2522554678 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a54003530 con 0x7f9a6c072760 2024-01-23T08:55:54.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.067+0000 7f9a6b7fe640 1 -- 172.21.15.46:0/2522554678 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 19973566 0 0) 0x7f9a54003530 con 0x7f9a6c072760 2024-01-23T08:55:54.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.067+0000 7f9a6b7fe640 1 -- 172.21.15.46:0/2522554678 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a6c1503c0 msgr2=0x7f9a6c0c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:54.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.067+0000 7f9a6b7fe640 1 --2- 172.21.15.46:0/2522554678 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a6c1503c0 0x7f9a6c0c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.067+0000 7f9a6b7fe640 1 -- 172.21.15.46:0/2522554678 >> v2:172.21.15.175:3300/0 conn(0x7f9a6c0c7cd0 msgr2=0x7f9a6c0c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:54.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.067+0000 7f9a6b7fe640 1 --2- 172.21.15.46:0/2522554678 >> v2:172.21.15.175:3300/0 conn(0x7f9a6c0c7cd0 0x7f9a6c0c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.067+0000 7f9a6b7fe640 1 -- 172.21.15.46:0/2522554678 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6c071a10 con 0x7f9a6c072760 2024-01-23T08:55:54.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.067+0000 7f9a6b7fe640 1 -- 172.21.15.46:0/2522554678 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466917103 0 0) 0x7f9a60001680 con 0x7f9a6c072760 2024-01-23T08:55:54.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.067+0000 7f9a6b7fe640 1 -- 172.21.15.46:0/2522554678 >> v1:172.21.15.46:6789/0 conn(0x7f9a6c072760 legacy=0x7f9a6c156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:54.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.067+0000 7f9a6b7fe640 1 --2- 172.21.15.46:0/2522554678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a540039f0 0x7f9a54003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:54.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.067+0000 7f9a6b7fe640 1 --2- 172.21.15.46:0/2522554678 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a6c1503c0 0x7f9a540047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:54.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.067+0000 7f9a6b7fe640 1 --2- 172.21.15.46:0/2522554678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a54004d10 0x7f9a54005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:54.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.067+0000 7f9a6b7fe640 1 -- 172.21.15.46:0/2522554678 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c157300 con 0x7f9a54004d10 2024-01-23T08:55:54.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.067+0000 7f9a6b7fe640 1 -- 172.21.15.46:0/2522554678 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c1507a0 con 0x7f9a540039f0 2024-01-23T08:55:54.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.067+0000 7f9a6b7fe640 1 -- 172.21.15.46:0/2522554678 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5400dc60 con 0x7f9a6c1503c0 2024-01-23T08:55:54.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.067+0000 7f9a71361640 1 --2- 172.21.15.46:0/2522554678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a54004d10 0x7f9a54005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:54.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.071+0000 7f9a6bfff640 1 --2- 172.21.15.46:0/2522554678 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a6c1503c0 0x7f9a540047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:54.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.071+0000 7f9a71361640 1 -- 172.21.15.46:0/2522554678 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a6c1503c0 msgr2=0x7f9a540047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:54.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.071+0000 7f9a71361640 1 --2- 172.21.15.46:0/2522554678 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a6c1503c0 0x7f9a540047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.071+0000 7f9a71361640 1 -- 172.21.15.46:0/2522554678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a540039f0 msgr2=0x7f9a54003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:54.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.071+0000 7f9a71361640 1 --2- 172.21.15.46:0/2522554678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a540039f0 0x7f9a54003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.071+0000 7f9a71361640 1 -- 172.21.15.46:0/2522554678 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a54003530 con 0x7f9a54004d10 2024-01-23T08:55:54.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.075+0000 7f9a71361640 1 --2- 172.21.15.46:0/2522554678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a54004d10 0x7f9a54005190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9a64009ae0 tx=0x7f9a6401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4b58d986426eda server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:54.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.079+0000 7f9a6b7fe640 1 -- 172.21.15.46:0/2522554678 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a640a5680 con 0x7f9a54004d10 2024-01-23T08:55:54.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.079+0000 7f9a6b7fe640 1 -- 172.21.15.46:0/2522554678 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a640a57e0 con 0x7f9a54004d10 2024-01-23T08:55:54.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.079+0000 7f9a6b7fe640 1 -- 172.21.15.46:0/2522554678 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a640a5bd0 con 0x7f9a54004d10 2024-01-23T08:55:54.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.079+0000 7f9a72dc4640 1 -- 172.21.15.46:0/2522554678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a54004d10 msgr2=0x7f9a54005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:54.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.079+0000 7f9a72dc4640 1 --2- 172.21.15.46:0/2522554678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a54004d10 0x7f9a54005190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9a64009ae0 tx=0x7f9a6401ca30 comp rx=0 tx=0).stop 2024-01-23T08:55:54.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.079+0000 7f9a71361640 1 -- 172.21.15.46:0/2522554678 reap_dead start 2024-01-23T08:55:54.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.079+0000 7f9a72dc4640 1 -- 172.21.15.46:0/2522554678 shutdown_connections 2024-01-23T08:55:54.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.079+0000 7f9a72dc4640 1 -- 172.21.15.46:0/2522554678 >> 172.21.15.46:0/2522554678 conn(0x7f9a6c06aa60 msgr2=0x7f9a6c06ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:54.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.079+0000 7f9a72dc4640 1 -- 172.21.15.46:0/2522554678 shutdown_connections 2024-01-23T08:55:54.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.079+0000 7f9a72dc4640 1 -- 172.21.15.46:0/2522554678 wait complete. 2024-01-23T08:55:54.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.083+0000 7f9a72dc4640 1 Processor -- start 2024-01-23T08:55:54.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.083+0000 7f9a72dc4640 1 -- start start 2024-01-23T08:55:54.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.083+0000 7f9a72dc4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a6c0ca200 0x7f9a6c14bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:54.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.083+0000 7f9a72dc4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a6c1e1c80 0x7f9a6c14b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:54.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.083+0000 7f9a72dc4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a6c14b8a0 0x7f9a6c14e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:54.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.083+0000 7f9a72dc4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c14f760 con 0x7f9a6c14b8a0 2024-01-23T08:55:54.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.083+0000 7f9a72dc4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c1ebd70 con 0x7f9a6c1e1c80 2024-01-23T08:55:54.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.083+0000 7f9a72dc4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c14a1d0 con 0x7f9a6c0ca200 2024-01-23T08:55:54.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.083+0000 7f9a71361640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a6c14b8a0 0x7f9a6c14e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:54.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.083+0000 7f9a71361640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a6c14b8a0 0x7f9a6c14e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52748/0 (socket says 172.21.15.46:52748) 2024-01-23T08:55:54.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.083+0000 7f9a71361640 1 -- 172.21.15.46:0/4204692099 learned_addr learned my addr 172.21.15.46:0/4204692099 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:54.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.083+0000 7f9a6bfff640 1 --2- 172.21.15.46:0/4204692099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a6c1e1c80 0x7f9a6c14b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:54.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.083+0000 7f9a70b60640 1 --2- 172.21.15.46:0/4204692099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a6c0ca200 0x7f9a6c14bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:54.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.087+0000 7f9a71361640 1 -- 172.21.15.46:0/4204692099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a6c0ca200 msgr2=0x7f9a6c14bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:54.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.087+0000 7f9a71361640 1 --2- 172.21.15.46:0/4204692099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a6c0ca200 0x7f9a6c14bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.087+0000 7f9a71361640 1 -- 172.21.15.46:0/4204692099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a6c1e1c80 msgr2=0x7f9a6c14b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:54.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.087+0000 7f9a71361640 1 --2- 172.21.15.46:0/4204692099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a6c1e1c80 0x7f9a6c14b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.087+0000 7f9a71361640 1 -- 172.21.15.46:0/4204692099 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6c1eb7d0 con 0x7f9a6c14b8a0 2024-01-23T08:55:54.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.091+0000 7f9a71361640 1 --2- 172.21.15.46:0/4204692099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a6c14b8a0 0x7f9a6c14e110 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9a6401c860 tx=0x7f9a64019830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:54.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.095+0000 7f9a697fa640 1 -- 172.21.15.46:0/4204692099 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a640a5680 con 0x7f9a6c14b8a0 2024-01-23T08:55:54.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.095+0000 7f9a697fa640 1 -- 172.21.15.46:0/4204692099 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a64004220 con 0x7f9a6c14b8a0 2024-01-23T08:55:54.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.095+0000 7f9a697fa640 1 -- 172.21.15.46:0/4204692099 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a64003620 con 0x7f9a6c14b8a0 2024-01-23T08:55:54.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.095+0000 7f9a72dc4640 1 -- 172.21.15.46:0/4204692099 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a6c14d930 con 0x7f9a6c14b8a0 2024-01-23T08:55:54.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.095+0000 7f9a72dc4640 1 -- 172.21.15.46:0/4204692099 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a6c14ad60 con 0x7f9a6c14b8a0 2024-01-23T08:55:54.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.095+0000 7f9a75f21000 1 Processor -- start 2024-01-23T08:55:54.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.095+0000 7f9a75f21000 1 -- start start 2024-01-23T08:55:54.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.099+0000 7f9a75f21000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a7751a920 0x564a7751ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:54.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.099+0000 7f9a75f21000 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a7751f7d0 0x564a7751fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:54.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.099+0000 7f9a75f21000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a775200f0 0x564a775204d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:54.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.099+0000 7f9a75f21000 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a7733ad70 con 0x564a7751f7d0 2024-01-23T08:55:54.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.099+0000 7f9a75f21000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a77336ba0 con 0x564a7751a920 2024-01-23T08:55:54.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.099+0000 7f9a75f21000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a773340d0 con 0x564a775200f0 2024-01-23T08:55:54.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.103+0000 7f9a6bfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a7751a920 0x564a7751ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:54.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.103+0000 7f9a6bfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a775200f0 0x564a775204d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:54.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.103+0000 7f9a6bfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a7751a920 0x564a7751ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:53988/0 (socket says 172.21.15.46:53988) 2024-01-23T08:55:54.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.103+0000 7f9a6bfff640 1 -- 172.21.15.46:0/2847793561 learned_addr learned my addr 172.21.15.46:0/2847793561 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:54.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.111+0000 7f9a6bfff640 1 -- 172.21.15.46:0/2847793561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a775200f0 msgr2=0x564a775204d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:54.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.111+0000 7f9a6bfff640 1 --2- 172.21.15.46:0/2847793561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a775200f0 0x564a775204d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.111+0000 7f9a6bfff640 1 -- 172.21.15.46:0/2847793561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a7751f7d0 msgr2=0x564a7751fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:54.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.111+0000 7f9a6bfff640 1 --2- 172.21.15.46:0/2847793561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a7751f7d0 0x564a7751fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.111+0000 7f9a6bfff640 1 -- 172.21.15.46:0/2847793561 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a77026890 con 0x564a7751a920 2024-01-23T08:55:54.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.115+0000 7f9a6bfff640 1 --2- 172.21.15.46:0/2847793561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a7751a920 0x564a7751ad00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9a600177d0 tx=0x7f9a60001bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f9ccfcaa1a9b63b server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:54.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.115+0000 7f9a697fa640 1 -- 172.21.15.46:0/4204692099 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f9a64003780 con 0x7f9a6c14b8a0 2024-01-23T08:55:54.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.115+0000 7f9a697fa640 1 --2- 172.21.15.46:0/4204692099 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9a58066500 0x7f9a580689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:54.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.115+0000 7f9a70b60640 1 --2- 172.21.15.46:0/4204692099 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9a58066500 0x7f9a580689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:54.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.119+0000 7f9a70b60640 1 --2- 172.21.15.46:0/4204692099 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9a58066500 0x7f9a580689c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c009a40 tx=0x7f9a5c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:54.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.119+0000 7f9a697fa640 1 -- 172.21.15.46:0/4204692099 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f9a640eea60 con 0x7f9a6c14b8a0 2024-01-23T08:55:54.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.123+0000 7f9a52ffd640 1 -- 172.21.15.46:0/2847793561 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60017ea0 con 0x564a7751a920 2024-01-23T08:55:54.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.123+0000 7f9a52ffd640 1 -- 172.21.15.46:0/2847793561 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6000d050 con 0x564a7751a920 2024-01-23T08:55:54.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.123+0000 7f9a52ffd640 1 -- 172.21.15.46:0/2847793561 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60004ab0 con 0x564a7751a920 2024-01-23T08:55:54.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.123+0000 7f9a75f21000 1 -- 172.21.15.46:0/2847793561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a7751a920 msgr2=0x564a7751ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:54.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.123+0000 7f9a75f21000 1 --2- 172.21.15.46:0/2847793561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a7751a920 0x564a7751ad00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9a600177d0 tx=0x7f9a60001bc0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.127+0000 7f9a75f21000 1 -- 172.21.15.46:0/2847793561 shutdown_connections 2024-01-23T08:55:54.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.127+0000 7f9a75f21000 1 --2- 172.21.15.46:0/2847793561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a775200f0 0x564a775204d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.127+0000 7f9a75f21000 1 --2- 172.21.15.46:0/2847793561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a7751f7d0 0x564a7751fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.127+0000 7f9a75f21000 1 --2- 172.21.15.46:0/2847793561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a7751a920 0x564a7751ad00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.127+0000 7f9a75f21000 1 -- 172.21.15.46:0/2847793561 >> 172.21.15.46:0/2847793561 conn(0x564a7751b580 msgr2=0x564a7751d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:54.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.127+0000 7f9a75f21000 1 -- 172.21.15.46:0/2847793561 shutdown_connections 2024-01-23T08:55:54.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.127+0000 7f9a75f21000 1 -- 172.21.15.46:0/2847793561 wait complete. 2024-01-23T08:55:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.127+0000 7f9a75f21000 1 -- start start 2024-01-23T08:55:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.127+0000 7f9a75f21000 1 Processor -- start 2024-01-23T08:55:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.127+0000 7f9a75f21000 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a7751a920 0x564a774e3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.127+0000 7f9a75f21000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a7751f7d0 0x564a77529b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.127+0000 7f9a75f21000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a775200f0 0x564a7752a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.127+0000 7f9a75f21000 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a7732f9c0 con 0x564a7751a920 2024-01-23T08:55:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.127+0000 7f9a75f21000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a772e7040 con 0x564a775200f0 2024-01-23T08:55:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.127+0000 7f9a75f21000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a772ecee0 con 0x564a7751f7d0 2024-01-23T08:55:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.127+0000 7f9a75f21000 10 client.0 _ll_register_callbacks cb 0x564a772ea1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-23T08:55:54.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.127+0000 7f9a70b60640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a7751a920 0x564a774e3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:54.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.127+0000 7f9a70b60640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a7751a920 0x564a774e3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52766/0 (socket says 172.21.15.46:52766) 2024-01-23T08:55:54.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.127+0000 7f9a70b60640 1 -- 172.21.15.46:0/3474282820 learned_addr learned my addr 172.21.15.46:0/3474282820 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:54.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.127+0000 7f9a6bfff640 1 --2- 172.21.15.46:0/3474282820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a7751f7d0 0x564a77529b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:54.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.131+0000 7f9a71361640 1 --2- 172.21.15.46:0/3474282820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a775200f0 0x564a7752a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:54.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.131+0000 7f9a70b60640 1 -- 172.21.15.46:0/3474282820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a7751f7d0 msgr2=0x564a77529b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:54.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.131+0000 7f9a70b60640 1 --2- 172.21.15.46:0/3474282820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a7751f7d0 0x564a77529b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.131+0000 7f9a70b60640 1 -- 172.21.15.46:0/3474282820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a775200f0 msgr2=0x564a7752a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:54.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.131+0000 7f9a70b60640 1 --2- 172.21.15.46:0/3474282820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a775200f0 0x564a7752a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.131+0000 7f9a70b60640 1 -- 172.21.15.46:0/3474282820 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a6c071a10 con 0x564a7751a920 2024-01-23T08:55:54.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.135+0000 7f9a70b60640 1 --2- 172.21.15.46:0/3474282820 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a7751a920 0x564a774e3960 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c018ea0 tx=0x7f9a5c004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8732150fb5782ed server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:54.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.135+0000 7f9a4bfff640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-01-23T08:55:54.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.139+0000 7f9a4bfff640 1 -- 172.21.15.46:0/3474282820 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c010040 con 0x564a7751a920 2024-01-23T08:55:54.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.139+0000 7f9a4bfff640 1 -- 172.21.15.46:0/3474282820 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f9a5c0223f0 con 0x564a7751a920 2024-01-23T08:55:54.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.139+0000 7f9a75f21000 1 -- 172.21.15.46:0/3474282820 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a772b5e30 con 0x564a7751a920 2024-01-23T08:55:54.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.139+0000 7f9a4bfff640 1 -- 172.21.15.46:0/3474282820 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a5c016e80 con 0x564a7751a920 2024-01-23T08:55:54.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.139+0000 7f9a75f21000 10 client.4728 fetch_fsmap learned FSMap version 18 2024-01-23T08:55:54.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.139+0000 7f9a75f21000 1 -- 172.21.15.46:0/3474282820 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x564a772ef5e0 con 0x564a7751a920 2024-01-23T08:55:54.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.143+0000 7f9a4bfff640 1 -- 172.21.15.46:0/3474282820 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564a772b5e30 con 0x564a7751a920 2024-01-23T08:55:54.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.147+0000 7f9a4bfff640 1 -- 172.21.15.46:0/3474282820 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f9a5c029060 con 0x564a7751a920 2024-01-23T08:55:54.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.147+0000 7f9a75f21000 10 client.4728 fetch_fsmap finished waiting for FSMap version 18 2024-01-23T08:55:54.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.147+0000 7f9a75f21000 10 client.4728 resolve_mds: resolved name 'e' to daemon mds.e 2024-01-23T08:55:54.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.147+0000 7f9a75f21000 20 client.4728 populate_metadata read hostname 'smithi046' 2024-01-23T08:55:54.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.147+0000 7f9a75f21000 1 --2- 172.21.15.46:0/3474282820 >> [v2:172.21.15.46:6838/1889172114,v1:172.21.15.46:6839/1889172114] conn(0x564a77519de0 0x564a7751a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:54.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.147+0000 7f9a75f21000 4 client.4728 mds_command: new command op to 4242 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:55:54.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.147+0000 7f9a75f21000 1 -- 172.21.15.46:0/3474282820 --> [v2:172.21.15.46:6838/1889172114,v1:172.21.15.46:6839/1889172114] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a772ec870 con 0x564a77519de0 2024-01-23T08:55:54.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.147+0000 7f9a6bfff640 1 --2- 172.21.15.46:0/3474282820 >> [v2:172.21.15.46:6838/1889172114,v1:172.21.15.46:6839/1889172114] conn(0x564a77519de0 0x564a7751a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:54.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.151+0000 7f9a4bfff640 10 client.4728 ms_handle_connect on v2:172.21.15.46:6838/1889172114 2024-01-23T08:55:54.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.151+0000 7f9a6bfff640 1 --2- 172.21.15.46:0/3474282820 >> [v2:172.21.15.46:6838/1889172114,v1:172.21.15.46:6839/1889172114] conn(0x564a77519de0 0x564a7751a1c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=358f8786edd7fc43 server_cookie=e7b873f5deabe549 in_seq=0 out_seq=0 2024-01-23T08:55:54.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.171+0000 7f9a4bfff640 1 -- 172.21.15.46:0/3474282820 <== mds.0 v2:172.21.15.46:6838/1889172114 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564a772ec870 con 0x564a77519de0 2024-01-23T08:55:54.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.171+0000 7f9a4bfff640 10 client.4728 handle_command_reply: tid=0 2024-01-23T08:55:54.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.171+0000 7f9a75f21000 1 client.4728 shutdown 2024-01-23T08:55:54.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.171+0000 7f9a75f21000 1 -- 172.21.15.46:0/3474282820 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a7751a920 msgr2=0x564a774e3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:54.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.171+0000 7f9a75f21000 1 --2- 172.21.15.46:0/3474282820 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a7751a920 0x564a774e3960 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c018ea0 tx=0x7f9a5c004a50 comp rx=0 tx=0).stop 2024-01-23T08:55:54.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.171+0000 7f9a75f21000 1 -- 172.21.15.46:0/3474282820 shutdown_connections 2024-01-23T08:55:54.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.171+0000 7f9a75f21000 1 --2- 172.21.15.46:0/3474282820 >> [v2:172.21.15.46:6838/1889172114,v1:172.21.15.46:6839/1889172114] conn(0x564a77519de0 0x564a7751a1c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.171+0000 7f9a75f21000 1 --2- 172.21.15.46:0/3474282820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a775200f0 0x564a7752a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.171+0000 7f9a4bfff640 0 client.4728 ms_handle_reset on v2:172.21.15.46:6838/1889172114 2024-01-23T08:55:54.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.171+0000 7f9a75f21000 1 --2- 172.21.15.46:0/3474282820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a7751f7d0 0x564a77529b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.171+0000 7f9a75f21000 1 --2- 172.21.15.46:0/3474282820 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a7751a920 0x564a774e3960 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.171+0000 7f9a75f21000 1 -- 172.21.15.46:0/3474282820 >> 172.21.15.46:0/3474282820 conn(0x564a7751b580 msgr2=0x564a7751db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:54.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.171+0000 7f9a75f21000 1 -- 172.21.15.46:0/3474282820 shutdown_connections 2024-01-23T08:55:54.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.171+0000 7f9a75f21000 1 -- 172.21.15.46:0/3474282820 wait complete. 2024-01-23T08:55:54.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.171+0000 7f9a75f21000 20 client.4728 trim_cache size 0 max 16384 2024-01-23T08:55:54.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.211+0000 7f9a75f21000 1 Processor -- start 2024-01-23T08:55:54.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.211+0000 7f9a75f21000 1 -- start start 2024-01-23T08:55:54.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.211+0000 7f9a75f21000 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a77519de0 0x564a7753e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:54.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.211+0000 7f9a75f21000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a7751a920 0x564a774df480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:54.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.211+0000 7f9a75f21000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a7751f7d0 0x564a774df9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:54.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.211+0000 7f9a75f21000 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a76fe7940 con 0x564a77519de0 2024-01-23T08:55:54.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.211+0000 7f9a75f21000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a770271b0 con 0x564a7751a920 2024-01-23T08:55:54.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.211+0000 7f9a75f21000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a772b1ac0 con 0x564a7751f7d0 2024-01-23T08:55:54.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.211+0000 7f9a70b60640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a77519de0 0x564a7753e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:54.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.211+0000 7f9a70b60640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a77519de0 0x564a7753e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52770/0 (socket says 172.21.15.46:52770) 2024-01-23T08:55:54.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.211+0000 7f9a70b60640 1 -- 172.21.15.46:0/625154157 learned_addr learned my addr 172.21.15.46:0/625154157 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:54.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.211+0000 7f9a71361640 1 --2- 172.21.15.46:0/625154157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a7751f7d0 0x564a774df9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:54.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.211+0000 7f9a6bfff640 1 --2- 172.21.15.46:0/625154157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a7751a920 0x564a774df480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:54.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.215+0000 7f9a70b60640 1 -- 172.21.15.46:0/625154157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a7751f7d0 msgr2=0x564a774df9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:54.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.215+0000 7f9a70b60640 1 --2- 172.21.15.46:0/625154157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a7751f7d0 0x564a774df9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.215+0000 7f9a70b60640 1 -- 172.21.15.46:0/625154157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a7751a920 msgr2=0x564a774df480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:54.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.215+0000 7f9a70b60640 1 --2- 172.21.15.46:0/625154157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a7751a920 0x564a774df480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.215+0000 7f9a70b60640 1 -- 172.21.15.46:0/625154157 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a772d58e0 con 0x564a77519de0 2024-01-23T08:55:54.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.219+0000 7f9a70b60640 1 --2- 172.21.15.46:0/625154157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a77519de0 0x564a7753e5a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c018880 tx=0x7f9a5c022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d745c2936cbf2671 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:54.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.223+0000 7f9a527fc640 1 -- 172.21.15.46:0/625154157 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c010040 con 0x564a77519de0 2024-01-23T08:55:54.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.223+0000 7f9a527fc640 1 -- 172.21.15.46:0/625154157 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5c02a390 con 0x564a77519de0 2024-01-23T08:55:54.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.223+0000 7f9a527fc640 1 -- 172.21.15.46:0/625154157 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c016e80 con 0x564a77519de0 2024-01-23T08:55:54.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.223+0000 7f9a75f21000 1 -- 172.21.15.46:0/625154157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a77519de0 msgr2=0x564a7753e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:54.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.223+0000 7f9a75f21000 1 --2- 172.21.15.46:0/625154157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a77519de0 0x564a7753e5a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c018880 tx=0x7f9a5c022000 comp rx=0 tx=0).stop 2024-01-23T08:55:54.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.223+0000 7f9a75f21000 1 -- 172.21.15.46:0/625154157 shutdown_connections 2024-01-23T08:55:54.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.223+0000 7f9a75f21000 1 --2- 172.21.15.46:0/625154157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a7751f7d0 0x564a774df9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.223+0000 7f9a75f21000 1 --2- 172.21.15.46:0/625154157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a7751a920 0x564a774df480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.223+0000 7f9a75f21000 1 --2- 172.21.15.46:0/625154157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a77519de0 0x564a7753e5a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.223+0000 7f9a75f21000 1 -- 172.21.15.46:0/625154157 >> 172.21.15.46:0/625154157 conn(0x564a7751b580 msgr2=0x564a774e2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:54.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.223+0000 7f9a75f21000 1 -- 172.21.15.46:0/625154157 shutdown_connections 2024-01-23T08:55:54.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.223+0000 7f9a75f21000 1 -- 172.21.15.46:0/625154157 wait complete. 2024-01-23T08:55:54.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.227+0000 7f9a75f21000 1 -- start start 2024-01-23T08:55:54.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.227+0000 7f9a75f21000 1 Processor -- start 2024-01-23T08:55:54.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.227+0000 7f9a75f21000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a77519de0 0x564a7753c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:54.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.227+0000 7f9a75f21000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a7751a920 0x564a7753cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:54.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.227+0000 7f9a75f21000 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a7751f7d0 0x564a7753d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:54.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.227+0000 7f9a75f21000 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a773383f0 con 0x564a7751f7d0 2024-01-23T08:55:54.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.227+0000 7f9a75f21000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a77326a40 con 0x564a7751a920 2024-01-23T08:55:54.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.227+0000 7f9a75f21000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a773046b0 con 0x564a77519de0 2024-01-23T08:55:54.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.227+0000 7f9a75f21000 10 client.0 _ll_register_callbacks cb 0x564a7735ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-23T08:55:54.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.227+0000 7f9a71361640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a7751f7d0 0x564a7753d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:54.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.227+0000 7f9a71361640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a7751f7d0 0x564a7753d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52786/0 (socket says 172.21.15.46:52786) 2024-01-23T08:55:54.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.227+0000 7f9a71361640 1 -- 172.21.15.46:0/4149608718 learned_addr learned my addr 172.21.15.46:0/4149608718 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:54.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.227+0000 7f9a6bfff640 1 --2- 172.21.15.46:0/4149608718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a7751a920 0x564a7753cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:54.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.231+0000 7f9a70b60640 1 --2- 172.21.15.46:0/4149608718 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a77519de0 0x564a7753c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:54.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.231+0000 7f9a71361640 1 -- 172.21.15.46:0/4149608718 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a77519de0 msgr2=0x564a7753c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:54.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.231+0000 7f9a71361640 1 --2- 172.21.15.46:0/4149608718 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a77519de0 0x564a7753c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.231+0000 7f9a71361640 1 -- 172.21.15.46:0/4149608718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a7751a920 msgr2=0x564a7753cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:54.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.231+0000 7f9a71361640 1 --2- 172.21.15.46:0/4149608718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a7751a920 0x564a7753cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.231+0000 7f9a71361640 1 -- 172.21.15.46:0/4149608718 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a772ef5e0 con 0x564a7751f7d0 2024-01-23T08:55:54.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.235+0000 7f9a71361640 1 --2- 172.21.15.46:0/4149608718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a7751f7d0 0x564a7753d0f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9a6401cfa0 tx=0x7f9a640ee4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04b821459677d93 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:54.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.235+0000 7f9a4bfff640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-01-23T08:55:54.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.239+0000 7f9a4bfff640 1 -- 172.21.15.46:0/4149608718 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6411a070 con 0x564a7751f7d0 2024-01-23T08:55:54.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.239+0000 7f9a4bfff640 1 -- 172.21.15.46:0/4149608718 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f9a6411c120 con 0x564a7751f7d0 2024-01-23T08:55:54.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.239+0000 7f9a75f21000 1 -- 172.21.15.46:0/4149608718 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a774e1890 con 0x564a7751f7d0 2024-01-23T08:55:54.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.243+0000 7f9a4bfff640 1 -- 172.21.15.46:0/4149608718 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a640eecc0 con 0x564a7751f7d0 2024-01-23T08:55:54.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.243+0000 7f9a75f21000 10 client.4734 fetch_fsmap learned FSMap version 18 2024-01-23T08:55:54.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.243+0000 7f9a75f21000 1 -- 172.21.15.46:0/4149608718 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x564a77026cc0 con 0x564a7751f7d0 2024-01-23T08:55:54.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.251+0000 7f9a4bfff640 1 -- 172.21.15.46:0/4149608718 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564a774e1890 con 0x564a7751f7d0 2024-01-23T08:55:54.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.251+0000 7f9a4bfff640 1 -- 172.21.15.46:0/4149608718 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 18) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f9a6410dc70 con 0x564a7751f7d0 2024-01-23T08:55:54.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.251+0000 7f9a75f21000 10 client.4734 fetch_fsmap finished waiting for FSMap version 18 2024-01-23T08:55:54.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.251+0000 7f9a75f21000 10 client.4734 resolve_mds: resolved name 'e' to daemon mds.e 2024-01-23T08:55:54.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.251+0000 7f9a75f21000 20 client.4734 populate_metadata read hostname 'smithi046' 2024-01-23T08:55:54.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.251+0000 7f9a75f21000 1 --2- 172.21.15.46:0/4149608718 >> [v2:172.21.15.46:6838/1889172114,v1:172.21.15.46:6839/1889172114] conn(0x564a775200f0 0x564a7753d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:54.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.251+0000 7f9a75f21000 4 client.4734 mds_command: new command op to 4242 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-23T08:55:54.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.251+0000 7f9a75f21000 1 -- 172.21.15.46:0/4149608718 --> [v2:172.21.15.46:6838/1889172114,v1:172.21.15.46:6839/1889172114] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564a772e14f0 con 0x564a775200f0 2024-01-23T08:55:54.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.251+0000 7f9a70b60640 1 --2- 172.21.15.46:0/4149608718 >> [v2:172.21.15.46:6838/1889172114,v1:172.21.15.46:6839/1889172114] conn(0x564a775200f0 0x564a7753d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.255+0000 7f9a70b60640 1 --2- 172.21.15.46:0/4149608718 >> [v2:172.21.15.46:6838/1889172114,v1:172.21.15.46:6839/1889172114] conn(0x564a775200f0 0x564a7753d630 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68d23a69e0aca00 server_cookie=d0cacd58a1b70bbd in_seq=0 out_seq=0 2024-01-23T08:55:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.255+0000 7f9a4bfff640 10 client.4734 ms_handle_connect on v2:172.21.15.46:6838/1889172114 2024-01-23T08:55:54.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.259+0000 7f9a4bfff640 1 -- 172.21.15.46:0/4149608718 <== mds.0 v2:172.21.15.46:6838/1889172114 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x564a772e14f0 con 0x564a775200f0 2024-01-23T08:55:54.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.259+0000 7f9a4bfff640 10 client.4734 handle_command_reply: tid=0 2024-01-23T08:55:54.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.259+0000 7f9a75f21000 1 client.4734 shutdown 2024-01-23T08:55:54.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.259+0000 7f9a75f21000 1 -- 172.21.15.46:0/4149608718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a7751f7d0 msgr2=0x564a7753d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:54.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.259+0000 7f9a75f21000 1 --2- 172.21.15.46:0/4149608718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a7751f7d0 0x564a7753d0f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9a6401cfa0 tx=0x7f9a640ee4b0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.259+0000 7f9a75f21000 1 -- 172.21.15.46:0/4149608718 shutdown_connections 2024-01-23T08:55:54.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.259+0000 7f9a75f21000 1 --2- 172.21.15.46:0/4149608718 >> [v2:172.21.15.46:6838/1889172114,v1:172.21.15.46:6839/1889172114] conn(0x564a775200f0 0x564a7753d630 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.259+0000 7f9a75f21000 1 --2- 172.21.15.46:0/4149608718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564a7751f7d0 0x564a7753d0f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.259+0000 7f9a75f21000 1 --2- 172.21.15.46:0/4149608718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a7751a920 0x564a7753cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.259+0000 7f9a75f21000 1 --2- 172.21.15.46:0/4149608718 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564a77519de0 0x564a7753c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.259+0000 7f9a4bfff640 0 client.4734 ms_handle_reset on v2:172.21.15.46:6838/1889172114 2024-01-23T08:55:54.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.259+0000 7f9a75f21000 1 -- 172.21.15.46:0/4149608718 >> 172.21.15.46:0/4149608718 conn(0x564a7751b580 msgr2=0x564a774e2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:54.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.259+0000 7f9a75f21000 1 -- 172.21.15.46:0/4149608718 shutdown_connections 2024-01-23T08:55:54.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.263+0000 7f9a75f21000 1 -- 172.21.15.46:0/4149608718 wait complete. 2024-01-23T08:55:54.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.263+0000 7f9a75f21000 20 client.4734 trim_cache size 0 max 16384 2024-01-23T08:55:54.261 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-23T08:55:54.261 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "fdbdd393-f422-45ae-a488-2bbb0163e580", 2024-01-23T08:55:54.261 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2024-01-23T08:55:54.261 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4242, 2024-01-23T08:55:54.261 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-01-23T08:55:54.261 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-01-23T08:55:54.261 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-01-23T08:55:54.262 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 70.663134982000003, 2024-01-23T08:55:54.262 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 18, 2024-01-23T08:55:54.262 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 30, 2024-01-23T08:55:54.262 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 28, 2024-01-23T08:55:54.262 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 104.67947533100001 2024-01-23T08:55:54.262 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-23T08:55:54.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.263+0000 7f9a72dc4640 1 -- 172.21.15.46:0/4204692099 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9a58066500 msgr2=0x7f9a580689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:54.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.263+0000 7f9a72dc4640 1 --2- 172.21.15.46:0/4204692099 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9a58066500 0x7f9a580689c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c009a40 tx=0x7f9a5c00b040 comp rx=0 tx=0).stop 2024-01-23T08:55:54.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.263+0000 7f9a72dc4640 1 -- 172.21.15.46:0/4204692099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a6c14b8a0 msgr2=0x7f9a6c14e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:54.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.263+0000 7f9a72dc4640 1 --2- 172.21.15.46:0/4204692099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a6c14b8a0 0x7f9a6c14e110 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9a6401c860 tx=0x7f9a64019830 comp rx=0 tx=0).stop 2024-01-23T08:55:54.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.263+0000 7f9a72dc4640 1 -- 172.21.15.46:0/4204692099 shutdown_connections 2024-01-23T08:55:54.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.263+0000 7f9a72dc4640 1 --2- 172.21.15.46:0/4204692099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a6c14b8a0 0x7f9a6c14e110 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.263+0000 7f9a72dc4640 1 --2- 172.21.15.46:0/4204692099 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9a58066500 0x7f9a580689c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.263+0000 7f9a72dc4640 1 --2- 172.21.15.46:0/4204692099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a6c1e1c80 0x7f9a6c14b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.263+0000 7f9a72dc4640 1 --2- 172.21.15.46:0/4204692099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a6c0ca200 0x7f9a6c14bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.263+0000 7f9a72dc4640 1 -- 172.21.15.46:0/4204692099 >> 172.21.15.46:0/4204692099 conn(0x7f9a6c06aa60 msgr2=0x7f9a6c0c17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:54.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.263+0000 7f9a72dc4640 1 -- 172.21.15.46:0/4204692099 shutdown_connections 2024-01-23T08:55:54.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.263+0000 7f9a72dc4640 1 -- 172.21.15.46:0/4204692099 wait complete. 2024-01-23T08:55:54.280 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-01-23T08:55:54.291 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-01-23T08:55:54.291 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-01-23T08:55:54.291 INFO:tasks.ceph_fuse:client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-01-23T08:55:54.291 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-23T08:55:54.291 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-23T08:55:54.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:55:54.292 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-01-23T08:55:54.297 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-01-23T08:55:54.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:55:54.298 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-23T08:55:54.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:55:54.352 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-01-23T08:55:54.529 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-01-23T08:55:54.529 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-23T08:55:54.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.663+0000 7f4e767f2640 1 Processor -- start 2024-01-23T08:55:54.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.663+0000 7f4e767f2640 1 -- start start 2024-01-23T08:55:54.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.663+0000 7f4e767f2640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4e70151600 0x7f4e7015b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:54.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.663+0000 7f4e767f2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e701519e0 0x7f4e700c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:54.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.663+0000 7f4e767f2640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e70158390 con 0x7f4e7006f350 2024-01-23T08:55:54.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.663+0000 7f4e767f2640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e7015b0e0 con 0x7f4e70151600 2024-01-23T08:55:54.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.663+0000 7f4e767f2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e70157b70 con 0x7f4e701519e0 2024-01-23T08:55:54.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.663+0000 7f4e67fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e701519e0 0x7f4e700c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:54.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.667+0000 7f4e67fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e701519e0 0x7f4e700c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:32824/0 (socket says 172.21.15.46:32824) 2024-01-23T08:55:54.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.667+0000 7f4e67fff640 1 -- 172.21.15.46:0/1424074553 learned_addr learned my addr 172.21.15.46:0/1424074553 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:54.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.667+0000 7f4e6ffff640 1 --2- 172.21.15.46:0/1424074553 >> v2:172.21.15.46:3300/0 conn(0x7f4e70151600 0x7f4e7015b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:54.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.671+0000 7f4e6ffff640 1 -- 172.21.15.46:0/1424074553 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e701519e0 msgr2=0x7f4e700c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:55:54.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.671+0000 7f4e6ffff640 1 --2- 172.21.15.46:0/1424074553 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e701519e0 0x7f4e700c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.671+0000 7f4e6ffff640 1 -- 172.21.15.46:0/1424074553 >> v1:172.21.15.46:6789/0 conn(0x7f4e7006f350 legacy=0x7f4e70157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:54.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.671+0000 7f4e6ffff640 1 -- 172.21.15.46:0/1424074553 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e70157dd0 con 0x7f4e70151600 2024-01-23T08:55:54.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.675+0000 7f4e6ffff640 1 --2- 172.21.15.46:0/1424074553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e70151600 0x7f4e7015b570 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4e600097c0 tx=0x7f4e6001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934dce4d6511ad8b server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:54.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.683+0000 7f4e6f7fe640 1 -- 172.21.15.46:0/1424074553 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e600ab600 con 0x7f4e70151600 2024-01-23T08:55:54.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.683+0000 7f4e6f7fe640 1 -- 172.21.15.46:0/1424074553 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e600a7050 con 0x7f4e70151600 2024-01-23T08:55:54.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.683+0000 7f4e6f7fe640 1 -- 172.21.15.46:0/1424074553 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e600ab980 con 0x7f4e70151600 2024-01-23T08:55:54.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.683+0000 7f4e767f2640 1 -- 172.21.15.46:0/1424074553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e70151600 msgr2=0x7f4e7015b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:54.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.683+0000 7f4e767f2640 1 --2- 172.21.15.46:0/1424074553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e70151600 0x7f4e7015b570 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4e600097c0 tx=0x7f4e6001c480 comp rx=0 tx=0).stop 2024-01-23T08:55:54.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.683+0000 7f4e767f2640 1 -- 172.21.15.46:0/1424074553 shutdown_connections 2024-01-23T08:55:54.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.683+0000 7f4e767f2640 1 --2- 172.21.15.46:0/1424074553 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e701519e0 0x7f4e700c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.683+0000 7f4e767f2640 1 --2- 172.21.15.46:0/1424074553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e70151600 0x7f4e7015b570 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.683+0000 7f4e767f2640 1 -- 172.21.15.46:0/1424074553 >> 172.21.15.46:0/1424074553 conn(0x7f4e7006d590 msgr2=0x7f4e70066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:54.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.683+0000 7f4e767f2640 1 -- 172.21.15.46:0/1424074553 shutdown_connections 2024-01-23T08:55:54.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.683+0000 7f4e767f2640 1 -- 172.21.15.46:0/1424074553 wait complete. 2024-01-23T08:55:54.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.683+0000 7f4e767f2640 1 Processor -- start 2024-01-23T08:55:54.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.683+0000 7f4e767f2640 1 -- start start 2024-01-23T08:55:54.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.687+0000 7f4e767f2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e7006f350 0x7f4e700c4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:54.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.687+0000 7f4e767f2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e70151600 0x7f4e70144f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:54.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.687+0000 7f4e767f2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e70159f20 0x7f4e7015a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:54.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.687+0000 7f4e767f2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e700c4b80 con 0x7f4e70151600 2024-01-23T08:55:54.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.687+0000 7f4e767f2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e700c2970 con 0x7f4e7006f350 2024-01-23T08:55:54.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.687+0000 7f4e767f2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e70140ca0 con 0x7f4e70159f20 2024-01-23T08:55:54.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.687+0000 7f4e67fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e70151600 0x7f4e70144f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:54.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.687+0000 7f4e67fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e70151600 0x7f4e70144f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52798/0 (socket says 172.21.15.46:52798) 2024-01-23T08:55:54.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.687+0000 7f4e67fff640 1 -- 172.21.15.46:0/1966409963 learned_addr learned my addr 172.21.15.46:0/1966409963 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T08:55:54.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.687+0000 7f4e74d8f640 1 --2- 172.21.15.46:0/1966409963 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e70159f20 0x7f4e7015a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:54.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.687+0000 7f4e6ffff640 1 --2- 172.21.15.46:0/1966409963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e7006f350 0x7f4e700c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:54.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.691+0000 7f4e67fff640 1 -- 172.21.15.46:0/1966409963 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e70159f20 msgr2=0x7f4e7015a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:54.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.691+0000 7f4e67fff640 1 --2- 172.21.15.46:0/1966409963 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e70159f20 0x7f4e7015a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.691+0000 7f4e67fff640 1 -- 172.21.15.46:0/1966409963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e7006f350 msgr2=0x7f4e700c4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:54.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.691+0000 7f4e67fff640 1 --2- 172.21.15.46:0/1966409963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e7006f350 0x7f4e700c4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:54.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.691+0000 7f4e67fff640 1 -- 172.21.15.46:0/1966409963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e60009420 con 0x7f4e70151600 2024-01-23T08:55:54.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.695+0000 7f4e67fff640 1 --2- 172.21.15.46:0/1966409963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e70151600 0x7f4e70144f30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800e890 tx=0x7f4e5800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:54.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.699+0000 7f4e6d7fa640 1 -- 172.21.15.46:0/1966409963 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e58009620 con 0x7f4e70151600 2024-01-23T08:55:54.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.699+0000 7f4e6d7fa640 1 -- 172.21.15.46:0/1966409963 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5800c940 con 0x7f4e70151600 2024-01-23T08:55:54.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.699+0000 7f4e6d7fa640 1 -- 172.21.15.46:0/1966409963 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5800ccf0 con 0x7f4e70151600 2024-01-23T08:55:54.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.699+0000 7f4e767f2640 1 -- 172.21.15.46:0/1966409963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e70140f80 con 0x7f4e70151600 2024-01-23T08:55:54.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.699+0000 7f4e767f2640 1 -- 172.21.15.46:0/1966409963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e70145470 con 0x7f4e70151600 2024-01-23T08:55:54.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.699+0000 7f4e767f2640 1 -- 172.21.15.46:0/1966409963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e70071fa0 con 0x7f4e70151600 2024-01-23T08:55:54.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.719+0000 7f4e6d7fa640 1 -- 172.21.15.46:0/1966409963 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f4e58013470 con 0x7f4e70151600 2024-01-23T08:55:54.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.719+0000 7f4e6d7fa640 1 --2- 172.21.15.46:0/1966409963 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4e50066550 0x7f4e50068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:55:54.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.719+0000 7f4e6ffff640 1 --2- 172.21.15.46:0/1966409963 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4e50066550 0x7f4e50068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:55:54.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.719+0000 7f4e6ffff640 1 --2- 172.21.15.46:0/1966409963 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4e50066550 0x7f4e50068a10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4e600ad000 tx=0x7f4e600a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:55:54.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.999+0000 7f4e6d7fa640 1 -- 172.21.15.46:0/1966409963 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f4e58055750 con 0x7f4e70151600 2024-01-23T08:55:54.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:54.999+0000 7f4e6d7fa640 1 -- 172.21.15.46:0/1966409963 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f4e58051a90 con 0x7f4e70151600 2024-01-23T08:55:55.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:55.215+0000 7f4e767f2640 1 -- 172.21.15.46:0/1966409963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4e70141110 con 0x7f4e70151600 2024-01-23T08:55:55.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:55.227+0000 7f4e6d7fa640 1 -- 172.21.15.46:0/1966409963 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+88 (secure 0 0 0) 0x7f4e58021070 con 0x7f4e70151600 2024-01-23T08:55:55.225 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-23T08:55:55.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:55.227+0000 7f4e767f2640 1 -- 172.21.15.46:0/1966409963 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4e50066550 msgr2=0x7f4e50068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:55.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:55.227+0000 7f4e767f2640 1 --2- 172.21.15.46:0/1966409963 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4e50066550 0x7f4e50068a10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4e600ad000 tx=0x7f4e600a6000 comp rx=0 tx=0).stop 2024-01-23T08:55:55.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:55.227+0000 7f4e767f2640 1 -- 172.21.15.46:0/1966409963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e70151600 msgr2=0x7f4e70144f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:55:55.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:55.227+0000 7f4e767f2640 1 --2- 172.21.15.46:0/1966409963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e70151600 0x7f4e70144f30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800e890 tx=0x7f4e5800ed50 comp rx=0 tx=0).stop 2024-01-23T08:55:55.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:55.231+0000 7f4e767f2640 1 -- 172.21.15.46:0/1966409963 shutdown_connections 2024-01-23T08:55:55.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:55.231+0000 7f4e767f2640 1 --2- 172.21.15.46:0/1966409963 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e70159f20 0x7f4e7015a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:55.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:55.231+0000 7f4e767f2640 1 --2- 172.21.15.46:0/1966409963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e70151600 0x7f4e70144f30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:55.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:55.231+0000 7f4e767f2640 1 --2- 172.21.15.46:0/1966409963 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4e50066550 0x7f4e50068a10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:55.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:55.231+0000 7f4e767f2640 1 --2- 172.21.15.46:0/1966409963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e7006f350 0x7f4e700c4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:55:55.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:55.231+0000 7f4e767f2640 1 -- 172.21.15.46:0/1966409963 >> 172.21.15.46:0/1966409963 conn(0x7f4e7006d590 msgr2=0x7f4e70066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:55:55.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:55.231+0000 7f4e767f2640 1 -- 172.21.15.46:0/1966409963 shutdown_connections 2024-01-23T08:55:55.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:55:55.231+0000 7f4e767f2640 1 -- 172.21.15.46:0/1966409963 wait complete. 2024-01-23T08:55:55.245 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-23T08:55:55.245 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-23T08:55:55.245 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2024-01-23T08:55:55.245 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-23T08:55:55.245 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-23T08:55:55.245 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-23T08:55:55.245 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-23T08:55:55.246 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-23T08:55:55.246 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-23T08:55:55.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:55:55.246 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2024-01-23T08:55:55.252 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-23T08:55:55.252 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-23T08:55:55.252 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2024-01-23T08:55:55.252 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-01-23T08:55:55.252 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2024-01-23T08:55:55.252 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-01-23T08:55:55.253 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-23T08:55:55.253 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2024-01-23T08:55:55.253 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2024-01-23T08:55:55.253 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-23T08:55:55.253 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2024-01-23T08:55:55.253 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2024-01-23T08:55:55.253 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-23T08:55:55.253 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2024-01-23T08:55:55.253 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2024-01-23T08:55:55.253 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-23T08:55:55.253 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42014sec preferred_lft 42014sec 2024-01-23T08:55:55.253 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2024-01-23T08:55:55.253 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-01-23T08:55:55.253 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-23T08:55:55.253 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2024-01-23T08:55:55.254 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2024-01-23T08:55:55.254 INFO:teuthology.orchestra.run.smithi046.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-23T08:55:55.254 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 02:42:e6:9d:71:a8 brd ff:ff:ff:ff:ff:ff 2024-01-23T08:55:55.254 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-23T08:55:55.254 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-01-23T08:55:55.254 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-23T08:55:55.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:55:55.254 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-23T08:55:55.254 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-23T08:55:55.255 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add name ceph-brx type bridge 2024-01-23T08:55:55.255 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr flush dev ceph-brx 2024-01-23T08:55:55.255 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set ceph-brx up 2024-01-23T08:55:55.255 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-23T08:55:55.255 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-23T08:55:55.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:55:55.335 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-23T08:55:55.389 INFO:teuthology.orchestra.run.smithi046.stdout:1 2024-01-23T08:55:55.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:55:55.391 DEBUG:teuthology.orchestra.run.smithi046:> route 2024-01-23T08:55:55.441 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2024-01-23T08:55:55.441 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-23T08:55:55.441 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-23T08:55:55.441 INFO:teuthology.orchestra.run.smithi046.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-23T08:55:55.441 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-23T08:55:55.441 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-23T08:55:55.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:55:55.442 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-23T08:55:55.442 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-23T08:55:55.442 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-23T08:55:55.442 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-23T08:55:55.442 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-23T08:55:55.442 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-23T08:55:55.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:55:55.521 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-01-23T08:55:55.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:55:55.569 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list-id 2024-01-23T08:55:55.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:55:55.616 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-23T08:55:55.616 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-23T08:55:55.617 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-23T08:55:55.617 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-01-23T08:55:55.617 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-23T08:55:55.685 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-01-23T08:55:55.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:55:55.686 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-23T08:55:55.686 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-23T08:55:55.686 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-01-23T08:55:55.686 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-23T08:55:55.686 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-01-23T08:55:55.686 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-01-23T08:55:55.686 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-01-23T08:55:55.686 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-23T08:55:55.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:55:55.780 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-23T08:55:55.780 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-23T08:55:55.780 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2024-01-23T08:55:55.780 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set dev brx.0 master ceph-brx 2024-01-23T08:55:55.780 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-23T08:55:55.801 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-01-23T08:55:55.801 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-23T08:55:55.801 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-23T08:55:55.848 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-23T08:55:55.848 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-23T08:55:55.848 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-23T08:55:55.896 DEBUG:tasks.ceph_manager:running client.0 under valgrind with args ['sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/client.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-01-23T08:55:55.896 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-23T08:55:55.952 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-23T08:55:56.003 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-23T08:55:56.003 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-23T08:55:56.003 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-23T08:55:56.003 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-23T08:55:56.003 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-23T08:55:56.003 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-23T08:55:56.003 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-23T08:55:56.003 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-23T08:55:56.003 INFO:teuthology.orchestra.run.smithi046.stdout:/run/lock 2024-01-23T08:55:56.003 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-23T08:55:56.004 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-23T08:55:56.004 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-23T08:55:56.004 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-23T08:55:56.004 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-23T08:55:56.004 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-23T08:55:56.005 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-23T08:55:56.005 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-23T08:55:56.005 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/fs/nfsd 2024-01-23T08:55:56.005 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-23T08:55:56.005 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-23T08:55:56.005 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysusers.service 2024-01-23T08:55:56.006 INFO:teuthology.orchestra.run.smithi046.stdout:/run/rpc_pipefs 2024-01-23T08:55:56.006 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-23T08:55:56.006 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-23T08:55:56.006 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-23T08:55:56.006 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-23T08:55:56.006 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-23T08:55:56.006 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-23T08:55:56.007 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-23T08:55:56.007 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-23T08:55:56.007 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-23T08:55:56.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:55:56.009 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-23T08:55:56.056 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-23T08:55:56.056 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-01-23T08:55:56.101 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-23T08:55:56.114 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-23T08:55:56.168 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-23T08:55:56.169 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-23T08:55:56.169 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-23T08:55:56.169 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-23T08:55:56.169 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-23T08:55:56.169 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-23T08:55:56.169 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-23T08:55:56.169 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-23T08:55:56.169 INFO:teuthology.orchestra.run.smithi046.stdout:/run/lock 2024-01-23T08:55:56.169 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-23T08:55:56.169 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-23T08:55:56.169 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-23T08:55:56.169 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-23T08:55:56.170 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-23T08:55:56.170 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-23T08:55:56.170 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-23T08:55:56.170 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-23T08:55:56.170 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/fs/nfsd 2024-01-23T08:55:56.170 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-23T08:55:56.170 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-23T08:55:56.170 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysusers.service 2024-01-23T08:55:56.170 INFO:teuthology.orchestra.run.smithi046.stdout:/run/rpc_pipefs 2024-01-23T08:55:56.170 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-23T08:55:56.170 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-23T08:55:56.170 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-23T08:55:56.170 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-23T08:55:56.170 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-23T08:55:56.170 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-23T08:55:56.171 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-23T08:55:56.171 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-23T08:55:56.171 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-23T08:55:56.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:55:56.172 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-23T08:55:57.326 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-23T08:55:57.341 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-23T08:55:57.388 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-23T08:55:57.389 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-23T08:55:57.389 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-23T08:55:57.389 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-23T08:55:57.389 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-23T08:55:57.389 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-23T08:55:57.389 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-23T08:55:57.389 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-23T08:55:57.389 INFO:teuthology.orchestra.run.smithi046.stdout:/run/lock 2024-01-23T08:55:57.389 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-23T08:55:57.389 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-23T08:55:57.389 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-23T08:55:57.389 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-23T08:55:57.389 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-23T08:55:57.389 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-23T08:55:57.390 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-23T08:55:57.390 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-23T08:55:57.390 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/fs/nfsd 2024-01-23T08:55:57.390 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-23T08:55:57.390 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-23T08:55:57.390 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysusers.service 2024-01-23T08:55:57.390 INFO:teuthology.orchestra.run.smithi046.stdout:/run/rpc_pipefs 2024-01-23T08:55:57.390 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-23T08:55:57.390 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-23T08:55:57.390 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-23T08:55:57.390 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-23T08:55:57.390 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-23T08:55:57.390 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-23T08:55:57.390 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-23T08:55:57.391 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-23T08:55:57.391 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-23T08:55:57.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:55:57.391 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-23T08:55:58.538 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-23T08:55:58.552 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-23T08:55:58.600 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-23T08:55:58.600 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-23T08:55:58.600 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-23T08:55:58.600 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-23T08:55:58.600 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-23T08:55:58.600 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-23T08:55:58.600 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-23T08:55:58.600 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-23T08:55:58.600 INFO:teuthology.orchestra.run.smithi046.stdout:/run/lock 2024-01-23T08:55:58.600 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-23T08:55:58.600 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-23T08:55:58.601 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-23T08:55:58.601 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-23T08:55:58.601 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-23T08:55:58.601 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-23T08:55:58.601 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-23T08:55:58.601 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-23T08:55:58.601 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/fs/nfsd 2024-01-23T08:55:58.601 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-23T08:55:58.601 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-23T08:55:58.601 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysusers.service 2024-01-23T08:55:58.601 INFO:teuthology.orchestra.run.smithi046.stdout:/run/rpc_pipefs 2024-01-23T08:55:58.601 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-23T08:55:58.601 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-23T08:55:58.601 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-23T08:55:58.602 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-23T08:55:58.602 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-23T08:55:58.602 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-23T08:55:58.602 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-23T08:55:58.602 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-23T08:55:58.602 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-23T08:55:58.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:55:58.603 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-23T08:55:59.754 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-23T08:55:59.768 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-23T08:55:59.816 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-23T08:55:59.816 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-23T08:55:59.816 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-23T08:55:59.816 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-23T08:55:59.816 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-23T08:55:59.816 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-23T08:55:59.816 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-23T08:55:59.817 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-23T08:55:59.817 INFO:teuthology.orchestra.run.smithi046.stdout:/run/lock 2024-01-23T08:55:59.817 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-23T08:55:59.817 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-23T08:55:59.817 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-23T08:55:59.817 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-23T08:55:59.817 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-23T08:55:59.817 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-23T08:55:59.817 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-23T08:55:59.817 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-23T08:55:59.817 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/fs/nfsd 2024-01-23T08:55:59.817 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-23T08:55:59.817 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-23T08:55:59.817 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysusers.service 2024-01-23T08:55:59.817 INFO:teuthology.orchestra.run.smithi046.stdout:/run/rpc_pipefs 2024-01-23T08:55:59.818 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-23T08:55:59.818 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-23T08:55:59.818 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-23T08:55:59.818 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-23T08:55:59.818 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-23T08:55:59.818 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-23T08:55:59.818 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-23T08:55:59.818 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-23T08:55:59.818 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-23T08:55:59.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:55:59.819 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-23T08:56:00.971 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-23T08:56:00.986 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-23T08:56:01.033 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-23T08:56:01.033 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-23T08:56:01.033 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-23T08:56:01.033 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-23T08:56:01.034 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-23T08:56:01.034 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-23T08:56:01.034 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-23T08:56:01.034 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-23T08:56:01.034 INFO:teuthology.orchestra.run.smithi046.stdout:/run/lock 2024-01-23T08:56:01.034 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-23T08:56:01.034 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-23T08:56:01.034 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-23T08:56:01.034 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-23T08:56:01.034 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-23T08:56:01.034 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-23T08:56:01.034 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-23T08:56:01.034 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-23T08:56:01.034 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/fs/nfsd 2024-01-23T08:56:01.035 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-23T08:56:01.035 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-23T08:56:01.035 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysusers.service 2024-01-23T08:56:01.035 INFO:teuthology.orchestra.run.smithi046.stdout:/run/rpc_pipefs 2024-01-23T08:56:01.035 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-23T08:56:01.035 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-23T08:56:01.035 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-23T08:56:01.035 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-23T08:56:01.035 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-23T08:56:01.035 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-23T08:56:01.035 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-23T08:56:01.035 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-23T08:56:01.035 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-23T08:56:01.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:56:01.037 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-23T08:56:02.185 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-23T08:56:02.202 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-23T08:56:02.253 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-23T08:56:02.253 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-23T08:56:02.253 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-23T08:56:02.253 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-23T08:56:02.253 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-23T08:56:02.253 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-23T08:56:02.253 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-23T08:56:02.253 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-23T08:56:02.254 INFO:teuthology.orchestra.run.smithi046.stdout:/run/lock 2024-01-23T08:56:02.254 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-23T08:56:02.254 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-23T08:56:02.254 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-23T08:56:02.254 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-23T08:56:02.254 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-23T08:56:02.254 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-23T08:56:02.254 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-23T08:56:02.254 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-23T08:56:02.254 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/fs/nfsd 2024-01-23T08:56:02.254 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-23T08:56:02.254 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-23T08:56:02.254 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysusers.service 2024-01-23T08:56:02.254 INFO:teuthology.orchestra.run.smithi046.stdout:/run/rpc_pipefs 2024-01-23T08:56:02.255 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-23T08:56:02.255 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-23T08:56:02.255 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-23T08:56:02.255 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-23T08:56:02.255 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-23T08:56:02.255 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-23T08:56:02.255 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-23T08:56:02.255 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-23T08:56:02.256 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-23T08:56:02.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:56:02.257 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-23T08:56:03.149 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[35670]: starting ceph client 2024-01-23T08:56:03.242 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:2024-01-23T08:56:03.026+0000 68f3100 -1 init, newargv = 0x7e439f0 newargc=15 2024-01-23T08:56:03.405 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-23T08:56:03.421 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-23T08:56:03.469 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-23T08:56:03.469 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-23T08:56:03.469 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-23T08:56:03.469 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-23T08:56:03.470 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-23T08:56:03.470 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-23T08:56:03.470 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-23T08:56:03.470 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-23T08:56:03.470 INFO:teuthology.orchestra.run.smithi046.stdout:/run/lock 2024-01-23T08:56:03.470 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-23T08:56:03.470 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-23T08:56:03.470 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-23T08:56:03.470 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-23T08:56:03.470 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-23T08:56:03.470 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-23T08:56:03.470 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-23T08:56:03.470 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-23T08:56:03.470 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/fs/nfsd 2024-01-23T08:56:03.471 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-23T08:56:03.471 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-23T08:56:03.471 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysusers.service 2024-01-23T08:56:03.471 INFO:teuthology.orchestra.run.smithi046.stdout:/run/rpc_pipefs 2024-01-23T08:56:03.471 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-23T08:56:03.471 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-23T08:56:03.471 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-23T08:56:03.471 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-23T08:56:03.471 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-23T08:56:03.471 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-23T08:56:03.471 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-23T08:56:03.471 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-23T08:56:03.471 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-23T08:56:03.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:56:03.473 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-23T08:56:04.625 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-23T08:56:04.642 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-23T08:56:04.690 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-23T08:56:04.690 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-23T08:56:04.690 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-23T08:56:04.690 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-23T08:56:04.690 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-23T08:56:04.691 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-23T08:56:04.691 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-23T08:56:04.691 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-23T08:56:04.691 INFO:teuthology.orchestra.run.smithi046.stdout:/run/lock 2024-01-23T08:56:04.691 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-23T08:56:04.691 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-23T08:56:04.691 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-23T08:56:04.691 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-23T08:56:04.691 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-23T08:56:04.691 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-23T08:56:04.691 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-23T08:56:04.691 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-23T08:56:04.691 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/fs/nfsd 2024-01-23T08:56:04.691 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-23T08:56:04.691 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-23T08:56:04.692 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysusers.service 2024-01-23T08:56:04.692 INFO:teuthology.orchestra.run.smithi046.stdout:/run/rpc_pipefs 2024-01-23T08:56:04.692 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-23T08:56:04.692 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-23T08:56:04.692 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-23T08:56:04.692 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-23T08:56:04.692 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-23T08:56:04.692 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-23T08:56:04.692 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-23T08:56:04.692 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-23T08:56:04.692 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-23T08:56:04.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:56:04.693 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-23T08:56:05.097 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[35670]: starting fuse 2024-01-23T08:56:05.842 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-23T08:56:05.858 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-23T08:56:05.905 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-23T08:56:05.905 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-23T08:56:05.905 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-23T08:56:05.906 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-23T08:56:05.906 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-23T08:56:05.906 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-23T08:56:05.906 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-23T08:56:05.906 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-23T08:56:05.906 INFO:teuthology.orchestra.run.smithi046.stdout:/run/lock 2024-01-23T08:56:05.906 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-23T08:56:05.906 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-23T08:56:05.906 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-23T08:56:05.906 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-23T08:56:05.906 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-23T08:56:05.906 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-23T08:56:05.906 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-23T08:56:05.906 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-23T08:56:05.907 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/fs/nfsd 2024-01-23T08:56:05.907 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-23T08:56:05.907 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-23T08:56:05.907 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysusers.service 2024-01-23T08:56:05.907 INFO:teuthology.orchestra.run.smithi046.stdout:/run/rpc_pipefs 2024-01-23T08:56:05.907 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-23T08:56:05.907 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-23T08:56:05.907 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-23T08:56:05.907 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-23T08:56:05.907 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-23T08:56:05.907 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-23T08:56:05.907 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-23T08:56:05.907 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-23T08:56:05.907 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-23T08:56:05.908 INFO:teuthology.orchestra.run.smithi046.stdout:/home/ubuntu/cephtest/mnt.0 2024-01-23T08:56:05.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:56:05.909 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-23T08:56:05.956 INFO:teuthology.orchestra.run.smithi046.stdout:45 2024-01-23T08:56:05.956 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-01-23T08:56:05.956 DEBUG:teuthology.orchestra.run.smithi046:> sudo stdin-killer -- python3 -c ' 2024-01-23T08:56:05.957 DEBUG:teuthology.orchestra.run.smithi046:> import glob 2024-01-23T08:56:05.957 DEBUG:teuthology.orchestra.run.smithi046:> import re 2024-01-23T08:56:05.957 DEBUG:teuthology.orchestra.run.smithi046:> import os 2024-01-23T08:56:05.957 DEBUG:teuthology.orchestra.run.smithi046:> import subprocess 2024-01-23T08:56:05.957 DEBUG:teuthology.orchestra.run.smithi046:> 2024-01-23T08:56:05.957 DEBUG:teuthology.orchestra.run.smithi046:> def _find_admin_socket(client_name): 2024-01-23T08:56:05.957 DEBUG:teuthology.orchestra.run.smithi046:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-01-23T08:56:05.957 DEBUG:teuthology.orchestra.run.smithi046:> files = glob.glob(asok_path) 2024-01-23T08:56:05.957 DEBUG:teuthology.orchestra.run.smithi046:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-01-23T08:56:05.957 DEBUG:teuthology.orchestra.run.smithi046:> 2024-01-23T08:56:05.957 DEBUG:teuthology.orchestra.run.smithi046:> # Given a non-glob path, it better be there 2024-01-23T08:56:05.957 DEBUG:teuthology.orchestra.run.smithi046:> if "*" not in asok_path: 2024-01-23T08:56:05.957 DEBUG:teuthology.orchestra.run.smithi046:> assert(len(files) == 1) 2024-01-23T08:56:05.957 DEBUG:teuthology.orchestra.run.smithi046:> return files[0] 2024-01-23T08:56:05.957 DEBUG:teuthology.orchestra.run.smithi046:> 2024-01-23T08:56:05.958 DEBUG:teuthology.orchestra.run.smithi046:> for f in files: 2024-01-23T08:56:05.958 DEBUG:teuthology.orchestra.run.smithi046:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-23T08:56:05.958 DEBUG:teuthology.orchestra.run.smithi046:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-23T08:56:05.958 DEBUG:teuthology.orchestra.run.smithi046:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-23T08:56:05.958 DEBUG:teuthology.orchestra.run.smithi046:> contents = proc_f.read() 2024-01-23T08:56:05.958 DEBUG:teuthology.orchestra.run.smithi046:> if mountpoint in contents: 2024-01-23T08:56:05.958 DEBUG:teuthology.orchestra.run.smithi046:> return f 2024-01-23T08:56:05.958 DEBUG:teuthology.orchestra.run.smithi046:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-23T08:56:05.958 DEBUG:teuthology.orchestra.run.smithi046:> 2024-01-23T08:56:05.958 DEBUG:teuthology.orchestra.run.smithi046:> print(_find_admin_socket("client.0")) 2024-01-23T08:56:05.958 DEBUG:teuthology.orchestra.run.smithi046:> ' 2024-01-23T08:56:06.088 INFO:teuthology.orchestra.run.smithi046.stdout:/var/run/ceph/ceph-client.0.35670.asok 2024-01-23T08:56:06.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T08:56:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-01-23T08:56:06.101 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.35670.asok 2024-01-23T08:56:06.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:56:06.102 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.35670.asok status 2024-01-23T08:56:06.386 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-23T08:56:06.386 INFO:teuthology.orchestra.run.smithi046.stdout: "metadata": { 2024-01-23T08:56:06.386 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_sha1": "0edf41a622739843d6b978b179ff3227b476dd9d", 2024-01-23T08:56:06.386 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_version": "ceph version 19.0.0-766-g0edf41a6 (0edf41a622739843d6b978b179ff3227b476dd9d) squid (dev)", 2024-01-23T08:56:06.387 INFO:teuthology.orchestra.run.smithi046.stdout: "entity_id": "0", 2024-01-23T08:56:06.387 INFO:teuthology.orchestra.run.smithi046.stdout: "hostname": "smithi046", 2024-01-23T08:56:06.387 INFO:teuthology.orchestra.run.smithi046.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-01-23T08:56:06.387 INFO:teuthology.orchestra.run.smithi046.stdout: "pid": "35670", 2024-01-23T08:56:06.387 INFO:teuthology.orchestra.run.smithi046.stdout: "root": "/" 2024-01-23T08:56:06.387 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-01-23T08:56:06.387 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_count": 0, 2024-01-23T08:56:06.387 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_pinned_count": 0, 2024-01-23T08:56:06.387 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4749, 2024-01-23T08:56:06.387 INFO:teuthology.orchestra.run.smithi046.stdout: "inst": { 2024-01-23T08:56:06.387 INFO:teuthology.orchestra.run.smithi046.stdout: "name": { 2024-01-23T08:56:06.387 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "client", 2024-01-23T08:56:06.387 INFO:teuthology.orchestra.run.smithi046.stdout: "num": 4749 2024-01-23T08:56:06.387 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-01-23T08:56:06.388 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2024-01-23T08:56:06.388 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-01-23T08:56:06.388 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "192.168.0.1:0", 2024-01-23T08:56:06.388 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 705375163 2024-01-23T08:56:06.388 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-01-23T08:56:06.388 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-01-23T08:56:06.388 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2024-01-23T08:56:06.388 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-01-23T08:56:06.388 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "192.168.0.1:0", 2024-01-23T08:56:06.388 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 705375163 2024-01-23T08:56:06.388 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-01-23T08:56:06.388 INFO:teuthology.orchestra.run.smithi046.stdout: "inst_str": "client.4749 192.168.0.1:0/705375163", 2024-01-23T08:56:06.388 INFO:teuthology.orchestra.run.smithi046.stdout: "addr_str": "192.168.0.1:0/705375163", 2024-01-23T08:56:06.389 INFO:teuthology.orchestra.run.smithi046.stdout: "inode_count": 1, 2024-01-23T08:56:06.389 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_epoch": 18, 2024-01-23T08:56:06.389 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch": 30, 2024-01-23T08:56:06.389 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch_barrier": 0, 2024-01-23T08:56:06.389 INFO:teuthology.orchestra.run.smithi046.stdout: "blocklisted": false, 2024-01-23T08:56:06.389 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs" 2024-01-23T08:56:06.389 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-23T08:56:06.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:56:06.407 DEBUG:teuthology.orchestra.run.smithi046:> stat --file-system '--printf=%T 2024-01-23T08:56:06.407 DEBUG:teuthology.orchestra.run.smithi046:> ' -- /home/ubuntu/cephtest/mnt.0 2024-01-23T08:56:06.471 INFO:teuthology.orchestra.run.smithi046.stdout:fuseblk 2024-01-23T08:56:06.472 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-01-23T08:56:06.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T08:56:06.472 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-23T08:56:06.540 INFO:teuthology.run_tasks:Running task workunit... 2024-01-23T08:56:06.554 INFO:tasks.workunit:Pulling workunits from ref 9db6bac5568c8be6cfd98da20bd2b62582f0776f 2024-01-23T08:56:06.554 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-01-23T08:56:06.554 INFO:tasks.workunit:timeout=3h 2024-01-23T08:56:06.554 INFO:tasks.workunit:cleanup=True 2024-01-23T08:56:06.555 DEBUG:teuthology.orchestra.run.smithi046:> stat -- /home/ubuntu/cephtest/mnt.0 2024-01-23T08:56:06.562 INFO:teuthology.orchestra.run.smithi046.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-01-23T08:56:06.562 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-01-23T08:56:06.562 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-01-23T08:56:06.562 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-23T08:56:06.562 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-01-23T08:56:06.562 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-01-23 08:54:43.897113712 +0000 2024-01-23T08:56:06.562 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-01-23 08:55:01.498585497 +0000 2024-01-23T08:56:06.562 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: - 2024-01-23T08:56:06.563 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-01-23T08:56:06.563 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-01-23T08:56:07.768 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 9db6bac5568c8be6cfd98da20bd2b62582f0776f 2024-01-23T08:56:07.776 INFO:tasks.workunit.client.0.smithi046.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-01-23T08:56:18.493 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T08:56:18.496 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T08:56:48.557 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T08:56:48.560 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T08:56:52.639 INFO:tasks.workunit.client.0.smithi046.stderr:Note: switching to '9db6bac5568c8be6cfd98da20bd2b62582f0776f'. 2024-01-23T08:56:52.639 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-01-23T08:56:52.639 INFO:tasks.workunit.client.0.smithi046.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-01-23T08:56:52.640 INFO:tasks.workunit.client.0.smithi046.stderr:changes and commit them, and you can discard any commits you make in this 2024-01-23T08:56:52.640 INFO:tasks.workunit.client.0.smithi046.stderr:state without impacting any branches by switching back to a branch. 2024-01-23T08:56:52.640 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-01-23T08:56:52.640 INFO:tasks.workunit.client.0.smithi046.stderr:If you want to create a new branch to retain commits you create, you may 2024-01-23T08:56:52.640 INFO:tasks.workunit.client.0.smithi046.stderr:do so (now or later) by using -c with the switch command. Example: 2024-01-23T08:56:52.640 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-01-23T08:56:52.640 INFO:tasks.workunit.client.0.smithi046.stderr: git switch -c 2024-01-23T08:56:52.640 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-01-23T08:56:52.640 INFO:tasks.workunit.client.0.smithi046.stderr:Or undo this operation with: 2024-01-23T08:56:52.640 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-01-23T08:56:52.640 INFO:tasks.workunit.client.0.smithi046.stderr: git switch - 2024-01-23T08:56:52.640 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-01-23T08:56:52.641 INFO:tasks.workunit.client.0.smithi046.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-01-23T08:56:52.641 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-01-23T08:56:52.641 INFO:tasks.workunit.client.0.smithi046.stderr:HEAD is now at 9db6bac5568 Merge branch 'pr-55233' into wip-yuri8-testing-2024-01-18-0823 2024-01-23T08:56:52.646 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-01-23T08:56:52.652 INFO:tasks.workunit.client.0.smithi046.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-01-23T08:56:52.655 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-23T08:56:52.655 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-01-23T08:56:53.437 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-01-23T08:56:53.531 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-01-23T08:56:53.593 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-23T08:56:53.595 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-23T08:56:53.595 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-01-23T08:56:53.646 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-23T08:56:53.650 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T08:56:53.650 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-01-23T08:56:53.696 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-01-23T08:56:53.697 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-01-23T08:56:53.698 DEBUG:teuthology.orchestra.run.smithi046:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9db6bac5568c8be6cfd98da20bd2b62582f0776f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-01-23T08:56:54.281 INFO:tasks.workunit.client.0.smithi046.stderr:+ dbench 1 2024-01-23T08:56:54.293 INFO:tasks.workunit.client.0.smithi046.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-01-23T08:56:54.293 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-01-23T08:56:54.293 INFO:tasks.workunit.client.0.smithi046.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-01-23T08:56:54.297 INFO:tasks.workunit.client.0.smithi046.stdout:0 of 1 processes prepared for launch 0 sec 2024-01-23T08:56:54.397 INFO:tasks.workunit.client.0.smithi046.stdout:1 of 1 processes prepared for launch 0 sec 2024-01-23T08:56:54.398 INFO:tasks.workunit.client.0.smithi046.stdout:releasing clients 2024-01-23T08:56:55.397 INFO:tasks.workunit.client.0.smithi046.stdout: 0 8 0.00 MB/sec warmup 1 sec latency 9.451 ms 2024-01-23T08:56:56.398 INFO:tasks.workunit.client.0.smithi046.stdout: 0 10 0.00 MB/sec warmup 2 sec latency 748.395 ms 2024-01-23T08:56:57.398 INFO:tasks.workunit.client.0.smithi046.stdout: 1 31 0.35 MB/sec warmup 3 sec latency 396.693 ms 2024-01-23T08:56:58.398 INFO:tasks.workunit.client.0.smithi046.stdout: 1 71 0.79 MB/sec warmup 4 sec latency 533.664 ms 2024-01-23T08:56:59.398 INFO:tasks.workunit.client.0.smithi046.stdout: 1 91 0.84 MB/sec warmup 5 sec latency 528.466 ms 2024-01-23T08:57:00.398 INFO:tasks.workunit.client.0.smithi046.stdout: 1 121 0.92 MB/sec warmup 6 sec latency 456.420 ms 2024-01-23T08:57:01.398 INFO:tasks.workunit.client.0.smithi046.stdout: 1 129 0.82 MB/sec warmup 7 sec latency 482.003 ms 2024-01-23T08:57:02.398 INFO:tasks.workunit.client.0.smithi046.stdout: 1 147 0.79 MB/sec warmup 8 sec latency 514.431 ms 2024-01-23T08:57:03.398 INFO:tasks.workunit.client.0.smithi046.stdout: 1 157 0.73 MB/sec warmup 9 sec latency 467.986 ms 2024-01-23T08:57:04.398 INFO:tasks.workunit.client.0.smithi046.stdout: 1 173 0.71 MB/sec warmup 10 sec latency 620.041 ms 2024-01-23T08:57:05.398 INFO:tasks.workunit.client.0.smithi046.stdout: 1 181 0.67 MB/sec warmup 11 sec latency 514.179 ms 2024-01-23T08:57:06.398 INFO:tasks.workunit.client.0.smithi046.stdout: 1 197 0.65 MB/sec warmup 12 sec latency 549.646 ms 2024-01-23T08:57:07.399 INFO:tasks.workunit.client.0.smithi046.stdout: 1 207 0.62 MB/sec warmup 13 sec latency 532.533 ms 2024-01-23T08:57:08.399 INFO:tasks.workunit.client.0.smithi046.stdout: 1 223 0.62 MB/sec warmup 14 sec latency 474.437 ms 2024-01-23T08:57:09.399 INFO:tasks.workunit.client.0.smithi046.stdout: 1 239 0.61 MB/sec warmup 15 sec latency 518.509 ms 2024-01-23T08:57:10.399 INFO:tasks.workunit.client.0.smithi046.stdout: 1 253 0.60 MB/sec warmup 16 sec latency 513.074 ms 2024-01-23T08:57:11.399 INFO:tasks.workunit.client.0.smithi046.stdout: 1 263 0.58 MB/sec warmup 17 sec latency 555.555 ms 2024-01-23T08:57:12.399 INFO:tasks.workunit.client.0.smithi046.stdout: 1 279 0.58 MB/sec warmup 18 sec latency 558.634 ms 2024-01-23T08:57:13.399 INFO:tasks.workunit.client.0.smithi046.stdout: 1 289 0.56 MB/sec warmup 19 sec latency 549.097 ms 2024-01-23T08:57:14.399 INFO:tasks.workunit.client.0.smithi046.stdout: 1 305 0.56 MB/sec warmup 20 sec latency 572.553 ms 2024-01-23T08:57:15.399 INFO:tasks.workunit.client.0.smithi046.stdout: 1 315 0.55 MB/sec warmup 21 sec latency 497.151 ms 2024-01-23T08:57:16.399 INFO:tasks.workunit.client.0.smithi046.stdout: 1 331 0.55 MB/sec warmup 22 sec latency 521.890 ms 2024-01-23T08:57:17.399 INFO:tasks.workunit.client.0.smithi046.stdout: 1 341 0.53 MB/sec warmup 23 sec latency 739.992 ms 2024-01-23T08:57:18.400 INFO:tasks.workunit.client.0.smithi046.stdout: 1 357 0.53 MB/sec warmup 24 sec latency 516.117 ms 2024-01-23T08:57:18.687 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T08:57:18.690 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T08:57:19.400 INFO:tasks.workunit.client.0.smithi046.stdout: 1 373 0.53 MB/sec warmup 25 sec latency 549.445 ms 2024-01-23T08:57:20.400 INFO:tasks.workunit.client.0.smithi046.stdout: 1 389 0.53 MB/sec warmup 26 sec latency 479.207 ms 2024-01-23T08:57:21.400 INFO:tasks.workunit.client.0.smithi046.stdout: 1 397 0.52 MB/sec warmup 27 sec latency 497.614 ms 2024-01-23T08:57:22.401 INFO:tasks.workunit.client.0.smithi046.stdout: 1 413 0.52 MB/sec warmup 28 sec latency 621.099 ms 2024-01-23T08:57:23.400 INFO:tasks.workunit.client.0.smithi046.stdout: 1 429 0.52 MB/sec warmup 29 sec latency 498.690 ms 2024-01-23T08:57:24.400 INFO:tasks.workunit.client.0.smithi046.stdout: 1 445 0.52 MB/sec warmup 30 sec latency 596.521 ms 2024-01-23T08:57:25.400 INFO:tasks.workunit.client.0.smithi046.stdout: 1 453 0.51 MB/sec warmup 31 sec latency 625.136 ms 2024-01-23T08:57:26.400 INFO:tasks.workunit.client.0.smithi046.stdout: 1 465 0.51 MB/sec warmup 32 sec latency 661.140 ms 2024-01-23T08:57:27.400 INFO:tasks.workunit.client.0.smithi046.stdout: 1 477 0.51 MB/sec warmup 33 sec latency 849.633 ms 2024-01-23T08:57:28.400 INFO:tasks.workunit.client.0.smithi046.stdout: 1 485 0.50 MB/sec warmup 34 sec latency 643.091 ms 2024-01-23T08:57:29.400 INFO:tasks.workunit.client.0.smithi046.stdout: 1 501 0.50 MB/sec warmup 35 sec latency 631.582 ms 2024-01-23T08:57:30.401 INFO:tasks.workunit.client.0.smithi046.stdout: 1 511 0.49 MB/sec warmup 36 sec latency 510.391 ms 2024-01-23T08:57:31.401 INFO:tasks.workunit.client.0.smithi046.stdout: 1 522 0.49 MB/sec warmup 37 sec latency 602.312 ms 2024-01-23T08:57:32.401 INFO:tasks.workunit.client.0.smithi046.stdout: 1 542 0.50 MB/sec warmup 38 sec latency 597.294 ms 2024-01-23T08:57:33.401 INFO:tasks.workunit.client.0.smithi046.stdout: 1 603 0.54 MB/sec warmup 39 sec latency 520.002 ms 2024-01-23T08:57:34.401 INFO:tasks.workunit.client.0.smithi046.stdout: 1 606 0.52 MB/sec warmup 40 sec latency 895.705 ms 2024-01-23T08:57:35.401 INFO:tasks.workunit.client.0.smithi046.stdout: 1 609 0.51 MB/sec warmup 41 sec latency 689.347 ms 2024-01-23T08:57:36.401 INFO:tasks.workunit.client.0.smithi046.stdout: 1 614 0.50 MB/sec warmup 42 sec latency 1101.587 ms 2024-01-23T08:57:37.401 INFO:tasks.workunit.client.0.smithi046.stdout: 1 636 0.49 MB/sec warmup 43 sec latency 1427.642 ms 2024-01-23T08:57:38.401 INFO:tasks.workunit.client.0.smithi046.stdout: 1 644 0.48 MB/sec warmup 44 sec latency 714.987 ms 2024-01-23T08:57:39.401 INFO:tasks.workunit.client.0.smithi046.stdout: 1 645 0.47 MB/sec warmup 45 sec latency 1081.448 ms 2024-01-23T08:57:40.401 INFO:tasks.workunit.client.0.smithi046.stdout: 1 652 0.46 MB/sec warmup 46 sec latency 987.523 ms 2024-01-23T08:57:41.402 INFO:tasks.workunit.client.0.smithi046.stdout: 1 653 0.45 MB/sec warmup 47 sec latency 899.743 ms 2024-01-23T08:57:42.402 INFO:tasks.workunit.client.0.smithi046.stdout: 1 655 0.44 MB/sec warmup 48 sec latency 1001.603 ms 2024-01-23T08:57:43.402 INFO:tasks.workunit.client.0.smithi046.stdout: 1 680 0.43 MB/sec warmup 49 sec latency 306.027 ms 2024-01-23T08:57:44.402 INFO:tasks.workunit.client.0.smithi046.stdout: 1 682 0.42 MB/sec warmup 50 sec latency 927.562 ms 2024-01-23T08:57:45.402 INFO:tasks.workunit.client.0.smithi046.stdout: 1 682 0.42 MB/sec warmup 51 sec latency 1115.584 ms 2024-01-23T08:57:46.402 INFO:tasks.workunit.client.0.smithi046.stdout: 1 705 0.41 MB/sec warmup 52 sec latency 1182.602 ms 2024-01-23T08:57:47.402 INFO:tasks.workunit.client.0.smithi046.stdout: 1 710 0.40 MB/sec warmup 53 sec latency 722.221 ms 2024-01-23T08:57:48.402 INFO:tasks.workunit.client.0.smithi046.stdout: 1 721 0.39 MB/sec warmup 54 sec latency 912.562 ms 2024-01-23T08:57:48.791 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T08:57:48.794 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T08:57:49.402 INFO:tasks.workunit.client.0.smithi046.stdout: 1 743 0.39 MB/sec warmup 55 sec latency 167.580 ms 2024-01-23T08:57:50.402 INFO:tasks.workunit.client.0.smithi046.stdout: 1 744 0.38 MB/sec warmup 56 sec latency 847.720 ms 2024-01-23T08:57:51.402 INFO:tasks.workunit.client.0.smithi046.stdout: 1 746 0.37 MB/sec warmup 57 sec latency 939.270 ms 2024-01-23T08:57:52.402 INFO:tasks.workunit.client.0.smithi046.stdout: 1 769 0.37 MB/sec warmup 58 sec latency 961.511 ms 2024-01-23T08:57:53.403 INFO:tasks.workunit.client.0.smithi046.stdout: 1 778 0.36 MB/sec warmup 59 sec latency 471.214 ms 2024-01-23T08:57:54.403 INFO:tasks.workunit.client.0.smithi046.stdout: 1 789 0.36 MB/sec warmup 60 sec latency 611.613 ms 2024-01-23T08:57:55.403 INFO:tasks.workunit.client.0.smithi046.stdout: 1 811 0.35 MB/sec warmup 61 sec latency 155.194 ms 2024-01-23T08:57:56.403 INFO:tasks.workunit.client.0.smithi046.stdout: 1 812 0.35 MB/sec warmup 62 sec latency 825.791 ms 2024-01-23T08:57:57.404 INFO:tasks.workunit.client.0.smithi046.stdout: 1 813 0.34 MB/sec warmup 63 sec latency 1028.313 ms 2024-01-23T08:57:58.403 INFO:tasks.workunit.client.0.smithi046.stdout: 1 817 0.34 MB/sec warmup 64 sec latency 1353.307 ms 2024-01-23T08:57:59.403 INFO:tasks.workunit.client.0.smithi046.stdout: 1 818 0.33 MB/sec warmup 65 sec latency 931.787 ms 2024-01-23T08:58:00.403 INFO:tasks.workunit.client.0.smithi046.stdout: 1 823 0.33 MB/sec warmup 66 sec latency 995.306 ms 2024-01-23T08:58:01.403 INFO:tasks.workunit.client.0.smithi046.stdout: 1 853 0.32 MB/sec warmup 67 sec latency 940.665 ms 2024-01-23T08:58:02.403 INFO:tasks.workunit.client.0.smithi046.stdout: 1 854 0.32 MB/sec warmup 68 sec latency 961.661 ms 2024-01-23T08:58:03.403 INFO:tasks.workunit.client.0.smithi046.stdout: 1 861 0.31 MB/sec warmup 69 sec latency 1012.276 ms 2024-01-23T08:58:04.403 INFO:tasks.workunit.client.0.smithi046.stdout: 1 862 0.31 MB/sec warmup 70 sec latency 945.943 ms 2024-01-23T08:58:05.404 INFO:tasks.workunit.client.0.smithi046.stdout: 1 870 0.30 MB/sec warmup 71 sec latency 1045.586 ms 2024-01-23T08:58:06.404 INFO:tasks.workunit.client.0.smithi046.stdout: 1 880 0.30 MB/sec warmup 72 sec latency 586.754 ms 2024-01-23T08:58:07.404 INFO:tasks.workunit.client.0.smithi046.stdout: 1 892 0.30 MB/sec warmup 73 sec latency 1305.132 ms 2024-01-23T08:58:08.404 INFO:tasks.workunit.client.0.smithi046.stdout: 1 902 0.29 MB/sec warmup 74 sec latency 410.157 ms 2024-01-23T08:58:09.404 INFO:tasks.workunit.client.0.smithi046.stdout: 1 904 0.29 MB/sec warmup 75 sec latency 738.070 ms 2024-01-23T08:58:10.404 INFO:tasks.workunit.client.0.smithi046.stdout: 1 925 0.29 MB/sec warmup 76 sec latency 278.082 ms 2024-01-23T08:58:11.404 INFO:tasks.workunit.client.0.smithi046.stdout: 1 927 0.28 MB/sec warmup 77 sec latency 769.468 ms 2024-01-23T08:58:12.404 INFO:tasks.workunit.client.0.smithi046.stdout: 1 928 0.28 MB/sec warmup 78 sec latency 963.009 ms 2024-01-23T08:58:13.404 INFO:tasks.workunit.client.0.smithi046.stdout: 1 930 0.28 MB/sec warmup 79 sec latency 1141.765 ms 2024-01-23T08:58:14.404 INFO:tasks.workunit.client.0.smithi046.stdout: 1 931 0.27 MB/sec warmup 80 sec latency 578.720 ms 2024-01-23T08:58:15.404 INFO:tasks.workunit.client.0.smithi046.stdout: 1 935 0.27 MB/sec warmup 81 sec latency 1027.269 ms 2024-01-23T08:58:16.405 INFO:tasks.workunit.client.0.smithi046.stdout: 1 937 0.27 MB/sec warmup 82 sec latency 744.504 ms 2024-01-23T08:58:17.405 INFO:tasks.workunit.client.0.smithi046.stdout: 1 942 0.26 MB/sec warmup 83 sec latency 916.518 ms 2024-01-23T08:58:18.405 INFO:tasks.workunit.client.0.smithi046.stdout: 1 959 0.26 MB/sec warmup 84 sec latency 1213.852 ms 2024-01-23T08:58:18.839 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T08:58:18.842 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T08:58:19.405 INFO:tasks.workunit.client.0.smithi046.stdout: 1 969 0.26 MB/sec warmup 85 sec latency 575.260 ms 2024-01-23T08:58:20.405 INFO:tasks.workunit.client.0.smithi046.stdout: 1 983 0.25 MB/sec warmup 86 sec latency 649.520 ms 2024-01-23T08:58:21.405 INFO:tasks.workunit.client.0.smithi046.stdout: 1 994 0.25 MB/sec warmup 87 sec latency 427.367 ms 2024-01-23T08:58:22.405 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1000 0.25 MB/sec warmup 88 sec latency 1125.077 ms 2024-01-23T08:58:23.405 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1027 0.26 MB/sec warmup 89 sec latency 511.334 ms 2024-01-23T08:58:24.405 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1031 0.25 MB/sec warmup 90 sec latency 960.513 ms 2024-01-23T08:58:25.405 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1033 0.25 MB/sec warmup 91 sec latency 901.445 ms 2024-01-23T08:58:26.405 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1046 0.25 MB/sec warmup 92 sec latency 1008.997 ms 2024-01-23T08:58:27.405 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1046 0.25 MB/sec warmup 93 sec latency 1148.693 ms 2024-01-23T08:58:28.406 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1047 0.24 MB/sec warmup 94 sec latency 1254.072 ms 2024-01-23T08:58:29.406 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1048 0.24 MB/sec warmup 95 sec latency 1141.177 ms 2024-01-23T08:58:30.406 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1059 0.24 MB/sec warmup 96 sec latency 1031.926 ms 2024-01-23T08:58:31.406 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1063 0.24 MB/sec warmup 97 sec latency 347.650 ms 2024-01-23T08:58:32.406 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1084 0.23 MB/sec warmup 98 sec latency 329.519 ms 2024-01-23T08:58:33.406 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1088 0.23 MB/sec warmup 99 sec latency 716.902 ms 2024-01-23T08:58:34.406 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1099 0.23 MB/sec warmup 100 sec latency 1016.744 ms 2024-01-23T08:58:35.406 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1100 0.23 MB/sec warmup 101 sec latency 779.132 ms 2024-01-23T08:58:36.406 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1114 0.23 MB/sec warmup 102 sec latency 926.885 ms 2024-01-23T08:58:37.406 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1117 0.22 MB/sec warmup 103 sec latency 1240.344 ms 2024-01-23T08:58:38.406 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1132 0.22 MB/sec warmup 104 sec latency 326.808 ms 2024-01-23T08:58:39.407 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1147 0.22 MB/sec warmup 105 sec latency 402.025 ms 2024-01-23T08:58:40.407 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1157 0.22 MB/sec warmup 106 sec latency 593.648 ms 2024-01-23T08:58:41.407 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1159 0.22 MB/sec warmup 107 sec latency 898.951 ms 2024-01-23T08:58:42.407 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1168 0.21 MB/sec warmup 108 sec latency 389.782 ms 2024-01-23T08:58:43.407 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1169 0.21 MB/sec warmup 109 sec latency 1001.931 ms 2024-01-23T08:58:44.407 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1170 0.21 MB/sec warmup 110 sec latency 945.125 ms 2024-01-23T08:58:45.407 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1173 0.21 MB/sec warmup 111 sec latency 1003.766 ms 2024-01-23T08:58:46.407 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1178 0.21 MB/sec warmup 112 sec latency 401.914 ms 2024-01-23T08:58:47.407 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1181 0.20 MB/sec warmup 113 sec latency 363.110 ms 2024-01-23T08:58:48.408 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1204 0.20 MB/sec warmup 114 sec latency 406.841 ms 2024-01-23T08:58:48.961 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T08:58:48.964 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T08:58:49.407 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1207 0.20 MB/sec warmup 115 sec latency 906.727 ms 2024-01-23T08:58:50.408 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1220 0.20 MB/sec warmup 116 sec latency 315.811 ms 2024-01-23T08:58:51.408 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1233 0.20 MB/sec warmup 117 sec latency 343.227 ms 2024-01-23T08:58:52.408 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1245 0.20 MB/sec warmup 118 sec latency 640.274 ms 2024-01-23T08:58:53.408 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1248 0.19 MB/sec warmup 119 sec latency 873.773 ms 2024-01-23T08:58:55.408 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1278 0.03 MB/sec execute 1 sec latency 941.203 ms 2024-01-23T08:58:56.408 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1280 0.02 MB/sec execute 2 sec latency 899.187 ms 2024-01-23T08:58:57.408 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1280 0.01 MB/sec execute 3 sec latency 1390.665 ms 2024-01-23T08:58:58.408 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1281 0.01 MB/sec execute 4 sec latency 1655.610 ms 2024-01-23T08:58:59.409 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1284 0.01 MB/sec execute 5 sec latency 973.990 ms 2024-01-23T08:59:00.408 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1376 0.48 MB/sec execute 6 sec latency 1020.205 ms 2024-01-23T08:59:01.408 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1377 0.41 MB/sec execute 7 sec latency 1022.365 ms 2024-01-23T08:59:02.408 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1378 0.36 MB/sec execute 8 sec latency 1071.100 ms 2024-01-23T08:59:03.409 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1381 0.32 MB/sec execute 9 sec latency 761.562 ms 2024-01-23T08:59:04.409 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1385 0.29 MB/sec execute 10 sec latency 1003.870 ms 2024-01-23T08:59:05.409 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1393 0.26 MB/sec execute 11 sec latency 966.722 ms 2024-01-23T08:59:06.409 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1397 0.24 MB/sec execute 12 sec latency 326.311 ms 2024-01-23T08:59:07.409 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1397 0.22 MB/sec execute 13 sec latency 1288.098 ms 2024-01-23T08:59:08.409 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1417 0.21 MB/sec execute 14 sec latency 1288.682 ms 2024-01-23T08:59:09.409 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1418 0.19 MB/sec execute 15 sec latency 915.491 ms 2024-01-23T08:59:10.409 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1428 0.18 MB/sec execute 16 sec latency 462.004 ms 2024-01-23T08:59:11.409 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1446 0.17 MB/sec execute 17 sec latency 441.984 ms 2024-01-23T08:59:12.409 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1448 0.16 MB/sec execute 18 sec latency 537.897 ms 2024-01-23T08:59:13.409 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1462 0.15 MB/sec execute 19 sec latency 927.654 ms 2024-01-23T08:59:14.410 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1466 0.15 MB/sec execute 20 sec latency 338.943 ms 2024-01-23T08:59:15.410 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1476 0.14 MB/sec execute 21 sec latency 982.567 ms 2024-01-23T08:59:16.410 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1485 0.13 MB/sec execute 22 sec latency 620.741 ms 2024-01-23T08:59:17.410 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1487 0.13 MB/sec execute 23 sec latency 923.171 ms 2024-01-23T08:59:18.410 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1490 0.12 MB/sec execute 24 sec latency 425.915 ms 2024-01-23T08:59:19.048 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T08:59:19.051 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T08:59:19.410 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1499 0.12 MB/sec execute 25 sec latency 893.406 ms 2024-01-23T08:59:20.410 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1509 0.11 MB/sec execute 26 sec latency 480.614 ms 2024-01-23T08:59:21.410 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1523 0.11 MB/sec execute 27 sec latency 521.810 ms 2024-01-23T08:59:22.410 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1526 0.11 MB/sec execute 28 sec latency 441.224 ms 2024-01-23T08:59:23.410 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1530 0.10 MB/sec execute 29 sec latency 1001.808 ms 2024-01-23T08:59:24.410 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1541 0.10 MB/sec execute 30 sec latency 967.927 ms 2024-01-23T08:59:25.411 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1554 0.10 MB/sec execute 31 sec latency 474.088 ms 2024-01-23T08:59:26.411 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1556 0.09 MB/sec execute 32 sec latency 985.083 ms 2024-01-23T08:59:27.411 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1568 0.09 MB/sec execute 33 sec latency 258.462 ms 2024-01-23T08:59:28.411 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1580 0.09 MB/sec execute 34 sec latency 217.317 ms 2024-01-23T08:59:29.411 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1588 0.09 MB/sec execute 35 sec latency 183.201 ms 2024-01-23T08:59:30.411 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1589 0.08 MB/sec execute 36 sec latency 766.573 ms 2024-01-23T08:59:31.411 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1603 0.08 MB/sec execute 37 sec latency 1045.973 ms 2024-01-23T08:59:32.411 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1606 0.08 MB/sec execute 38 sec latency 847.669 ms 2024-01-23T08:59:33.411 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1610 0.08 MB/sec execute 39 sec latency 964.492 ms 2024-01-23T08:59:34.411 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1615 0.08 MB/sec execute 40 sec latency 952.509 ms 2024-01-23T08:59:35.411 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1617 0.07 MB/sec execute 41 sec latency 694.708 ms 2024-01-23T08:59:36.411 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1641 0.07 MB/sec execute 42 sec latency 983.657 ms 2024-01-23T08:59:37.412 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1641 0.07 MB/sec execute 43 sec latency 1049.119 ms 2024-01-23T08:59:38.412 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1644 0.07 MB/sec execute 44 sec latency 1411.190 ms 2024-01-23T08:59:39.412 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1653 0.07 MB/sec execute 45 sec latency 1000.561 ms 2024-01-23T08:59:40.412 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1662 0.07 MB/sec execute 46 sec latency 630.580 ms 2024-01-23T08:59:41.412 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1686 0.07 MB/sec execute 47 sec latency 434.738 ms 2024-01-23T08:59:42.412 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1689 0.06 MB/sec execute 48 sec latency 754.010 ms 2024-01-23T08:59:43.412 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1700 0.06 MB/sec execute 49 sec latency 474.568 ms 2024-01-23T08:59:44.412 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1701 0.06 MB/sec execute 50 sec latency 918.201 ms 2024-01-23T08:59:45.412 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1707 0.06 MB/sec execute 51 sec latency 963.601 ms 2024-01-23T08:59:46.412 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1731 0.06 MB/sec execute 52 sec latency 927.699 ms 2024-01-23T08:59:47.412 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1769 0.06 MB/sec execute 53 sec latency 249.648 ms 2024-01-23T08:59:48.412 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1772 0.06 MB/sec execute 54 sec latency 449.565 ms 2024-01-23T08:59:49.162 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T08:59:49.165 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T08:59:49.415 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1781 0.06 MB/sec execute 55 sec latency 963.318 ms 2024-01-23T08:59:50.413 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1803 0.06 MB/sec execute 56 sec latency 168.862 ms 2024-01-23T08:59:51.413 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1806 0.06 MB/sec execute 57 sec latency 424.494 ms 2024-01-23T08:59:52.413 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1820 0.06 MB/sec execute 58 sec latency 993.337 ms 2024-01-23T08:59:53.413 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1822 0.05 MB/sec execute 59 sec latency 601.512 ms 2024-01-23T08:59:54.413 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1826 0.05 MB/sec execute 60 sec latency 944.522 ms 2024-01-23T08:59:55.413 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1830 0.05 MB/sec execute 61 sec latency 968.315 ms 2024-01-23T08:59:56.413 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1840 0.05 MB/sec execute 62 sec latency 180.704 ms 2024-01-23T08:59:57.414 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1841 0.05 MB/sec execute 63 sec latency 697.239 ms 2024-01-23T08:59:58.413 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1855 0.05 MB/sec execute 64 sec latency 1281.870 ms 2024-01-23T08:59:59.413 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1858 0.05 MB/sec execute 65 sec latency 607.851 ms 2024-01-23T09:00:00.414 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1862 0.05 MB/sec execute 66 sec latency 968.555 ms 2024-01-23T09:00:01.414 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1866 0.05 MB/sec execute 67 sec latency 967.380 ms 2024-01-23T09:00:02.414 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1869 0.05 MB/sec execute 68 sec latency 467.137 ms 2024-01-23T09:00:03.414 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1884 0.05 MB/sec execute 69 sec latency 1075.786 ms 2024-01-23T09:00:04.414 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1898 0.05 MB/sec execute 70 sec latency 573.499 ms 2024-01-23T09:00:05.414 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1903 0.05 MB/sec execute 71 sec latency 966.019 ms 2024-01-23T09:00:06.414 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1909 0.05 MB/sec execute 72 sec latency 1003.851 ms 2024-01-23T09:00:07.414 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1912 0.05 MB/sec execute 73 sec latency 641.760 ms 2024-01-23T09:00:08.415 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1920 0.05 MB/sec execute 74 sec latency 1170.201 ms 2024-01-23T09:00:09.414 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1927 0.04 MB/sec execute 75 sec latency 962.740 ms 2024-01-23T09:00:10.415 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1965 0.04 MB/sec execute 76 sec latency 212.643 ms 2024-01-23T09:00:11.415 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1975 0.04 MB/sec execute 77 sec latency 597.148 ms 2024-01-23T09:00:12.415 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1975 0.04 MB/sec execute 78 sec latency 1002.930 ms 2024-01-23T09:00:13.415 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1995 0.04 MB/sec execute 79 sec latency 1115.910 ms 2024-01-23T09:00:14.415 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1997 0.04 MB/sec execute 80 sec latency 845.121 ms 2024-01-23T09:00:15.415 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2006 0.04 MB/sec execute 81 sec latency 928.689 ms 2024-01-23T09:00:16.415 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2018 0.04 MB/sec execute 82 sec latency 308.264 ms 2024-01-23T09:00:17.415 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2031 0.04 MB/sec execute 83 sec latency 197.661 ms 2024-01-23T09:00:18.415 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2034 0.04 MB/sec execute 84 sec latency 751.487 ms 2024-01-23T09:00:19.225 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:00:19.229 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:00:19.415 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2043 0.04 MB/sec execute 85 sec latency 961.545 ms 2024-01-23T09:00:20.415 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2051 0.04 MB/sec execute 86 sec latency 993.183 ms 2024-01-23T09:00:21.416 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2053 0.04 MB/sec execute 87 sec latency 922.817 ms 2024-01-23T09:00:22.415 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2056 0.04 MB/sec execute 88 sec latency 1048.323 ms 2024-01-23T09:00:23.416 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2061 0.04 MB/sec execute 89 sec latency 296.878 ms 2024-01-23T09:00:24.416 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2061 0.04 MB/sec execute 90 sec latency 1009.850 ms 2024-01-23T09:00:25.416 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2079 0.04 MB/sec execute 91 sec latency 1016.512 ms 2024-01-23T09:00:26.416 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2081 0.04 MB/sec execute 92 sec latency 970.933 ms 2024-01-23T09:00:27.416 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2088 0.04 MB/sec execute 93 sec latency 1280.266 ms 2024-01-23T09:00:28.416 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2093 0.04 MB/sec execute 94 sec latency 464.963 ms 2024-01-23T09:00:29.416 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2096 0.04 MB/sec execute 95 sec latency 965.471 ms 2024-01-23T09:00:30.416 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2104 0.04 MB/sec execute 96 sec latency 1042.700 ms 2024-01-23T09:00:31.416 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2138 0.04 MB/sec execute 97 sec latency 289.097 ms 2024-01-23T09:00:32.416 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2140 0.04 MB/sec execute 98 sec latency 720.681 ms 2024-01-23T09:00:33.416 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2146 0.04 MB/sec execute 99 sec latency 1109.203 ms 2024-01-23T09:00:34.417 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2160 0.04 MB/sec execute 100 sec latency 952.969 ms 2024-01-23T09:00:35.417 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2173 0.04 MB/sec execute 101 sec latency 681.610 ms 2024-01-23T09:00:36.417 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2175 0.04 MB/sec execute 102 sec latency 954.371 ms 2024-01-23T09:00:37.417 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2177 0.04 MB/sec execute 103 sec latency 1192.926 ms 2024-01-23T09:00:38.417 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2183 0.04 MB/sec execute 104 sec latency 312.195 ms 2024-01-23T09:00:39.417 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2183 0.03 MB/sec execute 105 sec latency 1024.759 ms 2024-01-23T09:00:40.417 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2200 0.03 MB/sec execute 106 sec latency 1037.227 ms 2024-01-23T09:00:41.417 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2218 0.03 MB/sec execute 107 sec latency 323.420 ms 2024-01-23T09:00:42.417 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2221 0.03 MB/sec execute 108 sec latency 941.230 ms 2024-01-23T09:00:43.417 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2251 0.03 MB/sec execute 109 sec latency 1241.145 ms 2024-01-23T09:00:44.418 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2273 0.04 MB/sec execute 110 sec latency 242.857 ms 2024-01-23T09:00:45.418 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2292 0.04 MB/sec execute 111 sec latency 805.445 ms 2024-01-23T09:00:46.418 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2299 0.04 MB/sec execute 112 sec latency 1018.349 ms 2024-01-23T09:00:47.418 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2303 0.04 MB/sec execute 113 sec latency 555.100 ms 2024-01-23T09:00:48.418 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2306 0.04 MB/sec execute 114 sec latency 991.681 ms 2024-01-23T09:00:49.354 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:00:49.381 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:00:49.417 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2306 0.04 MB/sec execute 115 sec latency 1527.224 ms 2024-01-23T09:00:50.419 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2307 0.04 MB/sec execute 116 sec latency 1559.152 ms 2024-01-23T09:00:51.418 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2321 0.04 MB/sec execute 117 sec latency 1173.405 ms 2024-01-23T09:00:52.418 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2324 0.04 MB/sec execute 118 sec latency 1074.014 ms 2024-01-23T09:00:53.418 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2327 0.04 MB/sec execute 119 sec latency 1432.888 ms 2024-01-23T09:00:54.418 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2335 0.04 MB/sec execute 120 sec latency 377.718 ms 2024-01-23T09:00:55.419 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2337 0.04 MB/sec execute 121 sec latency 969.053 ms 2024-01-23T09:00:56.418 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2340 0.04 MB/sec execute 122 sec latency 829.698 ms 2024-01-23T09:00:57.418 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2354 0.04 MB/sec execute 123 sec latency 1056.184 ms 2024-01-23T09:00:58.418 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2361 0.04 MB/sec execute 124 sec latency 406.580 ms 2024-01-23T09:00:59.419 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2362 0.04 MB/sec execute 125 sec latency 1055.545 ms 2024-01-23T09:01:00.419 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2364 0.04 MB/sec execute 126 sec latency 1187.909 ms 2024-01-23T09:01:01.419 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2366 0.04 MB/sec execute 127 sec latency 1042.828 ms 2024-01-23T09:01:02.419 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2366 0.04 MB/sec execute 128 sec latency 1106.508 ms 2024-01-23T09:01:03.419 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2371 0.04 MB/sec execute 129 sec latency 1410.016 ms 2024-01-23T09:01:04.419 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2376 0.04 MB/sec execute 130 sec latency 897.564 ms 2024-01-23T09:01:05.419 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2388 0.04 MB/sec execute 131 sec latency 420.488 ms 2024-01-23T09:01:06.419 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2391 0.04 MB/sec execute 132 sec latency 701.717 ms 2024-01-23T09:01:07.419 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2396 0.04 MB/sec execute 133 sec latency 1026.013 ms 2024-01-23T09:01:08.419 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2401 0.04 MB/sec execute 134 sec latency 431.851 ms 2024-01-23T09:01:09.419 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2410 0.04 MB/sec execute 135 sec latency 329.473 ms 2024-01-23T09:01:10.420 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2416 0.04 MB/sec execute 136 sec latency 1020.811 ms 2024-01-23T09:01:11.420 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2428 0.04 MB/sec execute 137 sec latency 505.686 ms 2024-01-23T09:01:12.420 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2431 0.04 MB/sec execute 138 sec latency 782.346 ms 2024-01-23T09:01:13.420 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2432 0.04 MB/sec execute 139 sec latency 1316.263 ms 2024-01-23T09:01:14.420 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2435 0.04 MB/sec execute 140 sec latency 1060.579 ms 2024-01-23T09:01:15.420 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2440 0.04 MB/sec execute 141 sec latency 368.243 ms 2024-01-23T09:01:16.420 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2449 0.04 MB/sec execute 142 sec latency 468.933 ms 2024-01-23T09:01:17.420 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2454 0.03 MB/sec execute 143 sec latency 478.615 ms 2024-01-23T09:01:18.420 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2468 0.04 MB/sec execute 144 sec latency 401.091 ms 2024-01-23T09:01:19.420 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2474 0.04 MB/sec execute 145 sec latency 951.628 ms 2024-01-23T09:01:19.458 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:01:19.462 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:01:20.421 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2489 0.04 MB/sec execute 146 sec latency 383.188 ms 2024-01-23T09:01:21.421 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2492 0.04 MB/sec execute 147 sec latency 675.075 ms 2024-01-23T09:01:22.421 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2494 0.04 MB/sec execute 148 sec latency 1129.809 ms 2024-01-23T09:01:23.421 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2497 0.04 MB/sec execute 149 sec latency 1308.504 ms 2024-01-23T09:01:24.421 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2504 0.04 MB/sec execute 150 sec latency 270.515 ms 2024-01-23T09:01:25.421 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2506 0.04 MB/sec execute 151 sec latency 946.279 ms 2024-01-23T09:01:26.421 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2549 0.04 MB/sec execute 152 sec latency 989.805 ms 2024-01-23T09:01:27.421 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2552 0.04 MB/sec execute 153 sec latency 956.123 ms 2024-01-23T09:01:28.421 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2559 0.04 MB/sec execute 154 sec latency 407.546 ms 2024-01-23T09:01:29.421 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2560 0.04 MB/sec execute 155 sec latency 983.399 ms 2024-01-23T09:01:30.421 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2572 0.04 MB/sec execute 156 sec latency 990.567 ms 2024-01-23T09:01:31.421 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2580 0.04 MB/sec execute 157 sec latency 457.569 ms 2024-01-23T09:01:32.422 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2581 0.04 MB/sec execute 158 sec latency 1035.620 ms 2024-01-23T09:01:33.422 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2582 0.04 MB/sec execute 159 sec latency 1256.949 ms 2024-01-23T09:01:34.422 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2596 0.04 MB/sec execute 160 sec latency 326.923 ms 2024-01-23T09:01:35.422 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2600 0.04 MB/sec execute 161 sec latency 719.485 ms 2024-01-23T09:01:36.422 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2602 0.04 MB/sec execute 162 sec latency 1033.287 ms 2024-01-23T09:01:37.422 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2608 0.04 MB/sec execute 163 sec latency 333.345 ms 2024-01-23T09:01:38.422 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2615 0.04 MB/sec execute 164 sec latency 458.970 ms 2024-01-23T09:01:39.422 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2617 0.04 MB/sec execute 165 sec latency 967.846 ms 2024-01-23T09:01:40.422 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2618 0.04 MB/sec execute 166 sec latency 1004.167 ms 2024-01-23T09:01:41.422 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2621 0.04 MB/sec execute 167 sec latency 935.640 ms 2024-01-23T09:01:42.422 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2633 0.04 MB/sec execute 168 sec latency 958.123 ms 2024-01-23T09:01:43.424 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2718 0.05 MB/sec execute 169 sec latency 566.406 ms 2024-01-23T09:01:44.423 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2745 0.05 MB/sec execute 170 sec latency 973.454 ms 2024-01-23T09:01:45.423 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2748 0.05 MB/sec execute 171 sec latency 922.559 ms 2024-01-23T09:01:46.423 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2760 0.05 MB/sec execute 172 sec latency 311.938 ms 2024-01-23T09:01:47.423 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2760 0.05 MB/sec execute 173 sec latency 1043.399 ms 2024-01-23T09:01:48.423 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2768 0.05 MB/sec execute 174 sec latency 1151.236 ms 2024-01-23T09:01:49.423 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2779 0.05 MB/sec execute 175 sec latency 360.983 ms 2024-01-23T09:01:49.533 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:01:49.536 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:01:50.423 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2780 0.05 MB/sec execute 176 sec latency 770.824 ms 2024-01-23T09:01:51.423 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2872 0.05 MB/sec execute 177 sec latency 906.327 ms 2024-01-23T09:01:52.423 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2872 0.05 MB/sec execute 178 sec latency 1122.266 ms 2024-01-23T09:01:53.423 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2879 0.05 MB/sec execute 179 sec latency 1430.104 ms 2024-01-23T09:01:54.424 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2896 0.05 MB/sec execute 180 sec latency 421.688 ms 2024-01-23T09:01:55.424 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2902 0.05 MB/sec execute 181 sec latency 310.874 ms 2024-01-23T09:01:56.424 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2917 0.06 MB/sec execute 182 sec latency 402.387 ms 2024-01-23T09:01:57.424 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2931 0.06 MB/sec execute 183 sec latency 360.992 ms 2024-01-23T09:01:58.424 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2937 0.06 MB/sec execute 184 sec latency 510.242 ms 2024-01-23T09:01:59.424 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2938 0.06 MB/sec execute 185 sec latency 889.579 ms 2024-01-23T09:02:00.424 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2966 0.06 MB/sec execute 186 sec latency 1005.711 ms 2024-01-23T09:02:01.424 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2969 0.06 MB/sec execute 187 sec latency 1075.978 ms 2024-01-23T09:02:02.424 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2974 0.06 MB/sec execute 188 sec latency 637.626 ms 2024-01-23T09:02:03.424 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2976 0.06 MB/sec execute 189 sec latency 1358.158 ms 2024-01-23T09:02:04.424 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2984 0.05 MB/sec execute 190 sec latency 293.100 ms 2024-01-23T09:02:05.424 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2994 0.05 MB/sec execute 191 sec latency 345.578 ms 2024-01-23T09:02:06.424 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2995 0.05 MB/sec execute 192 sec latency 945.000 ms 2024-01-23T09:02:07.425 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3012 0.05 MB/sec execute 193 sec latency 304.538 ms 2024-01-23T09:02:08.425 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3017 0.05 MB/sec execute 194 sec latency 546.852 ms 2024-01-23T09:02:09.425 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3024 0.05 MB/sec execute 195 sec latency 330.122 ms 2024-01-23T09:02:10.425 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3031 0.05 MB/sec execute 196 sec latency 486.489 ms 2024-01-23T09:02:11.425 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3167 0.06 MB/sec execute 197 sec latency 964.133 ms 2024-01-23T09:02:12.425 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3170 0.06 MB/sec execute 198 sec latency 1014.802 ms 2024-01-23T09:02:13.425 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3176 0.06 MB/sec execute 199 sec latency 395.679 ms 2024-01-23T09:02:14.425 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3188 0.06 MB/sec execute 200 sec latency 507.366 ms 2024-01-23T09:02:15.425 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3190 0.06 MB/sec execute 201 sec latency 910.568 ms 2024-01-23T09:02:16.425 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3209 0.06 MB/sec execute 202 sec latency 356.566 ms 2024-01-23T09:02:17.425 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3224 0.06 MB/sec execute 203 sec latency 620.725 ms 2024-01-23T09:02:18.426 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3266 0.06 MB/sec execute 204 sec latency 209.092 ms 2024-01-23T09:02:19.426 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3268 0.06 MB/sec execute 205 sec latency 982.297 ms 2024-01-23T09:02:19.589 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:02:19.593 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:02:20.426 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3271 0.06 MB/sec execute 206 sec latency 1070.201 ms 2024-01-23T09:02:21.426 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3280 0.06 MB/sec execute 207 sec latency 300.669 ms 2024-01-23T09:02:22.426 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3281 0.06 MB/sec execute 208 sec latency 975.657 ms 2024-01-23T09:02:23.426 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3281 0.06 MB/sec execute 209 sec latency 1259.963 ms 2024-01-23T09:02:24.426 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3282 0.06 MB/sec execute 210 sec latency 1490.292 ms 2024-01-23T09:02:25.426 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3283 0.06 MB/sec execute 211 sec latency 974.635 ms 2024-01-23T09:02:26.426 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3285 0.06 MB/sec execute 212 sec latency 1051.073 ms 2024-01-23T09:02:27.426 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3286 0.06 MB/sec execute 213 sec latency 1129.925 ms 2024-01-23T09:02:28.426 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3287 0.06 MB/sec execute 214 sec latency 1096.907 ms 2024-01-23T09:02:29.426 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3290 0.06 MB/sec execute 215 sec latency 975.647 ms 2024-01-23T09:02:30.427 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3291 0.06 MB/sec execute 216 sec latency 959.626 ms 2024-01-23T09:02:31.427 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3292 0.06 MB/sec execute 217 sec latency 936.036 ms 2024-01-23T09:02:32.427 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3293 0.06 MB/sec execute 218 sec latency 965.422 ms 2024-01-23T09:02:33.427 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3294 0.06 MB/sec execute 219 sec latency 1176.641 ms 2024-01-23T09:02:34.427 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3295 0.06 MB/sec execute 220 sec latency 987.206 ms 2024-01-23T09:02:35.427 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3298 0.06 MB/sec execute 221 sec latency 967.753 ms 2024-01-23T09:02:36.427 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3299 0.06 MB/sec execute 222 sec latency 912.647 ms 2024-01-23T09:02:37.427 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3303 0.05 MB/sec execute 223 sec latency 952.304 ms 2024-01-23T09:02:38.427 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3306 0.05 MB/sec execute 224 sec latency 993.573 ms 2024-01-23T09:02:39.427 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3307 0.05 MB/sec execute 225 sec latency 944.273 ms 2024-01-23T09:02:40.428 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3308 0.05 MB/sec execute 226 sec latency 983.570 ms 2024-01-23T09:02:41.427 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3309 0.05 MB/sec execute 227 sec latency 914.519 ms 2024-01-23T09:02:42.428 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3310 0.05 MB/sec execute 228 sec latency 948.066 ms 2024-01-23T09:02:43.428 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3311 0.05 MB/sec execute 229 sec latency 1045.941 ms 2024-01-23T09:02:44.428 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3312 0.05 MB/sec execute 230 sec latency 977.967 ms 2024-01-23T09:02:45.428 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3313 0.05 MB/sec execute 231 sec latency 982.860 ms 2024-01-23T09:02:46.428 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3314 0.05 MB/sec execute 232 sec latency 952.536 ms 2024-01-23T09:02:47.428 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3316 0.05 MB/sec execute 233 sec latency 960.684 ms 2024-01-23T09:02:48.428 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3317 0.05 MB/sec execute 234 sec latency 967.355 ms 2024-01-23T09:02:49.428 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3318 0.05 MB/sec execute 235 sec latency 952.390 ms 2024-01-23T09:02:49.639 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:02:49.642 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:02:50.428 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3319 0.05 MB/sec execute 236 sec latency 892.281 ms 2024-01-23T09:02:51.428 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3320 0.05 MB/sec execute 237 sec latency 1016.821 ms 2024-01-23T09:02:52.428 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3322 0.05 MB/sec execute 238 sec latency 888.789 ms 2024-01-23T09:02:53.429 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3323 0.05 MB/sec execute 239 sec latency 956.430 ms 2024-01-23T09:02:54.429 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3324 0.05 MB/sec execute 240 sec latency 1001.926 ms 2024-01-23T09:02:54.640 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:09:31.990 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:02:54.807 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:09:32.157 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:02:54.813 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:09:32.101 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:02:54.823 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:09:32.110 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:02:54.914 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:09:32.202 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:02:54.932 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:09:32.220 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:02:55.388 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:09:32.738 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:02:55.428 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3325 0.05 MB/sec execute 241 sec latency 894.699 ms 2024-01-23T09:02:55.448 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:09:32.736 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:02:55.450 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:09:32.738 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:02:56.429 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3327 0.05 MB/sec execute 242 sec latency 833.882 ms 2024-01-23T09:02:57.429 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3330 0.05 MB/sec execute 243 sec latency 924.120 ms 2024-01-23T09:02:58.429 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3331 0.05 MB/sec execute 244 sec latency 985.101 ms 2024-01-23T09:02:59.429 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3332 0.05 MB/sec execute 245 sec latency 923.356 ms 2024-01-23T09:03:00.429 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3333 0.05 MB/sec execute 246 sec latency 971.886 ms 2024-01-23T09:03:01.429 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3334 0.05 MB/sec execute 247 sec latency 965.188 ms 2024-01-23T09:03:02.429 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3335 0.05 MB/sec execute 248 sec latency 973.267 ms 2024-01-23T09:03:03.429 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3336 0.05 MB/sec execute 249 sec latency 954.986 ms 2024-01-23T09:03:04.429 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3337 0.05 MB/sec execute 250 sec latency 948.934 ms 2024-01-23T09:03:05.429 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3341 0.05 MB/sec execute 251 sec latency 961.094 ms 2024-01-23T09:03:06.430 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3352 0.05 MB/sec execute 252 sec latency 282.283 ms 2024-01-23T09:03:07.429 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3361 0.05 MB/sec execute 253 sec latency 338.513 ms 2024-01-23T09:03:08.430 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3366 0.05 MB/sec execute 254 sec latency 463.490 ms 2024-01-23T09:03:09.430 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3376 0.05 MB/sec execute 255 sec latency 290.729 ms 2024-01-23T09:03:10.430 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3390 0.05 MB/sec execute 256 sec latency 411.126 ms 2024-01-23T09:03:11.430 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3391 0.05 MB/sec execute 257 sec latency 845.730 ms 2024-01-23T09:03:12.430 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3393 0.05 MB/sec execute 258 sec latency 1003.719 ms 2024-01-23T09:03:13.430 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3395 0.05 MB/sec execute 259 sec latency 1583.394 ms 2024-01-23T09:03:14.430 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3398 0.05 MB/sec execute 260 sec latency 991.495 ms 2024-01-23T09:03:15.430 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3410 0.05 MB/sec execute 261 sec latency 957.516 ms 2024-01-23T09:03:16.430 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3501 0.06 MB/sec execute 262 sec latency 285.679 ms 2024-01-23T09:03:17.430 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3515 0.06 MB/sec execute 263 sec latency 292.813 ms 2024-01-23T09:03:18.430 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3530 0.06 MB/sec execute 264 sec latency 293.074 ms 2024-01-23T09:03:19.431 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3531 0.06 MB/sec execute 265 sec latency 929.391 ms 2024-01-23T09:03:19.695 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:03:19.698 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:03:20.431 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3548 0.06 MB/sec execute 266 sec latency 949.361 ms 2024-01-23T09:03:21.431 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3551 0.06 MB/sec execute 267 sec latency 443.191 ms 2024-01-23T09:03:22.431 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3557 0.06 MB/sec execute 268 sec latency 788.998 ms 2024-01-23T09:03:23.431 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3558 0.06 MB/sec execute 269 sec latency 1490.618 ms 2024-01-23T09:03:24.431 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3566 0.06 MB/sec execute 270 sec latency 351.052 ms 2024-01-23T09:03:25.431 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3573 0.06 MB/sec execute 271 sec latency 607.663 ms 2024-01-23T09:03:26.431 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3584 0.06 MB/sec execute 272 sec latency 944.163 ms 2024-01-23T09:03:27.431 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3588 0.06 MB/sec execute 273 sec latency 661.899 ms 2024-01-23T09:03:28.431 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3617 0.06 MB/sec execute 274 sec latency 1175.776 ms 2024-01-23T09:03:29.431 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3628 0.06 MB/sec execute 275 sec latency 455.277 ms 2024-01-23T09:03:30.431 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3638 0.06 MB/sec execute 276 sec latency 427.044 ms 2024-01-23T09:03:31.431 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3642 0.06 MB/sec execute 277 sec latency 476.945 ms 2024-01-23T09:03:31.434 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:10:08.784 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:03:31.500 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:10:08.788 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:03:31.500 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:10:08.787 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:03:31.512 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:10:08.799 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:03:31.520 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:10:08.808 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:03:31.554 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:10:08.904 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:03:31.702 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:10:09.051 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:03:31.724 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:10:09.011 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:03:31.745 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:10:09.033 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:03:32.432 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3645 0.06 MB/sec execute 278 sec latency 998.373 ms 2024-01-23T09:03:33.432 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3663 0.06 MB/sec execute 279 sec latency 334.642 ms 2024-01-23T09:03:34.432 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3671 0.06 MB/sec execute 280 sec latency 343.712 ms 2024-01-23T09:03:35.432 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3672 0.06 MB/sec execute 281 sec latency 979.633 ms 2024-01-23T09:03:36.432 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3676 0.06 MB/sec execute 282 sec latency 1006.742 ms 2024-01-23T09:03:37.432 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3686 0.06 MB/sec execute 283 sec latency 330.045 ms 2024-01-23T09:03:38.432 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3689 0.06 MB/sec execute 284 sec latency 948.220 ms 2024-01-23T09:03:39.432 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3697 0.05 MB/sec execute 285 sec latency 399.718 ms 2024-01-23T09:03:40.432 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3707 0.05 MB/sec execute 286 sec latency 374.171 ms 2024-01-23T09:03:41.432 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3716 0.05 MB/sec execute 287 sec latency 445.342 ms 2024-01-23T09:03:42.432 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3738 0.06 MB/sec execute 288 sec latency 283.889 ms 2024-01-23T09:03:43.433 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3758 0.06 MB/sec execute 289 sec latency 757.083 ms 2024-01-23T09:03:44.433 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3768 0.06 MB/sec execute 290 sec latency 991.202 ms 2024-01-23T09:03:45.433 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3773 0.06 MB/sec execute 291 sec latency 517.893 ms 2024-01-23T09:03:46.433 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3780 0.06 MB/sec execute 292 sec latency 428.849 ms 2024-01-23T09:03:47.433 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3785 0.06 MB/sec execute 293 sec latency 457.857 ms 2024-01-23T09:03:48.433 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3789 0.06 MB/sec execute 294 sec latency 616.041 ms 2024-01-23T09:03:49.433 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3791 0.06 MB/sec execute 295 sec latency 571.603 ms 2024-01-23T09:03:49.757 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:03:49.760 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:03:50.433 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3795 0.06 MB/sec execute 296 sec latency 649.833 ms 2024-01-23T09:03:51.433 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3797 0.06 MB/sec execute 297 sec latency 498.082 ms 2024-01-23T09:03:52.433 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3805 0.06 MB/sec execute 298 sec latency 537.630 ms 2024-01-23T09:03:53.433 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3808 0.06 MB/sec execute 299 sec latency 474.148 ms 2024-01-23T09:03:54.434 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3813 0.06 MB/sec execute 300 sec latency 399.263 ms 2024-01-23T09:03:55.434 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3820 0.06 MB/sec execute 301 sec latency 294.650 ms 2024-01-23T09:03:56.434 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3824 0.06 MB/sec execute 302 sec latency 421.880 ms 2024-01-23T09:03:57.434 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3831 0.05 MB/sec execute 303 sec latency 413.220 ms 2024-01-23T09:03:58.434 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3836 0.05 MB/sec execute 304 sec latency 411.604 ms 2024-01-23T09:03:59.434 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3844 0.05 MB/sec execute 305 sec latency 473.067 ms 2024-01-23T09:04:00.434 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3848 0.05 MB/sec execute 306 sec latency 401.054 ms 2024-01-23T09:04:01.434 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3854 0.05 MB/sec execute 307 sec latency 395.480 ms 2024-01-23T09:04:02.434 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3860 0.05 MB/sec execute 308 sec latency 314.586 ms 2024-01-23T09:04:03.434 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3864 0.05 MB/sec execute 309 sec latency 396.157 ms 2024-01-23T09:04:04.434 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3870 0.05 MB/sec execute 310 sec latency 405.269 ms 2024-01-23T09:04:05.435 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3871 0.05 MB/sec execute 311 sec latency 952.391 ms 2024-01-23T09:04:06.435 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3876 0.05 MB/sec execute 312 sec latency 663.848 ms 2024-01-23T09:04:07.435 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3880 0.05 MB/sec execute 313 sec latency 1017.604 ms 2024-01-23T09:04:08.435 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3885 0.05 MB/sec execute 314 sec latency 376.733 ms 2024-01-23T09:04:09.435 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3896 0.05 MB/sec execute 315 sec latency 710.659 ms 2024-01-23T09:04:10.435 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3898 0.05 MB/sec execute 316 sec latency 1006.978 ms 2024-01-23T09:04:11.435 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3901 0.05 MB/sec execute 317 sec latency 989.770 ms 2024-01-23T09:04:12.435 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3914 0.05 MB/sec execute 318 sec latency 272.898 ms 2024-01-23T09:04:13.435 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3915 0.05 MB/sec execute 319 sec latency 1177.946 ms 2024-01-23T09:04:14.435 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3922 0.05 MB/sec execute 320 sec latency 368.817 ms 2024-01-23T09:04:15.435 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3927 0.05 MB/sec execute 321 sec latency 383.675 ms 2024-01-23T09:04:16.436 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3932 0.05 MB/sec execute 322 sec latency 453.560 ms 2024-01-23T09:04:17.436 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3937 0.05 MB/sec execute 323 sec latency 518.413 ms 2024-01-23T09:04:18.436 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3939 0.05 MB/sec execute 324 sec latency 619.214 ms 2024-01-23T09:04:19.436 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3944 0.05 MB/sec execute 325 sec latency 503.799 ms 2024-01-23T09:04:19.802 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:04:19.805 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:04:20.436 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3948 0.05 MB/sec execute 326 sec latency 612.305 ms 2024-01-23T09:04:21.436 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3953 0.05 MB/sec execute 327 sec latency 522.289 ms 2024-01-23T09:04:22.436 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3959 0.05 MB/sec execute 328 sec latency 331.017 ms 2024-01-23T09:04:23.436 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3963 0.05 MB/sec execute 329 sec latency 423.323 ms 2024-01-23T09:04:24.436 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3969 0.05 MB/sec execute 330 sec latency 428.769 ms 2024-01-23T09:04:25.436 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3975 0.05 MB/sec execute 331 sec latency 335.552 ms 2024-01-23T09:04:26.436 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3981 0.05 MB/sec execute 332 sec latency 427.689 ms 2024-01-23T09:04:27.436 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3986 0.05 MB/sec execute 333 sec latency 481.197 ms 2024-01-23T09:04:28.436 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3991 0.05 MB/sec execute 334 sec latency 318.488 ms 2024-01-23T09:04:29.436 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3998 0.05 MB/sec execute 335 sec latency 428.760 ms 2024-01-23T09:04:30.439 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4002 0.05 MB/sec execute 336 sec latency 378.460 ms 2024-01-23T09:04:31.436 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4009 0.05 MB/sec execute 337 sec latency 416.946 ms 2024-01-23T09:04:32.437 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4014 0.05 MB/sec execute 338 sec latency 344.012 ms 2024-01-23T09:04:33.437 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4018 0.05 MB/sec execute 339 sec latency 394.396 ms 2024-01-23T09:04:34.437 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4026 0.05 MB/sec execute 340 sec latency 426.340 ms 2024-01-23T09:04:35.437 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4027 0.05 MB/sec execute 341 sec latency 770.540 ms 2024-01-23T09:04:36.437 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4031 0.05 MB/sec execute 342 sec latency 1037.792 ms 2024-01-23T09:04:37.437 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4032 0.05 MB/sec execute 343 sec latency 920.982 ms 2024-01-23T09:04:38.437 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4035 0.05 MB/sec execute 344 sec latency 976.762 ms 2024-01-23T09:04:39.437 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4039 0.05 MB/sec execute 345 sec latency 1043.546 ms 2024-01-23T09:04:40.437 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4046 0.05 MB/sec execute 346 sec latency 165.861 ms 2024-01-23T09:04:41.437 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4047 0.05 MB/sec execute 347 sec latency 886.638 ms 2024-01-23T09:04:42.437 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4058 0.05 MB/sec execute 348 sec latency 968.357 ms 2024-01-23T09:04:43.438 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4060 0.05 MB/sec execute 349 sec latency 940.017 ms 2024-01-23T09:04:44.438 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4065 0.05 MB/sec execute 350 sec latency 635.944 ms 2024-01-23T09:04:45.438 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4071 0.05 MB/sec execute 351 sec latency 344.682 ms 2024-01-23T09:04:46.438 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4082 0.05 MB/sec execute 352 sec latency 970.571 ms 2024-01-23T09:04:47.438 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4085 0.05 MB/sec execute 353 sec latency 966.709 ms 2024-01-23T09:04:48.438 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4094 0.05 MB/sec execute 354 sec latency 367.356 ms 2024-01-23T09:04:49.438 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4105 0.05 MB/sec execute 355 sec latency 483.666 ms 2024-01-23T09:04:49.856 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:04:49.859 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:04:50.438 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4113 0.05 MB/sec execute 356 sec latency 503.373 ms 2024-01-23T09:04:51.438 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4120 0.05 MB/sec execute 357 sec latency 499.703 ms 2024-01-23T09:04:52.438 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4133 0.05 MB/sec execute 358 sec latency 280.667 ms 2024-01-23T09:04:53.438 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4141 0.05 MB/sec execute 359 sec latency 347.214 ms 2024-01-23T09:04:54.438 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4148 0.05 MB/sec execute 360 sec latency 732.064 ms 2024-01-23T09:04:55.439 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4155 0.05 MB/sec execute 361 sec latency 650.511 ms 2024-01-23T09:04:56.439 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4162 0.05 MB/sec execute 362 sec latency 239.641 ms 2024-01-23T09:04:57.439 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4171 0.05 MB/sec execute 363 sec latency 553.833 ms 2024-01-23T09:04:58.439 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4173 0.05 MB/sec execute 364 sec latency 585.547 ms 2024-01-23T09:04:59.439 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4176 0.05 MB/sec execute 365 sec latency 1017.273 ms 2024-01-23T09:05:00.439 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4179 0.05 MB/sec execute 366 sec latency 942.628 ms 2024-01-23T09:05:01.439 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4181 0.05 MB/sec execute 367 sec latency 730.591 ms 2024-01-23T09:05:02.439 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4186 0.05 MB/sec execute 368 sec latency 965.485 ms 2024-01-23T09:05:03.439 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4216 0.05 MB/sec execute 369 sec latency 959.906 ms 2024-01-23T09:05:04.440 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4217 0.05 MB/sec execute 370 sec latency 1027.628 ms 2024-01-23T09:05:05.440 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4221 0.05 MB/sec execute 371 sec latency 987.176 ms 2024-01-23T09:05:06.440 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4225 0.05 MB/sec execute 372 sec latency 773.410 ms 2024-01-23T09:05:07.440 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4227 0.05 MB/sec execute 373 sec latency 986.425 ms 2024-01-23T09:05:08.440 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4252 0.05 MB/sec execute 374 sec latency 343.356 ms 2024-01-23T09:05:09.440 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4254 0.05 MB/sec execute 375 sec latency 961.528 ms 2024-01-23T09:05:10.440 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4257 0.05 MB/sec execute 376 sec latency 936.527 ms 2024-01-23T09:05:11.440 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4277 0.05 MB/sec execute 377 sec latency 358.137 ms 2024-01-23T09:05:12.440 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4282 0.05 MB/sec execute 378 sec latency 671.434 ms 2024-01-23T09:05:13.440 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4299 0.05 MB/sec execute 379 sec latency 357.844 ms 2024-01-23T09:05:14.440 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4315 0.05 MB/sec execute 380 sec latency 219.197 ms 2024-01-23T09:05:15.441 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4317 0.05 MB/sec execute 381 sec latency 998.530 ms 2024-01-23T09:05:16.440 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4318 0.05 MB/sec execute 382 sec latency 953.940 ms 2024-01-23T09:05:17.441 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4344 0.05 MB/sec execute 383 sec latency 408.951 ms 2024-01-23T09:05:18.441 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4350 0.05 MB/sec execute 384 sec latency 630.727 ms 2024-01-23T09:05:19.441 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4365 0.05 MB/sec execute 385 sec latency 339.341 ms 2024-01-23T09:05:19.904 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:05:19.907 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:05:20.441 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4383 0.05 MB/sec execute 386 sec latency 167.526 ms 2024-01-23T09:05:21.441 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4384 0.05 MB/sec execute 387 sec latency 1027.667 ms 2024-01-23T09:05:22.441 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4386 0.05 MB/sec execute 388 sec latency 1045.812 ms 2024-01-23T09:05:23.441 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4388 0.04 MB/sec execute 389 sec latency 454.387 ms 2024-01-23T09:05:24.441 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4393 0.04 MB/sec execute 390 sec latency 1083.508 ms 2024-01-23T09:05:25.441 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4421 0.04 MB/sec execute 391 sec latency 968.641 ms 2024-01-23T09:05:26.441 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4423 0.04 MB/sec execute 392 sec latency 958.461 ms 2024-01-23T09:05:27.442 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4424 0.04 MB/sec execute 393 sec latency 986.324 ms 2024-01-23T09:05:28.442 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4432 0.04 MB/sec execute 394 sec latency 1002.083 ms 2024-01-23T09:05:29.442 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4433 0.04 MB/sec execute 395 sec latency 960.912 ms 2024-01-23T09:05:30.442 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4444 0.04 MB/sec execute 396 sec latency 421.019 ms 2024-01-23T09:05:31.442 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4450 0.04 MB/sec execute 397 sec latency 797.089 ms 2024-01-23T09:05:32.442 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4467 0.04 MB/sec execute 398 sec latency 960.376 ms 2024-01-23T09:05:33.442 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4472 0.04 MB/sec execute 399 sec latency 797.512 ms 2024-01-23T09:05:34.442 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4483 0.04 MB/sec execute 400 sec latency 813.616 ms 2024-01-23T09:05:35.442 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4497 0.04 MB/sec execute 401 sec latency 235.491 ms 2024-01-23T09:05:36.442 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4498 0.04 MB/sec execute 402 sec latency 1090.038 ms 2024-01-23T09:05:37.442 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4499 0.04 MB/sec execute 403 sec latency 975.995 ms 2024-01-23T09:05:38.442 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4500 0.04 MB/sec execute 404 sec latency 598.598 ms 2024-01-23T09:05:39.443 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4501 0.04 MB/sec execute 405 sec latency 872.270 ms 2024-01-23T09:05:40.443 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4506 0.04 MB/sec execute 406 sec latency 986.975 ms 2024-01-23T09:05:41.443 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4511 0.04 MB/sec execute 407 sec latency 930.332 ms 2024-01-23T09:05:42.443 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4521 0.04 MB/sec execute 408 sec latency 962.948 ms 2024-01-23T09:05:43.443 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4538 0.04 MB/sec execute 409 sec latency 296.173 ms 2024-01-23T09:05:44.443 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4539 0.04 MB/sec execute 410 sec latency 957.297 ms 2024-01-23T09:05:45.443 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4557 0.04 MB/sec execute 411 sec latency 384.268 ms 2024-01-23T09:05:46.443 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4563 0.04 MB/sec execute 412 sec latency 558.196 ms 2024-01-23T09:05:47.443 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4578 0.04 MB/sec execute 413 sec latency 953.185 ms 2024-01-23T09:05:48.443 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4596 0.05 MB/sec execute 414 sec latency 831.909 ms 2024-01-23T09:05:49.444 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4602 0.05 MB/sec execute 415 sec latency 953.014 ms 2024-01-23T09:05:49.953 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:05:49.957 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:05:50.444 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4606 0.05 MB/sec execute 416 sec latency 926.089 ms 2024-01-23T09:05:51.444 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4614 0.05 MB/sec execute 417 sec latency 612.967 ms 2024-01-23T09:05:52.444 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4615 0.05 MB/sec execute 418 sec latency 999.886 ms 2024-01-23T09:05:53.444 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4616 0.05 MB/sec execute 419 sec latency 1114.599 ms 2024-01-23T09:05:54.444 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4618 0.04 MB/sec execute 420 sec latency 1396.341 ms 2024-01-23T09:05:55.444 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4628 0.04 MB/sec execute 421 sec latency 331.420 ms 2024-01-23T09:05:56.445 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4632 0.04 MB/sec execute 422 sec latency 385.034 ms 2024-01-23T09:05:57.444 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4656 0.04 MB/sec execute 423 sec latency 403.039 ms 2024-01-23T09:05:58.444 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4656 0.04 MB/sec execute 424 sec latency 1009.205 ms 2024-01-23T09:05:59.444 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4668 0.04 MB/sec execute 425 sec latency 1148.257 ms 2024-01-23T09:06:00.444 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4673 0.04 MB/sec execute 426 sec latency 880.741 ms 2024-01-23T09:06:01.445 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4681 0.04 MB/sec execute 427 sec latency 764.272 ms 2024-01-23T09:06:02.445 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4685 0.04 MB/sec execute 428 sec latency 1206.875 ms 2024-01-23T09:06:03.445 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4701 0.04 MB/sec execute 429 sec latency 415.559 ms 2024-01-23T09:06:04.445 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4714 0.04 MB/sec execute 430 sec latency 439.038 ms 2024-01-23T09:06:05.445 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4724 0.04 MB/sec execute 431 sec latency 618.193 ms 2024-01-23T09:06:06.445 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4726 0.04 MB/sec execute 432 sec latency 1112.249 ms 2024-01-23T09:06:07.445 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4734 0.04 MB/sec execute 433 sec latency 352.595 ms 2024-01-23T09:06:08.445 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4735 0.04 MB/sec execute 434 sec latency 1055.507 ms 2024-01-23T09:06:09.445 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4736 0.04 MB/sec execute 435 sec latency 1058.715 ms 2024-01-23T09:06:10.445 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4738 0.04 MB/sec execute 436 sec latency 1066.644 ms 2024-01-23T09:06:11.446 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4743 0.04 MB/sec execute 437 sec latency 343.228 ms 2024-01-23T09:06:12.446 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4747 0.04 MB/sec execute 438 sec latency 469.461 ms 2024-01-23T09:06:13.446 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4766 0.04 MB/sec execute 439 sec latency 501.647 ms 2024-01-23T09:06:14.446 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4770 0.04 MB/sec execute 440 sec latency 643.489 ms 2024-01-23T09:06:15.446 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4780 0.04 MB/sec execute 441 sec latency 1074.432 ms 2024-01-23T09:06:16.446 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4791 0.04 MB/sec execute 442 sec latency 368.187 ms 2024-01-23T09:06:17.446 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4810 0.04 MB/sec execute 443 sec latency 372.544 ms 2024-01-23T09:06:18.446 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4814 0.04 MB/sec execute 444 sec latency 596.269 ms 2024-01-23T09:06:19.446 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4817 0.04 MB/sec execute 445 sec latency 985.690 ms 2024-01-23T09:06:20.011 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:06:20.014 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:06:20.446 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4840 0.04 MB/sec execute 446 sec latency 319.507 ms 2024-01-23T09:06:21.446 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4844 0.04 MB/sec execute 447 sec latency 779.021 ms 2024-01-23T09:06:22.446 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4846 0.04 MB/sec execute 448 sec latency 1071.985 ms 2024-01-23T09:06:23.447 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4847 0.04 MB/sec execute 449 sec latency 987.333 ms 2024-01-23T09:06:24.447 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4850 0.04 MB/sec execute 450 sec latency 1418.863 ms 2024-01-23T09:06:25.447 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4884 0.04 MB/sec execute 451 sec latency 958.194 ms 2024-01-23T09:06:26.447 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4942 0.05 MB/sec execute 452 sec latency 866.614 ms 2024-01-23T09:06:27.447 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4943 0.05 MB/sec execute 453 sec latency 1162.414 ms 2024-01-23T09:06:28.447 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4947 0.05 MB/sec execute 454 sec latency 973.061 ms 2024-01-23T09:06:29.447 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4948 0.05 MB/sec execute 455 sec latency 920.705 ms 2024-01-23T09:06:30.447 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4951 0.05 MB/sec execute 456 sec latency 928.170 ms 2024-01-23T09:06:31.447 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4962 0.05 MB/sec execute 457 sec latency 956.974 ms 2024-01-23T09:06:32.447 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4963 0.05 MB/sec execute 458 sec latency 761.599 ms 2024-01-23T09:06:33.447 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4969 0.05 MB/sec execute 459 sec latency 1012.101 ms 2024-01-23T09:06:34.448 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4983 0.05 MB/sec execute 460 sec latency 710.380 ms 2024-01-23T09:06:35.448 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4985 0.05 MB/sec execute 461 sec latency 967.988 ms 2024-01-23T09:06:36.448 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5006 0.05 MB/sec execute 462 sec latency 470.944 ms 2024-01-23T09:06:37.448 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5012 0.05 MB/sec execute 463 sec latency 525.027 ms 2024-01-23T09:06:38.448 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5015 0.05 MB/sec execute 464 sec latency 897.953 ms 2024-01-23T09:06:39.448 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5030 0.05 MB/sec execute 465 sec latency 190.863 ms 2024-01-23T09:06:40.448 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5032 0.05 MB/sec execute 466 sec latency 511.878 ms 2024-01-23T09:06:41.448 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5047 0.05 MB/sec execute 467 sec latency 1056.873 ms 2024-01-23T09:06:42.448 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5051 0.05 MB/sec execute 468 sec latency 892.521 ms 2024-01-23T09:06:43.448 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5054 0.05 MB/sec execute 469 sec latency 1081.339 ms 2024-01-23T09:06:44.448 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5056 0.05 MB/sec execute 470 sec latency 573.448 ms 2024-01-23T09:06:45.449 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5065 0.05 MB/sec execute 471 sec latency 1008.061 ms 2024-01-23T09:06:46.449 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5075 0.05 MB/sec execute 472 sec latency 544.685 ms 2024-01-23T09:06:47.449 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5089 0.05 MB/sec execute 473 sec latency 501.955 ms 2024-01-23T09:06:48.449 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5092 0.05 MB/sec execute 474 sec latency 432.775 ms 2024-01-23T09:06:49.449 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5096 0.05 MB/sec execute 475 sec latency 1060.133 ms 2024-01-23T09:06:50.085 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:06:50.088 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:06:50.449 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5101 0.05 MB/sec execute 476 sec latency 981.853 ms 2024-01-23T09:06:51.449 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5119 0.05 MB/sec execute 477 sec latency 443.332 ms 2024-01-23T09:06:52.449 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5120 0.05 MB/sec execute 478 sec latency 859.505 ms 2024-01-23T09:06:53.449 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5131 0.05 MB/sec execute 479 sec latency 994.217 ms 2024-01-23T09:06:54.449 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5145 0.05 MB/sec execute 480 sec latency 217.521 ms 2024-01-23T09:06:55.449 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5153 0.05 MB/sec execute 481 sec latency 193.887 ms 2024-01-23T09:06:56.450 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5154 0.05 MB/sec execute 482 sec latency 711.148 ms 2024-01-23T09:06:57.450 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5168 0.05 MB/sec execute 483 sec latency 1351.540 ms 2024-01-23T09:06:58.450 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5171 0.05 MB/sec execute 484 sec latency 564.177 ms 2024-01-23T09:06:59.367 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:13:36.716 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:06:59.375 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:13:36.724 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:06:59.450 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5175 0.05 MB/sec execute 485 sec latency 988.655 ms 2024-01-23T09:06:59.486 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:13:36.772 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:06:59.490 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:13:36.776 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:06:59.494 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:13:36.780 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:06:59.495 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:13:36.781 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:06:59.541 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:13:36.889 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:06:59.636 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:13:36.922 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:06:59.651 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:13:36.937 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:07:00.450 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5178 0.05 MB/sec execute 486 sec latency 979.474 ms 2024-01-23T09:07:01.450 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5182 0.05 MB/sec execute 487 sec latency 325.947 ms 2024-01-23T09:07:02.450 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5192 0.05 MB/sec execute 488 sec latency 1006.611 ms 2024-01-23T09:07:03.450 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5206 0.05 MB/sec execute 489 sec latency 504.615 ms 2024-01-23T09:07:04.450 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5208 0.05 MB/sec execute 490 sec latency 1358.458 ms 2024-01-23T09:07:05.450 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5209 0.05 MB/sec execute 491 sec latency 635.216 ms 2024-01-23T09:07:06.450 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5218 0.05 MB/sec execute 492 sec latency 1042.631 ms 2024-01-23T09:07:07.450 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5227 0.05 MB/sec execute 493 sec latency 669.298 ms 2024-01-23T09:07:08.451 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5251 0.04 MB/sec execute 494 sec latency 489.665 ms 2024-01-23T09:07:09.451 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5254 0.04 MB/sec execute 495 sec latency 726.192 ms 2024-01-23T09:07:10.451 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5265 0.04 MB/sec execute 496 sec latency 677.273 ms 2024-01-23T09:07:11.451 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5266 0.04 MB/sec execute 497 sec latency 976.175 ms 2024-01-23T09:07:12.451 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5272 0.04 MB/sec execute 498 sec latency 1003.995 ms 2024-01-23T09:07:13.451 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5286 0.04 MB/sec execute 499 sec latency 913.724 ms 2024-01-23T09:07:14.451 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5296 0.04 MB/sec execute 500 sec latency 489.798 ms 2024-01-23T09:07:15.451 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5334 0.04 MB/sec execute 501 sec latency 251.491 ms 2024-01-23T09:07:16.451 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5337 0.04 MB/sec execute 502 sec latency 517.090 ms 2024-01-23T09:07:17.451 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5344 0.04 MB/sec execute 503 sec latency 950.168 ms 2024-01-23T09:07:18.452 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5368 0.04 MB/sec execute 504 sec latency 170.592 ms 2024-01-23T09:07:19.451 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5371 0.04 MB/sec execute 505 sec latency 329.643 ms 2024-01-23T09:07:20.141 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:07:20.144 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:07:20.451 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5382 0.04 MB/sec execute 506 sec latency 1113.454 ms 2024-01-23T09:07:21.452 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5387 0.04 MB/sec execute 507 sec latency 518.054 ms 2024-01-23T09:07:22.452 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5391 0.04 MB/sec execute 508 sec latency 963.280 ms 2024-01-23T09:07:23.452 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5393 0.04 MB/sec execute 509 sec latency 925.113 ms 2024-01-23T09:07:24.452 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5402 0.04 MB/sec execute 510 sec latency 272.979 ms 2024-01-23T09:07:25.452 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5406 0.04 MB/sec execute 511 sec latency 349.209 ms 2024-01-23T09:07:26.452 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5414 0.04 MB/sec execute 512 sec latency 1036.264 ms 2024-01-23T09:07:27.452 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5423 0.04 MB/sec execute 513 sec latency 475.727 ms 2024-01-23T09:07:28.452 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5427 0.04 MB/sec execute 514 sec latency 944.958 ms 2024-01-23T09:07:29.452 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5429 0.04 MB/sec execute 515 sec latency 977.256 ms 2024-01-23T09:07:30.452 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5434 0.04 MB/sec execute 516 sec latency 303.751 ms 2024-01-23T09:07:31.453 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5440 0.04 MB/sec execute 517 sec latency 974.229 ms 2024-01-23T09:07:32.453 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5463 0.04 MB/sec execute 518 sec latency 260.312 ms 2024-01-23T09:07:33.453 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5468 0.04 MB/sec execute 519 sec latency 1004.633 ms 2024-01-23T09:07:34.453 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5468 0.04 MB/sec execute 520 sec latency 1056.441 ms 2024-01-23T09:07:35.453 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5475 0.04 MB/sec execute 521 sec latency 1419.042 ms 2024-01-23T09:07:36.453 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5477 0.04 MB/sec execute 522 sec latency 830.618 ms 2024-01-23T09:07:37.453 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5485 0.04 MB/sec execute 523 sec latency 1003.149 ms 2024-01-23T09:07:38.453 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5512 0.04 MB/sec execute 524 sec latency 1094.097 ms 2024-01-23T09:07:39.453 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5537 0.04 MB/sec execute 525 sec latency 226.278 ms 2024-01-23T09:07:40.453 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5540 0.04 MB/sec execute 526 sec latency 537.745 ms 2024-01-23T09:07:41.453 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5549 0.04 MB/sec execute 527 sec latency 993.493 ms 2024-01-23T09:07:42.453 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5562 0.04 MB/sec execute 528 sec latency 319.050 ms 2024-01-23T09:07:43.454 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5569 0.04 MB/sec execute 529 sec latency 984.519 ms 2024-01-23T09:07:44.454 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5591 0.04 MB/sec execute 530 sec latency 209.110 ms 2024-01-23T09:07:45.454 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5597 0.04 MB/sec execute 531 sec latency 491.419 ms 2024-01-23T09:07:46.454 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5605 0.04 MB/sec execute 532 sec latency 968.721 ms 2024-01-23T09:07:47.454 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5613 0.04 MB/sec execute 533 sec latency 975.331 ms 2024-01-23T09:07:48.454 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5615 0.04 MB/sec execute 534 sec latency 932.801 ms 2024-01-23T09:07:49.454 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5616 0.04 MB/sec execute 535 sec latency 971.942 ms 2024-01-23T09:07:50.204 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:07:50.207 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:07:50.454 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5622 0.04 MB/sec execute 536 sec latency 186.599 ms 2024-01-23T09:07:51.454 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5623 0.04 MB/sec execute 537 sec latency 868.688 ms 2024-01-23T09:07:52.454 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5641 0.04 MB/sec execute 538 sec latency 952.146 ms 2024-01-23T09:07:53.455 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5643 0.04 MB/sec execute 539 sec latency 1205.113 ms 2024-01-23T09:07:54.455 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5643 0.04 MB/sec execute 540 sec latency 1206.338 ms 2024-01-23T09:07:55.455 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5655 0.04 MB/sec execute 541 sec latency 1484.687 ms 2024-01-23T09:07:56.455 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5658 0.04 MB/sec execute 542 sec latency 931.911 ms 2024-01-23T09:07:57.455 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5658 0.04 MB/sec execute 543 sec latency 1004.725 ms 2024-01-23T09:07:58.455 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5699 0.04 MB/sec execute 544 sec latency 1103.855 ms 2024-01-23T09:07:59.455 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5702 0.04 MB/sec execute 545 sec latency 426.094 ms 2024-01-23T09:08:00.455 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5708 0.04 MB/sec execute 546 sec latency 988.070 ms 2024-01-23T09:08:01.456 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5714 0.04 MB/sec execute 547 sec latency 948.478 ms 2024-01-23T09:08:02.455 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5735 0.04 MB/sec execute 548 sec latency 402.300 ms 2024-01-23T09:08:03.455 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5737 0.04 MB/sec execute 549 sec latency 968.758 ms 2024-01-23T09:08:04.455 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5737 0.04 MB/sec execute 550 sec latency 1277.052 ms 2024-01-23T09:08:05.456 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5742 0.04 MB/sec execute 551 sec latency 1371.163 ms 2024-01-23T09:08:06.456 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5744 0.04 MB/sec execute 552 sec latency 665.950 ms 2024-01-23T09:08:07.456 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5759 0.04 MB/sec execute 553 sec latency 1021.501 ms 2024-01-23T09:08:08.456 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5763 0.04 MB/sec execute 554 sec latency 545.571 ms 2024-01-23T09:08:09.456 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5782 0.04 MB/sec execute 555 sec latency 494.447 ms 2024-01-23T09:08:10.456 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5809 0.04 MB/sec execute 556 sec latency 938.986 ms 2024-01-23T09:08:11.456 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5834 0.04 MB/sec execute 557 sec latency 171.261 ms 2024-01-23T09:08:12.456 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5853 0.04 MB/sec execute 558 sec latency 772.622 ms 2024-01-23T09:08:13.456 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5859 0.04 MB/sec execute 559 sec latency 950.136 ms 2024-01-23T09:08:14.456 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5863 0.04 MB/sec execute 560 sec latency 568.091 ms 2024-01-23T09:08:15.456 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5866 0.04 MB/sec execute 561 sec latency 986.388 ms 2024-01-23T09:08:16.457 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5867 0.04 MB/sec execute 562 sec latency 1013.263 ms 2024-01-23T09:08:17.457 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5867 0.04 MB/sec execute 563 sec latency 1531.765 ms 2024-01-23T09:08:18.457 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5881 0.04 MB/sec execute 564 sec latency 1532.153 ms 2024-01-23T09:08:19.457 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5884 0.04 MB/sec execute 565 sec latency 1053.771 ms 2024-01-23T09:08:20.457 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5893 0.04 MB/sec execute 566 sec latency 1350.067 ms 2024-01-23T09:08:20.476 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:08:20.479 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:08:21.457 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5895 0.04 MB/sec execute 567 sec latency 544.852 ms 2024-01-23T09:08:22.457 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5900 0.04 MB/sec execute 568 sec latency 908.095 ms 2024-01-23T09:08:23.457 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5905 0.04 MB/sec execute 569 sec latency 1060.016 ms 2024-01-23T09:08:24.457 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5918 0.04 MB/sec execute 570 sec latency 325.382 ms 2024-01-23T09:08:25.457 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5921 0.04 MB/sec execute 571 sec latency 606.526 ms 2024-01-23T09:08:26.458 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5922 0.04 MB/sec execute 572 sec latency 1027.211 ms 2024-01-23T09:08:27.458 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5924 0.04 MB/sec execute 573 sec latency 1076.491 ms 2024-01-23T09:08:28.458 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5926 0.04 MB/sec execute 574 sec latency 976.207 ms 2024-01-23T09:08:29.458 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5927 0.04 MB/sec execute 575 sec latency 1346.728 ms 2024-01-23T09:08:30.458 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5931 0.04 MB/sec execute 576 sec latency 612.652 ms 2024-01-23T09:08:31.458 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5945 0.04 MB/sec execute 577 sec latency 961.602 ms 2024-01-23T09:08:32.458 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5951 0.04 MB/sec execute 578 sec latency 601.940 ms 2024-01-23T09:08:33.458 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5954 0.04 MB/sec execute 579 sec latency 1064.737 ms 2024-01-23T09:08:34.458 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5960 0.04 MB/sec execute 580 sec latency 344.728 ms 2024-01-23T09:08:35.458 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5967 0.04 MB/sec execute 581 sec latency 397.749 ms 2024-01-23T09:08:36.458 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5970 0.04 MB/sec execute 582 sec latency 795.390 ms 2024-01-23T09:08:37.459 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5988 0.04 MB/sec execute 583 sec latency 1028.449 ms 2024-01-23T09:08:38.459 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5991 0.04 MB/sec execute 584 sec latency 639.462 ms 2024-01-23T09:08:39.459 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5991 0.04 MB/sec execute 585 sec latency 1236.988 ms 2024-01-23T09:08:40.459 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5992 0.04 MB/sec execute 586 sec latency 1250.302 ms 2024-01-23T09:08:41.459 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5999 0.04 MB/sec execute 587 sec latency 1108.374 ms 2024-01-23T09:08:42.459 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6007 0.04 MB/sec execute 588 sec latency 448.494 ms 2024-01-23T09:08:43.459 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6013 0.04 MB/sec execute 589 sec latency 348.223 ms 2024-01-23T09:08:44.459 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6026 0.04 MB/sec execute 590 sec latency 452.059 ms 2024-01-23T09:08:45.459 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6030 0.04 MB/sec execute 591 sec latency 618.019 ms 2024-01-23T09:08:46.459 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6046 0.04 MB/sec execute 592 sec latency 984.357 ms 2024-01-23T09:08:47.459 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6052 0.04 MB/sec execute 593 sec latency 653.706 ms 2024-01-23T09:08:48.460 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6054 0.04 MB/sec execute 594 sec latency 965.217 ms 2024-01-23T09:08:49.460 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6054 0.04 MB/sec execute 595 sec latency 1210.265 ms 2024-01-23T09:08:50.460 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6060 0.04 MB/sec execute 596 sec latency 1372.704 ms 2024-01-23T09:08:50.530 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:08:50.534 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:08:51.460 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6064 0.04 MB/sec execute 597 sec latency 644.381 ms 2024-01-23T09:08:52.460 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6107 0.04 MB/sec execute 598 sec latency 990.348 ms 2024-01-23T09:08:53.460 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6109 0.04 MB/sec execute 599 sec latency 984.213 ms 2024-01-23T09:08:54.460 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 600 sec 2024-01-23T09:08:55.460 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 601 sec 2024-01-23T09:08:56.460 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 602 sec 2024-01-23T09:08:57.460 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 603 sec 2024-01-23T09:08:58.460 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 604 sec 2024-01-23T09:08:59.460 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 605 sec 2024-01-23T09:09:00.461 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 606 sec 2024-01-23T09:09:01.461 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 607 sec 2024-01-23T09:09:02.461 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 608 sec 2024-01-23T09:09:03.463 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 609 sec 2024-01-23T09:09:04.461 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 610 sec 2024-01-23T09:09:05.461 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 611 sec 2024-01-23T09:09:06.461 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 612 sec 2024-01-23T09:09:07.461 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 613 sec 2024-01-23T09:09:08.461 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 614 sec 2024-01-23T09:09:09.461 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 615 sec 2024-01-23T09:09:10.462 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 616 sec 2024-01-23T09:09:11.462 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 617 sec 2024-01-23T09:09:12.462 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 618 sec 2024-01-23T09:09:12.926 INFO:tasks.workunit.client.0.smithi046.stdout: 0 cleanup 619 sec 2024-01-23T09:09:12.926 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-01-23T09:09:12.926 INFO:tasks.workunit.client.0.smithi046.stdout: Operation Count AvgLat MaxLat 2024-01-23T09:09:12.926 INFO:tasks.workunit.client.0.smithi046.stdout: ---------------------------------------- 2024-01-23T09:09:12.926 INFO:tasks.workunit.client.0.smithi046.stdout: NTCreateX 853 183.347 710.369 2024-01-23T09:09:12.926 INFO:tasks.workunit.client.0.smithi046.stdout: Close 651 3.991 36.180 2024-01-23T09:09:12.927 INFO:tasks.workunit.client.0.smithi046.stdout: Rename 31 551.126 957.273 2024-01-23T09:09:12.927 INFO:tasks.workunit.client.0.smithi046.stdout: Unlink 147 183.248 732.041 2024-01-23T09:09:12.927 INFO:tasks.workunit.client.0.smithi046.stdout: Qpathinfo 821 99.398 601.492 2024-01-23T09:09:12.927 INFO:tasks.workunit.client.0.smithi046.stdout: Qfileinfo 144 3.021 6.584 2024-01-23T09:09:12.927 INFO:tasks.workunit.client.0.smithi046.stdout: Qfsinfo 115 22.221 152.720 2024-01-23T09:09:12.927 INFO:tasks.workunit.client.0.smithi046.stdout: Sfileinfo 66 36.631 48.215 2024-01-23T09:09:12.927 INFO:tasks.workunit.client.0.smithi046.stdout: Find 292 1018.753 1655.595 2024-01-23T09:09:12.927 INFO:tasks.workunit.client.0.smithi046.stdout: WriteX 421 11.650 172.906 2024-01-23T09:09:12.927 INFO:tasks.workunit.client.0.smithi046.stdout: ReadX 1258 0.095 5.483 2024-01-23T09:09:12.927 INFO:tasks.workunit.client.0.smithi046.stdout: LockX 2 77.952 111.577 2024-01-23T09:09:12.927 INFO:tasks.workunit.client.0.smithi046.stdout: UnlockX 2 59.232 76.020 2024-01-23T09:09:12.927 INFO:tasks.workunit.client.0.smithi046.stdout: Flush 53 143.288 274.284 2024-01-23T09:09:12.927 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-01-23T09:09:12.927 INFO:tasks.workunit.client.0.smithi046.stdout:Throughput 0.041594 MB/sec 1 clients 1 procs max_latency=1655.610 ms 2024-01-23T09:09:12.928 INFO:tasks.workunit.client.0.smithi046.stderr:+ dbench 10 2024-01-23T09:09:12.928 INFO:tasks.workunit.client.0.smithi046.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-01-23T09:09:12.928 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-01-23T09:09:12.928 INFO:tasks.workunit.client.0.smithi046.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-01-23T09:09:12.929 INFO:tasks.workunit.client.0.smithi046.stdout:8 of 10 processes prepared for launch 0 sec 2024-01-23T09:09:13.029 INFO:tasks.workunit.client.0.smithi046.stdout:10 of 10 processes prepared for launch 0 sec 2024-01-23T09:09:13.029 INFO:tasks.workunit.client.0.smithi046.stdout:releasing clients 2024-01-23T09:09:14.029 INFO:tasks.workunit.client.0.smithi046.stdout: 0 2 0.00 MB/sec warmup 1 sec latency 999.888 ms 2024-01-23T09:09:15.029 INFO:tasks.workunit.client.0.smithi046.stdout: 0 2 0.00 MB/sec warmup 2 sec latency 1999.987 ms 2024-01-23T09:09:16.029 INFO:tasks.workunit.client.0.smithi046.stdout: 0 3 0.00 MB/sec warmup 3 sec latency 3000.088 ms 2024-01-23T09:09:17.029 INFO:tasks.workunit.client.0.smithi046.stdout: 0 4 0.00 MB/sec warmup 4 sec latency 4000.152 ms 2024-01-23T09:09:18.029 INFO:tasks.workunit.client.0.smithi046.stdout: 0 6 0.00 MB/sec warmup 5 sec latency 5000.250 ms 2024-01-23T09:09:19.029 INFO:tasks.workunit.client.0.smithi046.stdout: 0 7 0.00 MB/sec warmup 6 sec latency 939.932 ms 2024-01-23T09:09:20.030 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8 0.00 MB/sec warmup 7 sec latency 1325.370 ms 2024-01-23T09:09:20.644 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:09:20.647 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:09:21.030 INFO:tasks.workunit.client.0.smithi046.stdout: 2 12 0.16 MB/sec warmup 8 sec latency 1282.520 ms 2024-01-23T09:09:22.030 INFO:tasks.workunit.client.0.smithi046.stdout: 5 17 0.43 MB/sec warmup 9 sec latency 1231.944 ms 2024-01-23T09:09:23.030 INFO:tasks.workunit.client.0.smithi046.stdout: 7 23 0.64 MB/sec warmup 10 sec latency 1574.948 ms 2024-01-23T09:09:24.030 INFO:tasks.workunit.client.0.smithi046.stdout: 9 30 0.88 MB/sec warmup 11 sec latency 1667.140 ms 2024-01-23T09:09:25.030 INFO:tasks.workunit.client.0.smithi046.stdout: 10 35 1.03 MB/sec warmup 12 sec latency 2089.636 ms 2024-01-23T09:09:26.030 INFO:tasks.workunit.client.0.smithi046.stdout: 10 39 1.13 MB/sec warmup 13 sec latency 2124.650 ms 2024-01-23T09:09:27.030 INFO:tasks.workunit.client.0.smithi046.stdout: 10 44 1.25 MB/sec warmup 14 sec latency 2103.576 ms 2024-01-23T09:09:28.030 INFO:tasks.workunit.client.0.smithi046.stdout: 10 51 1.38 MB/sec warmup 15 sec latency 1965.610 ms 2024-01-23T09:09:29.030 INFO:tasks.workunit.client.0.smithi046.stdout: 10 56 1.45 MB/sec warmup 16 sec latency 2082.542 ms 2024-01-23T09:09:30.030 INFO:tasks.workunit.client.0.smithi046.stdout: 10 61 1.53 MB/sec warmup 17 sec latency 2175.814 ms 2024-01-23T09:09:31.030 INFO:tasks.workunit.client.0.smithi046.stdout: 10 67 1.64 MB/sec warmup 18 sec latency 2135.663 ms 2024-01-23T09:09:32.030 INFO:tasks.workunit.client.0.smithi046.stdout: 10 73 1.72 MB/sec warmup 19 sec latency 1842.006 ms 2024-01-23T09:09:33.030 INFO:tasks.workunit.client.0.smithi046.stdout: 10 78 1.74 MB/sec warmup 20 sec latency 1964.964 ms 2024-01-23T09:09:34.031 INFO:tasks.workunit.client.0.smithi046.stdout: 10 83 1.81 MB/sec warmup 21 sec latency 2243.469 ms 2024-01-23T09:09:35.031 INFO:tasks.workunit.client.0.smithi046.stdout: 10 89 1.85 MB/sec warmup 22 sec latency 2329.811 ms 2024-01-23T09:09:36.031 INFO:tasks.workunit.client.0.smithi046.stdout: 10 94 1.89 MB/sec warmup 23 sec latency 2540.159 ms 2024-01-23T09:09:37.031 INFO:tasks.workunit.client.0.smithi046.stdout: 10 100 1.94 MB/sec warmup 24 sec latency 2291.825 ms 2024-01-23T09:09:38.031 INFO:tasks.workunit.client.0.smithi046.stdout: 10 104 1.96 MB/sec warmup 25 sec latency 2127.193 ms 2024-01-23T09:09:39.031 INFO:tasks.workunit.client.0.smithi046.stdout: 10 108 1.94 MB/sec warmup 26 sec latency 2027.646 ms 2024-01-23T09:09:40.034 INFO:tasks.workunit.client.0.smithi046.stdout: 10 112 1.94 MB/sec warmup 27 sec latency 2308.698 ms 2024-01-23T09:09:41.031 INFO:tasks.workunit.client.0.smithi046.stdout: 10 114 1.90 MB/sec warmup 28 sec latency 2158.804 ms 2024-01-23T09:09:42.031 INFO:tasks.workunit.client.0.smithi046.stdout: 10 116 1.85 MB/sec warmup 29 sec latency 2611.330 ms 2024-01-23T09:09:43.031 INFO:tasks.workunit.client.0.smithi046.stdout: 10 120 1.83 MB/sec warmup 30 sec latency 2653.336 ms 2024-01-23T09:09:44.032 INFO:tasks.workunit.client.0.smithi046.stdout: 10 123 1.79 MB/sec warmup 31 sec latency 1948.795 ms 2024-01-23T09:09:45.032 INFO:tasks.workunit.client.0.smithi046.stdout: 10 125 1.76 MB/sec warmup 32 sec latency 2285.516 ms 2024-01-23T09:09:46.031 INFO:tasks.workunit.client.0.smithi046.stdout: 10 129 1.75 MB/sec warmup 33 sec latency 2517.178 ms 2024-01-23T09:09:47.032 INFO:tasks.workunit.client.0.smithi046.stdout: 10 131 1.71 MB/sec warmup 34 sec latency 2820.682 ms 2024-01-23T09:09:48.032 INFO:tasks.workunit.client.0.smithi046.stdout: 10 134 1.69 MB/sec warmup 35 sec latency 2290.563 ms 2024-01-23T09:09:49.032 INFO:tasks.workunit.client.0.smithi046.stdout: 10 137 1.67 MB/sec warmup 36 sec latency 2377.031 ms 2024-01-23T09:09:50.032 INFO:tasks.workunit.client.0.smithi046.stdout: 10 139 1.64 MB/sec warmup 37 sec latency 2739.489 ms 2024-01-23T09:09:50.748 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:09:50.752 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:09:51.032 INFO:tasks.workunit.client.0.smithi046.stdout: 10 140 1.60 MB/sec warmup 38 sec latency 2811.567 ms 2024-01-23T09:09:52.032 INFO:tasks.workunit.client.0.smithi046.stdout: 10 140 1.56 MB/sec warmup 39 sec latency 3811.662 ms 2024-01-23T09:09:53.032 INFO:tasks.workunit.client.0.smithi046.stdout: 10 143 1.54 MB/sec warmup 40 sec latency 4557.276 ms 2024-01-23T09:09:54.032 INFO:tasks.workunit.client.0.smithi046.stdout: 10 147 1.54 MB/sec warmup 41 sec latency 3394.666 ms 2024-01-23T09:09:55.032 INFO:tasks.workunit.client.0.smithi046.stdout: 10 149 1.51 MB/sec warmup 42 sec latency 1914.756 ms 2024-01-23T09:09:56.032 INFO:tasks.workunit.client.0.smithi046.stdout: 10 150 1.49 MB/sec warmup 43 sec latency 2854.163 ms 2024-01-23T09:09:57.032 INFO:tasks.workunit.client.0.smithi046.stdout: 10 154 1.48 MB/sec warmup 44 sec latency 2946.658 ms 2024-01-23T09:09:58.033 INFO:tasks.workunit.client.0.smithi046.stdout: 10 157 1.46 MB/sec warmup 45 sec latency 1722.959 ms 2024-01-23T09:09:59.033 INFO:tasks.workunit.client.0.smithi046.stdout: 10 159 1.44 MB/sec warmup 46 sec latency 2281.022 ms 2024-01-23T09:10:00.033 INFO:tasks.workunit.client.0.smithi046.stdout: 10 163 1.44 MB/sec warmup 47 sec latency 2408.198 ms 2024-01-23T09:10:01.033 INFO:tasks.workunit.client.0.smithi046.stdout: 10 164 1.41 MB/sec warmup 48 sec latency 2606.070 ms 2024-01-23T09:10:02.033 INFO:tasks.workunit.client.0.smithi046.stdout: 10 166 1.40 MB/sec warmup 49 sec latency 2980.592 ms 2024-01-23T09:10:03.033 INFO:tasks.workunit.client.0.smithi046.stdout: 10 170 1.40 MB/sec warmup 50 sec latency 3186.831 ms 2024-01-23T09:10:04.033 INFO:tasks.workunit.client.0.smithi046.stdout: 10 173 1.38 MB/sec warmup 51 sec latency 2699.419 ms 2024-01-23T09:10:05.034 INFO:tasks.workunit.client.0.smithi046.stdout: 10 173 1.36 MB/sec warmup 52 sec latency 2813.260 ms 2024-01-23T09:10:06.033 INFO:tasks.workunit.client.0.smithi046.stdout: 10 175 1.35 MB/sec warmup 53 sec latency 3247.583 ms 2024-01-23T09:10:07.033 INFO:tasks.workunit.client.0.smithi046.stdout: 10 179 1.34 MB/sec warmup 54 sec latency 3638.963 ms 2024-01-23T09:10:08.033 INFO:tasks.workunit.client.0.smithi046.stdout: 10 182 1.34 MB/sec warmup 55 sec latency 3504.614 ms 2024-01-23T09:10:09.033 INFO:tasks.workunit.client.0.smithi046.stdout: 10 183 1.32 MB/sec warmup 56 sec latency 2168.769 ms 2024-01-23T09:10:10.033 INFO:tasks.workunit.client.0.smithi046.stdout: 10 186 1.31 MB/sec warmup 57 sec latency 2887.139 ms 2024-01-23T09:10:11.034 INFO:tasks.workunit.client.0.smithi046.stdout: 10 187 1.30 MB/sec warmup 58 sec latency 3849.119 ms 2024-01-23T09:10:12.034 INFO:tasks.workunit.client.0.smithi046.stdout: 10 188 1.28 MB/sec warmup 59 sec latency 4278.535 ms 2024-01-23T09:10:13.034 INFO:tasks.workunit.client.0.smithi046.stdout: 10 191 1.28 MB/sec warmup 60 sec latency 4916.346 ms 2024-01-23T09:10:14.034 INFO:tasks.workunit.client.0.smithi046.stdout: 10 194 1.27 MB/sec warmup 61 sec latency 4957.078 ms 2024-01-23T09:10:15.034 INFO:tasks.workunit.client.0.smithi046.stdout: 10 195 1.25 MB/sec warmup 62 sec latency 3577.742 ms 2024-01-23T09:10:16.034 INFO:tasks.workunit.client.0.smithi046.stdout: 10 197 1.24 MB/sec warmup 63 sec latency 3209.814 ms 2024-01-23T09:10:17.034 INFO:tasks.workunit.client.0.smithi046.stdout: 10 201 1.24 MB/sec warmup 64 sec latency 2882.570 ms 2024-01-23T09:10:18.034 INFO:tasks.workunit.client.0.smithi046.stdout: 10 202 1.23 MB/sec warmup 65 sec latency 1948.065 ms 2024-01-23T09:10:19.034 INFO:tasks.workunit.client.0.smithi046.stdout: 10 206 1.22 MB/sec warmup 66 sec latency 1966.679 ms 2024-01-23T09:10:20.034 INFO:tasks.workunit.client.0.smithi046.stdout: 10 209 1.22 MB/sec warmup 67 sec latency 2318.131 ms 2024-01-23T09:10:20.860 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:10:20.863 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:10:21.034 INFO:tasks.workunit.client.0.smithi046.stdout: 10 211 1.21 MB/sec warmup 68 sec latency 2453.375 ms 2024-01-23T09:10:22.034 INFO:tasks.workunit.client.0.smithi046.stdout: 10 212 1.20 MB/sec warmup 69 sec latency 3031.571 ms 2024-01-23T09:10:23.034 INFO:tasks.workunit.client.0.smithi046.stdout: 10 215 1.19 MB/sec warmup 70 sec latency 3448.914 ms 2024-01-23T09:10:24.034 INFO:tasks.workunit.client.0.smithi046.stdout: 10 218 1.19 MB/sec warmup 71 sec latency 3705.855 ms 2024-01-23T09:10:25.035 INFO:tasks.workunit.client.0.smithi046.stdout: 10 223 1.20 MB/sec warmup 72 sec latency 2623.452 ms 2024-01-23T09:10:26.035 INFO:tasks.workunit.client.0.smithi046.stdout: 10 223 1.18 MB/sec warmup 73 sec latency 2527.201 ms 2024-01-23T09:10:27.035 INFO:tasks.workunit.client.0.smithi046.stdout: 10 224 1.17 MB/sec warmup 74 sec latency 3462.136 ms 2024-01-23T09:10:27.492 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:17:04.840 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:10:27.504 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:17:04.851 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:10:27.616 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:17:04.902 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:10:27.619 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:17:04.905 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:10:27.622 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:17:04.907 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:10:27.629 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:17:04.914 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:10:27.664 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:17:05.011 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:10:27.752 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:17:05.037 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:10:27.755 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:17:05.040 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:10:28.035 INFO:tasks.workunit.client.0.smithi046.stdout: 10 226 1.16 MB/sec warmup 75 sec latency 4102.633 ms 2024-01-23T09:10:29.035 INFO:tasks.workunit.client.0.smithi046.stdout: 10 226 1.15 MB/sec warmup 76 sec latency 4842.577 ms 2024-01-23T09:10:30.035 INFO:tasks.workunit.client.0.smithi046.stdout: 10 230 1.15 MB/sec warmup 77 sec latency 5107.171 ms 2024-01-23T09:10:31.035 INFO:tasks.workunit.client.0.smithi046.stdout: 10 231 1.14 MB/sec warmup 78 sec latency 5165.343 ms 2024-01-23T09:10:32.035 INFO:tasks.workunit.client.0.smithi046.stdout: 10 233 1.13 MB/sec warmup 79 sec latency 4445.030 ms 2024-01-23T09:10:33.035 INFO:tasks.workunit.client.0.smithi046.stdout: 10 234 1.12 MB/sec warmup 80 sec latency 3772.952 ms 2024-01-23T09:10:34.036 INFO:tasks.workunit.client.0.smithi046.stdout: 10 236 1.12 MB/sec warmup 81 sec latency 4178.741 ms 2024-01-23T09:10:35.035 INFO:tasks.workunit.client.0.smithi046.stdout: 10 241 1.12 MB/sec warmup 82 sec latency 4439.927 ms 2024-01-23T09:10:36.035 INFO:tasks.workunit.client.0.smithi046.stdout: 10 244 1.12 MB/sec warmup 83 sec latency 3280.652 ms 2024-01-23T09:10:37.036 INFO:tasks.workunit.client.0.smithi046.stdout: 10 244 1.11 MB/sec warmup 84 sec latency 2408.696 ms 2024-01-23T09:10:38.036 INFO:tasks.workunit.client.0.smithi046.stdout: 10 249 1.11 MB/sec warmup 85 sec latency 2867.512 ms 2024-01-23T09:10:39.036 INFO:tasks.workunit.client.0.smithi046.stdout: 10 252 1.11 MB/sec warmup 86 sec latency 1991.832 ms 2024-01-23T09:10:40.036 INFO:tasks.workunit.client.0.smithi046.stdout: 10 253 1.10 MB/sec warmup 87 sec latency 2161.999 ms 2024-01-23T09:10:41.036 INFO:tasks.workunit.client.0.smithi046.stdout: 10 256 1.10 MB/sec warmup 88 sec latency 2985.726 ms 2024-01-23T09:10:42.036 INFO:tasks.workunit.client.0.smithi046.stdout: 10 260 1.11 MB/sec warmup 89 sec latency 3129.649 ms 2024-01-23T09:10:43.036 INFO:tasks.workunit.client.0.smithi046.stdout: 10 261 1.10 MB/sec warmup 90 sec latency 2318.601 ms 2024-01-23T09:10:44.036 INFO:tasks.workunit.client.0.smithi046.stdout: 10 265 1.09 MB/sec warmup 91 sec latency 2967.322 ms 2024-01-23T09:10:45.037 INFO:tasks.workunit.client.0.smithi046.stdout: 10 269 1.10 MB/sec warmup 92 sec latency 2134.481 ms 2024-01-23T09:10:46.041 INFO:tasks.workunit.client.0.smithi046.stdout: 10 269 1.09 MB/sec warmup 93 sec latency 2528.901 ms 2024-01-23T09:10:47.037 INFO:tasks.workunit.client.0.smithi046.stdout: 10 272 1.09 MB/sec warmup 94 sec latency 3450.131 ms 2024-01-23T09:10:48.037 INFO:tasks.workunit.client.0.smithi046.stdout: 10 273 1.08 MB/sec warmup 95 sec latency 4166.164 ms 2024-01-23T09:10:49.037 INFO:tasks.workunit.client.0.smithi046.stdout: 10 276 1.08 MB/sec warmup 96 sec latency 4587.066 ms 2024-01-23T09:10:50.037 INFO:tasks.workunit.client.0.smithi046.stdout: 10 279 1.08 MB/sec warmup 97 sec latency 4663.427 ms 2024-01-23T09:10:50.982 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:10:50.986 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:10:51.036 INFO:tasks.workunit.client.0.smithi046.stdout: 10 280 1.07 MB/sec warmup 98 sec latency 3109.613 ms 2024-01-23T09:10:52.037 INFO:tasks.workunit.client.0.smithi046.stdout: 10 284 1.07 MB/sec warmup 99 sec latency 3059.262 ms 2024-01-23T09:10:53.037 INFO:tasks.workunit.client.0.smithi046.stdout: 10 285 1.07 MB/sec warmup 100 sec latency 3817.005 ms 2024-01-23T09:10:54.037 INFO:tasks.workunit.client.0.smithi046.stdout: 10 288 1.06 MB/sec warmup 101 sec latency 4259.506 ms 2024-01-23T09:10:55.037 INFO:tasks.workunit.client.0.smithi046.stdout: 10 291 1.06 MB/sec warmup 102 sec latency 3020.187 ms 2024-01-23T09:10:56.037 INFO:tasks.workunit.client.0.smithi046.stdout: 10 292 1.05 MB/sec warmup 103 sec latency 1802.802 ms 2024-01-23T09:10:57.037 INFO:tasks.workunit.client.0.smithi046.stdout: 10 292 1.04 MB/sec warmup 104 sec latency 2789.686 ms 2024-01-23T09:10:58.037 INFO:tasks.workunit.client.0.smithi046.stdout: 10 293 1.03 MB/sec warmup 105 sec latency 3789.781 ms 2024-01-23T09:10:59.037 INFO:tasks.workunit.client.0.smithi046.stdout: 10 295 1.03 MB/sec warmup 106 sec latency 4789.878 ms 2024-01-23T09:11:00.038 INFO:tasks.workunit.client.0.smithi046.stdout: 10 298 1.03 MB/sec warmup 107 sec latency 5450.852 ms 2024-01-23T09:11:01.038 INFO:tasks.workunit.client.0.smithi046.stdout: 10 298 1.02 MB/sec warmup 108 sec latency 4286.337 ms 2024-01-23T09:11:02.038 INFO:tasks.workunit.client.0.smithi046.stdout: 10 300 1.01 MB/sec warmup 109 sec latency 5140.299 ms 2024-01-23T09:11:03.038 INFO:tasks.workunit.client.0.smithi046.stdout: 10 303 1.01 MB/sec warmup 110 sec latency 4145.265 ms 2024-01-23T09:11:04.038 INFO:tasks.workunit.client.0.smithi046.stdout: 10 307 1.02 MB/sec warmup 111 sec latency 3550.925 ms 2024-01-23T09:11:05.038 INFO:tasks.workunit.client.0.smithi046.stdout: 10 309 1.01 MB/sec warmup 112 sec latency 2410.074 ms 2024-01-23T09:11:06.038 INFO:tasks.workunit.client.0.smithi046.stdout: 10 314 1.02 MB/sec warmup 113 sec latency 2572.510 ms 2024-01-23T09:11:07.040 INFO:tasks.workunit.client.0.smithi046.stdout: 10 314 1.01 MB/sec warmup 114 sec latency 3276.881 ms 2024-01-23T09:11:08.038 INFO:tasks.workunit.client.0.smithi046.stdout: 10 314 1.00 MB/sec warmup 115 sec latency 3770.870 ms 2024-01-23T09:11:09.038 INFO:tasks.workunit.client.0.smithi046.stdout: 10 318 1.00 MB/sec warmup 116 sec latency 3678.053 ms 2024-01-23T09:11:10.038 INFO:tasks.workunit.client.0.smithi046.stdout: 10 320 1.00 MB/sec warmup 117 sec latency 3885.485 ms 2024-01-23T09:11:11.039 INFO:tasks.workunit.client.0.smithi046.stdout: 10 322 0.99 MB/sec warmup 118 sec latency 2117.124 ms 2024-01-23T09:11:12.038 INFO:tasks.workunit.client.0.smithi046.stdout: 10 323 0.99 MB/sec warmup 119 sec latency 3003.079 ms 2024-01-23T09:11:13.713 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:17:51.061 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:11:13.726 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:17:51.074 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:11:13.789 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:17:51.137 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:11:13.838 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:17:51.123 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:11:13.852 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:17:51.138 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:11:13.854 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:17:51.139 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:11:13.863 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:17:51.149 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:11:13.930 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:17:51.216 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:11:13.931 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:17:51.217 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:11:14.039 INFO:tasks.workunit.client.0.smithi046.stdout: 10 332 1.82 MB/sec execute 1 sec latency 3583.963 ms 2024-01-23T09:11:15.039 INFO:tasks.workunit.client.0.smithi046.stdout: 10 334 1.30 MB/sec execute 2 sec latency 1818.938 ms 2024-01-23T09:11:16.039 INFO:tasks.workunit.client.0.smithi046.stdout: 10 339 1.37 MB/sec execute 3 sec latency 2173.448 ms 2024-01-23T09:11:17.039 INFO:tasks.workunit.client.0.smithi046.stdout: 10 341 1.17 MB/sec execute 4 sec latency 2408.589 ms 2024-01-23T09:11:18.039 INFO:tasks.workunit.client.0.smithi046.stdout: 10 341 0.94 MB/sec execute 5 sec latency 2616.207 ms 2024-01-23T09:11:19.039 INFO:tasks.workunit.client.0.smithi046.stdout: 10 341 0.79 MB/sec execute 6 sec latency 3602.421 ms 2024-01-23T09:11:20.039 INFO:tasks.workunit.client.0.smithi046.stdout: 10 344 0.79 MB/sec execute 7 sec latency 4368.376 ms 2024-01-23T09:11:21.039 INFO:tasks.workunit.client.0.smithi046.stdout: 10 346 0.75 MB/sec execute 8 sec latency 4438.392 ms 2024-01-23T09:11:21.079 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:11:21.082 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:11:22.039 INFO:tasks.workunit.client.0.smithi046.stdout: 10 347 0.69 MB/sec execute 9 sec latency 2720.752 ms 2024-01-23T09:11:23.039 INFO:tasks.workunit.client.0.smithi046.stdout: 10 351 0.75 MB/sec execute 10 sec latency 2785.822 ms 2024-01-23T09:11:24.040 INFO:tasks.workunit.client.0.smithi046.stdout: 10 353 0.76 MB/sec execute 11 sec latency 3023.466 ms 2024-01-23T09:11:25.040 INFO:tasks.workunit.client.0.smithi046.stdout: 10 358 0.80 MB/sec execute 12 sec latency 2117.016 ms 2024-01-23T09:11:26.040 INFO:tasks.workunit.client.0.smithi046.stdout: 10 361 0.84 MB/sec execute 13 sec latency 2190.463 ms 2024-01-23T09:11:27.040 INFO:tasks.workunit.client.0.smithi046.stdout: 10 361 0.78 MB/sec execute 14 sec latency 2406.120 ms 2024-01-23T09:11:28.040 INFO:tasks.workunit.client.0.smithi046.stdout: 10 363 0.76 MB/sec execute 15 sec latency 3295.272 ms 2024-01-23T09:11:29.040 INFO:tasks.workunit.client.0.smithi046.stdout: 10 364 0.73 MB/sec execute 16 sec latency 4041.597 ms 2024-01-23T09:11:30.040 INFO:tasks.workunit.client.0.smithi046.stdout: 10 366 0.73 MB/sec execute 17 sec latency 4705.274 ms 2024-01-23T09:11:31.040 INFO:tasks.workunit.client.0.smithi046.stdout: 10 371 0.76 MB/sec execute 18 sec latency 4750.352 ms 2024-01-23T09:11:32.040 INFO:tasks.workunit.client.0.smithi046.stdout: 10 372 0.76 MB/sec execute 19 sec latency 2086.056 ms 2024-01-23T09:11:33.040 INFO:tasks.workunit.client.0.smithi046.stdout: 10 374 0.75 MB/sec execute 20 sec latency 2433.413 ms 2024-01-23T09:11:34.040 INFO:tasks.workunit.client.0.smithi046.stdout: 10 379 0.80 MB/sec execute 21 sec latency 2613.002 ms 2024-01-23T09:11:35.040 INFO:tasks.workunit.client.0.smithi046.stdout: 10 382 0.80 MB/sec execute 22 sec latency 2499.745 ms 2024-01-23T09:11:36.041 INFO:tasks.workunit.client.0.smithi046.stdout: 10 386 0.81 MB/sec execute 23 sec latency 2212.910 ms 2024-01-23T09:11:37.041 INFO:tasks.workunit.client.0.smithi046.stdout: 10 388 0.81 MB/sec execute 24 sec latency 2915.164 ms 2024-01-23T09:11:38.041 INFO:tasks.workunit.client.0.smithi046.stdout: 10 389 0.80 MB/sec execute 25 sec latency 2981.650 ms 2024-01-23T09:11:39.041 INFO:tasks.workunit.client.0.smithi046.stdout: 10 391 0.79 MB/sec execute 26 sec latency 3575.390 ms 2024-01-23T09:11:40.041 INFO:tasks.workunit.client.0.smithi046.stdout: 10 397 0.83 MB/sec execute 27 sec latency 3266.361 ms 2024-01-23T09:11:41.041 INFO:tasks.workunit.client.0.smithi046.stdout: 10 397 0.81 MB/sec execute 28 sec latency 2365.767 ms 2024-01-23T09:11:42.041 INFO:tasks.workunit.client.0.smithi046.stdout: 10 402 0.83 MB/sec execute 29 sec latency 2439.836 ms 2024-01-23T09:11:43.041 INFO:tasks.workunit.client.0.smithi046.stdout: 10 405 0.83 MB/sec execute 30 sec latency 2645.186 ms 2024-01-23T09:11:44.041 INFO:tasks.workunit.client.0.smithi046.stdout: 10 409 0.84 MB/sec execute 31 sec latency 2399.348 ms 2024-01-23T09:11:45.041 INFO:tasks.workunit.client.0.smithi046.stdout: 10 410 0.84 MB/sec execute 32 sec latency 2388.474 ms 2024-01-23T09:11:46.044 INFO:tasks.workunit.client.0.smithi046.stdout: 10 413 0.84 MB/sec execute 33 sec latency 2547.000 ms 2024-01-23T09:11:47.042 INFO:tasks.workunit.client.0.smithi046.stdout: 10 414 0.83 MB/sec execute 34 sec latency 3179.209 ms 2024-01-23T09:11:48.041 INFO:tasks.workunit.client.0.smithi046.stdout: 10 415 0.81 MB/sec execute 35 sec latency 4056.327 ms 2024-01-23T09:11:49.041 INFO:tasks.workunit.client.0.smithi046.stdout: 10 415 0.79 MB/sec execute 36 sec latency 4977.226 ms 2024-01-23T09:11:50.042 INFO:tasks.workunit.client.0.smithi046.stdout: 10 417 0.79 MB/sec execute 37 sec latency 5580.293 ms 2024-01-23T09:11:51.042 INFO:tasks.workunit.client.0.smithi046.stdout: 10 420 0.79 MB/sec execute 38 sec latency 5594.155 ms 2024-01-23T09:11:51.151 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:11:51.154 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:11:52.042 INFO:tasks.workunit.client.0.smithi046.stdout: 10 422 0.79 MB/sec execute 39 sec latency 4973.256 ms 2024-01-23T09:11:53.042 INFO:tasks.workunit.client.0.smithi046.stdout: 10 425 0.79 MB/sec execute 40 sec latency 5117.873 ms 2024-01-23T09:11:54.042 INFO:tasks.workunit.client.0.smithi046.stdout: 10 426 0.78 MB/sec execute 41 sec latency 3732.494 ms 2024-01-23T09:11:55.042 INFO:tasks.workunit.client.0.smithi046.stdout: 10 430 0.79 MB/sec execute 42 sec latency 3565.920 ms 2024-01-23T09:11:56.042 INFO:tasks.workunit.client.0.smithi046.stdout: 10 433 0.80 MB/sec execute 43 sec latency 3125.152 ms 2024-01-23T09:11:57.042 INFO:tasks.workunit.client.0.smithi046.stdout: 10 434 0.78 MB/sec execute 44 sec latency 2846.821 ms 2024-01-23T09:11:58.042 INFO:tasks.workunit.client.0.smithi046.stdout: 10 436 0.78 MB/sec execute 45 sec latency 3605.410 ms 2024-01-23T09:11:59.042 INFO:tasks.workunit.client.0.smithi046.stdout: 10 437 0.77 MB/sec execute 46 sec latency 4095.988 ms 2024-01-23T09:12:00.042 INFO:tasks.workunit.client.0.smithi046.stdout: 10 438 0.76 MB/sec execute 47 sec latency 4571.876 ms 2024-01-23T09:12:01.043 INFO:tasks.workunit.client.0.smithi046.stdout: 10 440 0.76 MB/sec execute 48 sec latency 4969.015 ms 2024-01-23T09:12:02.043 INFO:tasks.workunit.client.0.smithi046.stdout: 10 445 0.78 MB/sec execute 49 sec latency 5005.958 ms 2024-01-23T09:12:03.043 INFO:tasks.workunit.client.0.smithi046.stdout: 10 446 0.77 MB/sec execute 50 sec latency 3617.142 ms 2024-01-23T09:12:04.043 INFO:tasks.workunit.client.0.smithi046.stdout: 10 446 0.75 MB/sec execute 51 sec latency 3296.011 ms 2024-01-23T09:12:05.043 INFO:tasks.workunit.client.0.smithi046.stdout: 10 449 0.76 MB/sec execute 52 sec latency 4043.245 ms 2024-01-23T09:12:06.043 INFO:tasks.workunit.client.0.smithi046.stdout: 10 454 0.78 MB/sec execute 53 sec latency 4284.236 ms 2024-01-23T09:12:07.043 INFO:tasks.workunit.client.0.smithi046.stdout: 10 455 0.77 MB/sec execute 54 sec latency 2780.571 ms 2024-01-23T09:12:08.043 INFO:tasks.workunit.client.0.smithi046.stdout: 10 457 0.76 MB/sec execute 55 sec latency 3310.719 ms 2024-01-23T09:12:09.044 INFO:tasks.workunit.client.0.smithi046.stdout: 10 457 0.75 MB/sec execute 56 sec latency 3639.406 ms 2024-01-23T09:12:10.043 INFO:tasks.workunit.client.0.smithi046.stdout: 10 460 0.75 MB/sec execute 57 sec latency 4347.335 ms 2024-01-23T09:12:11.044 INFO:tasks.workunit.client.0.smithi046.stdout: 10 464 0.76 MB/sec execute 58 sec latency 4353.048 ms 2024-01-23T09:12:12.043 INFO:tasks.workunit.client.0.smithi046.stdout: 10 465 0.76 MB/sec execute 59 sec latency 3439.186 ms 2024-01-23T09:12:13.043 INFO:tasks.workunit.client.0.smithi046.stdout: 10 465 0.75 MB/sec execute 60 sec latency 2918.918 ms 2024-01-23T09:12:14.044 INFO:tasks.workunit.client.0.smithi046.stdout: 10 466 0.74 MB/sec execute 61 sec latency 3919.010 ms 2024-01-23T09:12:15.044 INFO:tasks.workunit.client.0.smithi046.stdout: 10 473 0.76 MB/sec execute 62 sec latency 3945.903 ms 2024-01-23T09:12:16.044 INFO:tasks.workunit.client.0.smithi046.stdout: 10 474 0.75 MB/sec execute 63 sec latency 2415.961 ms 2024-01-23T09:12:17.044 INFO:tasks.workunit.client.0.smithi046.stdout: 10 474 0.74 MB/sec execute 64 sec latency 2817.116 ms 2024-01-23T09:12:18.044 INFO:tasks.workunit.client.0.smithi046.stdout: 10 476 0.74 MB/sec execute 65 sec latency 3588.163 ms 2024-01-23T09:12:19.044 INFO:tasks.workunit.client.0.smithi046.stdout: 10 480 0.75 MB/sec execute 66 sec latency 4113.677 ms 2024-01-23T09:12:20.044 INFO:tasks.workunit.client.0.smithi046.stdout: 10 482 0.75 MB/sec execute 67 sec latency 4391.968 ms 2024-01-23T09:12:21.044 INFO:tasks.workunit.client.0.smithi046.stdout: 10 483 0.74 MB/sec execute 68 sec latency 4459.586 ms 2024-01-23T09:12:21.280 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:12:21.283 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:12:22.044 INFO:tasks.workunit.client.0.smithi046.stdout: 10 483 0.73 MB/sec execute 69 sec latency 5459.682 ms 2024-01-23T09:12:23.044 INFO:tasks.workunit.client.0.smithi046.stdout: 10 485 0.73 MB/sec execute 70 sec latency 6289.018 ms 2024-01-23T09:12:24.044 INFO:tasks.workunit.client.0.smithi046.stdout: 10 489 0.74 MB/sec execute 71 sec latency 5445.932 ms 2024-01-23T09:12:25.045 INFO:tasks.workunit.client.0.smithi046.stdout: 10 492 0.75 MB/sec execute 72 sec latency 4848.124 ms 2024-01-23T09:12:26.045 INFO:tasks.workunit.client.0.smithi046.stdout: 10 493 0.74 MB/sec execute 73 sec latency 3095.171 ms 2024-01-23T09:12:27.045 INFO:tasks.workunit.client.0.smithi046.stdout: 10 495 0.74 MB/sec execute 74 sec latency 3846.774 ms 2024-01-23T09:12:28.045 INFO:tasks.workunit.client.0.smithi046.stdout: 10 504 0.76 MB/sec execute 75 sec latency 3619.077 ms 2024-01-23T09:12:29.045 INFO:tasks.workunit.client.0.smithi046.stdout: 10 505 0.76 MB/sec execute 76 sec latency 3832.327 ms 2024-01-23T09:12:30.045 INFO:tasks.workunit.client.0.smithi046.stdout: 10 506 0.75 MB/sec execute 77 sec latency 3402.997 ms 2024-01-23T09:12:31.045 INFO:tasks.workunit.client.0.smithi046.stdout: 10 508 0.75 MB/sec execute 78 sec latency 3698.123 ms 2024-01-23T09:12:32.045 INFO:tasks.workunit.client.0.smithi046.stdout: 10 512 0.76 MB/sec execute 79 sec latency 3874.530 ms 2024-01-23T09:12:33.045 INFO:tasks.workunit.client.0.smithi046.stdout: 10 512 0.75 MB/sec execute 80 sec latency 4874.594 ms 2024-01-23T09:12:34.045 INFO:tasks.workunit.client.0.smithi046.stdout: 10 515 0.75 MB/sec execute 81 sec latency 5874.674 ms 2024-01-23T09:12:35.046 INFO:tasks.workunit.client.0.smithi046.stdout: 10 516 0.74 MB/sec execute 82 sec latency 6874.757 ms 2024-01-23T09:12:36.046 INFO:tasks.workunit.client.0.smithi046.stdout: 10 519 0.74 MB/sec execute 83 sec latency 7162.829 ms 2024-01-23T09:12:37.046 INFO:tasks.workunit.client.0.smithi046.stdout: 10 523 0.75 MB/sec execute 84 sec latency 2212.028 ms 2024-01-23T09:12:38.046 INFO:tasks.workunit.client.0.smithi046.stdout: 10 524 0.75 MB/sec execute 85 sec latency 2404.890 ms 2024-01-23T09:12:39.046 INFO:tasks.workunit.client.0.smithi046.stdout: 10 528 0.75 MB/sec execute 86 sec latency 2761.306 ms 2024-01-23T09:12:40.046 INFO:tasks.workunit.client.0.smithi046.stdout: 10 531 0.76 MB/sec execute 87 sec latency 3274.118 ms 2024-01-23T09:12:41.046 INFO:tasks.workunit.client.0.smithi046.stdout: 10 535 0.76 MB/sec execute 88 sec latency 3223.054 ms 2024-01-23T09:12:42.047 INFO:tasks.workunit.client.0.smithi046.stdout: 10 543 0.79 MB/sec execute 89 sec latency 4223.108 ms 2024-01-23T09:12:43.046 INFO:tasks.workunit.client.0.smithi046.stdout: 10 547 0.80 MB/sec execute 90 sec latency 5223.165 ms 2024-01-23T09:12:44.048 INFO:tasks.workunit.client.0.smithi046.stdout: 10 552 0.81 MB/sec execute 91 sec latency 5676.077 ms 2024-01-23T09:12:45.047 INFO:tasks.workunit.client.0.smithi046.stdout: 10 559 0.82 MB/sec execute 92 sec latency 3223.746 ms 2024-01-23T09:12:46.047 INFO:tasks.workunit.client.0.smithi046.stdout: 10 566 0.83 MB/sec execute 93 sec latency 3579.085 ms 2024-01-23T09:12:47.047 INFO:tasks.workunit.client.0.smithi046.stdout: 10 572 0.85 MB/sec execute 94 sec latency 3405.544 ms 2024-01-23T09:12:48.047 INFO:tasks.workunit.client.0.smithi046.stdout: 10 579 0.88 MB/sec execute 95 sec latency 4405.619 ms 2024-01-23T09:12:49.047 INFO:tasks.workunit.client.0.smithi046.stdout: 10 580 0.87 MB/sec execute 96 sec latency 5405.704 ms 2024-01-23T09:12:50.047 INFO:tasks.workunit.client.0.smithi046.stdout: 10 588 0.88 MB/sec execute 97 sec latency 6107.156 ms 2024-01-23T09:12:51.047 INFO:tasks.workunit.client.0.smithi046.stdout: 10 595 0.88 MB/sec execute 98 sec latency 3877.139 ms 2024-01-23T09:12:51.427 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:12:51.433 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:12:52.047 INFO:tasks.workunit.client.0.smithi046.stdout: 10 601 0.89 MB/sec execute 99 sec latency 3933.489 ms 2024-01-23T09:12:53.047 INFO:tasks.workunit.client.0.smithi046.stdout: 10 608 0.91 MB/sec execute 100 sec latency 4523.811 ms 2024-01-23T09:12:54.047 INFO:tasks.workunit.client.0.smithi046.stdout: 10 609 0.90 MB/sec execute 101 sec latency 5523.914 ms 2024-01-23T09:12:55.047 INFO:tasks.workunit.client.0.smithi046.stdout: 10 610 0.90 MB/sec execute 102 sec latency 5682.504 ms 2024-01-23T09:12:56.047 INFO:tasks.workunit.client.0.smithi046.stdout: 10 611 0.89 MB/sec execute 103 sec latency 4740.440 ms 2024-01-23T09:12:57.047 INFO:tasks.workunit.client.0.smithi046.stdout: 10 612 0.88 MB/sec execute 104 sec latency 5578.188 ms 2024-01-23T09:12:58.048 INFO:tasks.workunit.client.0.smithi046.stdout: 10 613 0.87 MB/sec execute 105 sec latency 4992.530 ms 2024-01-23T09:12:59.048 INFO:tasks.workunit.client.0.smithi046.stdout: 10 613 0.86 MB/sec execute 106 sec latency 4050.783 ms 2024-01-23T09:13:00.048 INFO:tasks.workunit.client.0.smithi046.stdout: 10 617 0.85 MB/sec execute 107 sec latency 4889.596 ms 2024-01-23T09:13:01.048 INFO:tasks.workunit.client.0.smithi046.stdout: 10 618 0.85 MB/sec execute 108 sec latency 4396.634 ms 2024-01-23T09:13:02.048 INFO:tasks.workunit.client.0.smithi046.stdout: 10 619 0.84 MB/sec execute 109 sec latency 4753.752 ms 2024-01-23T09:13:03.048 INFO:tasks.workunit.client.0.smithi046.stdout: 10 623 0.83 MB/sec execute 110 sec latency 4800.923 ms 2024-01-23T09:13:04.048 INFO:tasks.workunit.client.0.smithi046.stdout: 10 623 0.82 MB/sec execute 111 sec latency 4127.623 ms 2024-01-23T09:13:05.048 INFO:tasks.workunit.client.0.smithi046.stdout: 10 624 0.82 MB/sec execute 112 sec latency 4309.565 ms 2024-01-23T09:13:06.048 INFO:tasks.workunit.client.0.smithi046.stdout: 10 631 0.81 MB/sec execute 113 sec latency 4424.604 ms 2024-01-23T09:13:07.048 INFO:tasks.workunit.client.0.smithi046.stdout: 10 639 0.81 MB/sec execute 114 sec latency 3728.418 ms 2024-01-23T09:13:08.048 INFO:tasks.workunit.client.0.smithi046.stdout: 10 644 0.80 MB/sec execute 115 sec latency 3731.497 ms 2024-01-23T09:13:09.051 INFO:tasks.workunit.client.0.smithi046.stdout: 10 645 0.79 MB/sec execute 116 sec latency 3440.999 ms 2024-01-23T09:13:10.048 INFO:tasks.workunit.client.0.smithi046.stdout: 10 645 0.79 MB/sec execute 117 sec latency 4441.064 ms 2024-01-23T09:13:11.048 INFO:tasks.workunit.client.0.smithi046.stdout: 10 647 0.78 MB/sec execute 118 sec latency 5146.596 ms 2024-01-23T09:13:12.049 INFO:tasks.workunit.client.0.smithi046.stdout: 10 647 0.78 MB/sec execute 119 sec latency 5210.038 ms 2024-01-23T09:13:13.049 INFO:tasks.workunit.client.0.smithi046.stdout: 10 648 0.77 MB/sec execute 120 sec latency 5600.753 ms 2024-01-23T09:13:14.049 INFO:tasks.workunit.client.0.smithi046.stdout: 10 650 0.76 MB/sec execute 121 sec latency 5927.564 ms 2024-01-23T09:13:15.049 INFO:tasks.workunit.client.0.smithi046.stdout: 10 650 0.76 MB/sec execute 122 sec latency 2217.860 ms 2024-01-23T09:13:16.049 INFO:tasks.workunit.client.0.smithi046.stdout: 10 650 0.75 MB/sec execute 123 sec latency 3217.918 ms 2024-01-23T09:13:17.049 INFO:tasks.workunit.client.0.smithi046.stdout: 10 650 0.74 MB/sec execute 124 sec latency 4217.982 ms 2024-01-23T09:13:18.049 INFO:tasks.workunit.client.0.smithi046.stdout: 10 650 0.74 MB/sec execute 125 sec latency 4452.700 ms 2024-01-23T09:13:19.049 INFO:tasks.workunit.client.0.smithi046.stdout: 10 650 0.73 MB/sec execute 126 sec latency 5452.787 ms 2024-01-23T09:13:20.049 INFO:tasks.workunit.client.0.smithi046.stdout: 10 653 0.73 MB/sec execute 127 sec latency 5759.852 ms 2024-01-23T09:13:21.049 INFO:tasks.workunit.client.0.smithi046.stdout: 10 654 0.72 MB/sec execute 128 sec latency 3847.765 ms 2024-01-23T09:13:21.506 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:13:21.510 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:13:22.049 INFO:tasks.workunit.client.0.smithi046.stdout: 10 656 0.72 MB/sec execute 129 sec latency 4847.836 ms 2024-01-23T09:13:23.049 INFO:tasks.workunit.client.0.smithi046.stdout: 10 658 0.71 MB/sec execute 130 sec latency 5847.937 ms 2024-01-23T09:13:24.050 INFO:tasks.workunit.client.0.smithi046.stdout: 10 658 0.71 MB/sec execute 131 sec latency 6848.032 ms 2024-01-23T09:13:25.050 INFO:tasks.workunit.client.0.smithi046.stdout: 10 660 0.70 MB/sec execute 132 sec latency 7764.050 ms 2024-01-23T09:13:26.050 INFO:tasks.workunit.client.0.smithi046.stdout: 10 662 0.70 MB/sec execute 133 sec latency 5146.982 ms 2024-01-23T09:13:27.050 INFO:tasks.workunit.client.0.smithi046.stdout: 10 663 0.69 MB/sec execute 134 sec latency 6147.047 ms 2024-01-23T09:13:28.050 INFO:tasks.workunit.client.0.smithi046.stdout: 10 663 0.69 MB/sec execute 135 sec latency 7147.126 ms 2024-01-23T09:13:29.050 INFO:tasks.workunit.client.0.smithi046.stdout: 10 664 0.68 MB/sec execute 136 sec latency 7222.449 ms 2024-01-23T09:13:30.050 INFO:tasks.workunit.client.0.smithi046.stdout: 10 664 0.68 MB/sec execute 137 sec latency 7304.809 ms 2024-01-23T09:13:31.050 INFO:tasks.workunit.client.0.smithi046.stdout: 10 666 0.67 MB/sec execute 138 sec latency 5529.993 ms 2024-01-23T09:13:32.050 INFO:tasks.workunit.client.0.smithi046.stdout: 10 669 0.67 MB/sec execute 139 sec latency 5377.431 ms 2024-01-23T09:13:33.050 INFO:tasks.workunit.client.0.smithi046.stdout: 10 672 0.67 MB/sec execute 140 sec latency 2142.880 ms 2024-01-23T09:13:34.052 INFO:tasks.workunit.client.0.smithi046.stdout: 10 674 0.66 MB/sec execute 141 sec latency 3142.963 ms 2024-01-23T09:13:35.051 INFO:tasks.workunit.client.0.smithi046.stdout: 10 675 0.66 MB/sec execute 142 sec latency 4143.029 ms 2024-01-23T09:13:36.051 INFO:tasks.workunit.client.0.smithi046.stdout: 10 677 0.65 MB/sec execute 143 sec latency 5143.103 ms 2024-01-23T09:13:37.051 INFO:tasks.workunit.client.0.smithi046.stdout: 10 679 0.65 MB/sec execute 144 sec latency 6143.166 ms 2024-01-23T09:13:38.051 INFO:tasks.workunit.client.0.smithi046.stdout: 10 682 0.64 MB/sec execute 145 sec latency 7143.235 ms 2024-01-23T09:13:39.051 INFO:tasks.workunit.client.0.smithi046.stdout: 10 685 0.64 MB/sec execute 146 sec latency 7152.872 ms 2024-01-23T09:13:40.051 INFO:tasks.workunit.client.0.smithi046.stdout: 10 687 0.64 MB/sec execute 147 sec latency 8073.535 ms 2024-01-23T09:13:41.051 INFO:tasks.workunit.client.0.smithi046.stdout: 10 688 0.63 MB/sec execute 148 sec latency 8198.030 ms 2024-01-23T09:13:42.051 INFO:tasks.workunit.client.0.smithi046.stdout: 10 690 0.63 MB/sec execute 149 sec latency 4419.337 ms 2024-01-23T09:13:43.051 INFO:tasks.workunit.client.0.smithi046.stdout: 10 691 0.62 MB/sec execute 150 sec latency 5419.399 ms 2024-01-23T09:13:44.051 INFO:tasks.workunit.client.0.smithi046.stdout: 10 691 0.62 MB/sec execute 151 sec latency 5454.729 ms 2024-01-23T09:13:45.051 INFO:tasks.workunit.client.0.smithi046.stdout: 10 693 0.62 MB/sec execute 152 sec latency 5320.774 ms 2024-01-23T09:13:46.051 INFO:tasks.workunit.client.0.smithi046.stdout: 10 694 0.61 MB/sec execute 153 sec latency 4288.726 ms 2024-01-23T09:13:47.051 INFO:tasks.workunit.client.0.smithi046.stdout: 10 694 0.61 MB/sec execute 154 sec latency 5170.859 ms 2024-01-23T09:13:48.051 INFO:tasks.workunit.client.0.smithi046.stdout: 10 696 0.60 MB/sec execute 155 sec latency 4494.750 ms 2024-01-23T09:13:49.052 INFO:tasks.workunit.client.0.smithi046.stdout: 10 700 0.60 MB/sec execute 156 sec latency 4704.188 ms 2024-01-23T09:13:50.052 INFO:tasks.workunit.client.0.smithi046.stdout: 10 702 0.60 MB/sec execute 157 sec latency 5199.737 ms 2024-01-23T09:13:51.052 INFO:tasks.workunit.client.0.smithi046.stdout: 10 705 0.59 MB/sec execute 158 sec latency 5704.069 ms 2024-01-23T09:13:51.619 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:13:51.622 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:13:52.052 INFO:tasks.workunit.client.0.smithi046.stdout: 10 711 0.59 MB/sec execute 159 sec latency 4349.099 ms 2024-01-23T09:13:53.052 INFO:tasks.workunit.client.0.smithi046.stdout: 10 714 0.59 MB/sec execute 160 sec latency 1215.011 ms 2024-01-23T09:13:54.052 INFO:tasks.workunit.client.0.smithi046.stdout: 10 718 0.58 MB/sec execute 161 sec latency 2215.110 ms 2024-01-23T09:13:55.052 INFO:tasks.workunit.client.0.smithi046.stdout: 10 718 0.58 MB/sec execute 162 sec latency 2996.824 ms 2024-01-23T09:13:56.052 INFO:tasks.workunit.client.0.smithi046.stdout: 10 720 0.58 MB/sec execute 163 sec latency 2952.828 ms 2024-01-23T09:13:57.052 INFO:tasks.workunit.client.0.smithi046.stdout: 10 723 0.57 MB/sec execute 164 sec latency 3271.746 ms 2024-01-23T09:13:58.052 INFO:tasks.workunit.client.0.smithi046.stdout: 10 724 0.57 MB/sec execute 165 sec latency 4271.802 ms 2024-01-23T09:13:59.053 INFO:tasks.workunit.client.0.smithi046.stdout: 10 725 0.57 MB/sec execute 166 sec latency 5271.880 ms 2024-01-23T09:14:00.053 INFO:tasks.workunit.client.0.smithi046.stdout: 10 726 0.56 MB/sec execute 167 sec latency 6271.943 ms 2024-01-23T09:14:01.052 INFO:tasks.workunit.client.0.smithi046.stdout: 10 727 0.56 MB/sec execute 168 sec latency 7271.995 ms 2024-01-23T09:14:02.053 INFO:tasks.workunit.client.0.smithi046.stdout: 10 728 0.56 MB/sec execute 169 sec latency 8272.083 ms 2024-01-23T09:14:03.053 INFO:tasks.workunit.client.0.smithi046.stdout: 10 728 0.55 MB/sec execute 170 sec latency 9272.145 ms 2024-01-23T09:14:04.053 INFO:tasks.workunit.client.0.smithi046.stdout: 10 729 0.55 MB/sec execute 171 sec latency 10272.239 ms 2024-01-23T09:14:05.053 INFO:tasks.workunit.client.0.smithi046.stdout: 10 730 0.55 MB/sec execute 172 sec latency 10757.974 ms 2024-01-23T09:14:06.053 INFO:tasks.workunit.client.0.smithi046.stdout: 10 733 0.55 MB/sec execute 173 sec latency 9997.254 ms 2024-01-23T09:14:07.053 INFO:tasks.workunit.client.0.smithi046.stdout: 10 738 0.54 MB/sec execute 174 sec latency 10434.607 ms 2024-01-23T09:14:08.053 INFO:tasks.workunit.client.0.smithi046.stdout: 10 741 0.54 MB/sec execute 175 sec latency 3501.033 ms 2024-01-23T09:14:09.053 INFO:tasks.workunit.client.0.smithi046.stdout: 10 742 0.54 MB/sec execute 176 sec latency 4501.126 ms 2024-01-23T09:14:10.053 INFO:tasks.workunit.client.0.smithi046.stdout: 10 743 0.54 MB/sec execute 177 sec latency 5501.218 ms 2024-01-23T09:14:11.054 INFO:tasks.workunit.client.0.smithi046.stdout: 10 745 0.53 MB/sec execute 178 sec latency 6501.296 ms 2024-01-23T09:14:12.053 INFO:tasks.workunit.client.0.smithi046.stdout: 10 750 0.53 MB/sec execute 179 sec latency 6719.257 ms 2024-01-23T09:14:13.054 INFO:tasks.workunit.client.0.smithi046.stdout: 10 752 0.53 MB/sec execute 180 sec latency 6277.260 ms 2024-01-23T09:14:14.054 INFO:tasks.workunit.client.0.smithi046.stdout: 10 755 0.52 MB/sec execute 181 sec latency 5571.926 ms 2024-01-23T09:14:15.054 INFO:tasks.workunit.client.0.smithi046.stdout: 10 755 0.52 MB/sec execute 182 sec latency 6571.991 ms 2024-01-23T09:14:16.054 INFO:tasks.workunit.client.0.smithi046.stdout: 10 755 0.52 MB/sec execute 183 sec latency 7572.084 ms 2024-01-23T09:14:17.054 INFO:tasks.workunit.client.0.smithi046.stdout: 10 756 0.52 MB/sec execute 184 sec latency 8106.647 ms 2024-01-23T09:14:18.054 INFO:tasks.workunit.client.0.smithi046.stdout: 10 758 0.51 MB/sec execute 185 sec latency 6356.006 ms 2024-01-23T09:14:19.054 INFO:tasks.workunit.client.0.smithi046.stdout: 10 758 0.51 MB/sec execute 186 sec latency 6479.626 ms 2024-01-23T09:14:20.054 INFO:tasks.workunit.client.0.smithi046.stdout: 10 758 0.51 MB/sec execute 187 sec latency 6584.002 ms 2024-01-23T09:14:21.054 INFO:tasks.workunit.client.0.smithi046.stdout: 10 759 0.51 MB/sec execute 188 sec latency 7223.029 ms 2024-01-23T09:14:21.758 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:14:21.761 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:14:22.054 INFO:tasks.workunit.client.0.smithi046.stdout: 10 764 0.50 MB/sec execute 189 sec latency 4759.585 ms 2024-01-23T09:14:23.054 INFO:tasks.workunit.client.0.smithi046.stdout: 10 768 0.50 MB/sec execute 190 sec latency 4708.547 ms 2024-01-23T09:14:24.055 INFO:tasks.workunit.client.0.smithi046.stdout: 10 771 0.50 MB/sec execute 191 sec latency 3254.020 ms 2024-01-23T09:14:25.054 INFO:tasks.workunit.client.0.smithi046.stdout: 10 773 0.50 MB/sec execute 192 sec latency 4254.076 ms 2024-01-23T09:14:26.055 INFO:tasks.workunit.client.0.smithi046.stdout: 10 775 0.49 MB/sec execute 193 sec latency 5254.122 ms 2024-01-23T09:14:27.055 INFO:tasks.workunit.client.0.smithi046.stdout: 10 782 0.49 MB/sec execute 194 sec latency 5307.267 ms 2024-01-23T09:14:28.055 INFO:tasks.workunit.client.0.smithi046.stdout: 10 785 0.49 MB/sec execute 195 sec latency 1732.987 ms 2024-01-23T09:14:29.055 INFO:tasks.workunit.client.0.smithi046.stdout: 10 786 0.49 MB/sec execute 196 sec latency 2238.306 ms 2024-01-23T09:14:30.055 INFO:tasks.workunit.client.0.smithi046.stdout: 10 786 0.48 MB/sec execute 197 sec latency 3141.406 ms 2024-01-23T09:14:31.055 INFO:tasks.workunit.client.0.smithi046.stdout: 10 788 0.48 MB/sec execute 198 sec latency 4141.476 ms 2024-01-23T09:14:32.055 INFO:tasks.workunit.client.0.smithi046.stdout: 10 790 0.48 MB/sec execute 199 sec latency 5141.541 ms 2024-01-23T09:14:33.055 INFO:tasks.workunit.client.0.smithi046.stdout: 10 792 0.48 MB/sec execute 200 sec latency 6141.612 ms 2024-01-23T09:14:34.055 INFO:tasks.workunit.client.0.smithi046.stdout: 10 793 0.48 MB/sec execute 201 sec latency 7141.688 ms 2024-01-23T09:14:35.055 INFO:tasks.workunit.client.0.smithi046.stdout: 10 794 0.47 MB/sec execute 202 sec latency 7188.876 ms 2024-01-23T09:14:36.055 INFO:tasks.workunit.client.0.smithi046.stdout: 10 796 0.47 MB/sec execute 203 sec latency 7944.968 ms 2024-01-23T09:14:37.055 INFO:tasks.workunit.client.0.smithi046.stdout: 10 798 0.47 MB/sec execute 204 sec latency 7742.808 ms 2024-01-23T09:14:38.056 INFO:tasks.workunit.client.0.smithi046.stdout: 10 802 0.47 MB/sec execute 205 sec latency 3953.163 ms 2024-01-23T09:14:39.056 INFO:tasks.workunit.client.0.smithi046.stdout: 10 805 0.47 MB/sec execute 206 sec latency 4953.257 ms 2024-01-23T09:14:40.056 INFO:tasks.workunit.client.0.smithi046.stdout: 10 806 0.47 MB/sec execute 207 sec latency 5953.351 ms 2024-01-23T09:14:41.058 INFO:tasks.workunit.client.0.smithi046.stdout: 10 807 0.46 MB/sec execute 208 sec latency 6953.445 ms 2024-01-23T09:14:42.056 INFO:tasks.workunit.client.0.smithi046.stdout: 10 808 0.46 MB/sec execute 209 sec latency 7953.522 ms 2024-01-23T09:14:43.056 INFO:tasks.workunit.client.0.smithi046.stdout: 10 810 0.46 MB/sec execute 210 sec latency 8953.602 ms 2024-01-23T09:14:44.056 INFO:tasks.workunit.client.0.smithi046.stdout: 10 812 0.46 MB/sec execute 211 sec latency 9223.158 ms 2024-01-23T09:14:45.056 INFO:tasks.workunit.client.0.smithi046.stdout: 10 813 0.45 MB/sec execute 212 sec latency 9148.384 ms 2024-01-23T09:14:46.056 INFO:tasks.workunit.client.0.smithi046.stdout: 10 814 0.45 MB/sec execute 213 sec latency 9455.207 ms 2024-01-23T09:14:47.056 INFO:tasks.workunit.client.0.smithi046.stdout: 10 817 0.45 MB/sec execute 214 sec latency 9257.077 ms 2024-01-23T09:14:48.056 INFO:tasks.workunit.client.0.smithi046.stdout: 10 817 0.45 MB/sec execute 215 sec latency 7190.395 ms 2024-01-23T09:14:49.057 INFO:tasks.workunit.client.0.smithi046.stdout: 10 817 0.45 MB/sec execute 216 sec latency 4788.541 ms 2024-01-23T09:14:50.057 INFO:tasks.workunit.client.0.smithi046.stdout: 10 817 0.44 MB/sec execute 217 sec latency 5711.553 ms 2024-01-23T09:14:51.057 INFO:tasks.workunit.client.0.smithi046.stdout: 10 818 0.44 MB/sec execute 218 sec latency 5156.747 ms 2024-01-23T09:14:51.862 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:14:51.865 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:14:52.057 INFO:tasks.workunit.client.0.smithi046.stdout: 10 818 0.44 MB/sec execute 219 sec latency 4843.356 ms 2024-01-23T09:14:53.057 INFO:tasks.workunit.client.0.smithi046.stdout: 10 820 0.44 MB/sec execute 220 sec latency 4956.714 ms 2024-01-23T09:14:54.057 INFO:tasks.workunit.client.0.smithi046.stdout: 10 820 0.44 MB/sec execute 221 sec latency 4077.376 ms 2024-01-23T09:14:55.057 INFO:tasks.workunit.client.0.smithi046.stdout: 10 821 0.43 MB/sec execute 222 sec latency 4818.591 ms 2024-01-23T09:14:56.057 INFO:tasks.workunit.client.0.smithi046.stdout: 10 821 0.43 MB/sec execute 223 sec latency 5349.632 ms 2024-01-23T09:14:57.057 INFO:tasks.workunit.client.0.smithi046.stdout: 10 824 0.43 MB/sec execute 224 sec latency 4758.866 ms 2024-01-23T09:14:58.057 INFO:tasks.workunit.client.0.smithi046.stdout: 10 826 0.43 MB/sec execute 225 sec latency 5170.795 ms 2024-01-23T09:14:59.057 INFO:tasks.workunit.client.0.smithi046.stdout: 10 829 0.43 MB/sec execute 226 sec latency 5356.406 ms 2024-01-23T09:15:00.057 INFO:tasks.workunit.client.0.smithi046.stdout: 10 831 0.43 MB/sec execute 227 sec latency 5442.631 ms 2024-01-23T09:15:01.058 INFO:tasks.workunit.client.0.smithi046.stdout: 10 831 0.42 MB/sec execute 228 sec latency 3860.965 ms 2024-01-23T09:15:02.058 INFO:tasks.workunit.client.0.smithi046.stdout: 10 832 0.42 MB/sec execute 229 sec latency 4710.929 ms 2024-01-23T09:15:03.058 INFO:tasks.workunit.client.0.smithi046.stdout: 10 833 0.42 MB/sec execute 230 sec latency 3837.243 ms 2024-01-23T09:15:04.058 INFO:tasks.workunit.client.0.smithi046.stdout: 10 838 0.42 MB/sec execute 231 sec latency 4091.061 ms 2024-01-23T09:15:05.058 INFO:tasks.workunit.client.0.smithi046.stdout: 10 841 0.42 MB/sec execute 232 sec latency 4985.364 ms 2024-01-23T09:15:06.058 INFO:tasks.workunit.client.0.smithi046.stdout: 10 845 0.42 MB/sec execute 233 sec latency 5091.422 ms 2024-01-23T09:15:07.058 INFO:tasks.workunit.client.0.smithi046.stdout: 10 846 0.41 MB/sec execute 234 sec latency 4769.475 ms 2024-01-23T09:15:08.058 INFO:tasks.workunit.client.0.smithi046.stdout: 10 849 0.41 MB/sec execute 235 sec latency 5211.193 ms 2024-01-23T09:15:09.058 INFO:tasks.workunit.client.0.smithi046.stdout: 10 855 0.41 MB/sec execute 236 sec latency 5070.719 ms 2024-01-23T09:15:10.058 INFO:tasks.workunit.client.0.smithi046.stdout: 10 856 0.41 MB/sec execute 237 sec latency 4180.442 ms 2024-01-23T09:15:11.058 INFO:tasks.workunit.client.0.smithi046.stdout: 10 857 0.41 MB/sec execute 238 sec latency 4363.002 ms 2024-01-23T09:15:12.058 INFO:tasks.workunit.client.0.smithi046.stdout: 10 857 0.41 MB/sec execute 239 sec latency 4379.195 ms 2024-01-23T09:15:13.058 INFO:tasks.workunit.client.0.smithi046.stdout: 10 858 0.41 MB/sec execute 240 sec latency 4377.120 ms 2024-01-23T09:15:14.059 INFO:tasks.workunit.client.0.smithi046.stdout: 10 859 0.40 MB/sec execute 241 sec latency 4505.897 ms 2024-01-23T09:15:15.059 INFO:tasks.workunit.client.0.smithi046.stdout: 10 860 0.40 MB/sec execute 242 sec latency 4958.021 ms 2024-01-23T09:15:16.059 INFO:tasks.workunit.client.0.smithi046.stdout: 10 862 0.40 MB/sec execute 243 sec latency 5034.198 ms 2024-01-23T09:15:17.059 INFO:tasks.workunit.client.0.smithi046.stdout: 10 862 0.40 MB/sec execute 244 sec latency 3267.189 ms 2024-01-23T09:15:18.059 INFO:tasks.workunit.client.0.smithi046.stdout: 10 864 0.40 MB/sec execute 245 sec latency 4267.263 ms 2024-01-23T09:15:19.059 INFO:tasks.workunit.client.0.smithi046.stdout: 10 865 0.40 MB/sec execute 246 sec latency 5267.339 ms 2024-01-23T09:15:20.059 INFO:tasks.workunit.client.0.smithi046.stdout: 10 866 0.39 MB/sec execute 247 sec latency 6267.431 ms 2024-01-23T09:15:21.059 INFO:tasks.workunit.client.0.smithi046.stdout: 10 867 0.39 MB/sec execute 248 sec latency 7103.597 ms 2024-01-23T09:15:21.926 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:15:21.929 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:15:22.059 INFO:tasks.workunit.client.0.smithi046.stdout: 10 868 0.39 MB/sec execute 249 sec latency 6312.276 ms 2024-01-23T09:15:23.059 INFO:tasks.workunit.client.0.smithi046.stdout: 10 868 0.39 MB/sec execute 250 sec latency 6083.053 ms 2024-01-23T09:15:24.059 INFO:tasks.workunit.client.0.smithi046.stdout: 10 869 0.39 MB/sec execute 251 sec latency 5346.315 ms 2024-01-23T09:15:25.059 INFO:tasks.workunit.client.0.smithi046.stdout: 10 871 0.39 MB/sec execute 252 sec latency 6313.378 ms 2024-01-23T09:15:26.059 INFO:tasks.workunit.client.0.smithi046.stdout: 10 872 0.39 MB/sec execute 253 sec latency 5757.813 ms 2024-01-23T09:15:27.060 INFO:tasks.workunit.client.0.smithi046.stdout: 10 875 0.39 MB/sec execute 254 sec latency 5995.303 ms 2024-01-23T09:15:28.060 INFO:tasks.workunit.client.0.smithi046.stdout: 10 878 0.38 MB/sec execute 255 sec latency 4653.842 ms 2024-01-23T09:15:29.060 INFO:tasks.workunit.client.0.smithi046.stdout: 10 880 0.38 MB/sec execute 256 sec latency 5219.499 ms 2024-01-23T09:15:30.060 INFO:tasks.workunit.client.0.smithi046.stdout: 10 880 0.38 MB/sec execute 257 sec latency 5439.185 ms 2024-01-23T09:15:31.060 INFO:tasks.workunit.client.0.smithi046.stdout: 10 881 0.38 MB/sec execute 258 sec latency 5587.532 ms 2024-01-23T09:15:32.060 INFO:tasks.workunit.client.0.smithi046.stdout: 10 883 0.38 MB/sec execute 259 sec latency 4250.495 ms 2024-01-23T09:15:33.060 INFO:tasks.workunit.client.0.smithi046.stdout: 10 885 0.38 MB/sec execute 260 sec latency 5250.582 ms 2024-01-23T09:15:34.060 INFO:tasks.workunit.client.0.smithi046.stdout: 10 887 0.38 MB/sec execute 261 sec latency 6250.641 ms 2024-01-23T09:15:35.060 INFO:tasks.workunit.client.0.smithi046.stdout: 10 889 0.38 MB/sec execute 262 sec latency 7143.377 ms 2024-01-23T09:15:36.060 INFO:tasks.workunit.client.0.smithi046.stdout: 10 891 0.37 MB/sec execute 263 sec latency 6699.525 ms 2024-01-23T09:15:37.060 INFO:tasks.workunit.client.0.smithi046.stdout: 10 893 0.37 MB/sec execute 264 sec latency 5715.844 ms 2024-01-23T09:15:38.060 INFO:tasks.workunit.client.0.smithi046.stdout: 10 896 0.37 MB/sec execute 265 sec latency 2829.448 ms 2024-01-23T09:15:39.060 INFO:tasks.workunit.client.0.smithi046.stdout: 10 898 0.37 MB/sec execute 266 sec latency 3829.515 ms 2024-01-23T09:15:40.061 INFO:tasks.workunit.client.0.smithi046.stdout: 10 899 0.37 MB/sec execute 267 sec latency 4829.591 ms 2024-01-23T09:15:41.061 INFO:tasks.workunit.client.0.smithi046.stdout: 10 902 0.37 MB/sec execute 268 sec latency 5244.693 ms 2024-01-23T09:15:42.061 INFO:tasks.workunit.client.0.smithi046.stdout: 10 904 0.37 MB/sec execute 269 sec latency 6244.768 ms 2024-01-23T09:15:43.061 INFO:tasks.workunit.client.0.smithi046.stdout: 10 906 0.37 MB/sec execute 270 sec latency 6261.328 ms 2024-01-23T09:15:44.061 INFO:tasks.workunit.client.0.smithi046.stdout: 10 908 0.36 MB/sec execute 271 sec latency 1983.580 ms 2024-01-23T09:15:45.061 INFO:tasks.workunit.client.0.smithi046.stdout: 10 910 0.36 MB/sec execute 272 sec latency 2983.672 ms 2024-01-23T09:15:46.061 INFO:tasks.workunit.client.0.smithi046.stdout: 10 911 0.36 MB/sec execute 273 sec latency 3983.774 ms 2024-01-23T09:15:47.061 INFO:tasks.workunit.client.0.smithi046.stdout: 10 911 0.36 MB/sec execute 274 sec latency 4983.874 ms 2024-01-23T09:15:48.061 INFO:tasks.workunit.client.0.smithi046.stdout: 10 913 0.36 MB/sec execute 275 sec latency 5009.082 ms 2024-01-23T09:15:49.061 INFO:tasks.workunit.client.0.smithi046.stdout: 10 913 0.36 MB/sec execute 276 sec latency 4748.369 ms 2024-01-23T09:15:50.061 INFO:tasks.workunit.client.0.smithi046.stdout: 10 915 0.36 MB/sec execute 277 sec latency 5748.434 ms 2024-01-23T09:15:51.061 INFO:tasks.workunit.client.0.smithi046.stdout: 10 916 0.36 MB/sec execute 278 sec latency 6748.530 ms 2024-01-23T09:15:51.979 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:15:51.982 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:15:52.061 INFO:tasks.workunit.client.0.smithi046.stdout: 10 917 0.35 MB/sec execute 279 sec latency 7748.609 ms 2024-01-23T09:15:53.062 INFO:tasks.workunit.client.0.smithi046.stdout: 10 921 0.35 MB/sec execute 280 sec latency 8748.693 ms 2024-01-23T09:15:54.062 INFO:tasks.workunit.client.0.smithi046.stdout: 10 924 0.35 MB/sec execute 281 sec latency 9298.763 ms 2024-01-23T09:15:55.062 INFO:tasks.workunit.client.0.smithi046.stdout: 10 926 0.35 MB/sec execute 282 sec latency 5356.488 ms 2024-01-23T09:15:56.062 INFO:tasks.workunit.client.0.smithi046.stdout: 10 927 0.35 MB/sec execute 283 sec latency 5172.005 ms 2024-01-23T09:15:57.062 INFO:tasks.workunit.client.0.smithi046.stdout: 10 928 0.35 MB/sec execute 284 sec latency 5258.334 ms 2024-01-23T09:15:58.062 INFO:tasks.workunit.client.0.smithi046.stdout: 10 928 0.35 MB/sec execute 285 sec latency 4586.996 ms 2024-01-23T09:15:59.062 INFO:tasks.workunit.client.0.smithi046.stdout: 10 928 0.35 MB/sec execute 286 sec latency 5246.660 ms 2024-01-23T09:16:00.062 INFO:tasks.workunit.client.0.smithi046.stdout: 10 928 0.35 MB/sec execute 287 sec latency 5267.040 ms 2024-01-23T09:16:01.062 INFO:tasks.workunit.client.0.smithi046.stdout: 10 928 0.34 MB/sec execute 288 sec latency 5927.196 ms 2024-01-23T09:16:02.062 INFO:tasks.workunit.client.0.smithi046.stdout: 10 929 0.34 MB/sec execute 289 sec latency 5895.706 ms 2024-01-23T09:16:03.063 INFO:tasks.workunit.client.0.smithi046.stdout: 10 929 0.34 MB/sec execute 290 sec latency 5704.119 ms 2024-01-23T09:16:04.063 INFO:tasks.workunit.client.0.smithi046.stdout: 10 929 0.34 MB/sec execute 291 sec latency 4188.183 ms 2024-01-23T09:16:05.063 INFO:tasks.workunit.client.0.smithi046.stdout: 10 930 0.34 MB/sec execute 292 sec latency 4407.577 ms 2024-01-23T09:16:06.063 INFO:tasks.workunit.client.0.smithi046.stdout: 10 930 0.34 MB/sec execute 293 sec latency 4339.957 ms 2024-01-23T09:16:07.063 INFO:tasks.workunit.client.0.smithi046.stdout: 10 931 0.34 MB/sec execute 294 sec latency 4660.495 ms 2024-01-23T09:16:08.063 INFO:tasks.workunit.client.0.smithi046.stdout: 10 931 0.34 MB/sec execute 295 sec latency 4227.443 ms 2024-01-23T09:16:09.063 INFO:tasks.workunit.client.0.smithi046.stdout: 10 932 0.34 MB/sec execute 296 sec latency 4563.014 ms 2024-01-23T09:16:10.063 INFO:tasks.workunit.client.0.smithi046.stdout: 10 934 0.33 MB/sec execute 297 sec latency 3342.020 ms 2024-01-23T09:16:11.063 INFO:tasks.workunit.client.0.smithi046.stdout: 10 935 0.33 MB/sec execute 298 sec latency 3985.434 ms 2024-01-23T09:16:12.063 INFO:tasks.workunit.client.0.smithi046.stdout: 10 935 0.33 MB/sec execute 299 sec latency 2788.506 ms 2024-01-23T09:16:13.063 INFO:tasks.workunit.client.0.smithi046.stdout: 10 936 0.33 MB/sec execute 300 sec latency 3788.578 ms 2024-01-23T09:16:14.063 INFO:tasks.workunit.client.0.smithi046.stdout: 10 937 0.33 MB/sec execute 301 sec latency 4277.972 ms 2024-01-23T09:16:15.063 INFO:tasks.workunit.client.0.smithi046.stdout: 10 938 0.33 MB/sec execute 302 sec latency 4604.197 ms 2024-01-23T09:16:16.063 INFO:tasks.workunit.client.0.smithi046.stdout: 10 939 0.33 MB/sec execute 303 sec latency 4722.015 ms 2024-01-23T09:16:17.064 INFO:tasks.workunit.client.0.smithi046.stdout: 10 941 0.33 MB/sec execute 304 sec latency 4289.519 ms 2024-01-23T09:16:18.064 INFO:tasks.workunit.client.0.smithi046.stdout: 10 943 0.33 MB/sec execute 305 sec latency 3959.033 ms 2024-01-23T09:16:19.064 INFO:tasks.workunit.client.0.smithi046.stdout: 10 944 0.32 MB/sec execute 306 sec latency 3682.253 ms 2024-01-23T09:16:20.064 INFO:tasks.workunit.client.0.smithi046.stdout: 10 946 0.32 MB/sec execute 307 sec latency 3915.898 ms 2024-01-23T09:16:21.064 INFO:tasks.workunit.client.0.smithi046.stdout: 10 947 0.32 MB/sec execute 308 sec latency 4843.119 ms 2024-01-23T09:16:22.027 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:16:22.030 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:16:22.064 INFO:tasks.workunit.client.0.smithi046.stdout: 10 950 0.32 MB/sec execute 309 sec latency 5020.785 ms 2024-01-23T09:16:23.064 INFO:tasks.workunit.client.0.smithi046.stdout: 10 953 0.32 MB/sec execute 310 sec latency 4625.979 ms 2024-01-23T09:16:24.064 INFO:tasks.workunit.client.0.smithi046.stdout: 10 955 0.32 MB/sec execute 311 sec latency 3886.111 ms 2024-01-23T09:16:25.064 INFO:tasks.workunit.client.0.smithi046.stdout: 10 957 0.32 MB/sec execute 312 sec latency 3634.403 ms 2024-01-23T09:16:26.064 INFO:tasks.workunit.client.0.smithi046.stdout: 10 961 0.32 MB/sec execute 313 sec latency 3611.274 ms 2024-01-23T09:16:27.064 INFO:tasks.workunit.client.0.smithi046.stdout: 10 962 0.32 MB/sec execute 314 sec latency 4611.359 ms 2024-01-23T09:16:28.064 INFO:tasks.workunit.client.0.smithi046.stdout: 10 966 0.32 MB/sec execute 315 sec latency 5083.268 ms 2024-01-23T09:16:29.064 INFO:tasks.workunit.client.0.smithi046.stdout: 10 969 0.32 MB/sec execute 316 sec latency 4713.014 ms 2024-01-23T09:16:30.064 INFO:tasks.workunit.client.0.smithi046.stdout: 10 972 0.32 MB/sec execute 317 sec latency 3729.892 ms 2024-01-23T09:16:31.065 INFO:tasks.workunit.client.0.smithi046.stdout: 10 973 0.32 MB/sec execute 318 sec latency 3966.280 ms 2024-01-23T09:16:32.065 INFO:tasks.workunit.client.0.smithi046.stdout: 10 974 0.32 MB/sec execute 319 sec latency 2241.141 ms 2024-01-23T09:16:33.065 INFO:tasks.workunit.client.0.smithi046.stdout: 10 976 0.32 MB/sec execute 320 sec latency 3241.234 ms 2024-01-23T09:16:34.065 INFO:tasks.workunit.client.0.smithi046.stdout: 10 978 0.31 MB/sec execute 321 sec latency 3835.439 ms 2024-01-23T09:16:35.065 INFO:tasks.workunit.client.0.smithi046.stdout: 10 981 0.31 MB/sec execute 322 sec latency 1416.545 ms 2024-01-23T09:16:36.065 INFO:tasks.workunit.client.0.smithi046.stdout: 10 983 0.31 MB/sec execute 323 sec latency 1728.427 ms 2024-01-23T09:16:37.065 INFO:tasks.workunit.client.0.smithi046.stdout: 10 984 0.31 MB/sec execute 324 sec latency 2728.521 ms 2024-01-23T09:16:38.065 INFO:tasks.workunit.client.0.smithi046.stdout: 10 986 0.31 MB/sec execute 325 sec latency 3472.531 ms 2024-01-23T09:16:39.065 INFO:tasks.workunit.client.0.smithi046.stdout: 10 987 0.31 MB/sec execute 326 sec latency 3724.504 ms 2024-01-23T09:16:40.065 INFO:tasks.workunit.client.0.smithi046.stdout: 10 987 0.31 MB/sec execute 327 sec latency 4531.884 ms 2024-01-23T09:16:41.066 INFO:tasks.workunit.client.0.smithi046.stdout: 10 988 0.31 MB/sec execute 328 sec latency 5531.978 ms 2024-01-23T09:16:42.066 INFO:tasks.workunit.client.0.smithi046.stdout: 10 988 0.31 MB/sec execute 329 sec latency 6532.069 ms 2024-01-23T09:16:43.066 INFO:tasks.workunit.client.0.smithi046.stdout: 10 992 0.31 MB/sec execute 330 sec latency 7532.142 ms 2024-01-23T09:16:44.066 INFO:tasks.workunit.client.0.smithi046.stdout: 10 995 0.31 MB/sec execute 331 sec latency 7990.647 ms 2024-01-23T09:16:45.066 INFO:tasks.workunit.client.0.smithi046.stdout: 10 997 0.31 MB/sec execute 332 sec latency 6357.639 ms 2024-01-23T09:16:46.066 INFO:tasks.workunit.client.0.smithi046.stdout: 10 999 0.31 MB/sec execute 333 sec latency 7183.564 ms 2024-01-23T09:16:47.066 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1003 0.31 MB/sec execute 334 sec latency 7361.989 ms 2024-01-23T09:16:48.066 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1008 0.31 MB/sec execute 335 sec latency 5996.429 ms 2024-01-23T09:16:49.066 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1012 0.31 MB/sec execute 336 sec latency 6487.286 ms 2024-01-23T09:16:50.066 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1013 0.31 MB/sec execute 337 sec latency 3922.588 ms 2024-01-23T09:16:51.066 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1013 0.31 MB/sec execute 338 sec latency 4922.682 ms 2024-01-23T09:16:52.066 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1015 0.31 MB/sec execute 339 sec latency 5922.775 ms 2024-01-23T09:16:52.094 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:16:52.096 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:16:53.066 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1018 0.31 MB/sec execute 340 sec latency 6063.793 ms 2024-01-23T09:16:54.067 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1021 0.32 MB/sec execute 341 sec latency 5252.001 ms 2024-01-23T09:16:55.067 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1023 0.32 MB/sec execute 342 sec latency 6252.097 ms 2024-01-23T09:16:56.067 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1027 0.32 MB/sec execute 343 sec latency 6876.316 ms 2024-01-23T09:16:57.067 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1030 0.32 MB/sec execute 344 sec latency 5549.033 ms 2024-01-23T09:16:58.067 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1031 0.32 MB/sec execute 345 sec latency 5341.081 ms 2024-01-23T09:16:59.067 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1031 0.32 MB/sec execute 346 sec latency 5754.717 ms 2024-01-23T09:17:00.067 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1032 0.32 MB/sec execute 347 sec latency 5241.282 ms 2024-01-23T09:17:01.067 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1032 0.32 MB/sec execute 348 sec latency 4936.010 ms 2024-01-23T09:17:02.067 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1033 0.32 MB/sec execute 349 sec latency 5437.645 ms 2024-01-23T09:17:03.067 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1034 0.32 MB/sec execute 350 sec latency 5710.747 ms 2024-01-23T09:17:04.067 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1037 0.31 MB/sec execute 351 sec latency 5462.345 ms 2024-01-23T09:17:05.067 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1038 0.31 MB/sec execute 352 sec latency 4857.576 ms 2024-01-23T09:17:06.068 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1039 0.31 MB/sec execute 353 sec latency 2947.201 ms 2024-01-23T09:17:07.068 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1041 0.31 MB/sec execute 354 sec latency 3947.298 ms 2024-01-23T09:17:08.068 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1042 0.31 MB/sec execute 355 sec latency 4945.773 ms 2024-01-23T09:17:09.068 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1043 0.31 MB/sec execute 356 sec latency 5040.782 ms 2024-01-23T09:17:10.068 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1045 0.31 MB/sec execute 357 sec latency 5503.315 ms 2024-01-23T09:17:11.068 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1046 0.31 MB/sec execute 358 sec latency 5325.309 ms 2024-01-23T09:17:12.068 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1047 0.31 MB/sec execute 359 sec latency 5742.925 ms 2024-01-23T09:17:13.068 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1049 0.31 MB/sec execute 360 sec latency 4944.436 ms 2024-01-23T09:17:14.068 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1050 0.31 MB/sec execute 361 sec latency 4537.879 ms 2024-01-23T09:17:15.068 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1050 0.31 MB/sec execute 362 sec latency 5142.505 ms 2024-01-23T09:17:16.068 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1050 0.30 MB/sec execute 363 sec latency 5176.750 ms 2024-01-23T09:17:17.068 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1051 0.30 MB/sec execute 364 sec latency 5339.075 ms 2024-01-23T09:17:18.069 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1051 0.30 MB/sec execute 365 sec latency 5101.687 ms 2024-01-23T09:17:19.069 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1051 0.30 MB/sec execute 366 sec latency 4397.621 ms 2024-01-23T09:17:20.069 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1052 0.30 MB/sec execute 367 sec latency 4681.538 ms 2024-01-23T09:17:21.069 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1053 0.30 MB/sec execute 368 sec latency 4721.504 ms 2024-01-23T09:17:22.069 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1053 0.30 MB/sec execute 369 sec latency 5330.898 ms 2024-01-23T09:17:22.153 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:17:22.156 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:17:23.069 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1055 0.30 MB/sec execute 370 sec latency 5583.281 ms 2024-01-23T09:17:24.071 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1055 0.30 MB/sec execute 371 sec latency 3933.757 ms 2024-01-23T09:17:25.069 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1056 0.30 MB/sec execute 372 sec latency 4933.822 ms 2024-01-23T09:17:25.753 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:24:03.100 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:17:25.770 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:24:03.116 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:17:25.811 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:24:03.096 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:17:25.814 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:24:03.099 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:17:25.828 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:24:03.113 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:17:25.828 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:24:03.114 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:17:26.026 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:24:03.373 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:17:26.053 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:24:03.338 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:17:26.054 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:24:03.340 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:17:26.069 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1059 0.30 MB/sec execute 373 sec latency 5217.823 ms 2024-01-23T09:17:27.069 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1060 0.30 MB/sec execute 374 sec latency 4892.163 ms 2024-01-23T09:17:28.069 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1063 0.29 MB/sec execute 375 sec latency 5380.185 ms 2024-01-23T09:17:29.069 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1065 0.29 MB/sec execute 376 sec latency 1466.859 ms 2024-01-23T09:17:30.069 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1068 0.29 MB/sec execute 377 sec latency 2006.301 ms 2024-01-23T09:17:31.070 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1071 0.29 MB/sec execute 378 sec latency 3006.395 ms 2024-01-23T09:17:32.070 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1071 0.29 MB/sec execute 379 sec latency 4006.456 ms 2024-01-23T09:17:33.070 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1071 0.29 MB/sec execute 380 sec latency 5006.542 ms 2024-01-23T09:17:34.070 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1073 0.29 MB/sec execute 381 sec latency 6006.637 ms 2024-01-23T09:17:35.070 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1074 0.29 MB/sec execute 382 sec latency 7006.732 ms 2024-01-23T09:17:36.070 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1078 0.29 MB/sec execute 383 sec latency 8006.784 ms 2024-01-23T09:17:37.070 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1079 0.29 MB/sec execute 384 sec latency 9006.875 ms 2024-01-23T09:17:38.070 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1079 0.29 MB/sec execute 385 sec latency 10006.968 ms 2024-01-23T09:17:39.070 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1080 0.29 MB/sec execute 386 sec latency 10061.678 ms 2024-01-23T09:17:40.070 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1082 0.29 MB/sec execute 387 sec latency 7515.002 ms 2024-01-23T09:17:41.070 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1085 0.29 MB/sec execute 388 sec latency 8427.518 ms 2024-01-23T09:17:42.070 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1088 0.29 MB/sec execute 389 sec latency 6708.323 ms 2024-01-23T09:17:43.070 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1091 0.28 MB/sec execute 390 sec latency 6740.250 ms 2024-01-23T09:17:44.071 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1093 0.28 MB/sec execute 391 sec latency 6245.171 ms 2024-01-23T09:17:45.071 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1095 0.28 MB/sec execute 392 sec latency 5770.491 ms 2024-01-23T09:17:46.071 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1097 0.28 MB/sec execute 393 sec latency 5928.380 ms 2024-01-23T09:17:47.072 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1098 0.28 MB/sec execute 394 sec latency 3235.351 ms 2024-01-23T09:17:48.071 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1099 0.28 MB/sec execute 395 sec latency 4235.442 ms 2024-01-23T09:17:49.071 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1100 0.28 MB/sec execute 396 sec latency 5144.248 ms 2024-01-23T09:17:50.071 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1102 0.28 MB/sec execute 397 sec latency 5375.925 ms 2024-01-23T09:17:51.071 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1105 0.28 MB/sec execute 398 sec latency 4487.893 ms 2024-01-23T09:17:52.071 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1106 0.28 MB/sec execute 399 sec latency 5487.964 ms 2024-01-23T09:17:52.199 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:17:52.202 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:17:53.071 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1107 0.28 MB/sec execute 400 sec latency 6488.050 ms 2024-01-23T09:17:54.071 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1108 0.28 MB/sec execute 401 sec latency 7163.566 ms 2024-01-23T09:17:55.071 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1110 0.28 MB/sec execute 402 sec latency 7007.553 ms 2024-01-23T09:17:56.072 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1112 0.28 MB/sec execute 403 sec latency 3384.074 ms 2024-01-23T09:17:57.071 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1112 0.28 MB/sec execute 404 sec latency 4384.144 ms 2024-01-23T09:17:58.072 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1112 0.27 MB/sec execute 405 sec latency 5384.210 ms 2024-01-23T09:17:59.072 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1114 0.27 MB/sec execute 406 sec latency 5500.607 ms 2024-01-23T09:18:00.072 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1117 0.27 MB/sec execute 407 sec latency 4444.455 ms 2024-01-23T09:18:01.072 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1121 0.27 MB/sec execute 408 sec latency 4229.444 ms 2024-01-23T09:18:02.072 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1123 0.27 MB/sec execute 409 sec latency 1782.770 ms 2024-01-23T09:18:03.072 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1124 0.27 MB/sec execute 410 sec latency 2782.842 ms 2024-01-23T09:18:04.072 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1125 0.27 MB/sec execute 411 sec latency 3782.908 ms 2024-01-23T09:18:05.072 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1127 0.27 MB/sec execute 412 sec latency 4782.996 ms 2024-01-23T09:18:06.072 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1128 0.27 MB/sec execute 413 sec latency 5783.055 ms 2024-01-23T09:18:07.072 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1131 0.27 MB/sec execute 414 sec latency 6098.256 ms 2024-01-23T09:18:08.072 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1133 0.27 MB/sec execute 415 sec latency 5112.399 ms 2024-01-23T09:18:09.072 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1134 0.27 MB/sec execute 416 sec latency 2367.343 ms 2024-01-23T09:18:10.072 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1137 0.27 MB/sec execute 417 sec latency 3367.413 ms 2024-01-23T09:18:11.072 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1142 0.27 MB/sec execute 418 sec latency 4108.577 ms 2024-01-23T09:18:12.073 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1143 0.27 MB/sec execute 419 sec latency 1633.708 ms 2024-01-23T09:18:12.128 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:24:49.474 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:18:12.136 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:24:49.483 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:18:12.186 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:24:49.532 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:18:12.254 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:24:49.539 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:18:12.257 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:24:49.542 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:18:12.262 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:24:49.547 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:18:12.263 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:24:49.549 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:18:12.315 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:24:49.600 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:18:12.320 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:24:49.606 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:18:13.073 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1145 0.27 MB/sec execute 420 sec latency 2633.804 ms 2024-01-23T09:18:14.073 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1147 0.26 MB/sec execute 421 sec latency 3633.868 ms 2024-01-23T09:18:15.073 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1150 0.26 MB/sec execute 422 sec latency 4259.192 ms 2024-01-23T09:18:16.073 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1152 0.26 MB/sec execute 423 sec latency 4265.651 ms 2024-01-23T09:18:17.073 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1154 0.26 MB/sec execute 424 sec latency 4688.111 ms 2024-01-23T09:18:18.073 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1156 0.26 MB/sec execute 425 sec latency 5362.301 ms 2024-01-23T09:18:19.073 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1158 0.26 MB/sec execute 426 sec latency 3574.996 ms 2024-01-23T09:18:20.073 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1158 0.26 MB/sec execute 427 sec latency 4575.083 ms 2024-01-23T09:18:21.073 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1159 0.26 MB/sec execute 428 sec latency 5575.177 ms 2024-01-23T09:18:22.073 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1161 0.26 MB/sec execute 429 sec latency 6575.275 ms 2024-01-23T09:18:22.322 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:18:22.325 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:18:23.073 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1161 0.26 MB/sec execute 430 sec latency 7575.370 ms 2024-01-23T09:18:24.074 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1161 0.26 MB/sec execute 431 sec latency 7748.629 ms 2024-01-23T09:18:25.074 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1163 0.26 MB/sec execute 432 sec latency 7611.124 ms 2024-01-23T09:18:26.074 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1165 0.26 MB/sec execute 433 sec latency 5475.947 ms 2024-01-23T09:18:27.074 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1165 0.26 MB/sec execute 434 sec latency 6476.032 ms 2024-01-23T09:18:28.074 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1166 0.26 MB/sec execute 435 sec latency 7476.122 ms 2024-01-23T09:18:29.074 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1168 0.26 MB/sec execute 436 sec latency 7596.719 ms 2024-01-23T09:18:30.074 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1169 0.26 MB/sec execute 437 sec latency 4809.546 ms 2024-01-23T09:18:31.074 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1169 0.26 MB/sec execute 438 sec latency 5204.040 ms 2024-01-23T09:18:32.074 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1171 0.25 MB/sec execute 439 sec latency 4823.857 ms 2024-01-23T09:18:33.074 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1172 0.25 MB/sec execute 440 sec latency 4919.744 ms 2024-01-23T09:18:34.074 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1172 0.25 MB/sec execute 441 sec latency 5029.790 ms 2024-01-23T09:18:35.074 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1173 0.25 MB/sec execute 442 sec latency 5113.909 ms 2024-01-23T09:18:36.075 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1173 0.25 MB/sec execute 443 sec latency 5000.116 ms 2024-01-23T09:18:37.075 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1174 0.25 MB/sec execute 444 sec latency 4904.519 ms 2024-01-23T09:18:38.075 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1175 0.25 MB/sec execute 445 sec latency 5192.535 ms 2024-01-23T09:18:39.075 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1176 0.25 MB/sec execute 446 sec latency 3425.683 ms 2024-01-23T09:18:40.075 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1176 0.25 MB/sec execute 447 sec latency 4425.756 ms 2024-01-23T09:18:41.075 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1177 0.25 MB/sec execute 448 sec latency 5105.341 ms 2024-01-23T09:18:42.075 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1178 0.25 MB/sec execute 449 sec latency 4742.470 ms 2024-01-23T09:18:43.075 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1179 0.25 MB/sec execute 450 sec latency 5156.561 ms 2024-01-23T09:18:44.075 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1181 0.25 MB/sec execute 451 sec latency 3334.189 ms 2024-01-23T09:18:45.075 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1182 0.25 MB/sec execute 452 sec latency 4334.259 ms 2024-01-23T09:18:46.075 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1184 0.25 MB/sec execute 453 sec latency 4988.594 ms 2024-01-23T09:18:47.075 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1184 0.25 MB/sec execute 454 sec latency 4260.747 ms 2024-01-23T09:18:48.075 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1186 0.25 MB/sec execute 455 sec latency 5260.823 ms 2024-01-23T09:18:49.075 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1187 0.25 MB/sec execute 456 sec latency 5794.329 ms 2024-01-23T09:18:50.076 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1189 0.24 MB/sec execute 457 sec latency 3290.398 ms 2024-01-23T09:18:51.076 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1191 0.24 MB/sec execute 458 sec latency 4290.466 ms 2024-01-23T09:18:52.076 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1192 0.24 MB/sec execute 459 sec latency 4912.908 ms 2024-01-23T09:18:52.370 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:18:52.373 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:18:53.076 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1195 0.24 MB/sec execute 460 sec latency 2124.686 ms 2024-01-23T09:18:54.076 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1197 0.24 MB/sec execute 461 sec latency 1594.861 ms 2024-01-23T09:18:55.076 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1199 0.24 MB/sec execute 462 sec latency 2594.919 ms 2024-01-23T09:18:56.076 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1201 0.24 MB/sec execute 463 sec latency 3595.013 ms 2024-01-23T09:18:57.076 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1204 0.24 MB/sec execute 464 sec latency 4595.093 ms 2024-01-23T09:18:58.076 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1207 0.24 MB/sec execute 465 sec latency 4921.987 ms 2024-01-23T09:18:59.076 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1210 0.24 MB/sec execute 466 sec latency 5103.232 ms 2024-01-23T09:19:00.076 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1213 0.24 MB/sec execute 467 sec latency 5385.519 ms 2024-01-23T09:19:01.076 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1214 0.24 MB/sec execute 468 sec latency 3071.476 ms 2024-01-23T09:19:02.076 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1215 0.24 MB/sec execute 469 sec latency 4071.576 ms 2024-01-23T09:19:03.077 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1216 0.24 MB/sec execute 470 sec latency 5071.652 ms 2024-01-23T09:19:04.077 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1218 0.24 MB/sec execute 471 sec latency 6071.724 ms 2024-01-23T09:19:05.077 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1219 0.24 MB/sec execute 472 sec latency 6098.669 ms 2024-01-23T09:19:06.077 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1222 0.24 MB/sec execute 473 sec latency 6504.033 ms 2024-01-23T09:19:07.077 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1223 0.24 MB/sec execute 474 sec latency 6018.381 ms 2024-01-23T09:19:08.077 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1224 0.24 MB/sec execute 475 sec latency 6722.705 ms 2024-01-23T09:19:09.077 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1226 0.24 MB/sec execute 476 sec latency 5197.442 ms 2024-01-23T09:19:10.077 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1231 0.24 MB/sec execute 477 sec latency 4525.993 ms 2024-01-23T09:19:11.079 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1232 0.23 MB/sec execute 478 sec latency 5379.160 ms 2024-01-23T09:19:12.077 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1234 0.23 MB/sec execute 479 sec latency 6018.569 ms 2024-01-23T09:19:13.077 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1234 0.23 MB/sec execute 480 sec latency 2802.399 ms 2024-01-23T09:19:14.077 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1238 0.23 MB/sec execute 481 sec latency 3802.454 ms 2024-01-23T09:19:15.078 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1239 0.23 MB/sec execute 482 sec latency 4802.542 ms 2024-01-23T09:19:16.078 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1242 0.23 MB/sec execute 483 sec latency 5802.612 ms 2024-01-23T09:19:17.078 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1244 0.23 MB/sec execute 484 sec latency 6802.691 ms 2024-01-23T09:19:18.078 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1246 0.23 MB/sec execute 485 sec latency 7419.097 ms 2024-01-23T09:19:19.078 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1248 0.23 MB/sec execute 486 sec latency 2566.103 ms 2024-01-23T09:19:20.078 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1250 0.23 MB/sec execute 487 sec latency 2159.198 ms 2024-01-23T09:19:21.078 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1253 0.23 MB/sec execute 488 sec latency 3159.265 ms 2024-01-23T09:19:22.078 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1256 0.23 MB/sec execute 489 sec latency 4159.351 ms 2024-01-23T09:19:22.664 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:19:22.667 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:19:23.078 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1258 0.23 MB/sec execute 490 sec latency 5159.441 ms 2024-01-23T09:19:24.078 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1258 0.23 MB/sec execute 491 sec latency 6159.539 ms 2024-01-23T09:19:25.078 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1259 0.23 MB/sec execute 492 sec latency 6259.427 ms 2024-01-23T09:19:26.078 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1260 0.23 MB/sec execute 493 sec latency 6938.101 ms 2024-01-23T09:19:27.078 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1263 0.23 MB/sec execute 494 sec latency 7938.175 ms 2024-01-23T09:19:28.079 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1269 0.23 MB/sec execute 495 sec latency 8938.253 ms 2024-01-23T09:19:29.079 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1270 0.23 MB/sec execute 496 sec latency 9754.907 ms 2024-01-23T09:19:30.079 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1270 0.23 MB/sec execute 497 sec latency 9416.272 ms 2024-01-23T09:19:31.079 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1270 0.23 MB/sec execute 498 sec latency 6398.330 ms 2024-01-23T09:19:32.079 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1272 0.23 MB/sec execute 499 sec latency 6956.318 ms 2024-01-23T09:19:33.079 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1272 0.23 MB/sec execute 500 sec latency 5709.835 ms 2024-01-23T09:19:34.079 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1274 0.23 MB/sec execute 501 sec latency 6230.700 ms 2024-01-23T09:19:35.079 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1276 0.23 MB/sec execute 502 sec latency 4899.211 ms 2024-01-23T09:19:36.079 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1277 0.23 MB/sec execute 503 sec latency 4307.691 ms 2024-01-23T09:19:37.079 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1280 0.23 MB/sec execute 504 sec latency 4928.682 ms 2024-01-23T09:19:37.997 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:26:15.343 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:19:38.002 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:26:15.349 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:19:38.048 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:26:15.395 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:19:38.079 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1285 0.23 MB/sec execute 505 sec latency 4647.120 ms 2024-01-23T09:19:38.125 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:26:15.410 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:19:38.126 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:26:15.412 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:19:38.129 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:26:15.415 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:19:38.133 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:26:15.419 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:19:38.202 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:26:15.488 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:19:38.217 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:26:15.503 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:19:39.079 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1288 0.23 MB/sec execute 506 sec latency 4688.195 ms 2024-01-23T09:19:40.079 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1289 0.23 MB/sec execute 507 sec latency 5375.652 ms 2024-01-23T09:19:41.080 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1289 0.23 MB/sec execute 508 sec latency 6373.002 ms 2024-01-23T09:19:42.080 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1289 0.23 MB/sec execute 509 sec latency 5503.703 ms 2024-01-23T09:19:43.080 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1289 0.23 MB/sec execute 510 sec latency 6503.778 ms 2024-01-23T09:19:44.080 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1289 0.23 MB/sec execute 511 sec latency 7433.592 ms 2024-01-23T09:19:45.080 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1290 0.23 MB/sec execute 512 sec latency 7668.479 ms 2024-01-23T09:19:46.080 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1291 0.23 MB/sec execute 513 sec latency 6059.669 ms 2024-01-23T09:19:47.080 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1291 0.23 MB/sec execute 514 sec latency 5412.011 ms 2024-01-23T09:19:48.080 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1292 0.23 MB/sec execute 515 sec latency 4356.004 ms 2024-01-23T09:19:49.080 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1302 0.23 MB/sec execute 516 sec latency 4677.794 ms 2024-01-23T09:19:50.080 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1310 0.24 MB/sec execute 517 sec latency 5043.466 ms 2024-01-23T09:19:51.080 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1319 0.24 MB/sec execute 518 sec latency 4977.693 ms 2024-01-23T09:19:52.080 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1319 0.24 MB/sec execute 519 sec latency 5083.284 ms 2024-01-23T09:19:52.719 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:19:52.723 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:19:53.080 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1320 0.24 MB/sec execute 520 sec latency 5189.198 ms 2024-01-23T09:19:54.081 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1321 0.24 MB/sec execute 521 sec latency 5013.398 ms 2024-01-23T09:19:55.084 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1322 0.24 MB/sec execute 522 sec latency 5096.263 ms 2024-01-23T09:19:56.081 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1323 0.24 MB/sec execute 523 sec latency 4940.873 ms 2024-01-23T09:19:57.081 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1323 0.24 MB/sec execute 524 sec latency 3657.005 ms 2024-01-23T09:19:58.081 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1323 0.24 MB/sec execute 525 sec latency 4609.012 ms 2024-01-23T09:19:59.081 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1325 0.24 MB/sec execute 526 sec latency 4340.968 ms 2024-01-23T09:20:00.081 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1342 0.25 MB/sec execute 527 sec latency 5340.193 ms 2024-01-23T09:20:01.081 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1348 0.25 MB/sec execute 528 sec latency 5401.756 ms 2024-01-23T09:20:02.081 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1360 0.26 MB/sec execute 529 sec latency 4696.236 ms 2024-01-23T09:20:03.081 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1374 0.26 MB/sec execute 530 sec latency 3287.890 ms 2024-01-23T09:20:04.081 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1380 0.27 MB/sec execute 531 sec latency 4287.978 ms 2024-01-23T09:20:05.082 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1381 0.27 MB/sec execute 532 sec latency 5078.695 ms 2024-01-23T09:20:06.082 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1382 0.27 MB/sec execute 533 sec latency 5147.358 ms 2024-01-23T09:20:07.082 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1382 0.26 MB/sec execute 534 sec latency 4973.419 ms 2024-01-23T09:20:08.082 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1383 0.26 MB/sec execute 535 sec latency 4806.515 ms 2024-01-23T09:20:09.082 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1383 0.26 MB/sec execute 536 sec latency 4244.622 ms 2024-01-23T09:20:10.082 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1383 0.26 MB/sec execute 537 sec latency 4255.875 ms 2024-01-23T09:20:11.082 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1384 0.26 MB/sec execute 538 sec latency 4738.818 ms 2024-01-23T09:20:12.082 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1386 0.26 MB/sec execute 539 sec latency 4828.947 ms 2024-01-23T09:20:13.082 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1387 0.26 MB/sec execute 540 sec latency 4755.782 ms 2024-01-23T09:20:14.082 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1388 0.26 MB/sec execute 541 sec latency 4964.791 ms 2024-01-23T09:20:15.082 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1390 0.26 MB/sec execute 542 sec latency 5360.135 ms 2024-01-23T09:20:16.082 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1391 0.26 MB/sec execute 543 sec latency 4512.231 ms 2024-01-23T09:20:17.082 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1391 0.26 MB/sec execute 544 sec latency 5512.300 ms 2024-01-23T09:20:18.082 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1392 0.26 MB/sec execute 545 sec latency 6005.097 ms 2024-01-23T09:20:19.083 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1393 0.26 MB/sec execute 546 sec latency 4923.889 ms 2024-01-23T09:20:20.083 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1394 0.26 MB/sec execute 547 sec latency 4741.116 ms 2024-01-23T09:20:21.083 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1395 0.26 MB/sec execute 548 sec latency 4580.126 ms 2024-01-23T09:20:22.083 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1395 0.26 MB/sec execute 549 sec latency 4542.845 ms 2024-01-23T09:20:22.765 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:20:22.768 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:20:23.083 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1395 0.26 MB/sec execute 550 sec latency 4955.719 ms 2024-01-23T09:20:24.083 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1397 0.26 MB/sec execute 551 sec latency 5064.717 ms 2024-01-23T09:20:25.083 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1399 0.26 MB/sec execute 552 sec latency 5290.259 ms 2024-01-23T09:20:26.083 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1403 0.26 MB/sec execute 553 sec latency 5340.673 ms 2024-01-23T09:20:27.083 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1404 0.26 MB/sec execute 554 sec latency 5930.383 ms 2024-01-23T09:20:28.083 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1407 0.26 MB/sec execute 555 sec latency 3582.626 ms 2024-01-23T09:20:29.083 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1408 0.25 MB/sec execute 556 sec latency 4478.101 ms 2024-01-23T09:20:30.084 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1408 0.25 MB/sec execute 557 sec latency 3799.623 ms 2024-01-23T09:20:31.084 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1409 0.25 MB/sec execute 558 sec latency 4102.870 ms 2024-01-23T09:20:32.084 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1409 0.25 MB/sec execute 559 sec latency 4378.264 ms 2024-01-23T09:20:33.084 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1411 0.25 MB/sec execute 560 sec latency 3358.783 ms 2024-01-23T09:20:34.084 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1411 0.25 MB/sec execute 561 sec latency 4358.859 ms 2024-01-23T09:20:35.084 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1412 0.25 MB/sec execute 562 sec latency 5358.957 ms 2024-01-23T09:20:36.084 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1415 0.25 MB/sec execute 563 sec latency 5761.631 ms 2024-01-23T09:20:37.084 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1416 0.25 MB/sec execute 564 sec latency 6318.191 ms 2024-01-23T09:20:38.084 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1420 0.25 MB/sec execute 565 sec latency 6808.453 ms 2024-01-23T09:20:39.084 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1421 0.25 MB/sec execute 566 sec latency 7008.817 ms 2024-01-23T09:20:40.087 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1423 0.25 MB/sec execute 567 sec latency 6215.121 ms 2024-01-23T09:20:41.084 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1426 0.25 MB/sec execute 568 sec latency 7191.559 ms 2024-01-23T09:20:42.084 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1428 0.25 MB/sec execute 569 sec latency 7385.529 ms 2024-01-23T09:20:43.085 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1430 0.25 MB/sec execute 570 sec latency 4013.223 ms 2024-01-23T09:20:44.085 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1430 0.25 MB/sec execute 571 sec latency 5013.322 ms 2024-01-23T09:20:45.085 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1430 0.25 MB/sec execute 572 sec latency 6013.416 ms 2024-01-23T09:20:46.085 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1432 0.25 MB/sec execute 573 sec latency 6491.459 ms 2024-01-23T09:20:47.085 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1433 0.25 MB/sec execute 574 sec latency 5823.650 ms 2024-01-23T09:20:48.085 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1434 0.25 MB/sec execute 575 sec latency 6823.721 ms 2024-01-23T09:20:49.086 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1434 0.25 MB/sec execute 576 sec latency 7823.817 ms 2024-01-23T09:20:50.085 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1436 0.25 MB/sec execute 577 sec latency 8337.321 ms 2024-01-23T09:20:51.085 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1437 0.25 MB/sec execute 578 sec latency 4883.167 ms 2024-01-23T09:20:52.085 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1438 0.24 MB/sec execute 579 sec latency 5883.232 ms 2024-01-23T09:20:52.869 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:20:52.873 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:20:53.085 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1439 0.24 MB/sec execute 580 sec latency 6117.166 ms 2024-01-23T09:20:53.105 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:27:30.451 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:20:53.120 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:27:30.466 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:20:53.154 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:27:30.440 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:20:53.155 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:27:30.440 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:20:53.164 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:27:30.450 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:20:53.176 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:27:30.462 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:20:53.273 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:27:30.619 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:20:53.300 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:27:30.586 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:20:53.312 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:27:30.598 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:20:54.085 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1443 0.24 MB/sec execute 581 sec latency 1467.634 ms 2024-01-23T09:20:55.086 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1445 0.24 MB/sec execute 582 sec latency 1363.145 ms 2024-01-23T09:20:56.086 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1446 0.24 MB/sec execute 583 sec latency 2030.741 ms 2024-01-23T09:20:57.086 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1447 0.24 MB/sec execute 584 sec latency 3030.833 ms 2024-01-23T09:20:58.086 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1450 0.24 MB/sec execute 585 sec latency 4030.927 ms 2024-01-23T09:20:59.086 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1453 0.24 MB/sec execute 586 sec latency 4704.885 ms 2024-01-23T09:21:00.086 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1457 0.24 MB/sec execute 587 sec latency 1962.706 ms 2024-01-23T09:21:01.086 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1458 0.24 MB/sec execute 588 sec latency 2962.761 ms 2024-01-23T09:21:02.086 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1459 0.24 MB/sec execute 589 sec latency 3962.857 ms 2024-01-23T09:21:03.086 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1459 0.24 MB/sec execute 590 sec latency 4962.938 ms 2024-01-23T09:21:04.086 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1460 0.24 MB/sec execute 591 sec latency 5963.014 ms 2024-01-23T09:21:05.086 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1460 0.24 MB/sec execute 592 sec latency 6963.112 ms 2024-01-23T09:21:06.086 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1461 0.24 MB/sec execute 593 sec latency 7963.203 ms 2024-01-23T09:21:07.086 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1463 0.24 MB/sec execute 594 sec latency 8482.328 ms 2024-01-23T09:21:08.087 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1464 0.24 MB/sec execute 595 sec latency 8668.561 ms 2024-01-23T09:21:09.087 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1466 0.24 MB/sec execute 596 sec latency 9059.788 ms 2024-01-23T09:21:10.087 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1467 0.24 MB/sec execute 597 sec latency 8018.761 ms 2024-01-23T09:21:11.087 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1469 0.24 MB/sec execute 598 sec latency 8182.787 ms 2024-01-23T09:21:12.087 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1470 0.24 MB/sec execute 599 sec latency 4224.674 ms 2024-01-23T09:21:13.087 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 600 sec 2024-01-23T09:21:14.087 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 601 sec 2024-01-23T09:21:15.087 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 602 sec 2024-01-23T09:21:16.087 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 603 sec 2024-01-23T09:21:17.087 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 604 sec 2024-01-23T09:21:18.087 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 605 sec 2024-01-23T09:21:19.087 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 606 sec 2024-01-23T09:21:20.088 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 607 sec 2024-01-23T09:21:21.088 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 608 sec 2024-01-23T09:21:22.088 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 609 sec 2024-01-23T09:21:23.038 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:21:23.041 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:21:23.087 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 610 sec 2024-01-23T09:21:24.088 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 611 sec 2024-01-23T09:21:25.088 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 612 sec 2024-01-23T09:21:26.088 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 613 sec 2024-01-23T09:21:27.088 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 614 sec 2024-01-23T09:21:28.088 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 615 sec 2024-01-23T09:21:29.088 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 616 sec 2024-01-23T09:21:30.088 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 617 sec 2024-01-23T09:21:31.088 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 618 sec 2024-01-23T09:21:32.089 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 619 sec 2024-01-23T09:21:33.088 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 620 sec 2024-01-23T09:21:34.089 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 621 sec 2024-01-23T09:21:35.089 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 622 sec 2024-01-23T09:21:36.089 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 623 sec 2024-01-23T09:21:37.089 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 624 sec 2024-01-23T09:21:38.089 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 625 sec 2024-01-23T09:21:39.089 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 626 sec 2024-01-23T09:21:40.089 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 627 sec 2024-01-23T09:21:41.089 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 628 sec 2024-01-23T09:21:42.089 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 629 sec 2024-01-23T09:21:43.089 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 630 sec 2024-01-23T09:21:44.090 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 631 sec 2024-01-23T09:21:45.089 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 632 sec 2024-01-23T09:21:46.090 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 633 sec 2024-01-23T09:21:47.090 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 634 sec 2024-01-23T09:21:48.090 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 635 sec 2024-01-23T09:21:49.090 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 636 sec 2024-01-23T09:21:50.090 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 637 sec 2024-01-23T09:21:51.090 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 638 sec 2024-01-23T09:21:52.090 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 639 sec 2024-01-23T09:21:53.090 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 640 sec 2024-01-23T09:21:53.102 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:21:53.105 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:21:54.090 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 641 sec 2024-01-23T09:21:55.090 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 642 sec 2024-01-23T09:21:56.090 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 643 sec 2024-01-23T09:21:57.090 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 644 sec 2024-01-23T09:21:58.090 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 645 sec 2024-01-23T09:21:59.090 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 646 sec 2024-01-23T09:22:00.091 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 647 sec 2024-01-23T09:22:01.091 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 648 sec 2024-01-23T09:22:02.091 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 649 sec 2024-01-23T09:22:03.091 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 650 sec 2024-01-23T09:22:04.091 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 651 sec 2024-01-23T09:22:05.091 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 652 sec 2024-01-23T09:22:06.091 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 653 sec 2024-01-23T09:22:07.091 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 654 sec 2024-01-23T09:22:08.091 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 655 sec 2024-01-23T09:22:09.091 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 656 sec 2024-01-23T09:22:10.091 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 657 sec 2024-01-23T09:22:11.091 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 658 sec 2024-01-23T09:22:12.091 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 659 sec 2024-01-23T09:22:13.092 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 660 sec 2024-01-23T09:22:14.092 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 661 sec 2024-01-23T09:22:15.092 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 662 sec 2024-01-23T09:22:16.092 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 663 sec 2024-01-23T09:22:17.092 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 664 sec 2024-01-23T09:22:18.092 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 665 sec 2024-01-23T09:22:19.092 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 666 sec 2024-01-23T09:22:20.092 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 667 sec 2024-01-23T09:22:21.092 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 668 sec 2024-01-23T09:22:22.092 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 669 sec 2024-01-23T09:22:23.092 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 670 sec 2024-01-23T09:22:23.235 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:22:23.238 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:22:24.092 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 671 sec 2024-01-23T09:22:25.092 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 672 sec 2024-01-23T09:22:26.092 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 673 sec 2024-01-23T09:22:27.092 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 674 sec 2024-01-23T09:22:28.093 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 675 sec 2024-01-23T09:22:29.093 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 676 sec 2024-01-23T09:22:30.093 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 677 sec 2024-01-23T09:22:31.093 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 678 sec 2024-01-23T09:22:32.093 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 679 sec 2024-01-23T09:22:33.093 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 680 sec 2024-01-23T09:22:34.093 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 681 sec 2024-01-23T09:22:35.093 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 682 sec 2024-01-23T09:22:36.093 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 683 sec 2024-01-23T09:22:37.093 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 684 sec 2024-01-23T09:22:38.093 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 685 sec 2024-01-23T09:22:39.093 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 686 sec 2024-01-23T09:22:40.094 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 687 sec 2024-01-23T09:22:41.094 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 688 sec 2024-01-23T09:22:42.094 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 689 sec 2024-01-23T09:22:43.094 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 690 sec 2024-01-23T09:22:44.094 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 691 sec 2024-01-23T09:22:45.094 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 692 sec 2024-01-23T09:22:46.095 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 693 sec 2024-01-23T09:22:47.094 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 694 sec 2024-01-23T09:22:48.094 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 695 sec 2024-01-23T09:22:49.094 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 696 sec 2024-01-23T09:22:50.094 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 697 sec 2024-01-23T09:22:51.094 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 698 sec 2024-01-23T09:22:52.095 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 699 sec 2024-01-23T09:22:53.095 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 700 sec 2024-01-23T09:22:53.331 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:22:53.334 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:22:54.095 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 701 sec 2024-01-23T09:22:55.095 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 702 sec 2024-01-23T09:22:56.095 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 703 sec 2024-01-23T09:22:57.095 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 704 sec 2024-01-23T09:22:58.095 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 705 sec 2024-01-23T09:22:59.095 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 706 sec 2024-01-23T09:23:00.095 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 707 sec 2024-01-23T09:23:01.095 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 708 sec 2024-01-23T09:23:02.095 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 709 sec 2024-01-23T09:23:03.095 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 710 sec 2024-01-23T09:23:04.095 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 711 sec 2024-01-23T09:23:05.095 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 712 sec 2024-01-23T09:23:06.096 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 713 sec 2024-01-23T09:23:07.096 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 714 sec 2024-01-23T09:23:08.096 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 715 sec 2024-01-23T09:23:09.096 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 716 sec 2024-01-23T09:23:10.096 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 717 sec 2024-01-23T09:23:11.096 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 718 sec 2024-01-23T09:23:12.096 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 719 sec 2024-01-23T09:23:13.096 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 720 sec 2024-01-23T09:23:14.096 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 721 sec 2024-01-23T09:23:15.096 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 722 sec 2024-01-23T09:23:16.096 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 723 sec 2024-01-23T09:23:17.096 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 724 sec 2024-01-23T09:23:18.096 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 725 sec 2024-01-23T09:23:19.097 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 726 sec 2024-01-23T09:23:20.097 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 727 sec 2024-01-23T09:23:21.097 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 728 sec 2024-01-23T09:23:22.097 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 729 sec 2024-01-23T09:23:23.097 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 730 sec 2024-01-23T09:23:23.427 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:23:23.430 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:23:24.097 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 731 sec 2024-01-23T09:23:25.097 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 732 sec 2024-01-23T09:23:26.097 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 733 sec 2024-01-23T09:23:27.097 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 734 sec 2024-01-23T09:23:28.097 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 735 sec 2024-01-23T09:23:29.097 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 736 sec 2024-01-23T09:23:30.097 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 737 sec 2024-01-23T09:23:31.097 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 738 sec 2024-01-23T09:23:32.098 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 739 sec 2024-01-23T09:23:33.098 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 740 sec 2024-01-23T09:23:34.098 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 741 sec 2024-01-23T09:23:35.098 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 742 sec 2024-01-23T09:23:36.098 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 743 sec 2024-01-23T09:23:37.098 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 744 sec 2024-01-23T09:23:38.098 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 745 sec 2024-01-23T09:23:39.098 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 746 sec 2024-01-23T09:23:40.098 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 747 sec 2024-01-23T09:23:41.098 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 748 sec 2024-01-23T09:23:42.098 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 749 sec 2024-01-23T09:23:43.098 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 750 sec 2024-01-23T09:23:44.099 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 751 sec 2024-01-23T09:23:45.099 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 752 sec 2024-01-23T09:23:46.099 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 753 sec 2024-01-23T09:23:47.099 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 754 sec 2024-01-23T09:23:48.099 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 755 sec 2024-01-23T09:23:49.099 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 756 sec 2024-01-23T09:23:50.099 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 757 sec 2024-01-23T09:23:51.099 INFO:tasks.workunit.client.0.smithi046.stdout: 9 cleanup 758 sec 2024-01-23T09:23:52.099 INFO:tasks.workunit.client.0.smithi046.stdout: 7 cleanup 759 sec 2024-01-23T09:23:53.099 INFO:tasks.workunit.client.0.smithi046.stdout: 4 cleanup 760 sec 2024-01-23T09:23:53.557 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:23:53.561 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:23:54.099 INFO:tasks.workunit.client.0.smithi046.stdout: 2 cleanup 761 sec 2024-01-23T09:23:55.099 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 762 sec 2024-01-23T09:23:55.480 INFO:tasks.workunit.client.0.smithi046.stdout: 0 cleanup 762 sec 2024-01-23T09:23:55.480 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-01-23T09:23:55.480 INFO:tasks.workunit.client.0.smithi046.stdout: Operation Count AvgLat MaxLat 2024-01-23T09:23:55.480 INFO:tasks.workunit.client.0.smithi046.stdout: ---------------------------------------- 2024-01-23T09:23:55.480 INFO:tasks.workunit.client.0.smithi046.stdout: NTCreateX 1612 1157.902 6289.006 2024-01-23T09:23:55.480 INFO:tasks.workunit.client.0.smithi046.stdout: Close 1469 8.647 91.662 2024-01-23T09:23:55.480 INFO:tasks.workunit.client.0.smithi046.stdout: Rename 100 2366.827 5427.638 2024-01-23T09:23:55.480 INFO:tasks.workunit.client.0.smithi046.stdout: Unlink 191 759.460 2417.002 2024-01-23T09:23:55.480 INFO:tasks.workunit.client.0.smithi046.stdout: Qpathinfo 1104 561.904 5009.061 2024-01-23T09:23:55.481 INFO:tasks.workunit.client.0.smithi046.stdout: Qfileinfo 594 30.068 209.989 2024-01-23T09:23:55.481 INFO:tasks.workunit.client.0.smithi046.stdout: Qfsinfo 330 79.573 304.560 2024-01-23T09:23:55.481 INFO:tasks.workunit.client.0.smithi046.stdout: Sfileinfo 340 172.027 612.332 2024-01-23T09:23:55.481 INFO:tasks.workunit.client.0.smithi046.stdout: Find 500 5440.031 10757.961 2024-01-23T09:23:55.481 INFO:tasks.workunit.client.0.smithi046.stdout: WriteX 2682 47.032 394.714 2024-01-23T09:23:55.481 INFO:tasks.workunit.client.0.smithi046.stdout: ReadX 2290 0.245 34.807 2024-01-23T09:23:55.481 INFO:tasks.workunit.client.0.smithi046.stdout: Flush 244 775.756 2578.669 2024-01-23T09:23:55.481 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-01-23T09:23:55.481 INFO:tasks.workunit.client.0.smithi046.stdout:Throughput 0.236868 MB/sec 10 clients 10 procs max_latency=10757.974 ms 2024-01-23T09:23:55.482 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-01-23T09:23:55.482 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-01-23T09:24:20.361 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:30:57.707 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:24:20.416 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:30:57.762 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:24:20.416 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:30:57.703 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:24:20.421 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:30:57.707 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:24:20.429 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:30:57.716 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:24:20.433 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:30:57.719 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:24:20.600 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:30:57.886 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:24:20.623 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:30:57.910 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:24:20.678 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:30:58.024 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:24:23.653 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:24:23.656 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:24:52.498 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-01-23T09:24:52.498 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-01-23T09:24:52.830 DEBUG:teuthology.parallel:result is None 2024-01-23T09:24:52.830 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-01-23T09:24:53.555 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-01-23T09:24:53.555 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-01-23T09:24:53.565 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-01-23T09:24:53.565 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T09:24:53.565 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-23T09:24:53.572 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T09:24:53.572 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-23T09:24:53.621 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-23T09:24:53.724 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:24:53.726 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:24:53.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.790+0000 7f947cb34640 1 Processor -- start 2024-01-23T09:24:53.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.790+0000 7f947cb34640 1 -- start start 2024-01-23T09:24:53.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.794+0000 7f947cb34640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f94781519e0 0x7f947815b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:53.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.794+0000 7f947cb34640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9478158390 con 0x7f947806f350 2024-01-23T09:24:53.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.794+0000 7f947cb34640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f947815b0e0 con 0x7f9478151600 2024-01-23T09:24:53.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.794+0000 7f947cb34640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9478157b70 con 0x7f94781519e0 2024-01-23T09:24:53.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.794+0000 7f9475d9b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f94781519e0 0x7f947815b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:53.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.794+0000 7f947659c640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f9478151600 0x7f9478157460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.46:34914/0 (socket says 172.21.15.46:34914) 2024-01-23T09:24:53.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.794+0000 7f947659c640 1 -- 172.21.15.46:0/2506237668 learned_addr learned my addr 172.21.15.46:0/2506237668 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T09:24:53.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.798+0000 7f9475d9b640 1 -- 172.21.15.46:0/2506237668 >> v1:172.21.15.175:6789/0 conn(0x7f9478151600 legacy=0x7f9478157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:53.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.798+0000 7f9475d9b640 1 -- 172.21.15.46:0/2506237668 >> v1:172.21.15.46:6789/0 conn(0x7f947806f350 legacy=0x7f94780cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:53.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.798+0000 7f9475d9b640 1 -- 172.21.15.46:0/2506237668 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9478157dd0 con 0x7f94781519e0 2024-01-23T09:24:53.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.802+0000 7f9475d9b640 1 --2- 172.21.15.46:0/2506237668 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94781519e0 0x7f947815b570 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f946c009d90 tx=0x7f946c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a72e3066f625029 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:24:53.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.810+0000 7f947559a640 1 -- 172.21.15.46:0/2506237668 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c0a59e0 con 0x7f94781519e0 2024-01-23T09:24:53.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.810+0000 7f947559a640 1 -- 172.21.15.46:0/2506237668 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946c0a5b40 con 0x7f94781519e0 2024-01-23T09:24:53.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.810+0000 7f947559a640 1 -- 172.21.15.46:0/2506237668 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c0ad440 con 0x7f94781519e0 2024-01-23T09:24:53.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.810+0000 7f947cb34640 1 -- 172.21.15.46:0/2506237668 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94781519e0 msgr2=0x7f947815b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:53.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.810+0000 7f947cb34640 1 --2- 172.21.15.46:0/2506237668 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94781519e0 0x7f947815b570 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f946c009d90 tx=0x7f946c01c920 comp rx=0 tx=0).stop 2024-01-23T09:24:53.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.810+0000 7f947cb34640 1 -- 172.21.15.46:0/2506237668 shutdown_connections 2024-01-23T09:24:53.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.810+0000 7f947cb34640 1 --2- 172.21.15.46:0/2506237668 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94781519e0 0x7f947815b570 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:53.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.810+0000 7f947cb34640 1 -- 172.21.15.46:0/2506237668 >> 172.21.15.46:0/2506237668 conn(0x7f947806d590 msgr2=0x7f9478066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:24:53.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.810+0000 7f947cb34640 1 -- 172.21.15.46:0/2506237668 shutdown_connections 2024-01-23T09:24:53.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.810+0000 7f947cb34640 1 -- 172.21.15.46:0/2506237668 wait complete. 2024-01-23T09:24:53.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.814+0000 7f947cb34640 1 Processor -- start 2024-01-23T09:24:53.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.814+0000 7f947cb34640 1 -- start start 2024-01-23T09:24:53.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.814+0000 7f947cb34640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f947806f350 0x7f94780c4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:53.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.814+0000 7f947cb34640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9478151600 0x7f947814aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:53.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.814+0000 7f947cb34640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94781428e0 0x7f94780c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:53.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.814+0000 7f947cb34640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94780bfe80 con 0x7f9478151600 2024-01-23T09:24:53.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.814+0000 7f947cb34640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94780c3ca0 con 0x7f94781428e0 2024-01-23T09:24:53.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.814+0000 7f947cb34640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94780cab90 con 0x7f947806f350 2024-01-23T09:24:53.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.814+0000 7f9475d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9478151600 0x7f947814aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:53.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.814+0000 7f9475d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9478151600 0x7f947814aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53548/0 (socket says 172.21.15.46:53548) 2024-01-23T09:24:53.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.814+0000 7f9475d9b640 1 -- 172.21.15.46:0/103066782 learned_addr learned my addr 172.21.15.46:0/103066782 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:24:53.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.814+0000 7f947659c640 1 --2- 172.21.15.46:0/103066782 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f947806f350 0x7f94780c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:53.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.814+0000 7f9476d9d640 1 --2- 172.21.15.46:0/103066782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94781428e0 0x7f94780c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:53.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.818+0000 7f9475d9b640 1 -- 172.21.15.46:0/103066782 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f947806f350 msgr2=0x7f94780c4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:53.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.818+0000 7f9475d9b640 1 --2- 172.21.15.46:0/103066782 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f947806f350 0x7f94780c4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:53.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.818+0000 7f9475d9b640 1 -- 172.21.15.46:0/103066782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94781428e0 msgr2=0x7f94780c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:53.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.818+0000 7f9475d9b640 1 --2- 172.21.15.46:0/103066782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94781428e0 0x7f94780c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:53.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.818+0000 7f9475d9b640 1 -- 172.21.15.46:0/103066782 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f946c009a70 con 0x7f9478151600 2024-01-23T09:24:53.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.822+0000 7f9475d9b640 1 --2- 172.21.15.46:0/103066782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9478151600 0x7f947814aa80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f946c019530 tx=0x7f946c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:24:53.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.826+0000 7f9466ffd640 1 -- 172.21.15.46:0/103066782 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c0aee30 con 0x7f9478151600 2024-01-23T09:24:53.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.826+0000 7f9466ffd640 1 -- 172.21.15.46:0/103066782 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946c0b7410 con 0x7f9478151600 2024-01-23T09:24:53.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.826+0000 7f9466ffd640 1 -- 172.21.15.46:0/103066782 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c0b77c0 con 0x7f9478151600 2024-01-23T09:24:53.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.826+0000 7f947cb34640 1 -- 172.21.15.46:0/103066782 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94780c41d0 con 0x7f9478151600 2024-01-23T09:24:53.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.826+0000 7f947cb34640 1 -- 172.21.15.46:0/103066782 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94780c00b0 con 0x7f9478151600 2024-01-23T09:24:53.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.826+0000 7f947cb34640 1 -- 172.21.15.46:0/103066782 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9478071fa0 con 0x7f9478151600 2024-01-23T09:24:53.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.850+0000 7f9466ffd640 1 -- 172.21.15.46:0/103066782 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f946c0b4050 con 0x7f9478151600 2024-01-23T09:24:53.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.850+0000 7f9466ffd640 1 --2- 172.21.15.46:0/103066782 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9458066550 0x7f9458068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:53.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.850+0000 7f947659c640 1 --2- 172.21.15.46:0/103066782 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9458066550 0x7f9458068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:53.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:53.850+0000 7f947659c640 1 --2- 172.21.15.46:0/103066782 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9458066550 0x7f9458068a10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9468000f70 tx=0x7f9468007e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:24:54.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.138+0000 7f9466ffd640 1 -- 172.21.15.46:0/103066782 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f946c0f07b0 con 0x7f9478151600 2024-01-23T09:24:54.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.138+0000 7f9466ffd640 1 -- 172.21.15.46:0/103066782 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f946c0ecaf0 con 0x7f9478151600 2024-01-23T09:24:54.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.310+0000 7f947cb34640 1 -- 172.21.15.46:0/103066782 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9478074340 con 0x7f9478151600 2024-01-23T09:24:54.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.390+0000 7f9466ffd640 1 -- 172.21.15.46:0/103066782 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18552 (secure 0 0 0) 0x7f946c0c7020 con 0x7f9478151600 2024-01-23T09:24:54.395 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T09:24:54.395 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":30,"fsid":"fdbdd393-f422-45ae-a488-2bbb0163e580","created":"2024-01-23T08:53:36.942515+0000","modified":"2024-01-23T08:55:46.483867+0000","last_up_change":"2024-01-23T08:53:57.198113+0000","last_in_change":"2024-01-23T08:53:47.852614+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-23T08:53:59.340853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-23T08:54:38.278770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-23T08:54:40.216521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-23T08:54:47.311079+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f32c3d7d-e32a-42d8-b55f-db874d915a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6818","nonce":2681790976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6821","nonce":2681790976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6825","nonce":2681790976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6823","nonce":2681790976}]},"public_addr":"172.21.15.46:6818/2681790976","cluster_addr":"172.21.15.46:6821/2681790976","heartbeat_back_addr":"172.21.15.46:6825/2681790976","heartbeat_front_addr":"172.21.15.46:6823/2681790976","state":["exists","up"]},{"osd":1,"uuid":"6f3b6bd2-bbea-4d08-84d5-4407363b5eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6803","nonce":3679152623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6805","nonce":3679152623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6809","nonce":3679152623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6807","nonce":3679152623}]},"public_addr":"172.21.15.46:6803/3679152623","cluster_addr":"172.21.15.46:6805/3679152623","heartbeat_back_addr":"172.21.15.46:6809/3679152623","heartbeat_front_addr":"172.21.15.46:6807/3679152623","state":["exists","up"]},{"osd":2,"uuid":"8f110727-31e7-4f69-926b-c87481d4d28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6811","nonce":3869652274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6813","nonce":3869652274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6820","nonce":3869652274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6815","nonce":3869652274}]},"public_addr":"172.21.15.46:6811/3869652274","cluster_addr":"172.21.15.46:6813/3869652274","heartbeat_back_addr":"172.21.15.46:6820/3869652274","heartbeat_front_addr":"172.21.15.46:6815/3869652274","state":["exists","up"]},{"osd":3,"uuid":"3aa7527d-0463-4373-b9c7-e6b507a7987f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6827","nonce":4168860822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6829","nonce":4168860822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6833","nonce":4168860822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6831","nonce":4168860822}]},"public_addr":"172.21.15.46:6827/4168860822","cluster_addr":"172.21.15.46:6829/4168860822","heartbeat_back_addr":"172.21.15.46:6833/4168860822","heartbeat_front_addr":"172.21.15.46:6831/4168860822","state":["exists","up"]},{"osd":4,"uuid":"eb47a1e5-9f26-465f-b188-87c6eed63c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6805","nonce":3115257412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6808","nonce":3115257412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6815","nonce":3115257412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6812","nonce":3115257412}]},"public_addr":"172.21.15.175:6805/3115257412","cluster_addr":"172.21.15.175:6808/3115257412","heartbeat_back_addr":"172.21.15.175:6815/3115257412","heartbeat_front_addr":"172.21.15.175:6812/3115257412","state":["exists","up"]},{"osd":5,"uuid":"34048409-998c-44f3-a29d-dcad7a6c917b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6818","nonce":3146473948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6822","nonce":3146473948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6831","nonce":3146473948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6826","nonce":3146473948}]},"public_addr":"172.21.15.175:6818/3146473948","cluster_addr":"172.21.15.175:6822/3146473948","heartbeat_back_addr":"172.21.15.175:6831/3146473948","heartbeat_front_addr":"172.21.15.175:6826/3146473948","state":["exists","up"]},{"osd":6,"uuid":"f5d45d3f-9af3-44a1-a730-c260ed1654b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6801","nonce":4161180058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6804","nonce":4161180058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6814","nonce":4161180058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6809","nonce":4161180058}]},"public_addr":"172.21.15.175:6801/4161180058","cluster_addr":"172.21.15.175:6804/4161180058","heartbeat_back_addr":"172.21.15.175:6814/4161180058","heartbeat_front_addr":"172.21.15.175:6809/4161180058","state":["exists","up"]},{"osd":7,"uuid":"16d12e53-2ad3-4b5c-a789-22b45056fd9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6819","nonce":2670236415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6823","nonce":2670236415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6830","nonce":2670236415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6827","nonce":2670236415}]},"public_addr":"172.21.15.175:6819/2670236415","cluster_addr":"172.21.15.175:6823/2670236415","heartbeat_back_addr":"172.21.15.175:6830/2670236415","heartbeat_front_addr":"172.21.15.175:6827/2670236415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.847037+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.765547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.716122+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.874628+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.786580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.924885+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.285635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.898130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":0,"to":7}]},{"pgid":"4.4","mappings":[{"from":3,"to":5}]},{"pgid":"4.17","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T09:24:54.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.394+0000 7f947cb34640 1 -- 172.21.15.46:0/103066782 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9458066550 msgr2=0x7f9458068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:54.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.394+0000 7f947cb34640 1 --2- 172.21.15.46:0/103066782 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9458066550 0x7f9458068a10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9468000f70 tx=0x7f9468007e90 comp rx=0 tx=0).stop 2024-01-23T09:24:54.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.394+0000 7f947cb34640 1 -- 172.21.15.46:0/103066782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9478151600 msgr2=0x7f947814aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:54.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.394+0000 7f947cb34640 1 --2- 172.21.15.46:0/103066782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9478151600 0x7f947814aa80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f946c019530 tx=0x7f946c0196c0 comp rx=0 tx=0).stop 2024-01-23T09:24:54.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.394+0000 7f947cb34640 1 -- 172.21.15.46:0/103066782 shutdown_connections 2024-01-23T09:24:54.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.394+0000 7f947cb34640 1 --2- 172.21.15.46:0/103066782 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f9458066550 0x7f9458068a10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:54.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.394+0000 7f947cb34640 1 --2- 172.21.15.46:0/103066782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94781428e0 0x7f94780c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:54.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.394+0000 7f947cb34640 1 --2- 172.21.15.46:0/103066782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9478151600 0x7f947814aa80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:54.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.394+0000 7f947cb34640 1 --2- 172.21.15.46:0/103066782 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f947806f350 0x7f94780c4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:54.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.394+0000 7f947cb34640 1 -- 172.21.15.46:0/103066782 >> 172.21.15.46:0/103066782 conn(0x7f947806d590 msgr2=0x7f94780c7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:24:54.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.394+0000 7f947cb34640 1 -- 172.21.15.46:0/103066782 shutdown_connections 2024-01-23T09:24:54.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.394+0000 7f947cb34640 1 -- 172.21.15.46:0/103066782 wait complete. 2024-01-23T09:24:54.420 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-23T08:53:59.340853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-23T08:54:38.278770+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-23T08:54:40.216521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-23T08:54:47.311079+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-23T09:24:54.420 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-23T09:24:54.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.546+0000 7fa7844ca640 1 Processor -- start 2024-01-23T09:24:54.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.546+0000 7fa7844ca640 1 -- start start 2024-01-23T09:24:54.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.550+0000 7fa7844ca640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa77c0c7d10 0x7fa77c15e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:54.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.550+0000 7fa7844ca640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa77c0c39a0 con 0x7fa77c0c8d40 2024-01-23T09:24:54.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.550+0000 7fa7844ca640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa77c0c2e20 con 0x7fa77c1580a0 2024-01-23T09:24:54.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.550+0000 7fa7844ca640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa77c0c3100 con 0x7fa77c0c7d10 2024-01-23T09:24:54.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.550+0000 7fa782266640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa77c0c7d10 0x7fa77c15e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:54.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.550+0000 7fa782a67640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fa77c1580a0 0x7fa77c0cccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.46:34928/0 (socket says 172.21.15.46:34928) 2024-01-23T09:24:54.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.550+0000 7fa782a67640 1 -- 172.21.15.46:0/987037480 learned_addr learned my addr 172.21.15.46:0/987037480 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T09:24:54.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.562+0000 7fa782266640 1 -- 172.21.15.46:0/987037480 >> v1:172.21.15.175:6789/0 conn(0x7fa77c1580a0 legacy=0x7fa77c0cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:54.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.562+0000 7fa782266640 1 -- 172.21.15.46:0/987037480 >> v1:172.21.15.46:6789/0 conn(0x7fa77c0c8d40 legacy=0x7fa77c157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:24:54.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.562+0000 7fa782266640 1 -- 172.21.15.46:0/987037480 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77c0c33e0 con 0x7fa77c0c7d10 2024-01-23T09:24:54.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.586+0000 7fa782266640 1 --2- 172.21.15.46:0/987037480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa77c0c7d10 0x7fa77c15e190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa7700097c0 tx=0x7fa77001ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc4f5d7d8bcb0d20 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:24:54.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.594+0000 7fa781264640 1 -- 172.21.15.46:0/987037480 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7700a8930 con 0x7fa77c0c7d10 2024-01-23T09:24:54.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.594+0000 7fa781264640 1 -- 172.21.15.46:0/987037480 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7700a8a90 con 0x7fa77c0c7d10 2024-01-23T09:24:54.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.594+0000 7fa781264640 1 -- 172.21.15.46:0/987037480 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7700a8e20 con 0x7fa77c0c7d10 2024-01-23T09:24:54.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.598+0000 7fa7844ca640 1 -- 172.21.15.46:0/987037480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa77c0c7d10 msgr2=0x7fa77c15e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:54.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.598+0000 7fa7844ca640 1 --2- 172.21.15.46:0/987037480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa77c0c7d10 0x7fa77c15e190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa7700097c0 tx=0x7fa77001ec30 comp rx=0 tx=0).stop 2024-01-23T09:24:54.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.598+0000 7fa7844ca640 1 -- 172.21.15.46:0/987037480 shutdown_connections 2024-01-23T09:24:54.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.598+0000 7fa7844ca640 1 --2- 172.21.15.46:0/987037480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa77c0c7d10 0x7fa77c15e190 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:54.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.598+0000 7fa7844ca640 1 -- 172.21.15.46:0/987037480 >> 172.21.15.46:0/987037480 conn(0x7fa77c070c60 msgr2=0x7fa77c071070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:24:54.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.598+0000 7fa7844ca640 1 -- 172.21.15.46:0/987037480 shutdown_connections 2024-01-23T09:24:54.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.598+0000 7fa7844ca640 1 -- 172.21.15.46:0/987037480 wait complete. 2024-01-23T09:24:54.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.598+0000 7fa7844ca640 1 Processor -- start 2024-01-23T09:24:54.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.598+0000 7fa7844ca640 1 -- start start 2024-01-23T09:24:54.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.602+0000 7fa7844ca640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa77c0c7d10 0x7fa77c1584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:54.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.602+0000 7fa7844ca640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa77c0c8d40 0x7fa77c0c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:54.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.602+0000 7fa7844ca640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa77c1580a0 0x7fa77c153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:54.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.602+0000 7fa7844ca640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c1594a0 con 0x7fa77c0c8d40 2024-01-23T09:24:54.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.602+0000 7fa7844ca640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c0c47e0 con 0x7fa77c1580a0 2024-01-23T09:24:54.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.602+0000 7fa7844ca640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c0c60f0 con 0x7fa77c0c7d10 2024-01-23T09:24:54.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.602+0000 7fa782a67640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa77c1580a0 0x7fa77c153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:54.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.602+0000 7fa782266640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa77c0c7d10 0x7fa77c1584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:54.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.602+0000 7fa782a67640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa77c1580a0 0x7fa77c153820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:59262/0 (socket says 172.21.15.46:59262) 2024-01-23T09:24:54.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.602+0000 7fa782a67640 1 -- 172.21.15.46:0/726640496 learned_addr learned my addr 172.21.15.46:0/726640496 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:24:54.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.614+0000 7fa782266640 1 -- 172.21.15.46:0/726640496 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa77c1580a0 msgr2=0x7fa77c153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:54.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.614+0000 7fa782266640 1 --2- 172.21.15.46:0/726640496 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa77c1580a0 0x7fa77c153820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:54.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.614+0000 7fa782266640 1 -- 172.21.15.46:0/726640496 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa77c0c8d40 msgr2=0x7fa77c0c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:54.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.614+0000 7fa782266640 1 --2- 172.21.15.46:0/726640496 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa77c0c8d40 0x7fa77c0c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:54.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.614+0000 7fa782266640 1 -- 172.21.15.46:0/726640496 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa770009420 con 0x7fa77c0c7d10 2024-01-23T09:24:54.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.626+0000 7fa782266640 1 --2- 172.21.15.46:0/726640496 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa77c0c7d10 0x7fa77c1584d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa7700af000 tx=0x7fa77001b9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:24:54.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.722+0000 7fa76effd640 1 -- 172.21.15.46:0/726640496 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7700b9600 con 0x7fa77c0c7d10 2024-01-23T09:24:54.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.726+0000 7fa76effd640 1 -- 172.21.15.46:0/726640496 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7700b0e90 con 0x7fa77c0c7d10 2024-01-23T09:24:54.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.726+0000 7fa7844ca640 1 -- 172.21.15.46:0/726640496 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa77c0c3e80 con 0x7fa77c0c7d10 2024-01-23T09:24:54.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.726+0000 7fa76effd640 1 -- 172.21.15.46:0/726640496 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7700b99e0 con 0x7fa77c0c7d10 2024-01-23T09:24:54.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.726+0000 7fa7844ca640 1 -- 172.21.15.46:0/726640496 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa77c0c4120 con 0x7fa77c0c7d10 2024-01-23T09:24:54.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:54.726+0000 7fa7844ca640 1 -- 172.21.15.46:0/726640496 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa77c074340 con 0x7fa77c0c7d10 2024-01-23T09:24:55.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.018+0000 7fa76effd640 1 -- 172.21.15.46:0/726640496 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa7700b7040 con 0x7fa77c0c7d10 2024-01-23T09:24:55.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.018+0000 7fa76effd640 1 --2- 172.21.15.46:0/726640496 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa760066550 0x7fa760068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:55.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.018+0000 7fa781a65640 1 --2- 172.21.15.46:0/726640496 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa760066550 0x7fa760068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:55.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.022+0000 7fa781a65640 1 --2- 172.21.15.46:0/726640496 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa760066550 0x7fa760068a10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa77c157c80 tx=0x7fa778009250 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:24:55.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.026+0000 7fa76effd640 1 -- 172.21.15.46:0/726640496 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fa7700a88d0 con 0x7fa77c0c7d10 2024-01-23T09:24:55.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.058+0000 7fa76effd640 1 -- 172.21.15.46:0/726640496 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa7700efc20 con 0x7fa77c0c7d10 2024-01-23T09:24:55.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.254+0000 7fa7844ca640 1 -- 172.21.15.46:0/726640496 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa77c0c1d00 con 0x7fa77c0c7d10 2024-01-23T09:24:55.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.442+0000 7fa76effd640 1 -- 172.21.15.46:0/726640496 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa7700b5030 con 0x7fa77c0c7d10 2024-01-23T09:24:55.447 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-01-23T09:24:55.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.446+0000 7fa7844ca640 1 -- 172.21.15.46:0/726640496 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa760066550 msgr2=0x7fa760068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:55.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.446+0000 7fa7844ca640 1 --2- 172.21.15.46:0/726640496 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa760066550 0x7fa760068a10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa77c157c80 tx=0x7fa778009250 comp rx=0 tx=0).stop 2024-01-23T09:24:55.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.446+0000 7fa7844ca640 1 -- 172.21.15.46:0/726640496 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa77c0c7d10 msgr2=0x7fa77c1584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:55.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.446+0000 7fa7844ca640 1 --2- 172.21.15.46:0/726640496 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa77c0c7d10 0x7fa77c1584d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa7700af000 tx=0x7fa77001b9d0 comp rx=0 tx=0).stop 2024-01-23T09:24:55.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.446+0000 7fa7844ca640 1 -- 172.21.15.46:0/726640496 shutdown_connections 2024-01-23T09:24:55.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.446+0000 7fa7844ca640 1 --2- 172.21.15.46:0/726640496 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa760066550 0x7fa760068a10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:55.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.446+0000 7fa7844ca640 1 --2- 172.21.15.46:0/726640496 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa77c1580a0 0x7fa77c153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:55.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.446+0000 7fa7844ca640 1 --2- 172.21.15.46:0/726640496 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa77c0c8d40 0x7fa77c0c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:55.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.446+0000 7fa7844ca640 1 --2- 172.21.15.46:0/726640496 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa77c0c7d10 0x7fa77c1584d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:55.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.446+0000 7fa7844ca640 1 -- 172.21.15.46:0/726640496 >> 172.21.15.46:0/726640496 conn(0x7fa77c070c60 msgr2=0x7fa77c073b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:24:55.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.446+0000 7fa7844ca640 1 -- 172.21.15.46:0/726640496 shutdown_connections 2024-01-23T09:24:55.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.446+0000 7fa7844ca640 1 -- 172.21.15.46:0/726640496 wait complete. 2024-01-23T09:24:55.478 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-23T09:24:55.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.610+0000 7f69e4f74640 1 Processor -- start 2024-01-23T09:24:55.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.610+0000 7f69e4f74640 1 -- start start 2024-01-23T09:24:55.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.610+0000 7f69e4f74640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69e00c8160 0x7f69e00c3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:55.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.610+0000 7f69e4f74640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e00c3200 con 0x7f69e00c8dc0 2024-01-23T09:24:55.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.610+0000 7f69e4f74640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e00c9230 con 0x7f69e0151640 2024-01-23T09:24:55.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.610+0000 7f69e4f74640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e00b0530 con 0x7f69e00c8160 2024-01-23T09:24:55.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.610+0000 7f69ded9d640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f69e00c8dc0 0x7f69e015a960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46020/0 (socket says 172.21.15.46:46020) 2024-01-23T09:24:55.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.610+0000 7f69ded9d640 1 -- 172.21.15.46:0/3200186877 learned_addr learned my addr 172.21.15.46:0/3200186877 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T09:24:55.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.610+0000 7f69d5d9b640 1 --2- 172.21.15.46:0/3200186877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69e00c8160 0x7f69e00c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:55.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.614+0000 7f69ddd9b640 1 -- 172.21.15.46:0/3200186877 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2778111315 0 0) 0x7f69e00c3200 con 0x7f69e00c8dc0 2024-01-23T09:24:55.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.614+0000 7f69ddd9b640 1 -- 172.21.15.46:0/3200186877 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69cc003530 con 0x7f69e00c8dc0 2024-01-23T09:24:55.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.618+0000 7f69d5d9b640 1 -- 172.21.15.46:0/3200186877 >> v1:172.21.15.175:6789/0 conn(0x7f69e0151640 legacy=0x7f69e00ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:55.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.618+0000 7f69d5d9b640 1 -- 172.21.15.46:0/3200186877 >> v1:172.21.15.46:6789/0 conn(0x7f69e00c8dc0 legacy=0x7f69e015a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:55.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.618+0000 7f69d5d9b640 1 -- 172.21.15.46:0/3200186877 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e015b4f0 con 0x7f69e00c8160 2024-01-23T09:24:55.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.622+0000 7f69d5d9b640 1 --2- 172.21.15.46:0/3200186877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69e00c8160 0x7f69e00c3690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f69c80097f0 tx=0x7f69c801ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a9fdae67f3a9daf server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:24:55.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.630+0000 7f69ddd9b640 1 -- 172.21.15.46:0/3200186877 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c80a89b0 con 0x7f69e00c8160 2024-01-23T09:24:55.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.630+0000 7f69ddd9b640 1 -- 172.21.15.46:0/3200186877 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c80a8b10 con 0x7f69e00c8160 2024-01-23T09:24:55.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.630+0000 7f69ddd9b640 1 -- 172.21.15.46:0/3200186877 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c80a8ea0 con 0x7f69e00c8160 2024-01-23T09:24:55.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.634+0000 7f69e4f74640 1 -- 172.21.15.46:0/3200186877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69e00c8160 msgr2=0x7f69e00c3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:55.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.634+0000 7f69e4f74640 1 --2- 172.21.15.46:0/3200186877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69e00c8160 0x7f69e00c3690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f69c80097f0 tx=0x7f69c801ecb0 comp rx=0 tx=0).stop 2024-01-23T09:24:55.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.634+0000 7f69e4f74640 1 -- 172.21.15.46:0/3200186877 shutdown_connections 2024-01-23T09:24:55.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.634+0000 7f69e4f74640 1 --2- 172.21.15.46:0/3200186877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69e00c8160 0x7f69e00c3690 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:55.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.634+0000 7f69e4f74640 1 -- 172.21.15.46:0/3200186877 >> 172.21.15.46:0/3200186877 conn(0x7f69e006a660 msgr2=0x7f69e006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:24:55.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.634+0000 7f69e4f74640 1 -- 172.21.15.46:0/3200186877 shutdown_connections 2024-01-23T09:24:55.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.634+0000 7f69e4f74640 1 -- 172.21.15.46:0/3200186877 wait complete. 2024-01-23T09:24:55.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.634+0000 7f69e4f74640 1 Processor -- start 2024-01-23T09:24:55.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.634+0000 7f69e4f74640 1 -- start start 2024-01-23T09:24:55.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.634+0000 7f69e4f74640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69e00c8160 0x7f69e0156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:55.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.634+0000 7f69e4f74640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69e00c8dc0 0x7f69e01ed030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:55.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.634+0000 7f69e4f74640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69e0151640 0x7f69e00cd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:55.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.634+0000 7f69e4f74640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e00c8580 con 0x7f69e00c8160 2024-01-23T09:24:55.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.634+0000 7f69e4f74640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e0157240 con 0x7f69e0151640 2024-01-23T09:24:55.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.634+0000 7f69e4f74640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e01562b0 con 0x7f69e00c8dc0 2024-01-23T09:24:55.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.634+0000 7f69de59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69e00c8160 0x7f69e0156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:55.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.638+0000 7f69de59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69e00c8160 0x7f69e0156d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53568/0 (socket says 172.21.15.46:53568) 2024-01-23T09:24:55.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.638+0000 7f69de59c640 1 -- 172.21.15.46:0/244357033 learned_addr learned my addr 172.21.15.46:0/244357033 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:24:55.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.638+0000 7f69ded9d640 1 --2- 172.21.15.46:0/244357033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69e0151640 0x7f69e00cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:55.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.638+0000 7f69d5d9b640 1 --2- 172.21.15.46:0/244357033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69e00c8dc0 0x7f69e01ed030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:55.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.642+0000 7f69de59c640 1 -- 172.21.15.46:0/244357033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69e00c8dc0 msgr2=0x7f69e01ed030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:55.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.642+0000 7f69de59c640 1 --2- 172.21.15.46:0/244357033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69e00c8dc0 0x7f69e01ed030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:55.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.642+0000 7f69de59c640 1 -- 172.21.15.46:0/244357033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69e0151640 msgr2=0x7f69e00cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:55.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.642+0000 7f69de59c640 1 --2- 172.21.15.46:0/244357033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69e0151640 0x7f69e00cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:55.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.642+0000 7f69de59c640 1 -- 172.21.15.46:0/244357033 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c8009420 con 0x7f69e00c8160 2024-01-23T09:24:55.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.642+0000 7f69de59c640 1 --2- 172.21.15.46:0/244357033 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69e00c8160 0x7f69e0156d00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f69d000c3f0 tx=0x7f69d000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:24:55.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.646+0000 7f69d77fe640 1 -- 172.21.15.46:0/244357033 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d00052d0 con 0x7f69e00c8160 2024-01-23T09:24:55.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.646+0000 7f69d77fe640 1 -- 172.21.15.46:0/244357033 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d0005430 con 0x7f69e00c8160 2024-01-23T09:24:55.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.646+0000 7f69e4f74640 1 -- 172.21.15.46:0/244357033 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e01580d0 con 0x7f69e00c8160 2024-01-23T09:24:55.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.646+0000 7f69d77fe640 1 -- 172.21.15.46:0/244357033 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d0003840 con 0x7f69e00c8160 2024-01-23T09:24:55.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.646+0000 7f69e4f74640 1 -- 172.21.15.46:0/244357033 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e01ede30 con 0x7f69e00c8160 2024-01-23T09:24:55.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.650+0000 7f69e4f74640 1 -- 172.21.15.46:0/244357033 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e00c2e50 con 0x7f69e00c8160 2024-01-23T09:24:55.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.946+0000 7f69d77fe640 1 -- 172.21.15.46:0/244357033 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f69d00039a0 con 0x7f69e00c8160 2024-01-23T09:24:55.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.946+0000 7f69d77fe640 1 --2- 172.21.15.46:0/244357033 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f69c0066550 0x7f69c0068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:55.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.946+0000 7f69d5d9b640 1 --2- 172.21.15.46:0/244357033 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f69c0066550 0x7f69c0068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:55.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.950+0000 7f69d5d9b640 1 --2- 172.21.15.46:0/244357033 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f69c0066550 0x7f69c0068a10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f69c80b2000 tx=0x7f69c80aa070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:24:55.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.986+0000 7f69d77fe640 1 -- 172.21.15.46:0/244357033 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f69d0054800 con 0x7f69e00c8160 2024-01-23T09:24:55.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:55.990+0000 7f69d77fe640 1 -- 172.21.15.46:0/244357033 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f69d0050b40 con 0x7f69e00c8160 2024-01-23T09:24:56.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.166+0000 7f69e4f74640 1 -- 172.21.15.46:0/244357033 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f69e0074340 con 0x7f69e00c8160 2024-01-23T09:24:56.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.178+0000 7f69d77fe640 1 -- 172.21.15.46:0/244357033 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f69d00170a0 con 0x7f69e00c8160 2024-01-23T09:24:56.180 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-23T09:24:56.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.178+0000 7f69e4f74640 1 -- 172.21.15.46:0/244357033 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f69c0066550 msgr2=0x7f69c0068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:56.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.178+0000 7f69e4f74640 1 --2- 172.21.15.46:0/244357033 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f69c0066550 0x7f69c0068a10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f69c80b2000 tx=0x7f69c80aa070 comp rx=0 tx=0).stop 2024-01-23T09:24:56.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.178+0000 7f69e4f74640 1 -- 172.21.15.46:0/244357033 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69e00c8160 msgr2=0x7f69e0156d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:56.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.178+0000 7f69e4f74640 1 --2- 172.21.15.46:0/244357033 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69e00c8160 0x7f69e0156d00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f69d000c3f0 tx=0x7f69d000c8b0 comp rx=0 tx=0).stop 2024-01-23T09:24:56.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.178+0000 7f69e4f74640 1 -- 172.21.15.46:0/244357033 shutdown_connections 2024-01-23T09:24:56.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.178+0000 7f69e4f74640 1 --2- 172.21.15.46:0/244357033 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f69c0066550 0x7f69c0068a10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:56.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.178+0000 7f69e4f74640 1 --2- 172.21.15.46:0/244357033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69e0151640 0x7f69e00cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:56.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.178+0000 7f69e4f74640 1 --2- 172.21.15.46:0/244357033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69e00c8dc0 0x7f69e01ed030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:56.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.178+0000 7f69e4f74640 1 --2- 172.21.15.46:0/244357033 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f69e00c8160 0x7f69e0156d00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:56.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.178+0000 7f69e4f74640 1 -- 172.21.15.46:0/244357033 >> 172.21.15.46:0/244357033 conn(0x7f69e006a660 msgr2=0x7f69e0159a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:24:56.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.178+0000 7f69e4f74640 1 -- 172.21.15.46:0/244357033 shutdown_connections 2024-01-23T09:24:56.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.178+0000 7f69e4f74640 1 -- 172.21.15.46:0/244357033 wait complete. 2024-01-23T09:24:56.201 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-23T09:24:56.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.326+0000 7f5d7453c640 1 Processor -- start 2024-01-23T09:24:56.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.326+0000 7f5d7453c640 1 -- start start 2024-01-23T09:24:56.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.326+0000 7f5d7453c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d6c0c9920 0x7f5d6c0c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:56.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.326+0000 7f5d7453c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5d6c0cf9e0 0x7f5d6c15cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:56.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.326+0000 7f5d7453c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d6c15a170 con 0x7f5d6c15a600 2024-01-23T09:24:56.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.326+0000 7f5d7453c640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d6c159950 con 0x7f5d6c0cf9e0 2024-01-23T09:24:56.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.326+0000 7f5d7453c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c0c9420 con 0x7f5d6c0c9920 2024-01-23T09:24:56.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.326+0000 7f5d71ad7640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f5d6c15a600 0x7f5d6c0b2090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.46:34942/0 (socket says 172.21.15.46:34942) 2024-01-23T09:24:56.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.326+0000 7f5d71ad7640 1 -- 172.21.15.46:0/3049408310 learned_addr learned my addr 172.21.15.46:0/3049408310 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T09:24:56.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.330+0000 7f5d72ad9640 1 --2- 172.21.15.46:0/3049408310 >> v2:172.21.15.46:3300/0 conn(0x7f5d6c0cf9e0 0x7f5d6c15cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:56.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.334+0000 7f5d72ad9640 1 -- 172.21.15.46:0/3049408310 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d6c0c9920 msgr2=0x7f5d6c0c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:24:56.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.334+0000 7f5d72ad9640 1 --2- 172.21.15.46:0/3049408310 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d6c0c9920 0x7f5d6c0c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:56.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.334+0000 7f5d72ad9640 1 -- 172.21.15.46:0/3049408310 >> v1:172.21.15.175:6789/0 conn(0x7f5d6c15a600 legacy=0x7f5d6c0b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:56.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.334+0000 7f5d72ad9640 1 -- 172.21.15.46:0/3049408310 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c15d420 con 0x7f5d6c0cf9e0 2024-01-23T09:24:56.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.338+0000 7f5d72ad9640 1 --2- 172.21.15.46:0/3049408310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d6c0cf9e0 0x7f5d6c15cee0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5d64009d90 tx=0x7f5d6401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fcbf9457185f70a server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:24:56.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.342+0000 7f5d712d6640 1 -- 172.21.15.46:0/3049408310 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d640a5920 con 0x7f5d6c0cf9e0 2024-01-23T09:24:56.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.342+0000 7f5d712d6640 1 -- 172.21.15.46:0/3049408310 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d640a5a80 con 0x7f5d6c0cf9e0 2024-01-23T09:24:56.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.342+0000 7f5d712d6640 1 -- 172.21.15.46:0/3049408310 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d640a5e10 con 0x7f5d6c0cf9e0 2024-01-23T09:24:56.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.342+0000 7f5d7453c640 1 -- 172.21.15.46:0/3049408310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d6c0cf9e0 msgr2=0x7f5d6c15cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:56.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.342+0000 7f5d7453c640 1 --2- 172.21.15.46:0/3049408310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d6c0cf9e0 0x7f5d6c15cee0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5d64009d90 tx=0x7f5d6401c950 comp rx=0 tx=0).stop 2024-01-23T09:24:56.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.342+0000 7f5d7453c640 1 -- 172.21.15.46:0/3049408310 shutdown_connections 2024-01-23T09:24:56.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.342+0000 7f5d7453c640 1 --2- 172.21.15.46:0/3049408310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d6c0cf9e0 0x7f5d6c15cee0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:56.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.342+0000 7f5d7453c640 1 --2- 172.21.15.46:0/3049408310 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d6c0c9920 0x7f5d6c0c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:56.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.342+0000 7f5d7453c640 1 -- 172.21.15.46:0/3049408310 >> 172.21.15.46:0/3049408310 conn(0x7f5d6c08afa0 msgr2=0x7f5d6c08b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:24:56.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.342+0000 7f5d7453c640 1 -- 172.21.15.46:0/3049408310 shutdown_connections 2024-01-23T09:24:56.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.342+0000 7f5d7453c640 1 -- 172.21.15.46:0/3049408310 wait complete. 2024-01-23T09:24:56.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.346+0000 7f5d7453c640 1 Processor -- start 2024-01-23T09:24:56.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.346+0000 7f5d7453c640 1 -- start start 2024-01-23T09:24:56.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.346+0000 7f5d7453c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d6c0c9920 0x7f5d6c15c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:56.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.346+0000 7f5d7453c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d6c0cf9e0 0x7f5d6c15c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:56.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.346+0000 7f5d7453c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d6c15a600 0x7f5d6c156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:56.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.346+0000 7f5d7453c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c1550a0 con 0x7f5d6c0cf9e0 2024-01-23T09:24:56.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.346+0000 7f5d7453c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c15b7e0 con 0x7f5d6c0c9920 2024-01-23T09:24:56.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.346+0000 7f5d7453c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c15add0 con 0x7f5d6c15a600 2024-01-23T09:24:56.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.346+0000 7f5d71ad7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d6c0cf9e0 0x7f5d6c15c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:56.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.346+0000 7f5d71ad7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d6c0cf9e0 0x7f5d6c15c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53584/0 (socket says 172.21.15.46:53584) 2024-01-23T09:24:56.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.346+0000 7f5d71ad7640 1 -- 172.21.15.46:0/628191604 learned_addr learned my addr 172.21.15.46:0/628191604 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:24:56.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.350+0000 7f5d71ad7640 1 -- 172.21.15.46:0/628191604 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d6c15a600 msgr2=0x7f5d6c156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:56.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.350+0000 7f5d71ad7640 1 --2- 172.21.15.46:0/628191604 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d6c15a600 0x7f5d6c156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:56.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.350+0000 7f5d71ad7640 1 -- 172.21.15.46:0/628191604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d6c0c9920 msgr2=0x7f5d6c15c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:56.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.350+0000 7f5d71ad7640 1 --2- 172.21.15.46:0/628191604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d6c0c9920 0x7f5d6c15c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:56.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.350+0000 7f5d71ad7640 1 -- 172.21.15.46:0/628191604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d64009a70 con 0x7f5d6c0cf9e0 2024-01-23T09:24:56.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.354+0000 7f5d71ad7640 1 --2- 172.21.15.46:0/628191604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d6c0cf9e0 0x7f5d6c15c960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c00c3a0 tx=0x7f5d5c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:24:56.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.358+0000 7f5d62ffd640 1 -- 172.21.15.46:0/628191604 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c005cf0 con 0x7f5d6c0cf9e0 2024-01-23T09:24:56.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.358+0000 7f5d62ffd640 1 -- 172.21.15.46:0/628191604 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5c005e50 con 0x7f5d6c0cf9e0 2024-01-23T09:24:56.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.358+0000 7f5d62ffd640 1 -- 172.21.15.46:0/628191604 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c0072f0 con 0x7f5d6c0cf9e0 2024-01-23T09:24:56.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.358+0000 7f5d7453c640 1 -- 172.21.15.46:0/628191604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d6c154e00 con 0x7f5d6c0cf9e0 2024-01-23T09:24:56.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.358+0000 7f5d7453c640 1 -- 172.21.15.46:0/628191604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6c15b220 con 0x7f5d6c0cf9e0 2024-01-23T09:24:56.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.358+0000 7f5d7453c640 1 -- 172.21.15.46:0/628191604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d6c06d7f0 con 0x7f5d6c0cf9e0 2024-01-23T09:24:56.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.378+0000 7f5d62ffd640 1 -- 172.21.15.46:0/628191604 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5d5c007450 con 0x7f5d6c0cf9e0 2024-01-23T09:24:56.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.378+0000 7f5d62ffd640 1 --2- 172.21.15.46:0/628191604 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5d50066580 0x7f5d50068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:56.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.378+0000 7f5d722d8640 1 --2- 172.21.15.46:0/628191604 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5d50066580 0x7f5d50068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:56.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.382+0000 7f5d722d8640 1 --2- 172.21.15.46:0/628191604 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5d50066580 0x7f5d50068a40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009690 tx=0x7f5d68006c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:24:56.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.646+0000 7f5d62ffd640 1 -- 172.21.15.46:0/628191604 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f5d5c054ef0 con 0x7f5d6c0cf9e0 2024-01-23T09:24:56.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.646+0000 7f5d62ffd640 1 -- 172.21.15.46:0/628191604 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5d5c050b30 con 0x7f5d6c0cf9e0 2024-01-23T09:24:56.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.818+0000 7f5d7453c640 1 -- 172.21.15.46:0/628191604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5d6c15c140 con 0x7f5d6c0cf9e0 2024-01-23T09:24:56.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.882+0000 7f5d62ffd640 1 -- 172.21.15.46:0/628191604 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5d6c15c140 con 0x7f5d6c0cf9e0 2024-01-23T09:24:56.886 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-01-23T09:24:56.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.886+0000 7f5d7453c640 1 -- 172.21.15.46:0/628191604 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5d50066580 msgr2=0x7f5d50068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:56.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.886+0000 7f5d7453c640 1 --2- 172.21.15.46:0/628191604 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5d50066580 0x7f5d50068a40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009690 tx=0x7f5d68006c00 comp rx=0 tx=0).stop 2024-01-23T09:24:56.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.886+0000 7f5d7453c640 1 -- 172.21.15.46:0/628191604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d6c0cf9e0 msgr2=0x7f5d6c15c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:56.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.886+0000 7f5d7453c640 1 --2- 172.21.15.46:0/628191604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d6c0cf9e0 0x7f5d6c15c960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c00c3a0 tx=0x7f5d5c00c860 comp rx=0 tx=0).stop 2024-01-23T09:24:56.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.886+0000 7f5d7453c640 1 -- 172.21.15.46:0/628191604 shutdown_connections 2024-01-23T09:24:56.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.886+0000 7f5d7453c640 1 --2- 172.21.15.46:0/628191604 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d6c15a600 0x7f5d6c156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:56.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.886+0000 7f5d7453c640 1 --2- 172.21.15.46:0/628191604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d6c0cf9e0 0x7f5d6c15c960 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:56.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.886+0000 7f5d7453c640 1 --2- 172.21.15.46:0/628191604 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5d50066580 0x7f5d50068a40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:56.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.886+0000 7f5d7453c640 1 --2- 172.21.15.46:0/628191604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d6c0c9920 0x7f5d6c15c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:56.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.886+0000 7f5d7453c640 1 -- 172.21.15.46:0/628191604 >> 172.21.15.46:0/628191604 conn(0x7f5d6c08afa0 msgr2=0x7f5d6c08b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:24:56.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.886+0000 7f5d7453c640 1 -- 172.21.15.46:0/628191604 shutdown_connections 2024-01-23T09:24:56.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:56.886+0000 7f5d7453c640 1 -- 172.21.15.46:0/628191604 wait complete. 2024-01-23T09:24:56.910 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-23T09:24:57.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.038+0000 7efc27065640 1 Processor -- start 2024-01-23T09:24:57.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.038+0000 7efc27065640 1 -- start start 2024-01-23T09:24:57.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.038+0000 7efc27065640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efc200c8310 0x7efc20151190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:57.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.038+0000 7efc27065640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc20071970 0x7efc201516d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:57.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.038+0000 7efc27065640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc2015a9d0 con 0x7efc200c7f30 2024-01-23T09:24:57.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.038+0000 7efc27065640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc201573e0 con 0x7efc200c8310 2024-01-23T09:24:57.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.038+0000 7efc27065640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2006e1a0 con 0x7efc20071970 2024-01-23T09:24:57.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.038+0000 7efc1ffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efc200c8310 0x7efc20151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:57.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.038+0000 7efc1ffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efc200c8310 0x7efc20151190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53596/0 (socket says 172.21.15.46:53596) 2024-01-23T09:24:57.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.038+0000 7efc1ffff640 1 -- 172.21.15.46:0/278596948 learned_addr learned my addr 172.21.15.46:0/278596948 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:24:57.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.038+0000 7efc25602640 1 --2- 172.21.15.46:0/278596948 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc20071970 0x7efc201516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:57.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.042+0000 7efc1ffff640 1 -- 172.21.15.46:0/278596948 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc20071970 msgr2=0x7efc201516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:24:57.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.042+0000 7efc1ffff640 1 --2- 172.21.15.46:0/278596948 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc20071970 0x7efc201516d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:57.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.042+0000 7efc1ffff640 1 -- 172.21.15.46:0/278596948 >> v1:172.21.15.175:6789/0 conn(0x7efc200c7f30 legacy=0x7efc2006da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:57.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.042+0000 7efc1ffff640 1 -- 172.21.15.46:0/278596948 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc201576a0 con 0x7efc200c8310 2024-01-23T09:24:57.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.046+0000 7efc1ffff640 1 --2- 172.21.15.46:0/278596948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc200c8310 0x7efc20151190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efc14009870 tx=0x7efc1401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a60277c44002a221 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:24:57.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.050+0000 7efc1f7fe640 1 -- 172.21.15.46:0/278596948 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc140a8a30 con 0x7efc200c8310 2024-01-23T09:24:57.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.050+0000 7efc1f7fe640 1 -- 172.21.15.46:0/278596948 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc140a8b90 con 0x7efc200c8310 2024-01-23T09:24:57.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.050+0000 7efc1f7fe640 1 -- 172.21.15.46:0/278596948 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc140b0440 con 0x7efc200c8310 2024-01-23T09:24:57.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.050+0000 7efc27065640 1 -- 172.21.15.46:0/278596948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc200c8310 msgr2=0x7efc20151190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:57.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.050+0000 7efc27065640 1 --2- 172.21.15.46:0/278596948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc200c8310 0x7efc20151190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efc14009870 tx=0x7efc1401ed30 comp rx=0 tx=0).stop 2024-01-23T09:24:57.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.050+0000 7efc27065640 1 -- 172.21.15.46:0/278596948 shutdown_connections 2024-01-23T09:24:57.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.050+0000 7efc27065640 1 --2- 172.21.15.46:0/278596948 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc20071970 0x7efc201516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:57.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.050+0000 7efc27065640 1 --2- 172.21.15.46:0/278596948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc200c8310 0x7efc20151190 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:57.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.050+0000 7efc27065640 1 -- 172.21.15.46:0/278596948 >> 172.21.15.46:0/278596948 conn(0x7efc2006aa60 msgr2=0x7efc2006ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:24:57.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.050+0000 7efc27065640 1 -- 172.21.15.46:0/278596948 shutdown_connections 2024-01-23T09:24:57.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.050+0000 7efc27065640 1 -- 172.21.15.46:0/278596948 wait complete. 2024-01-23T09:24:57.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.054+0000 7efc27065640 1 Processor -- start 2024-01-23T09:24:57.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.054+0000 7efc27065640 1 -- start start 2024-01-23T09:24:57.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.054+0000 7efc27065640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc20071970 0x7efc200c33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:57.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.054+0000 7efc27065640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc200c7f30 0x7efc201ecc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:57.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.054+0000 7efc27065640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc200c8310 0x7efc20146620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:57.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.054+0000 7efc27065640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc200ca6b0 con 0x7efc200c8310 2024-01-23T09:24:57.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.054+0000 7efc27065640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc200ca990 con 0x7efc200c7f30 2024-01-23T09:24:57.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.054+0000 7efc27065640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc201f0330 con 0x7efc20071970 2024-01-23T09:24:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.054+0000 7efc25602640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc200c8310 0x7efc20146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.054+0000 7efc25602640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc200c8310 0x7efc20146620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53608/0 (socket says 172.21.15.46:53608) 2024-01-23T09:24:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.054+0000 7efc25602640 1 -- 172.21.15.46:0/1885633046 learned_addr learned my addr 172.21.15.46:0/1885633046 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:24:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.054+0000 7efc1ffff640 1 --2- 172.21.15.46:0/1885633046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc200c7f30 0x7efc201ecc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.054+0000 7efc24e01640 1 --2- 172.21.15.46:0/1885633046 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc20071970 0x7efc200c33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:57.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.058+0000 7efc25602640 1 -- 172.21.15.46:0/1885633046 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc20071970 msgr2=0x7efc200c33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:57.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.058+0000 7efc25602640 1 --2- 172.21.15.46:0/1885633046 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc20071970 0x7efc200c33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:57.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.058+0000 7efc25602640 1 -- 172.21.15.46:0/1885633046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc200c7f30 msgr2=0x7efc201ecc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:57.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.058+0000 7efc25602640 1 --2- 172.21.15.46:0/1885633046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc200c7f30 0x7efc201ecc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:57.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.058+0000 7efc25602640 1 -- 172.21.15.46:0/1885633046 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc140094d0 con 0x7efc200c8310 2024-01-23T09:24:57.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.062+0000 7efc25602640 1 --2- 172.21.15.46:0/1885633046 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc200c8310 0x7efc20146620 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7efc1800d800 tx=0x7efc1800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:24:57.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.066+0000 7efc1d7fa640 1 -- 172.21.15.46:0/1885633046 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1800b6c0 con 0x7efc200c8310 2024-01-23T09:24:57.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.066+0000 7efc1d7fa640 1 -- 172.21.15.46:0/1885633046 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1800b820 con 0x7efc200c8310 2024-01-23T09:24:57.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.066+0000 7efc1d7fa640 1 -- 172.21.15.46:0/1885633046 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1800bbd0 con 0x7efc200c8310 2024-01-23T09:24:57.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.066+0000 7efc27065640 1 -- 172.21.15.46:0/1885633046 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc201f0610 con 0x7efc200c8310 2024-01-23T09:24:57.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.066+0000 7efc27065640 1 -- 172.21.15.46:0/1885633046 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc200c45b0 con 0x7efc200c8310 2024-01-23T09:24:57.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.066+0000 7efc27065640 1 -- 172.21.15.46:0/1885633046 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc201f0190 con 0x7efc200c8310 2024-01-23T09:24:57.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.358+0000 7efc1d7fa640 1 -- 172.21.15.46:0/1885633046 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7efc1800bd30 con 0x7efc200c8310 2024-01-23T09:24:57.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.358+0000 7efc1d7fa640 1 --2- 172.21.15.46:0/1885633046 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7efc0c066550 0x7efc0c068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:57.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.358+0000 7efc24e01640 1 --2- 172.21.15.46:0/1885633046 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7efc0c066550 0x7efc0c068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:57.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.362+0000 7efc24e01640 1 --2- 172.21.15.46:0/1885633046 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7efc0c066550 0x7efc0c068a10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efc10001ea0 tx=0x7efc10009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:24:57.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.398+0000 7efc1d7fa640 1 -- 172.21.15.46:0/1885633046 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7efc18055bf0 con 0x7efc200c8310 2024-01-23T09:24:57.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.398+0000 7efc1d7fa640 1 -- 172.21.15.46:0/1885633046 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7efc18051f30 con 0x7efc200c8310 2024-01-23T09:24:57.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.574+0000 7efc27065640 1 -- 172.21.15.46:0/1885633046 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7efc201f0190 con 0x7efc200c8310 2024-01-23T09:24:57.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.586+0000 7efc1d7fa640 1 -- 172.21.15.46:0/1885633046 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7efc201f0190 con 0x7efc200c8310 2024-01-23T09:24:57.591 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-23T09:24:57.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.590+0000 7efc27065640 1 -- 172.21.15.46:0/1885633046 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7efc0c066550 msgr2=0x7efc0c068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:57.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.590+0000 7efc27065640 1 --2- 172.21.15.46:0/1885633046 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7efc0c066550 0x7efc0c068a10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efc10001ea0 tx=0x7efc10009040 comp rx=0 tx=0).stop 2024-01-23T09:24:57.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.590+0000 7efc27065640 1 -- 172.21.15.46:0/1885633046 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc200c8310 msgr2=0x7efc20146620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:57.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.590+0000 7efc27065640 1 --2- 172.21.15.46:0/1885633046 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc200c8310 0x7efc20146620 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7efc1800d800 tx=0x7efc1800dcc0 comp rx=0 tx=0).stop 2024-01-23T09:24:57.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.590+0000 7efc27065640 1 -- 172.21.15.46:0/1885633046 shutdown_connections 2024-01-23T09:24:57.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.590+0000 7efc27065640 1 --2- 172.21.15.46:0/1885633046 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc200c8310 0x7efc20146620 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:57.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.590+0000 7efc27065640 1 --2- 172.21.15.46:0/1885633046 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7efc0c066550 0x7efc0c068a10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:57.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.590+0000 7efc27065640 1 --2- 172.21.15.46:0/1885633046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc200c7f30 0x7efc201ecc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:57.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.590+0000 7efc27065640 1 --2- 172.21.15.46:0/1885633046 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc20071970 0x7efc200c33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:57.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.590+0000 7efc27065640 1 -- 172.21.15.46:0/1885633046 >> 172.21.15.46:0/1885633046 conn(0x7efc2006aa60 msgr2=0x7efc20155f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:24:57.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.590+0000 7efc27065640 1 -- 172.21.15.46:0/1885633046 shutdown_connections 2024-01-23T09:24:57.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.590+0000 7efc27065640 1 -- 172.21.15.46:0/1885633046 wait complete. 2024-01-23T09:24:57.613 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-23T09:24:57.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.734+0000 7f3c3cf13640 1 Processor -- start 2024-01-23T09:24:57.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.734+0000 7f3c3cf13640 1 -- start start 2024-01-23T09:24:57.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.738+0000 7f3c3cf13640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3c380cf280 0x7f3c380c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:57.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.738+0000 7f3c3cf13640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3c380cf660 0x7f3c380c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:57.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.738+0000 7f3c3cf13640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c380c44b0 con 0x7f3c3815da50 2024-01-23T09:24:57.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.738+0000 7f3c3cf13640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c3815d630 con 0x7f3c380cf660 2024-01-23T09:24:57.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.738+0000 7f3c3cf13640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c3815a2b0 con 0x7f3c380cf280 2024-01-23T09:24:57.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.738+0000 7f3c35d9b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3c380cf660 0x7f3c380c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:57.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.738+0000 7f3c35d9b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3c380cf660 0x7f3c380c3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53618/0 (socket says 172.21.15.46:53618) 2024-01-23T09:24:57.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.738+0000 7f3c35d9b640 1 -- 172.21.15.46:0/3419296165 learned_addr learned my addr 172.21.15.46:0/3419296165 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:24:57.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.738+0000 7f3c3659c640 1 --2- 172.21.15.46:0/3419296165 >> v2:172.21.15.175:3300/0 conn(0x7f3c380cf280 0x7f3c380c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:57.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.742+0000 7f3c35d9b640 1 -- 172.21.15.46:0/3419296165 >> v2:172.21.15.175:3300/0 conn(0x7f3c380cf280 msgr2=0x7f3c380c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:24:57.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.742+0000 7f3c35d9b640 1 --2- 172.21.15.46:0/3419296165 >> v2:172.21.15.175:3300/0 conn(0x7f3c380cf280 0x7f3c380c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:57.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.742+0000 7f3c35d9b640 1 -- 172.21.15.46:0/3419296165 >> v1:172.21.15.175:6789/0 conn(0x7f3c3815da50 legacy=0x7f3c38159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:24:57.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.742+0000 7f3c35d9b640 1 -- 172.21.15.46:0/3419296165 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3815a590 con 0x7f3c380cf660 2024-01-23T09:24:57.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.746+0000 7f3c35d9b640 1 --2- 172.21.15.46:0/3419296165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c380cf660 0x7f3c380c3f70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c0098a0 tx=0x7f3c2c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ede7559225bce39 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:24:57.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.754+0000 7f3c3559a640 1 -- 172.21.15.46:0/3419296165 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c0ad640 con 0x7f3c380cf660 2024-01-23T09:24:57.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.754+0000 7f3c3559a640 1 -- 172.21.15.46:0/3419296165 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2c0ad7a0 con 0x7f3c380cf660 2024-01-23T09:24:57.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.754+0000 7f3c3559a640 1 -- 172.21.15.46:0/3419296165 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c0adb30 con 0x7f3c380cf660 2024-01-23T09:24:57.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.758+0000 7f3c3cf13640 1 -- 172.21.15.46:0/3419296165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c380cf660 msgr2=0x7f3c380c3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:57.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.758+0000 7f3c3cf13640 1 --2- 172.21.15.46:0/3419296165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c380cf660 0x7f3c380c3f70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c0098a0 tx=0x7f3c2c01c4a0 comp rx=0 tx=0).stop 2024-01-23T09:24:57.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.758+0000 7f3c3cf13640 1 -- 172.21.15.46:0/3419296165 shutdown_connections 2024-01-23T09:24:57.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.758+0000 7f3c3cf13640 1 --2- 172.21.15.46:0/3419296165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c380cf660 0x7f3c380c3f70 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:57.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.758+0000 7f3c3cf13640 1 --2- 172.21.15.46:0/3419296165 >> v2:172.21.15.175:3300/0 conn(0x7f3c380cf280 0x7f3c380c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:57.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.758+0000 7f3c3cf13640 1 -- 172.21.15.46:0/3419296165 >> 172.21.15.46:0/3419296165 conn(0x7f3c3808afa0 msgr2=0x7f3c3808b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:24:57.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.758+0000 7f3c3cf13640 1 -- 172.21.15.46:0/3419296165 shutdown_connections 2024-01-23T09:24:57.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.758+0000 7f3c3cf13640 1 -- 172.21.15.46:0/3419296165 wait complete. 2024-01-23T09:24:57.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.758+0000 7f3c3cf13640 1 Processor -- start 2024-01-23T09:24:57.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.758+0000 7f3c3cf13640 1 -- start start 2024-01-23T09:24:57.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.758+0000 7f3c3cf13640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c380cf280 0x7f3c38144640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:57.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.758+0000 7f3c3cf13640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c380cf660 0x7f3c3815bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:57.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.758+0000 7f3c3cf13640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c3815da50 0x7f3c3814dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:57.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.758+0000 7f3c3cf13640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c38145bd0 con 0x7f3c380cf660 2024-01-23T09:24:57.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.758+0000 7f3c3cf13640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c38158800 con 0x7f3c3815da50 2024-01-23T09:24:57.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.758+0000 7f3c3cf13640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c38158ae0 con 0x7f3c380cf280 2024-01-23T09:24:57.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.762+0000 7f3c3659c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c380cf280 0x7f3c38144640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:57.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.762+0000 7f3c36d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c3815da50 0x7f3c3814dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:57.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.762+0000 7f3c3659c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c380cf280 0x7f3c38144640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:34540/0 (socket says 172.21.15.46:34540) 2024-01-23T09:24:57.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.762+0000 7f3c3659c640 1 -- 172.21.15.46:0/2412500215 learned_addr learned my addr 172.21.15.46:0/2412500215 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:24:57.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.762+0000 7f3c35d9b640 1 --2- 172.21.15.46:0/2412500215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c380cf660 0x7f3c3815bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:57.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.770+0000 7f3c3659c640 1 -- 172.21.15.46:0/2412500215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c3815da50 msgr2=0x7f3c3814dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:57.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.770+0000 7f3c3659c640 1 --2- 172.21.15.46:0/2412500215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c3815da50 0x7f3c3814dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:57.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.770+0000 7f3c3659c640 1 -- 172.21.15.46:0/2412500215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c380cf660 msgr2=0x7f3c3815bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:57.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.770+0000 7f3c3659c640 1 --2- 172.21.15.46:0/2412500215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c380cf660 0x7f3c3815bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:57.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.770+0000 7f3c3659c640 1 -- 172.21.15.46:0/2412500215 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2c0094d0 con 0x7f3c380cf280 2024-01-23T09:24:57.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.782+0000 7f3c3659c640 1 --2- 172.21.15.46:0/2412500215 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c380cf280 0x7f3c38144640 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3c2800d800 tx=0x7f3c2800dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:24:57.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.902+0000 7f3c26ffd640 1 -- 172.21.15.46:0/2412500215 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2800b6c0 con 0x7f3c380cf280 2024-01-23T09:24:57.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.902+0000 7f3c26ffd640 1 -- 172.21.15.46:0/2412500215 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2800b820 con 0x7f3c380cf280 2024-01-23T09:24:57.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.902+0000 7f3c26ffd640 1 -- 172.21.15.46:0/2412500215 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2800bb90 con 0x7f3c380cf280 2024-01-23T09:24:57.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.902+0000 7f3c3cf13640 1 -- 172.21.15.46:0/2412500215 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c38158dc0 con 0x7f3c380cf280 2024-01-23T09:24:57.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.902+0000 7f3c3cf13640 1 -- 172.21.15.46:0/2412500215 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c38159b00 con 0x7f3c380cf280 2024-01-23T09:24:57.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:57.902+0000 7f3c3cf13640 1 -- 172.21.15.46:0/2412500215 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c38074340 con 0x7f3c380cf280 2024-01-23T09:24:58.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.290+0000 7f3c26ffd640 1 -- 172.21.15.46:0/2412500215 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f3c2800bcf0 con 0x7f3c380cf280 2024-01-23T09:24:58.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.290+0000 7f3c26ffd640 1 --2- 172.21.15.46:0/2412500215 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3c18066550 0x7f3c18068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:58.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.290+0000 7f3c35d9b640 1 --2- 172.21.15.46:0/2412500215 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3c18066550 0x7f3c18068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:58.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.290+0000 7f3c35d9b640 1 --2- 172.21.15.46:0/2412500215 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3c18066550 0x7f3c18068a10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c0af000 tx=0x7f3c2c0a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:24:58.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.306+0000 7f3c26ffd640 1 -- 172.21.15.46:0/2412500215 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f3c28015e40 con 0x7f3c380cf280 2024-01-23T09:24:58.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.334+0000 7f3c26ffd640 1 -- 172.21.15.46:0/2412500215 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f3c28052110 con 0x7f3c380cf280 2024-01-23T09:24:58.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.530+0000 7f3c3cf13640 1 -- 172.21.15.46:0/2412500215 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3c380cc760 con 0x7f3c380cf280 2024-01-23T09:24:58.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.542+0000 7f3c26ffd640 1 -- 172.21.15.46:0/2412500215 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3c28055730 con 0x7f3c380cf280 2024-01-23T09:24:58.545 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2024-01-23T09:24:58.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.542+0000 7f3c3cf13640 1 -- 172.21.15.46:0/2412500215 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3c18066550 msgr2=0x7f3c18068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:58.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.542+0000 7f3c3cf13640 1 --2- 172.21.15.46:0/2412500215 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3c18066550 0x7f3c18068a10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c0af000 tx=0x7f3c2c0a7070 comp rx=0 tx=0).stop 2024-01-23T09:24:58.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.542+0000 7f3c3cf13640 1 -- 172.21.15.46:0/2412500215 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c380cf280 msgr2=0x7f3c38144640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:58.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.542+0000 7f3c3cf13640 1 --2- 172.21.15.46:0/2412500215 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c380cf280 0x7f3c38144640 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3c2800d800 tx=0x7f3c2800dcc0 comp rx=0 tx=0).stop 2024-01-23T09:24:58.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.542+0000 7f3c3cf13640 1 -- 172.21.15.46:0/2412500215 shutdown_connections 2024-01-23T09:24:58.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.542+0000 7f3c3cf13640 1 --2- 172.21.15.46:0/2412500215 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3c18066550 0x7f3c18068a10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:58.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.542+0000 7f3c3cf13640 1 --2- 172.21.15.46:0/2412500215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c3815da50 0x7f3c3814dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:58.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.542+0000 7f3c3cf13640 1 --2- 172.21.15.46:0/2412500215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c380cf660 0x7f3c3815bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:58.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.542+0000 7f3c3cf13640 1 --2- 172.21.15.46:0/2412500215 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c380cf280 0x7f3c38144640 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:58.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.542+0000 7f3c3cf13640 1 -- 172.21.15.46:0/2412500215 >> 172.21.15.46:0/2412500215 conn(0x7f3c3808afa0 msgr2=0x7f3c380ce850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:24:58.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.542+0000 7f3c3cf13640 1 -- 172.21.15.46:0/2412500215 shutdown_connections 2024-01-23T09:24:58.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.542+0000 7f3c3cf13640 1 -- 172.21.15.46:0/2412500215 wait complete. 2024-01-23T09:24:58.567 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-23T09:24:58.567 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-23T09:24:58.573 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-23T09:24:58.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.742+0000 7f910ee27640 1 Processor -- start 2024-01-23T09:24:58.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.742+0000 7f910ee27640 1 -- start start 2024-01-23T09:24:58.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.742+0000 7f910ee27640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f91081580d0 0x7f910806f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:58.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.742+0000 7f910ee27640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9108070f20 0x7f91080cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:58.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.742+0000 7f910ee27640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9108161fd0 con 0x7f9108157cf0 2024-01-23T09:24:58.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.742+0000 7f910ee27640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f910806f990 con 0x7f91081580d0 2024-01-23T09:24:58.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.742+0000 7f910ee27640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9108072d40 con 0x7f9108070f20 2024-01-23T09:24:58.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.742+0000 7f9107fff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f91081580d0 0x7f910806f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:58.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.742+0000 7f910d3c4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9108070f20 0x7f91080cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:58.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.742+0000 7f9107fff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f91081580d0 0x7f910806f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:59328/0 (socket says 172.21.15.46:59328) 2024-01-23T09:24:58.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.742+0000 7f9107fff640 1 -- 172.21.15.46:0/3183156957 learned_addr learned my addr 172.21.15.46:0/3183156957 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:24:58.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.750+0000 7f910d3c4640 1 -- 172.21.15.46:0/3183156957 >> v2:172.21.15.175:3300/0 conn(0x7f91081580d0 msgr2=0x7f910806f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:24:58.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.750+0000 7f910d3c4640 1 --2- 172.21.15.46:0/3183156957 >> v2:172.21.15.175:3300/0 conn(0x7f91081580d0 0x7f910806f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:58.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.750+0000 7f910d3c4640 1 -- 172.21.15.46:0/3183156957 >> v1:172.21.15.175:6789/0 conn(0x7f9108157cf0 legacy=0x7f910815e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:24:58.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.750+0000 7f910d3c4640 1 -- 172.21.15.46:0/3183156957 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9108161450 con 0x7f9108070f20 2024-01-23T09:24:58.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.754+0000 7f910d3c4640 1 --2- 172.21.15.46:0/3183156957 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9108070f20 0x7f91080cb000 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9100009d90 tx=0x7f910001c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bebd9b44296b728 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:24:58.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.766+0000 7f91077fe640 1 -- 172.21.15.46:0/3183156957 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91000a6710 con 0x7f9108070f20 2024-01-23T09:24:58.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.766+0000 7f91077fe640 1 -- 172.21.15.46:0/3183156957 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91000a6870 con 0x7f9108070f20 2024-01-23T09:24:58.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.766+0000 7f91077fe640 1 -- 172.21.15.46:0/3183156957 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91000a6c00 con 0x7f9108070f20 2024-01-23T09:24:58.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.766+0000 7f910ee27640 1 -- 172.21.15.46:0/3183156957 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9108070f20 msgr2=0x7f91080cb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:58.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.766+0000 7f910ee27640 1 --2- 172.21.15.46:0/3183156957 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9108070f20 0x7f91080cb000 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9100009d90 tx=0x7f910001c880 comp rx=0 tx=0).stop 2024-01-23T09:24:58.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.766+0000 7f910ee27640 1 -- 172.21.15.46:0/3183156957 shutdown_connections 2024-01-23T09:24:58.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.766+0000 7f910ee27640 1 --2- 172.21.15.46:0/3183156957 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9108070f20 0x7f91080cb000 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:58.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.766+0000 7f910ee27640 1 --2- 172.21.15.46:0/3183156957 >> v2:172.21.15.175:3300/0 conn(0x7f91081580d0 0x7f910806f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:58.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.766+0000 7f910ee27640 1 -- 172.21.15.46:0/3183156957 >> 172.21.15.46:0/3183156957 conn(0x7f910806d590 msgr2=0x7f9108066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:24:58.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.766+0000 7f910ee27640 1 -- 172.21.15.46:0/3183156957 shutdown_connections 2024-01-23T09:24:58.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.766+0000 7f910ee27640 1 -- 172.21.15.46:0/3183156957 wait complete. 2024-01-23T09:24:58.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.770+0000 7f910ee27640 1 Processor -- start 2024-01-23T09:24:58.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.770+0000 7f910ee27640 1 -- start start 2024-01-23T09:24:58.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.770+0000 7f910ee27640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9108070f20 0x7f910815ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:58.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.770+0000 7f910ee27640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9108157cf0 0x7f91081461f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:58.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.770+0000 7f910ee27640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91080c9a50 0x7f91081fa4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:58.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.770+0000 7f910ee27640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910815bf60 con 0x7f9108070f20 2024-01-23T09:24:58.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.770+0000 7f910ee27640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910815fb00 con 0x7f91080c9a50 2024-01-23T09:24:58.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.770+0000 7f910ee27640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910815d550 con 0x7f9108157cf0 2024-01-23T09:24:58.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.770+0000 7f910d3c4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91080c9a50 0x7f91081fa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:58.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.774+0000 7f910cbc3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9108070f20 0x7f910815ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:58.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.774+0000 7f9107fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9108157cf0 0x7f91081461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:58.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.774+0000 7f910d3c4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91080c9a50 0x7f91081fa4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:59338/0 (socket says 172.21.15.46:59338) 2024-01-23T09:24:58.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.774+0000 7f910d3c4640 1 -- 172.21.15.46:0/1770665907 learned_addr learned my addr 172.21.15.46:0/1770665907 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:24:58.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.778+0000 7f910cbc3640 1 -- 172.21.15.46:0/1770665907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9108157cf0 msgr2=0x7f91081461f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:58.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.778+0000 7f910cbc3640 1 --2- 172.21.15.46:0/1770665907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9108157cf0 0x7f91081461f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:58.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.778+0000 7f910cbc3640 1 -- 172.21.15.46:0/1770665907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91080c9a50 msgr2=0x7f91081fa4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:58.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.778+0000 7f910cbc3640 1 --2- 172.21.15.46:0/1770665907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91080c9a50 0x7f91081fa4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:58.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.778+0000 7f910cbc3640 1 -- 172.21.15.46:0/1770665907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9100009a70 con 0x7f9108070f20 2024-01-23T09:24:58.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.778+0000 7f910cbc3640 1 --2- 172.21.15.46:0/1770665907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9108070f20 0x7f910815ecb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f90fc00c3e0 tx=0x7f90fc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:24:58.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.786+0000 7f91057fa640 1 -- 172.21.15.46:0/1770665907 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc011790 con 0x7f9108070f20 2024-01-23T09:24:58.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.786+0000 7f91057fa640 1 -- 172.21.15.46:0/1770665907 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90fc0118f0 con 0x7f9108070f20 2024-01-23T09:24:58.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.786+0000 7f91057fa640 1 -- 172.21.15.46:0/1770665907 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc011ce0 con 0x7f9108070f20 2024-01-23T09:24:58.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.786+0000 7f910ee27640 1 -- 172.21.15.46:0/1770665907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f910815db30 con 0x7f9108070f20 2024-01-23T09:24:58.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.786+0000 7f910ee27640 1 -- 172.21.15.46:0/1770665907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f910815c830 con 0x7f9108070f20 2024-01-23T09:24:58.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:58.786+0000 7f910ee27640 1 -- 172.21.15.46:0/1770665907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9108074340 con 0x7f9108070f20 2024-01-23T09:24:59.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.086+0000 7f91057fa640 1 -- 172.21.15.46:0/1770665907 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f90fc01c460 con 0x7f9108070f20 2024-01-23T09:24:59.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.090+0000 7f91057fa640 1 --2- 172.21.15.46:0/1770665907 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f90ec066580 0x7f90ec068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:59.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.090+0000 7f9107fff640 1 --2- 172.21.15.46:0/1770665907 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f90ec066580 0x7f90ec068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:59.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.090+0000 7f9107fff640 1 --2- 172.21.15.46:0/1770665907 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f90ec066580 0x7f90ec068a40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f91080c9920 tx=0x7f90f4009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:24:59.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.118+0000 7f91057fa640 1 -- 172.21.15.46:0/1770665907 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f90fc011e40 con 0x7f9108070f20 2024-01-23T09:24:59.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.122+0000 7f91057fa640 1 -- 172.21.15.46:0/1770665907 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f90fc051860 con 0x7f9108070f20 2024-01-23T09:24:59.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.306+0000 7f910ee27640 1 -- 172.21.15.46:0/1770665907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f910815c830 con 0x7f9108070f20 2024-01-23T09:24:59.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.362+0000 7f91057fa640 1 -- 172.21.15.46:0/1770665907 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18552 (secure 0 0 0) 0x7f910815c830 con 0x7f9108070f20 2024-01-23T09:24:59.368 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T09:24:59.368 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":30,"fsid":"fdbdd393-f422-45ae-a488-2bbb0163e580","created":"2024-01-23T08:53:36.942515+0000","modified":"2024-01-23T08:55:46.483867+0000","last_up_change":"2024-01-23T08:53:57.198113+0000","last_in_change":"2024-01-23T08:53:47.852614+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-23T08:53:59.340853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-23T08:54:38.278770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-23T08:54:40.216521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-23T08:54:47.311079+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f32c3d7d-e32a-42d8-b55f-db874d915a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6818","nonce":2681790976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6821","nonce":2681790976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6825","nonce":2681790976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6823","nonce":2681790976}]},"public_addr":"172.21.15.46:6818/2681790976","cluster_addr":"172.21.15.46:6821/2681790976","heartbeat_back_addr":"172.21.15.46:6825/2681790976","heartbeat_front_addr":"172.21.15.46:6823/2681790976","state":["exists","up"]},{"osd":1,"uuid":"6f3b6bd2-bbea-4d08-84d5-4407363b5eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6803","nonce":3679152623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6805","nonce":3679152623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6809","nonce":3679152623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6807","nonce":3679152623}]},"public_addr":"172.21.15.46:6803/3679152623","cluster_addr":"172.21.15.46:6805/3679152623","heartbeat_back_addr":"172.21.15.46:6809/3679152623","heartbeat_front_addr":"172.21.15.46:6807/3679152623","state":["exists","up"]},{"osd":2,"uuid":"8f110727-31e7-4f69-926b-c87481d4d28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6811","nonce":3869652274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6813","nonce":3869652274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6820","nonce":3869652274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6815","nonce":3869652274}]},"public_addr":"172.21.15.46:6811/3869652274","cluster_addr":"172.21.15.46:6813/3869652274","heartbeat_back_addr":"172.21.15.46:6820/3869652274","heartbeat_front_addr":"172.21.15.46:6815/3869652274","state":["exists","up"]},{"osd":3,"uuid":"3aa7527d-0463-4373-b9c7-e6b507a7987f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6827","nonce":4168860822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6829","nonce":4168860822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6833","nonce":4168860822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6831","nonce":4168860822}]},"public_addr":"172.21.15.46:6827/4168860822","cluster_addr":"172.21.15.46:6829/4168860822","heartbeat_back_addr":"172.21.15.46:6833/4168860822","heartbeat_front_addr":"172.21.15.46:6831/4168860822","state":["exists","up"]},{"osd":4,"uuid":"eb47a1e5-9f26-465f-b188-87c6eed63c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6805","nonce":3115257412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6808","nonce":3115257412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6815","nonce":3115257412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6812","nonce":3115257412}]},"public_addr":"172.21.15.175:6805/3115257412","cluster_addr":"172.21.15.175:6808/3115257412","heartbeat_back_addr":"172.21.15.175:6815/3115257412","heartbeat_front_addr":"172.21.15.175:6812/3115257412","state":["exists","up"]},{"osd":5,"uuid":"34048409-998c-44f3-a29d-dcad7a6c917b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6818","nonce":3146473948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6822","nonce":3146473948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6831","nonce":3146473948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6826","nonce":3146473948}]},"public_addr":"172.21.15.175:6818/3146473948","cluster_addr":"172.21.15.175:6822/3146473948","heartbeat_back_addr":"172.21.15.175:6831/3146473948","heartbeat_front_addr":"172.21.15.175:6826/3146473948","state":["exists","up"]},{"osd":6,"uuid":"f5d45d3f-9af3-44a1-a730-c260ed1654b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6801","nonce":4161180058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6804","nonce":4161180058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6814","nonce":4161180058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6809","nonce":4161180058}]},"public_addr":"172.21.15.175:6801/4161180058","cluster_addr":"172.21.15.175:6804/4161180058","heartbeat_back_addr":"172.21.15.175:6814/4161180058","heartbeat_front_addr":"172.21.15.175:6809/4161180058","state":["exists","up"]},{"osd":7,"uuid":"16d12e53-2ad3-4b5c-a789-22b45056fd9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6819","nonce":2670236415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6823","nonce":2670236415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6830","nonce":2670236415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6827","nonce":2670236415}]},"public_addr":"172.21.15.175:6819/2670236415","cluster_addr":"172.21.15.175:6823/2670236415","heartbeat_back_addr":"172.21.15.175:6830/2670236415","heartbeat_front_addr":"172.21.15.175:6827/2670236415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.847037+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.765547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.716122+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.874628+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.786580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.924885+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.285635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.898130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":0,"to":7}]},{"pgid":"4.4","mappings":[{"from":3,"to":5}]},{"pgid":"4.17","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T09:24:59.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.366+0000 7f910ee27640 1 -- 172.21.15.46:0/1770665907 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f90ec066580 msgr2=0x7f90ec068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:59.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.366+0000 7f910ee27640 1 --2- 172.21.15.46:0/1770665907 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f90ec066580 0x7f90ec068a40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f91080c9920 tx=0x7f90f4009240 comp rx=0 tx=0).stop 2024-01-23T09:24:59.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.366+0000 7f910ee27640 1 -- 172.21.15.46:0/1770665907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9108070f20 msgr2=0x7f910815ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:59.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.366+0000 7f910ee27640 1 --2- 172.21.15.46:0/1770665907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9108070f20 0x7f910815ecb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f90fc00c3e0 tx=0x7f90fc00c8a0 comp rx=0 tx=0).stop 2024-01-23T09:24:59.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.366+0000 7f910ee27640 1 -- 172.21.15.46:0/1770665907 shutdown_connections 2024-01-23T09:24:59.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.366+0000 7f910ee27640 1 --2- 172.21.15.46:0/1770665907 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f90ec066580 0x7f90ec068a40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:59.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.366+0000 7f910ee27640 1 --2- 172.21.15.46:0/1770665907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91080c9a50 0x7f91081fa4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:59.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.366+0000 7f910ee27640 1 --2- 172.21.15.46:0/1770665907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9108157cf0 0x7f91081461f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:59.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.366+0000 7f910ee27640 1 --2- 172.21.15.46:0/1770665907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9108070f20 0x7f910815ecb0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:59.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.366+0000 7f910ee27640 1 -- 172.21.15.46:0/1770665907 >> 172.21.15.46:0/1770665907 conn(0x7f910806d590 msgr2=0x7f910815e210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:24:59.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.366+0000 7f910ee27640 1 -- 172.21.15.46:0/1770665907 shutdown_connections 2024-01-23T09:24:59.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.366+0000 7f910ee27640 1 -- 172.21.15.46:0/1770665907 wait complete. 2024-01-23T09:24:59.394 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-23T08:53:59.340853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-23T08:54:38.278770+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-23T08:54:40.216521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-23T08:54:47.311079+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-23T09:24:59.394 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-23T09:24:59.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.522+0000 7f49f1d72640 1 Processor -- start 2024-01-23T09:24:59.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.522+0000 7f49f1d72640 1 -- start start 2024-01-23T09:24:59.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.522+0000 7f49f1d72640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f49ec1503c0 0x7f49ec0c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:59.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.522+0000 7f49f1d72640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49ec072760 0x7f49ec156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:59.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.522+0000 7f49f1d72640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49ec156760 con 0x7f49ec0c7cd0 2024-01-23T09:24:59.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.522+0000 7f49f1d72640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49ec1507a0 con 0x7f49ec1503c0 2024-01-23T09:24:59.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.522+0000 7f49f1d72640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec071a10 con 0x7f49ec072760 2024-01-23T09:24:59.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.522+0000 7f49eb7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f49ec1503c0 0x7f49ec0c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:59.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.526+0000 7f49eaffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49ec072760 0x7f49ec156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:59.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.526+0000 7f49eb7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f49ec1503c0 0x7f49ec0c57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53638/0 (socket says 172.21.15.46:53638) 2024-01-23T09:24:59.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.526+0000 7f49eb7fe640 1 -- 172.21.15.46:0/3079125304 learned_addr learned my addr 172.21.15.46:0/3079125304 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:24:59.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.526+0000 7f49eb7fe640 1 -- 172.21.15.46:0/3079125304 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49ec072760 msgr2=0x7f49ec156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:24:59.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.526+0000 7f49eb7fe640 1 --2- 172.21.15.46:0/3079125304 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49ec072760 0x7f49ec156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:59.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.526+0000 7f49eb7fe640 1 -- 172.21.15.46:0/3079125304 >> v1:172.21.15.175:6789/0 conn(0x7f49ec0c7cd0 legacy=0x7f49ec1598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:59.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.526+0000 7f49eb7fe640 1 -- 172.21.15.46:0/3079125304 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ec071cf0 con 0x7f49ec1503c0 2024-01-23T09:24:59.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.530+0000 7f49eb7fe640 1 --2- 172.21.15.46:0/3079125304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49ec1503c0 0x7f49ec0c57d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f49e4009e50 tx=0x7f49e4021400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e6bae03c555b16 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:24:59.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.534+0000 7f49ea7fc640 1 -- 172.21.15.46:0/3079125304 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e40b1400 con 0x7f49ec1503c0 2024-01-23T09:24:59.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.534+0000 7f49ea7fc640 1 -- 172.21.15.46:0/3079125304 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e40ad050 con 0x7f49ec1503c0 2024-01-23T09:24:59.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.534+0000 7f49ea7fc640 1 -- 172.21.15.46:0/3079125304 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e40b1780 con 0x7f49ec1503c0 2024-01-23T09:24:59.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.538+0000 7f49f1d72640 1 -- 172.21.15.46:0/3079125304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49ec1503c0 msgr2=0x7f49ec0c57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:59.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.538+0000 7f49f1d72640 1 --2- 172.21.15.46:0/3079125304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49ec1503c0 0x7f49ec0c57d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f49e4009e50 tx=0x7f49e4021400 comp rx=0 tx=0).stop 2024-01-23T09:24:59.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.538+0000 7f49f1d72640 1 -- 172.21.15.46:0/3079125304 shutdown_connections 2024-01-23T09:24:59.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.538+0000 7f49f1d72640 1 --2- 172.21.15.46:0/3079125304 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49ec072760 0x7f49ec156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:59.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.538+0000 7f49f1d72640 1 --2- 172.21.15.46:0/3079125304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49ec1503c0 0x7f49ec0c57d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:59.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.538+0000 7f49f1d72640 1 -- 172.21.15.46:0/3079125304 >> 172.21.15.46:0/3079125304 conn(0x7f49ec06aa60 msgr2=0x7f49ec06ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:24:59.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.538+0000 7f49f1d72640 1 -- 172.21.15.46:0/3079125304 shutdown_connections 2024-01-23T09:24:59.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.538+0000 7f49f1d72640 1 -- 172.21.15.46:0/3079125304 wait complete. 2024-01-23T09:24:59.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.538+0000 7f49f1d72640 1 Processor -- start 2024-01-23T09:24:59.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.538+0000 7f49f1d72640 1 -- start start 2024-01-23T09:24:59.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.538+0000 7f49f1d72640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49ec072760 0x7f49ec1eb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:59.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.538+0000 7f49f1d72640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49ec0c7cd0 0x7f49ec0c2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:59.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.538+0000 7f49f1d72640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49ec1503c0 0x7f49ec1557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:59.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.538+0000 7f49f1d72640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec1548f0 con 0x7f49ec1503c0 2024-01-23T09:24:59.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.538+0000 7f49f1d72640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec1ebe60 con 0x7f49ec072760 2024-01-23T09:24:59.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.538+0000 7f49f1d72640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec154370 con 0x7f49ec0c7cd0 2024-01-23T09:24:59.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.542+0000 7f49ebfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49ec1503c0 0x7f49ec1557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:59.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.542+0000 7f49ebfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49ec1503c0 0x7f49ec1557c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53642/0 (socket says 172.21.15.46:53642) 2024-01-23T09:24:59.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.542+0000 7f49ebfff640 1 -- 172.21.15.46:0/779444355 learned_addr learned my addr 172.21.15.46:0/779444355 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:24:59.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.542+0000 7f49eb7fe640 1 --2- 172.21.15.46:0/779444355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49ec072760 0x7f49ec1eb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:59.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.542+0000 7f49eaffd640 1 --2- 172.21.15.46:0/779444355 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49ec0c7cd0 0x7f49ec0c2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:59.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.546+0000 7f49ebfff640 1 -- 172.21.15.46:0/779444355 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49ec0c7cd0 msgr2=0x7f49ec0c2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:59.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.546+0000 7f49ebfff640 1 --2- 172.21.15.46:0/779444355 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49ec0c7cd0 0x7f49ec0c2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:59.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.546+0000 7f49ebfff640 1 -- 172.21.15.46:0/779444355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49ec072760 msgr2=0x7f49ec1eb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:24:59.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.546+0000 7f49ebfff640 1 --2- 172.21.15.46:0/779444355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49ec072760 0x7f49ec1eb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:24:59.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.546+0000 7f49ebfff640 1 -- 172.21.15.46:0/779444355 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e4009b30 con 0x7f49ec1503c0 2024-01-23T09:24:59.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.546+0000 7f49ebfff640 1 --2- 172.21.15.46:0/779444355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49ec1503c0 0x7f49ec1557c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f49dc00c430 tx=0x7f49dc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:24:59.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.550+0000 7f49d3fff640 1 -- 172.21.15.46:0/779444355 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc005220 con 0x7f49ec1503c0 2024-01-23T09:24:59.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.550+0000 7f49d3fff640 1 -- 172.21.15.46:0/779444355 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49dc005380 con 0x7f49ec1503c0 2024-01-23T09:24:59.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.550+0000 7f49f1d72640 1 -- 172.21.15.46:0/779444355 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49ec154610 con 0x7f49ec1503c0 2024-01-23T09:24:59.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.550+0000 7f49d3fff640 1 -- 172.21.15.46:0/779444355 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc007270 con 0x7f49ec1503c0 2024-01-23T09:24:59.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.550+0000 7f49f1d72640 1 -- 172.21.15.46:0/779444355 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49ec154fc0 con 0x7f49ec1503c0 2024-01-23T09:24:59.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.554+0000 7f49f1d72640 1 -- 172.21.15.46:0/779444355 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49ec074340 con 0x7f49ec1503c0 2024-01-23T09:24:59.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.578+0000 7f49d3fff640 1 -- 172.21.15.46:0/779444355 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f49dc0073d0 con 0x7f49ec1503c0 2024-01-23T09:24:59.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.578+0000 7f49d3fff640 1 --2- 172.21.15.46:0/779444355 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f49d8066580 0x7f49d8068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:24:59.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.578+0000 7f49eb7fe640 1 --2- 172.21.15.46:0/779444355 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f49d8066580 0x7f49d8068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:24:59.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.578+0000 7f49eb7fe640 1 --2- 172.21.15.46:0/779444355 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f49d8066580 0x7f49d8068a40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f49e40b3000 tx=0x7f49e40ac000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:24:59.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.870+0000 7f49d3fff640 1 -- 172.21.15.46:0/779444355 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f49dc007680 con 0x7f49ec1503c0 2024-01-23T09:24:59.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:24:59.870+0000 7f49d3fff640 1 -- 172.21.15.46:0/779444355 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f49dc0508d0 con 0x7f49ec1503c0 2024-01-23T09:25:00.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.046+0000 7f49f1d72640 1 -- 172.21.15.46:0/779444355 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f49ec0c5af0 con 0x7f49ec1503c0 2024-01-23T09:25:00.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.054+0000 7f49d3fff640 1 -- 172.21.15.46:0/779444355 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f49dc053ef0 con 0x7f49ec1503c0 2024-01-23T09:25:00.056 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-01-23T09:25:00.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.054+0000 7f49f1d72640 1 -- 172.21.15.46:0/779444355 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f49d8066580 msgr2=0x7f49d8068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:00.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.054+0000 7f49f1d72640 1 --2- 172.21.15.46:0/779444355 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f49d8066580 0x7f49d8068a40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f49e40b3000 tx=0x7f49e40ac000 comp rx=0 tx=0).stop 2024-01-23T09:25:00.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.054+0000 7f49f1d72640 1 -- 172.21.15.46:0/779444355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49ec1503c0 msgr2=0x7f49ec1557c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:00.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.054+0000 7f49f1d72640 1 --2- 172.21.15.46:0/779444355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49ec1503c0 0x7f49ec1557c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f49dc00c430 tx=0x7f49dc00c8f0 comp rx=0 tx=0).stop 2024-01-23T09:25:00.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.054+0000 7f49f1d72640 1 -- 172.21.15.46:0/779444355 shutdown_connections 2024-01-23T09:25:00.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.054+0000 7f49f1d72640 1 --2- 172.21.15.46:0/779444355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49ec1503c0 0x7f49ec1557c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:00.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.054+0000 7f49f1d72640 1 --2- 172.21.15.46:0/779444355 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49ec0c7cd0 0x7f49ec0c2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:00.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.054+0000 7f49f1d72640 1 --2- 172.21.15.46:0/779444355 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f49d8066580 0x7f49d8068a40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:00.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.054+0000 7f49f1d72640 1 --2- 172.21.15.46:0/779444355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49ec072760 0x7f49ec1eb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:00.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.054+0000 7f49f1d72640 1 -- 172.21.15.46:0/779444355 >> 172.21.15.46:0/779444355 conn(0x7f49ec06aa60 msgr2=0x7f49ec06f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:00.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.054+0000 7f49f1d72640 1 -- 172.21.15.46:0/779444355 shutdown_connections 2024-01-23T09:25:00.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.054+0000 7f49f1d72640 1 -- 172.21.15.46:0/779444355 wait complete. 2024-01-23T09:25:00.077 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-23T09:25:00.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.198+0000 7fd8e5136640 1 Processor -- start 2024-01-23T09:25:00.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.198+0000 7fd8e5136640 1 -- start start 2024-01-23T09:25:00.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.198+0000 7fd8e5136640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd8e015dc40 0x7fd8e00c6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:00.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.198+0000 7fd8e5136640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd8e00728e0 0x7fd8e006b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:00.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.198+0000 7fd8e5136640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8e015e020 0x7fd8e0157690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:00.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.198+0000 7fd8e5136640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e006b890 con 0x7fd8e00728e0 2024-01-23T09:25:00.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.198+0000 7fd8e5136640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e0071840 con 0x7fd8e015dc40 2024-01-23T09:25:00.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.198+0000 7fd8e5136640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e0071b20 con 0x7fd8e015e020 2024-01-23T09:25:00.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.202+0000 7fd8ded9d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd8e015dc40 0x7fd8e00c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:00.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.202+0000 7fd8df59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8e015e020 0x7fd8e0157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:00.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.202+0000 7fd8ded9d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd8e015dc40 0x7fd8e00c6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:59368/0 (socket says 172.21.15.46:59368) 2024-01-23T09:25:00.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.202+0000 7fd8ded9d640 1 -- 172.21.15.46:0/3719583528 learned_addr learned my addr 172.21.15.46:0/3719583528 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:00.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.206+0000 7fd8de59c640 1 --2- 172.21.15.46:0/3719583528 >> v2:172.21.15.46:3300/0 conn(0x7fd8e00728e0 0x7fd8e006b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:00.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.206+0000 7fd8de59c640 1 -- 172.21.15.46:0/3719583528 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8e015e020 msgr2=0x7fd8e0157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:00.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.206+0000 7fd8de59c640 1 --2- 172.21.15.46:0/3719583528 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8e015e020 0x7fd8e0157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:00.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.206+0000 7fd8de59c640 1 -- 172.21.15.46:0/3719583528 >> v2:172.21.15.175:3300/0 conn(0x7fd8e015dc40 msgr2=0x7fd8e00c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:00.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.206+0000 7fd8de59c640 1 --2- 172.21.15.46:0/3719583528 >> v2:172.21.15.175:3300/0 conn(0x7fd8e015dc40 0x7fd8e00c6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:00.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.206+0000 7fd8de59c640 1 -- 172.21.15.46:0/3719583528 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e0071e00 con 0x7fd8e00728e0 2024-01-23T09:25:00.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.210+0000 7fd8de59c640 1 --2- 172.21.15.46:0/3719583528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8e00728e0 0x7fd8e006b070 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0070390 tx=0x7fd8d001ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f0d589aae3403d8 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:00.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.214+0000 7fd8ddd9b640 1 -- 172.21.15.46:0/3719583528 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d00a8910 con 0x7fd8e00728e0 2024-01-23T09:25:00.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.214+0000 7fd8ddd9b640 1 -- 172.21.15.46:0/3719583528 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d00a8a70 con 0x7fd8e00728e0 2024-01-23T09:25:00.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.214+0000 7fd8ddd9b640 1 -- 172.21.15.46:0/3719583528 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d00a8e00 con 0x7fd8e00728e0 2024-01-23T09:25:00.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.218+0000 7fd8e5136640 1 -- 172.21.15.46:0/3719583528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8e00728e0 msgr2=0x7fd8e006b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:00.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.218+0000 7fd8e5136640 1 --2- 172.21.15.46:0/3719583528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8e00728e0 0x7fd8e006b070 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0070390 tx=0x7fd8d001ec50 comp rx=0 tx=0).stop 2024-01-23T09:25:00.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.218+0000 7fd8e5136640 1 -- 172.21.15.46:0/3719583528 shutdown_connections 2024-01-23T09:25:00.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.218+0000 7fd8e5136640 1 --2- 172.21.15.46:0/3719583528 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8e015e020 0x7fd8e0157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:00.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.218+0000 7fd8e5136640 1 --2- 172.21.15.46:0/3719583528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8e00728e0 0x7fd8e006b070 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:00.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.218+0000 7fd8e5136640 1 --2- 172.21.15.46:0/3719583528 >> v2:172.21.15.175:3300/0 conn(0x7fd8e015dc40 0x7fd8e00c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:00.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.218+0000 7fd8e5136640 1 -- 172.21.15.46:0/3719583528 >> 172.21.15.46:0/3719583528 conn(0x7fd8e00cb3e0 msgr2=0x7fd8e00cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:00.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.218+0000 7fd8e5136640 1 -- 172.21.15.46:0/3719583528 shutdown_connections 2024-01-23T09:25:00.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.218+0000 7fd8e5136640 1 -- 172.21.15.46:0/3719583528 wait complete. 2024-01-23T09:25:00.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.218+0000 7fd8e5136640 1 Processor -- start 2024-01-23T09:25:00.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.218+0000 7fd8e5136640 1 -- start start 2024-01-23T09:25:00.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.218+0000 7fd8e5136640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8e00728e0 0x7fd8e00ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:00.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.218+0000 7fd8e5136640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8e015dc40 0x7fd8e01545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:00.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.218+0000 7fd8e5136640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8e015e020 0x7fd8e0160030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:00.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.218+0000 7fd8e5136640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e00caa60 con 0x7fd8e015e020 2024-01-23T09:25:00.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.218+0000 7fd8e5136640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e015f300 con 0x7fd8e00728e0 2024-01-23T09:25:00.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.218+0000 7fd8e5136640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e00c9d70 con 0x7fd8e015dc40 2024-01-23T09:25:00.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.226+0000 7fd8de59c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8e015dc40 0x7fd8e01545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:00.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.226+0000 7fd8de59c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8e015dc40 0x7fd8e01545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:34586/0 (socket says 172.21.15.46:34586) 2024-01-23T09:25:00.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.226+0000 7fd8de59c640 1 -- 172.21.15.46:0/1705359407 learned_addr learned my addr 172.21.15.46:0/1705359407 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:00.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.226+0000 7fd8ded9d640 1 --2- 172.21.15.46:0/1705359407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8e00728e0 0x7fd8e00ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:00.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.226+0000 7fd8df59e640 1 --2- 172.21.15.46:0/1705359407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8e015e020 0x7fd8e0160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:00.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.234+0000 7fd8df59e640 1 -- 172.21.15.46:0/1705359407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8e015dc40 msgr2=0x7fd8e01545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:00.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.234+0000 7fd8df59e640 1 --2- 172.21.15.46:0/1705359407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8e015dc40 0x7fd8e01545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:00.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.234+0000 7fd8df59e640 1 -- 172.21.15.46:0/1705359407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8e00728e0 msgr2=0x7fd8e00ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:00.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.234+0000 7fd8df59e640 1 --2- 172.21.15.46:0/1705359407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8e00728e0 0x7fd8e00ca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:00.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.234+0000 7fd8df59e640 1 -- 172.21.15.46:0/1705359407 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d0009420 con 0x7fd8e015e020 2024-01-23T09:25:00.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.238+0000 7fd8df59e640 1 --2- 172.21.15.46:0/1705359407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8e015e020 0x7fd8e0160030 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd8d800eba0 tx=0x7fd8d800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:00.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.242+0000 7fd8c77fe640 1 -- 172.21.15.46:0/1705359407 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d800cd20 con 0x7fd8e015e020 2024-01-23T09:25:00.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.242+0000 7fd8c77fe640 1 -- 172.21.15.46:0/1705359407 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d800f040 con 0x7fd8e015e020 2024-01-23T09:25:00.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.242+0000 7fd8e5136640 1 -- 172.21.15.46:0/1705359407 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e00ca050 con 0x7fd8e015e020 2024-01-23T09:25:00.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.242+0000 7fd8c77fe640 1 -- 172.21.15.46:0/1705359407 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d80146c0 con 0x7fd8e015e020 2024-01-23T09:25:00.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.242+0000 7fd8e5136640 1 -- 172.21.15.46:0/1705359407 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e015f830 con 0x7fd8e015e020 2024-01-23T09:25:00.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.242+0000 7fd8e5136640 1 -- 172.21.15.46:0/1705359407 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e0074340 con 0x7fd8e015e020 2024-01-23T09:25:00.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.622+0000 7fd8c77fe640 1 -- 172.21.15.46:0/1705359407 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd8d8014820 con 0x7fd8e015e020 2024-01-23T09:25:00.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.622+0000 7fd8c77fe640 1 --2- 172.21.15.46:0/1705359407 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd8cc066550 0x7fd8cc068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:00.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.622+0000 7fd8ded9d640 1 --2- 172.21.15.46:0/1705359407 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd8cc066550 0x7fd8cc068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:00.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.626+0000 7fd8ded9d640 1 --2- 172.21.15.46:0/1705359407 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd8cc066550 0x7fd8cc068a10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4006cd0 tx=0x7fd8d4009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:00.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.662+0000 7fd8c77fe640 1 -- 172.21.15.46:0/1705359407 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fd8d8056020 con 0x7fd8e015e020 2024-01-23T09:25:00.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.662+0000 7fd8c77fe640 1 -- 172.21.15.46:0/1705359407 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd8d8052360 con 0x7fd8e015e020 2024-01-23T09:25:00.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.842+0000 7fd8e5136640 1 -- 172.21.15.46:0/1705359407 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd8e00c2730 con 0x7fd8e015e020 2024-01-23T09:25:00.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.882+0000 7fd8c77fe640 1 -- 172.21.15.46:0/1705359407 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd8d8055980 con 0x7fd8e015e020 2024-01-23T09:25:00.885 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-23T09:25:00.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.882+0000 7fd8e5136640 1 -- 172.21.15.46:0/1705359407 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd8cc066550 msgr2=0x7fd8cc068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:00.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.882+0000 7fd8e5136640 1 --2- 172.21.15.46:0/1705359407 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd8cc066550 0x7fd8cc068a10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4006cd0 tx=0x7fd8d4009240 comp rx=0 tx=0).stop 2024-01-23T09:25:00.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.882+0000 7fd8e5136640 1 -- 172.21.15.46:0/1705359407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8e015e020 msgr2=0x7fd8e0160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:00.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.882+0000 7fd8e5136640 1 --2- 172.21.15.46:0/1705359407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8e015e020 0x7fd8e0160030 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd8d800eba0 tx=0x7fd8d800c490 comp rx=0 tx=0).stop 2024-01-23T09:25:00.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.886+0000 7fd8e5136640 1 -- 172.21.15.46:0/1705359407 shutdown_connections 2024-01-23T09:25:00.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.886+0000 7fd8e5136640 1 --2- 172.21.15.46:0/1705359407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8e015e020 0x7fd8e0160030 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:00.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.886+0000 7fd8e5136640 1 --2- 172.21.15.46:0/1705359407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8e015dc40 0x7fd8e01545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:00.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.886+0000 7fd8e5136640 1 --2- 172.21.15.46:0/1705359407 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd8cc066550 0x7fd8cc068a10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:00.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.886+0000 7fd8e5136640 1 --2- 172.21.15.46:0/1705359407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8e00728e0 0x7fd8e00ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:00.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.886+0000 7fd8e5136640 1 -- 172.21.15.46:0/1705359407 >> 172.21.15.46:0/1705359407 conn(0x7fd8e00cb3e0 msgr2=0x7fd8e01556b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:00.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.886+0000 7fd8e5136640 1 -- 172.21.15.46:0/1705359407 shutdown_connections 2024-01-23T09:25:00.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:00.886+0000 7fd8e5136640 1 -- 172.21.15.46:0/1705359407 wait complete. 2024-01-23T09:25:00.912 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-23T09:25:01.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.042+0000 7efd455d7640 1 Processor -- start 2024-01-23T09:25:01.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.042+0000 7efd455d7640 1 -- start start 2024-01-23T09:25:01.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.042+0000 7efd455d7640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efd400c7f30 0x7efd4006da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:01.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.042+0000 7efd455d7640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd4015a9d0 con 0x7efd401518a0 2024-01-23T09:25:01.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.042+0000 7efd455d7640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd401573e0 con 0x7efd4006dfd0 2024-01-23T09:25:01.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.042+0000 7efd455d7640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd401576a0 con 0x7efd400c7f30 2024-01-23T09:25:01.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.042+0000 7efd3effd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efd400c7f30 0x7efd4006da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:01.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.046+0000 7efd3effd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efd400c7f30 0x7efd4006da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:59384/0 (socket says 172.21.15.46:59384) 2024-01-23T09:25:01.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.046+0000 7efd3effd640 1 -- 172.21.15.46:0/1594487358 learned_addr learned my addr 172.21.15.46:0/1594487358 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:01.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.050+0000 7efd3effd640 1 -- 172.21.15.46:0/1594487358 >> v1:172.21.15.175:6789/0 conn(0x7efd4006dfd0 legacy=0x7efd40151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:01.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.050+0000 7efd3effd640 1 -- 172.21.15.46:0/1594487358 >> v1:172.21.15.46:6789/0 conn(0x7efd401518a0 legacy=0x7efd4015ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:01.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.050+0000 7efd3effd640 1 -- 172.21.15.46:0/1594487358 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd40157980 con 0x7efd400c7f30 2024-01-23T09:25:01.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.062+0000 7efd3effd640 1 --2- 172.21.15.46:0/1594487358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd400c7f30 0x7efd4006da90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efd300098a0 tx=0x7efd3001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5e7f8f7497765d3 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:01.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.074+0000 7efd3e7fc640 1 -- 172.21.15.46:0/1594487358 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd300ad640 con 0x7efd400c7f30 2024-01-23T09:25:01.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.074+0000 7efd3e7fc640 1 -- 172.21.15.46:0/1594487358 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd300ad7a0 con 0x7efd400c7f30 2024-01-23T09:25:01.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.074+0000 7efd3e7fc640 1 -- 172.21.15.46:0/1594487358 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd300adb30 con 0x7efd400c7f30 2024-01-23T09:25:01.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.074+0000 7efd455d7640 1 -- 172.21.15.46:0/1594487358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd400c7f30 msgr2=0x7efd4006da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:01.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.074+0000 7efd455d7640 1 --2- 172.21.15.46:0/1594487358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd400c7f30 0x7efd4006da90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efd300098a0 tx=0x7efd3001c4a0 comp rx=0 tx=0).stop 2024-01-23T09:25:01.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.074+0000 7efd455d7640 1 -- 172.21.15.46:0/1594487358 shutdown_connections 2024-01-23T09:25:01.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.074+0000 7efd455d7640 1 --2- 172.21.15.46:0/1594487358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd400c7f30 0x7efd4006da90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:01.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.074+0000 7efd455d7640 1 -- 172.21.15.46:0/1594487358 >> 172.21.15.46:0/1594487358 conn(0x7efd4006aa60 msgr2=0x7efd4006ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:01.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.074+0000 7efd455d7640 1 -- 172.21.15.46:0/1594487358 shutdown_connections 2024-01-23T09:25:01.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.074+0000 7efd455d7640 1 -- 172.21.15.46:0/1594487358 wait complete. 2024-01-23T09:25:01.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.078+0000 7efd455d7640 1 Processor -- start 2024-01-23T09:25:01.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.078+0000 7efd455d7640 1 -- start start 2024-01-23T09:25:01.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.078+0000 7efd455d7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd4006dfd0 0x7efd40159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:01.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.078+0000 7efd455d7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd400c7f30 0x7efd400c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:01.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.078+0000 7efd455d7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd401518a0 0x7efd400c0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:01.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.078+0000 7efd455d7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd400c3a60 con 0x7efd401518a0 2024-01-23T09:25:01.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.078+0000 7efd455d7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd400c05e0 con 0x7efd400c7f30 2024-01-23T09:25:01.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.078+0000 7efd455d7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd4015a700 con 0x7efd4006dfd0 2024-01-23T09:25:01.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.078+0000 7efd3effd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd4006dfd0 0x7efd40159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:01.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.078+0000 7efd3f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd401518a0 0x7efd400c0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:01.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.082+0000 7efd3f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd401518a0 0x7efd400c0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53650/0 (socket says 172.21.15.46:53650) 2024-01-23T09:25:01.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.082+0000 7efd3f7fe640 1 -- 172.21.15.46:0/438902568 learned_addr learned my addr 172.21.15.46:0/438902568 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:01.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.082+0000 7efd367fc640 1 --2- 172.21.15.46:0/438902568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd400c7f30 0x7efd400c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:01.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.086+0000 7efd3f7fe640 1 -- 172.21.15.46:0/438902568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd4006dfd0 msgr2=0x7efd40159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:01.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.086+0000 7efd3f7fe640 1 --2- 172.21.15.46:0/438902568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd4006dfd0 0x7efd40159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:01.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.086+0000 7efd3f7fe640 1 -- 172.21.15.46:0/438902568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd400c7f30 msgr2=0x7efd400c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:01.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.086+0000 7efd3f7fe640 1 --2- 172.21.15.46:0/438902568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd400c7f30 0x7efd400c3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:01.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.086+0000 7efd3f7fe640 1 -- 172.21.15.46:0/438902568 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd300094d0 con 0x7efd401518a0 2024-01-23T09:25:01.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.086+0000 7efd3f7fe640 1 --2- 172.21.15.46:0/438902568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd401518a0 0x7efd400c0e20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7efd3800b9c0 tx=0x7efd3800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:01.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.090+0000 7efd37fff640 1 -- 172.21.15.46:0/438902568 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3800cba0 con 0x7efd401518a0 2024-01-23T09:25:01.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.090+0000 7efd37fff640 1 -- 172.21.15.46:0/438902568 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3800cd00 con 0x7efd401518a0 2024-01-23T09:25:01.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.090+0000 7efd455d7640 1 -- 172.21.15.46:0/438902568 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd4015a180 con 0x7efd401518a0 2024-01-23T09:25:01.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.090+0000 7efd37fff640 1 -- 172.21.15.46:0/438902568 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd38014680 con 0x7efd401518a0 2024-01-23T09:25:01.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.090+0000 7efd455d7640 1 -- 172.21.15.46:0/438902568 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd4015a420 con 0x7efd401518a0 2024-01-23T09:25:01.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.094+0000 7efd455d7640 1 -- 172.21.15.46:0/438902568 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd40074340 con 0x7efd401518a0 2024-01-23T09:25:01.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.110+0000 7efd37fff640 1 -- 172.21.15.46:0/438902568 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7efd3801d3b0 con 0x7efd401518a0 2024-01-23T09:25:01.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.110+0000 7efd37fff640 1 --2- 172.21.15.46:0/438902568 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7efd20066550 0x7efd20068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:01.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.114+0000 7efd3effd640 1 --2- 172.21.15.46:0/438902568 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7efd20066550 0x7efd20068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:01.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.114+0000 7efd3effd640 1 --2- 172.21.15.46:0/438902568 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7efd20066550 0x7efd20068a10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efd300af000 tx=0x7efd300a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:01.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.114+0000 7efd37fff640 1 -- 172.21.15.46:0/438902568 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7efd38055250 con 0x7efd401518a0 2024-01-23T09:25:01.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.398+0000 7efd37fff640 1 -- 172.21.15.46:0/438902568 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7efd38051590 con 0x7efd401518a0 2024-01-23T09:25:01.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.578+0000 7efd455d7640 1 -- 172.21.15.46:0/438902568 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efd400c0720 con 0x7efd401518a0 2024-01-23T09:25:01.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.586+0000 7efd37fff640 1 -- 172.21.15.46:0/438902568 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7efd38019070 con 0x7efd401518a0 2024-01-23T09:25:01.589 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-01-23T09:25:01.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.590+0000 7efd455d7640 1 -- 172.21.15.46:0/438902568 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7efd20066550 msgr2=0x7efd20068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:01.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.590+0000 7efd455d7640 1 --2- 172.21.15.46:0/438902568 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7efd20066550 0x7efd20068a10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efd300af000 tx=0x7efd300a7070 comp rx=0 tx=0).stop 2024-01-23T09:25:01.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.590+0000 7efd455d7640 1 -- 172.21.15.46:0/438902568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd401518a0 msgr2=0x7efd400c0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:01.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.590+0000 7efd455d7640 1 --2- 172.21.15.46:0/438902568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd401518a0 0x7efd400c0e20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7efd3800b9c0 tx=0x7efd3800be80 comp rx=0 tx=0).stop 2024-01-23T09:25:01.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.590+0000 7efd455d7640 1 -- 172.21.15.46:0/438902568 shutdown_connections 2024-01-23T09:25:01.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.590+0000 7efd455d7640 1 --2- 172.21.15.46:0/438902568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd401518a0 0x7efd400c0e20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:01.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.590+0000 7efd455d7640 1 --2- 172.21.15.46:0/438902568 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7efd20066550 0x7efd20068a10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:01.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.590+0000 7efd455d7640 1 --2- 172.21.15.46:0/438902568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd400c7f30 0x7efd400c3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:01.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.590+0000 7efd455d7640 1 --2- 172.21.15.46:0/438902568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd4006dfd0 0x7efd40159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:01.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.590+0000 7efd455d7640 1 -- 172.21.15.46:0/438902568 >> 172.21.15.46:0/438902568 conn(0x7efd4006aa60 msgr2=0x7efd40155870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:01.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.590+0000 7efd455d7640 1 -- 172.21.15.46:0/438902568 shutdown_connections 2024-01-23T09:25:01.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.590+0000 7efd455d7640 1 -- 172.21.15.46:0/438902568 wait complete. 2024-01-23T09:25:01.610 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-23T09:25:01.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.738+0000 7f98c65a7640 1 Processor -- start 2024-01-23T09:25:01.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.738+0000 7f98c65a7640 1 -- start start 2024-01-23T09:25:01.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.738+0000 7f98c65a7640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f98c00c9920 0x7f98c00c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:01.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.738+0000 7f98c65a7640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f98c00cf9e0 0x7f98c015cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:01.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.738+0000 7f98c65a7640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c015a170 con 0x7f98c015a600 2024-01-23T09:25:01.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.738+0000 7f98c65a7640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c0159950 con 0x7f98c00c9920 2024-01-23T09:25:01.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.738+0000 7f98c65a7640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c00c9420 con 0x7f98c00cf9e0 2024-01-23T09:25:01.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.742+0000 7f98bffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f98c00c9920 0x7f98c00c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:01.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.742+0000 7f98bffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f98c00c9920 0x7f98c00c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53664/0 (socket says 172.21.15.46:53664) 2024-01-23T09:25:01.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.742+0000 7f98bffff640 1 -- 172.21.15.46:0/2613340872 learned_addr learned my addr 172.21.15.46:0/2613340872 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:01.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.742+0000 7f98c4b44640 1 --2- 172.21.15.46:0/2613340872 >> v2:172.21.15.175:3300/0 conn(0x7f98c00cf9e0 0x7f98c015cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:01.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.742+0000 7f98bffff640 1 -- 172.21.15.46:0/2613340872 >> v2:172.21.15.175:3300/0 conn(0x7f98c00cf9e0 msgr2=0x7f98c015cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:01.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.742+0000 7f98bffff640 1 --2- 172.21.15.46:0/2613340872 >> v2:172.21.15.175:3300/0 conn(0x7f98c00cf9e0 0x7f98c015cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:01.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.742+0000 7f98bffff640 1 -- 172.21.15.46:0/2613340872 >> v1:172.21.15.175:6789/0 conn(0x7f98c015a600 legacy=0x7f98c00b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:01.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.742+0000 7f98bffff640 1 -- 172.21.15.46:0/2613340872 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c015d420 con 0x7f98c00c9920 2024-01-23T09:25:01.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.754+0000 7f98bffff640 1 --2- 172.21.15.46:0/2613340872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98c00c9920 0x7f98c00c9d00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f98c006b360 tx=0x7f98a801ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267490ba43c1ae82 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:01.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.762+0000 7f98beffd640 1 -- 172.21.15.46:0/2613340872 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a80a89b0 con 0x7f98c00c9920 2024-01-23T09:25:01.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.762+0000 7f98beffd640 1 -- 172.21.15.46:0/2613340872 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a80a8b10 con 0x7f98c00c9920 2024-01-23T09:25:01.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.762+0000 7f98beffd640 1 -- 172.21.15.46:0/2613340872 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a80a8ea0 con 0x7f98c00c9920 2024-01-23T09:25:01.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.762+0000 7f98c65a7640 1 -- 172.21.15.46:0/2613340872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98c00c9920 msgr2=0x7f98c00c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:01.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.762+0000 7f98c65a7640 1 --2- 172.21.15.46:0/2613340872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98c00c9920 0x7f98c00c9d00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f98c006b360 tx=0x7f98a801ecb0 comp rx=0 tx=0).stop 2024-01-23T09:25:01.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.762+0000 7f98c65a7640 1 -- 172.21.15.46:0/2613340872 shutdown_connections 2024-01-23T09:25:01.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.762+0000 7f98c65a7640 1 --2- 172.21.15.46:0/2613340872 >> v2:172.21.15.175:3300/0 conn(0x7f98c00cf9e0 0x7f98c015cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:01.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.762+0000 7f98c65a7640 1 --2- 172.21.15.46:0/2613340872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98c00c9920 0x7f98c00c9d00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:01.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.762+0000 7f98c65a7640 1 -- 172.21.15.46:0/2613340872 >> 172.21.15.46:0/2613340872 conn(0x7f98c008afa0 msgr2=0x7f98c008b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:01.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.762+0000 7f98c65a7640 1 -- 172.21.15.46:0/2613340872 shutdown_connections 2024-01-23T09:25:01.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.762+0000 7f98c65a7640 1 -- 172.21.15.46:0/2613340872 wait complete. 2024-01-23T09:25:01.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.762+0000 7f98c65a7640 1 Processor -- start 2024-01-23T09:25:01.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.762+0000 7f98c65a7640 1 -- start start 2024-01-23T09:25:01.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.762+0000 7f98c65a7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98c00c9920 0x7f98c0155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:01.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.762+0000 7f98c65a7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98c00cf9e0 0x7f98c0153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:01.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.762+0000 7f98c65a7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98c015a600 0x7f98c0156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:01.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.766+0000 7f98c65a7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c0155b40 con 0x7f98c00c9920 2024-01-23T09:25:01.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.766+0000 7f98c65a7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c01542c0 con 0x7f98c00cf9e0 2024-01-23T09:25:01.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.766+0000 7f98c65a7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c0154560 con 0x7f98c015a600 2024-01-23T09:25:01.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.766+0000 7f98c4b44640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98c015a600 0x7f98c0156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:01.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.766+0000 7f98bf7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98c00cf9e0 0x7f98c0153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:01.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.766+0000 7f98c4b44640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98c015a600 0x7f98c0156010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:34598/0 (socket says 172.21.15.46:34598) 2024-01-23T09:25:01.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.766+0000 7f98c4b44640 1 -- 172.21.15.46:0/133957181 learned_addr learned my addr 172.21.15.46:0/133957181 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:01.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.770+0000 7f98bffff640 1 --2- 172.21.15.46:0/133957181 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98c00c9920 0x7f98c0155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:01.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.770+0000 7f98c4b44640 1 -- 172.21.15.46:0/133957181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98c00cf9e0 msgr2=0x7f98c0153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:01.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.770+0000 7f98c4b44640 1 --2- 172.21.15.46:0/133957181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98c00cf9e0 0x7f98c0153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:01.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.770+0000 7f98c4b44640 1 -- 172.21.15.46:0/133957181 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98c00c9920 msgr2=0x7f98c0155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:01.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.770+0000 7f98c4b44640 1 --2- 172.21.15.46:0/133957181 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98c00c9920 0x7f98c0155600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:01.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.770+0000 7f98c4b44640 1 -- 172.21.15.46:0/133957181 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a80094d0 con 0x7f98c015a600 2024-01-23T09:25:01.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.774+0000 7f98c4b44640 1 --2- 172.21.15.46:0/133957181 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98c015a600 0x7f98c0156010 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f98b000e930 tx=0x7f98b000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:01.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.782+0000 7f98bcff9640 1 -- 172.21.15.46:0/133957181 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b00096b0 con 0x7f98c015a600 2024-01-23T09:25:01.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.782+0000 7f98bcff9640 1 -- 172.21.15.46:0/133957181 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b000c9a0 con 0x7f98c015a600 2024-01-23T09:25:01.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.782+0000 7f98c65a7640 1 -- 172.21.15.46:0/133957181 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c0154840 con 0x7f98c015a600 2024-01-23T09:25:01.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.782+0000 7f98bcff9640 1 -- 172.21.15.46:0/133957181 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b000cd30 con 0x7f98c015a600 2024-01-23T09:25:01.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.782+0000 7f98c65a7640 1 -- 172.21.15.46:0/133957181 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c0154e00 con 0x7f98c015a600 2024-01-23T09:25:01.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:01.786+0000 7f98c65a7640 1 -- 172.21.15.46:0/133957181 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c006d7f0 con 0x7f98c015a600 2024-01-23T09:25:02.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.114+0000 7f98bcff9640 1 -- 172.21.15.46:0/133957181 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f98b0013470 con 0x7f98c015a600 2024-01-23T09:25:02.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.114+0000 7f98bcff9640 1 --2- 172.21.15.46:0/133957181 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f98a0066550 0x7f98a0068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:02.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.114+0000 7f98bffff640 1 --2- 172.21.15.46:0/133957181 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f98a0066550 0x7f98a0068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:02.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.118+0000 7f98bffff640 1 --2- 172.21.15.46:0/133957181 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f98a0066550 0x7f98a0068a10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f98a80b2000 tx=0x7f98a80aa070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:02.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.122+0000 7f98bcff9640 1 -- 172.21.15.46:0/133957181 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f98b00558f0 con 0x7f98c015a600 2024-01-23T09:25:02.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.150+0000 7f98bcff9640 1 -- 172.21.15.46:0/133957181 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f98b0051c30 con 0x7f98c015a600 2024-01-23T09:25:02.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.330+0000 7f98c65a7640 1 -- 172.21.15.46:0/133957181 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f98c0067730 con 0x7f98c015a600 2024-01-23T09:25:02.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.382+0000 7f98bcff9640 1 -- 172.21.15.46:0/133957181 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f98b0021020 con 0x7f98c015a600 2024-01-23T09:25:02.385 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-23T09:25:02.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.382+0000 7f98c65a7640 1 -- 172.21.15.46:0/133957181 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f98a0066550 msgr2=0x7f98a0068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:02.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.382+0000 7f98c65a7640 1 --2- 172.21.15.46:0/133957181 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f98a0066550 0x7f98a0068a10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f98a80b2000 tx=0x7f98a80aa070 comp rx=0 tx=0).stop 2024-01-23T09:25:02.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.382+0000 7f98c65a7640 1 -- 172.21.15.46:0/133957181 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98c015a600 msgr2=0x7f98c0156010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:02.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.382+0000 7f98c65a7640 1 --2- 172.21.15.46:0/133957181 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98c015a600 0x7f98c0156010 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f98b000e930 tx=0x7f98b000edf0 comp rx=0 tx=0).stop 2024-01-23T09:25:02.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.382+0000 7f98c65a7640 1 -- 172.21.15.46:0/133957181 shutdown_connections 2024-01-23T09:25:02.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.382+0000 7f98c65a7640 1 --2- 172.21.15.46:0/133957181 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98c015a600 0x7f98c0156010 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:02.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.382+0000 7f98c65a7640 1 --2- 172.21.15.46:0/133957181 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f98a0066550 0x7f98a0068a10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:02.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.382+0000 7f98c65a7640 1 --2- 172.21.15.46:0/133957181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98c00cf9e0 0x7f98c0153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:02.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.382+0000 7f98c65a7640 1 --2- 172.21.15.46:0/133957181 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98c00c9920 0x7f98c0155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:02.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.382+0000 7f98c65a7640 1 -- 172.21.15.46:0/133957181 >> 172.21.15.46:0/133957181 conn(0x7f98c008afa0 msgr2=0x7f98c0071d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:02.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.386+0000 7f98c65a7640 1 -- 172.21.15.46:0/133957181 shutdown_connections 2024-01-23T09:25:02.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.386+0000 7f98c65a7640 1 -- 172.21.15.46:0/133957181 wait complete. 2024-01-23T09:25:02.408 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-23T09:25:02.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.534+0000 7f288a834640 1 Processor -- start 2024-01-23T09:25:02.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.534+0000 7f288a834640 1 -- start start 2024-01-23T09:25:02.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.534+0000 7f288a834640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2884153880 0x7f288406e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:02.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.534+0000 7f288a834640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2884153c60 con 0x7f28840c6770 2024-01-23T09:25:02.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.534+0000 7f288a834640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28840c0f30 con 0x7f28840c1e40 2024-01-23T09:25:02.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.534+0000 7f288a834640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28840c14f0 con 0x7f2884153880 2024-01-23T09:25:02.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.534+0000 7f28837fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f28840c6770 0x7f28840c1730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:46038/0 (socket says 172.21.15.46:46038) 2024-01-23T09:25:02.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.534+0000 7f28837fe640 1 -- 172.21.15.46:0/2562655491 learned_addr learned my addr 172.21.15.46:0/2562655491 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T09:25:02.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.534+0000 7f2883fff640 1 --2- 172.21.15.46:0/2562655491 >> v2:172.21.15.175:3300/0 conn(0x7f2884153880 0x7f288406e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:02.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.538+0000 7f2882ffd640 1 -- 172.21.15.46:0/2562655491 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3741568948 0 0) 0x7f2884153c60 con 0x7f28840c6770 2024-01-23T09:25:02.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.538+0000 7f2882ffd640 1 -- 172.21.15.46:0/2562655491 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f286c003530 con 0x7f28840c6770 2024-01-23T09:25:02.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.542+0000 7f2882ffd640 1 -- 172.21.15.46:0/2562655491 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 190875396 0 0) 0x7f286c003530 con 0x7f28840c6770 2024-01-23T09:25:02.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.542+0000 7f2882ffd640 1 -- 172.21.15.46:0/2562655491 >> v2:172.21.15.175:3300/0 conn(0x7f2884153880 msgr2=0x7f288406e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:02.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.542+0000 7f2882ffd640 1 --2- 172.21.15.46:0/2562655491 >> v2:172.21.15.175:3300/0 conn(0x7f2884153880 0x7f288406e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:02.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.542+0000 7f2882ffd640 1 -- 172.21.15.46:0/2562655491 >> v1:172.21.15.175:6789/0 conn(0x7f28840c1e40 legacy=0x7f2884163ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:02.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.542+0000 7f2882ffd640 1 -- 172.21.15.46:0/2562655491 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28840c1210 con 0x7f28840c6770 2024-01-23T09:25:02.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.542+0000 7f2882ffd640 1 -- 172.21.15.46:0/2562655491 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466917103 0 0) 0x7f2874001680 con 0x7f28840c6770 2024-01-23T09:25:02.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.542+0000 7f2882ffd640 1 -- 172.21.15.46:0/2562655491 >> v1:172.21.15.46:6789/0 conn(0x7f28840c6770 legacy=0x7f28840c1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:02.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.542+0000 7f2882ffd640 1 --2- 172.21.15.46:0/2562655491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f286c003a40 0x7f286c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:02.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.542+0000 7f2882ffd640 1 --2- 172.21.15.46:0/2562655491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f286c0047d0 0x7f286c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:02.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.542+0000 7f2882ffd640 1 --2- 172.21.15.46:0/2562655491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f286c0052b0 0x7f286c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:02.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.542+0000 7f2882ffd640 1 -- 172.21.15.46:0/2562655491 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28840c14f0 con 0x7f286c0052b0 2024-01-23T09:25:02.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.542+0000 7f2882ffd640 1 -- 172.21.15.46:0/2562655491 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286c00c180 con 0x7f286c0047d0 2024-01-23T09:25:02.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.542+0000 7f2882ffd640 1 -- 172.21.15.46:0/2562655491 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286c00c340 con 0x7f286c003a40 2024-01-23T09:25:02.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.542+0000 7f2883fff640 1 --2- 172.21.15.46:0/2562655491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f286c003a40 0x7f286c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:02.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.546+0000 7f2888dd1640 1 --2- 172.21.15.46:0/2562655491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f286c0052b0 0x7f286c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:02.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.550+0000 7f2888dd1640 1 -- 172.21.15.46:0/2562655491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f286c003a40 msgr2=0x7f286c003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:02.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.550+0000 7f2888dd1640 1 --2- 172.21.15.46:0/2562655491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f286c003a40 0x7f286c003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:02.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.550+0000 7f2888dd1640 1 -- 172.21.15.46:0/2562655491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f286c0047d0 msgr2=0x7f286c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:02.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.550+0000 7f2888dd1640 1 --2- 172.21.15.46:0/2562655491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f286c0047d0 0x7f286c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:02.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.550+0000 7f2888dd1640 1 -- 172.21.15.46:0/2562655491 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c003530 con 0x7f286c0052b0 2024-01-23T09:25:02.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.550+0000 7f2888dd1640 1 -- 172.21.15.46:0/2562655491 reap_dead start 2024-01-23T09:25:02.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.554+0000 7f2888dd1640 1 --2- 172.21.15.46:0/2562655491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f286c0052b0 0x7f286c00b990 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f287c001e70 tx=0x7f287c01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c97f049440ca68 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:02.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.554+0000 7f2882ffd640 1 -- 172.21.15.46:0/2562655491 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c003b80 con 0x7f286c0052b0 2024-01-23T09:25:02.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.554+0000 7f2882ffd640 1 -- 172.21.15.46:0/2562655491 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c003d20 con 0x7f286c0052b0 2024-01-23T09:25:02.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.554+0000 7f2882ffd640 1 -- 172.21.15.46:0/2562655491 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c005260 con 0x7f286c0052b0 2024-01-23T09:25:02.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.558+0000 7f288a834640 1 -- 172.21.15.46:0/2562655491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f286c0052b0 msgr2=0x7f286c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:02.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.558+0000 7f288a834640 1 --2- 172.21.15.46:0/2562655491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f286c0052b0 0x7f286c00b990 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f287c001e70 tx=0x7f287c01c760 comp rx=0 tx=0).stop 2024-01-23T09:25:02.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.558+0000 7f288a834640 1 -- 172.21.15.46:0/2562655491 shutdown_connections 2024-01-23T09:25:02.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.558+0000 7f288a834640 1 --2- 172.21.15.46:0/2562655491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f286c0052b0 0x7f286c00b990 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:02.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.558+0000 7f288a834640 1 -- 172.21.15.46:0/2562655491 >> 172.21.15.46:0/2562655491 conn(0x7f2884072450 msgr2=0x7f288406fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:02.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.558+0000 7f288a834640 1 -- 172.21.15.46:0/2562655491 shutdown_connections 2024-01-23T09:25:02.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.558+0000 7f288a834640 1 -- 172.21.15.46:0/2562655491 wait complete. 2024-01-23T09:25:02.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.558+0000 7f288a834640 1 Processor -- start 2024-01-23T09:25:02.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.558+0000 7f288a834640 1 -- start start 2024-01-23T09:25:02.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.558+0000 7f288a834640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f286c0052b0 0x7f28841e2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:02.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.558+0000 7f288a834640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f288414ead0 0x7f288415b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:02.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.558+0000 7f288a834640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28840c4e50 0x7f28840c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:02.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.558+0000 7f288a834640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2884150f70 con 0x7f28840c4e50 2024-01-23T09:25:02.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.558+0000 7f288a834640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28841e4430 con 0x7f286c0052b0 2024-01-23T09:25:02.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.558+0000 7f288a834640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28841e2fe0 con 0x7f288414ead0 2024-01-23T09:25:02.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.558+0000 7f2888dd1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28840c4e50 0x7f28840c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:02.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.562+0000 7f2888dd1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28840c4e50 0x7f28840c52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53682/0 (socket says 172.21.15.46:53682) 2024-01-23T09:25:02.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.562+0000 7f2888dd1640 1 -- 172.21.15.46:0/3522447700 learned_addr learned my addr 172.21.15.46:0/3522447700 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:02.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.562+0000 7f28837fe640 1 --2- 172.21.15.46:0/3522447700 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f288414ead0 0x7f288415b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:02.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.562+0000 7f2883fff640 1 --2- 172.21.15.46:0/3522447700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f286c0052b0 0x7f28841e2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:02.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.562+0000 7f2888dd1640 1 -- 172.21.15.46:0/3522447700 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f288414ead0 msgr2=0x7f288415b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:02.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.562+0000 7f2888dd1640 1 --2- 172.21.15.46:0/3522447700 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f288414ead0 0x7f288415b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:02.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.562+0000 7f2888dd1640 1 -- 172.21.15.46:0/3522447700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f286c0052b0 msgr2=0x7f28841e2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:02.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.562+0000 7f2888dd1640 1 --2- 172.21.15.46:0/3522447700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f286c0052b0 0x7f28841e2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:02.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.562+0000 7f2888dd1640 1 -- 172.21.15.46:0/3522447700 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28840c2f40 con 0x7f28840c4e50 2024-01-23T09:25:02.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.566+0000 7f2888dd1640 1 --2- 172.21.15.46:0/3522447700 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28840c4e50 0x7f28840c52d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f287c01c590 tx=0x7f286c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:02.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.570+0000 7f2880ff9640 1 -- 172.21.15.46:0/3522447700 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c0ac070 con 0x7f28840c4e50 2024-01-23T09:25:02.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.570+0000 7f2880ff9640 1 -- 172.21.15.46:0/3522447700 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c003e90 con 0x7f28840c4e50 2024-01-23T09:25:02.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.570+0000 7f288a834640 1 -- 172.21.15.46:0/3522447700 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28840c3220 con 0x7f28840c4e50 2024-01-23T09:25:02.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.570+0000 7f2880ff9640 1 -- 172.21.15.46:0/3522447700 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c0057a0 con 0x7f28840c4e50 2024-01-23T09:25:02.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.570+0000 7f288a834640 1 -- 172.21.15.46:0/3522447700 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28840c37e0 con 0x7f28840c4e50 2024-01-23T09:25:02.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.570+0000 7f288a834640 1 -- 172.21.15.46:0/3522447700 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2884074340 con 0x7f28840c4e50 2024-01-23T09:25:02.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.870+0000 7f2880ff9640 1 -- 172.21.15.46:0/3522447700 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f287c006b60 con 0x7f28840c4e50 2024-01-23T09:25:02.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.870+0000 7f2880ff9640 1 --2- 172.21.15.46:0/3522447700 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f2870066550 0x7f2870068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:02.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.870+0000 7f2883fff640 1 --2- 172.21.15.46:0/3522447700 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f2870066550 0x7f2870068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:02.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.870+0000 7f2883fff640 1 --2- 172.21.15.46:0/3522447700 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f2870066550 0x7f2870068a10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2878009b60 tx=0x7f2878009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:02.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.906+0000 7f2880ff9640 1 -- 172.21.15.46:0/3522447700 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f287c0bde30 con 0x7f28840c4e50 2024-01-23T09:25:02.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:02.906+0000 7f2880ff9640 1 -- 172.21.15.46:0/3522447700 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f287c0ea4b0 con 0x7f28840c4e50 2024-01-23T09:25:03.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:03.110+0000 7f288a834640 1 -- 172.21.15.46:0/3522447700 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f28841e6830 con 0x7f28840c4e50 2024-01-23T09:25:03.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:03.122+0000 7f2880ff9640 1 -- 172.21.15.46:0/3522447700 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f287c0ec3e0 con 0x7f28840c4e50 2024-01-23T09:25:03.124 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2024-01-23T09:25:03.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:03.122+0000 7f288a834640 1 -- 172.21.15.46:0/3522447700 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f2870066550 msgr2=0x7f2870068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:03.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:03.122+0000 7f288a834640 1 --2- 172.21.15.46:0/3522447700 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f2870066550 0x7f2870068a10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2878009b60 tx=0x7f2878009190 comp rx=0 tx=0).stop 2024-01-23T09:25:03.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:03.122+0000 7f288a834640 1 -- 172.21.15.46:0/3522447700 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28840c4e50 msgr2=0x7f28840c52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:03.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:03.122+0000 7f288a834640 1 --2- 172.21.15.46:0/3522447700 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28840c4e50 0x7f28840c52d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f287c01c590 tx=0x7f286c005800 comp rx=0 tx=0).stop 2024-01-23T09:25:03.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:03.122+0000 7f288a834640 1 -- 172.21.15.46:0/3522447700 shutdown_connections 2024-01-23T09:25:03.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:03.122+0000 7f288a834640 1 --2- 172.21.15.46:0/3522447700 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28840c4e50 0x7f28840c52d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:03.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:03.122+0000 7f288a834640 1 --2- 172.21.15.46:0/3522447700 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f288414ead0 0x7f288415b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:03.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:03.122+0000 7f288a834640 1 --2- 172.21.15.46:0/3522447700 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f2870066550 0x7f2870068a10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:03.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:03.122+0000 7f288a834640 1 --2- 172.21.15.46:0/3522447700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f286c0052b0 0x7f28841e2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:03.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:03.122+0000 7f288a834640 1 -- 172.21.15.46:0/3522447700 >> 172.21.15.46:0/3522447700 conn(0x7f2884072450 msgr2=0x7f28840c5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:03.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:03.122+0000 7f288a834640 1 -- 172.21.15.46:0/3522447700 shutdown_connections 2024-01-23T09:25:03.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:03.122+0000 7f288a834640 1 -- 172.21.15.46:0/3522447700 wait complete. 2024-01-23T09:25:03.145 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi046.front.sepia.ceph.com... 2024-01-23T09:25:03.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T09:25:03.145 DEBUG:teuthology.orchestra.run.smithi046:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-01-23T09:25:03.156 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T09:25:03.184 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[35670]: fuse finished with error 0 and tester_r 0 2024-01-23T09:25:04.094 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:==00:00:29:07.921 35670== 2024-01-23T09:25:04.095 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:==00:00:29:07.921 35670== Exit program on first error (--exit-on-first-error=yes) 2024-01-23T09:25:04.208 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:daemon-helper: command failed with exit status 42 2024-01-23T09:25:09.257 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-01-23T09:25:09.257 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2024-01-23T09:25:09.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T09:25:09.258 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-23T09:25:09.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T09:25:09.265 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-01-23T09:25:09.313 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-23T09:25:09.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T09:25:09.313 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-23T09:25:09.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-23T09:25:09.370 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-01-23T09:25:09.562 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-01-23T09:25:09.571 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-23T09:25:09.571 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-23T09:25:09.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.698+0000 7fd8bd71f640 1 Processor -- start 2024-01-23T09:25:09.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.698+0000 7fd8bd71f640 1 -- start start 2024-01-23T09:25:09.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.702+0000 7fd8bd71f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8b80c8f60 0x7fd8b80c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:09.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.702+0000 7fd8bd71f640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd8b80c8130 0x7fd8b815a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:09.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.702+0000 7fd8bd71f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b80c24a0 con 0x7fd8b8151940 2024-01-23T09:25:09.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.702+0000 7fd8bd71f640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b815b760 con 0x7fd8b80c8130 2024-01-23T09:25:09.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.702+0000 7fd8bd71f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b80c26f0 con 0x7fd8b80c8f60 2024-01-23T09:25:09.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.702+0000 7fd8b6ffd640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd8b8151940 0x7fd8b80c34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.46:37672/0 (socket says 172.21.15.46:37672) 2024-01-23T09:25:09.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.702+0000 7fd8b6ffd640 1 -- 172.21.15.46:0/4215556852 learned_addr learned my addr 172.21.15.46:0/4215556852 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T09:25:09.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.702+0000 7fd8b67fc640 1 --2- 172.21.15.46:0/4215556852 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8b80c8f60 0x7fd8b80c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:09.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.710+0000 7fd8b67fc640 1 -- 172.21.15.46:0/4215556852 >> v2:172.21.15.46:3300/0 conn(0x7fd8b80c8130 msgr2=0x7fd8b815a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:09.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.710+0000 7fd8b67fc640 1 --2- 172.21.15.46:0/4215556852 >> v2:172.21.15.46:3300/0 conn(0x7fd8b80c8130 0x7fd8b815a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:09.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.710+0000 7fd8b67fc640 1 -- 172.21.15.46:0/4215556852 >> v1:172.21.15.175:6789/0 conn(0x7fd8b8151940 legacy=0x7fd8b80c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:09.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.710+0000 7fd8b67fc640 1 -- 172.21.15.46:0/4215556852 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b80c29d0 con 0x7fd8b80c8f60 2024-01-23T09:25:09.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.714+0000 7fd8b67fc640 1 --2- 172.21.15.46:0/4215556852 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8b80c8f60 0x7fd8b80c7bf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0009d90 tx=0x7fd8a001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba6b9f86f5c0fe6f server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:09.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.730+0000 7fd8b5ffb640 1 -- 172.21.15.46:0/4215556852 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a00a59e0 con 0x7fd8b80c8f60 2024-01-23T09:25:09.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.730+0000 7fd8b5ffb640 1 -- 172.21.15.46:0/4215556852 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a00a5b40 con 0x7fd8b80c8f60 2024-01-23T09:25:09.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.730+0000 7fd8b5ffb640 1 -- 172.21.15.46:0/4215556852 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a00ad440 con 0x7fd8b80c8f60 2024-01-23T09:25:09.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.734+0000 7fd8bd71f640 1 -- 172.21.15.46:0/4215556852 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8b80c8f60 msgr2=0x7fd8b80c7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:09.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.734+0000 7fd8bd71f640 1 --2- 172.21.15.46:0/4215556852 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8b80c8f60 0x7fd8b80c7bf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0009d90 tx=0x7fd8a001c920 comp rx=0 tx=0).stop 2024-01-23T09:25:09.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.734+0000 7fd8bd71f640 1 -- 172.21.15.46:0/4215556852 shutdown_connections 2024-01-23T09:25:09.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.734+0000 7fd8bd71f640 1 --2- 172.21.15.46:0/4215556852 >> v2:172.21.15.46:3300/0 conn(0x7fd8b80c8130 0x7fd8b815a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:09.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.734+0000 7fd8bd71f640 1 --2- 172.21.15.46:0/4215556852 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8b80c8f60 0x7fd8b80c7bf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:09.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.734+0000 7fd8bd71f640 1 -- 172.21.15.46:0/4215556852 >> 172.21.15.46:0/4215556852 conn(0x7fd8b806a660 msgr2=0x7fd8b806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:09.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.734+0000 7fd8bd71f640 1 -- 172.21.15.46:0/4215556852 shutdown_connections 2024-01-23T09:25:09.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.734+0000 7fd8bd71f640 1 -- 172.21.15.46:0/4215556852 wait complete. 2024-01-23T09:25:09.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.734+0000 7fd8bd71f640 1 Processor -- start 2024-01-23T09:25:09.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.734+0000 7fd8bd71f640 1 -- start start 2024-01-23T09:25:09.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.734+0000 7fd8bd71f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8b80c8130 0x7fd8b80b2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:09.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.734+0000 7fd8bd71f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8b80c8f60 0x7fd8b81f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:09.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.734+0000 7fd8bd71f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8b8151940 0x7fd8b81f24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:09.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.734+0000 7fd8bd71f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b806d3e0 con 0x7fd8b80c8f60 2024-01-23T09:25:09.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.734+0000 7fd8bd71f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b806bfa0 con 0x7fd8b8151940 2024-01-23T09:25:09.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.734+0000 7fd8bd71f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b806c1f0 con 0x7fd8b80c8130 2024-01-23T09:25:09.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.734+0000 7fd8b67fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8b80c8f60 0x7fd8b81f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:09.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.738+0000 7fd8b67fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8b80c8f60 0x7fd8b81f1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51964/0 (socket says 172.21.15.46:51964) 2024-01-23T09:25:09.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.738+0000 7fd8b67fc640 1 -- 172.21.15.46:0/2930281624 learned_addr learned my addr 172.21.15.46:0/2930281624 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:09.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.742+0000 7fd8b67fc640 1 -- 172.21.15.46:0/2930281624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8b80c8130 msgr2=0x7fd8b80b2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:09.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.742+0000 7fd8b67fc640 1 --2- 172.21.15.46:0/2930281624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8b80c8130 0x7fd8b80b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:09.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.742+0000 7fd8b67fc640 1 -- 172.21.15.46:0/2930281624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8b8151940 msgr2=0x7fd8b81f24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:09.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.742+0000 7fd8b67fc640 1 --2- 172.21.15.46:0/2930281624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8b8151940 0x7fd8b81f24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:09.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.742+0000 7fd8b67fc640 1 -- 172.21.15.46:0/2930281624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a0009a70 con 0x7fd8b80c8f60 2024-01-23T09:25:09.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.742+0000 7fd8b67fc640 1 --2- 172.21.15.46:0/2930281624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8b80c8f60 0x7fd8b81f1fa0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd8a001afd0 tx=0x7fd8a00196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:09.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.746+0000 7fd8af7fe640 1 -- 172.21.15.46:0/2930281624 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a00adbc0 con 0x7fd8b80c8f60 2024-01-23T09:25:09.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.746+0000 7fd8af7fe640 1 -- 172.21.15.46:0/2930281624 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a00add20 con 0x7fd8b80c8f60 2024-01-23T09:25:09.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.746+0000 7fd8bd71f640 1 -- 172.21.15.46:0/2930281624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b806ca40 con 0x7fd8b80c8f60 2024-01-23T09:25:09.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.750+0000 7fd8af7fe640 1 -- 172.21.15.46:0/2930281624 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a00b8640 con 0x7fd8b80c8f60 2024-01-23T09:25:09.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.750+0000 7fd8bd71f640 1 -- 172.21.15.46:0/2930281624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b806d000 con 0x7fd8b80c8f60 2024-01-23T09:25:09.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.750+0000 7fd8bd71f640 1 -- 172.21.15.46:0/2930281624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b806d520 con 0x7fd8b80c8f60 2024-01-23T09:25:09.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.774+0000 7fd8af7fe640 1 -- 172.21.15.46:0/2930281624 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd8a00b87a0 con 0x7fd8b80c8f60 2024-01-23T09:25:09.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.774+0000 7fd8af7fe640 1 --2- 172.21.15.46:0/2930281624 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd898066550 0x7fd898068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:09.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.774+0000 7fd8b6ffd640 1 --2- 172.21.15.46:0/2930281624 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd898066550 0x7fd898068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:09.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:09.774+0000 7fd8b6ffd640 1 --2- 172.21.15.46:0/2930281624 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd898066550 0x7fd898068a10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8000f70 tx=0x7fd8a8007a90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:10.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.062+0000 7fd8af7fe640 1 -- 172.21.15.46:0/2930281624 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fd8a00cbe30 con 0x7fd8b80c8f60 2024-01-23T09:25:10.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.062+0000 7fd8af7fe640 1 -- 172.21.15.46:0/2930281624 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd8a00ec9e0 con 0x7fd8b80c8f60 2024-01-23T09:25:10.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.230+0000 7fd8bd71f640 1 -- 172.21.15.46:0/2930281624 --> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd8b806d520 con 0x7fd898066550 2024-01-23T09:25:10.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.246+0000 7fd8af7fe640 1 -- 172.21.15.46:0/2930281624 <== mgr.4107 v2:172.21.15.46:6800/2324478006 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368657 (secure 0 0 0) 0x7fd8b806d520 con 0x7fd898066550 2024-01-23T09:25:10.254 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T09:25:10.257 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-01-23T09:25:10.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.254+0000 7fd8bd71f640 1 -- 172.21.15.46:0/2930281624 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd898066550 msgr2=0x7fd898068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:10.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.254+0000 7fd8bd71f640 1 --2- 172.21.15.46:0/2930281624 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd898066550 0x7fd898068a10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8000f70 tx=0x7fd8a8007a90 comp rx=0 tx=0).stop 2024-01-23T09:25:10.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.254+0000 7fd8bd71f640 1 -- 172.21.15.46:0/2930281624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8b80c8f60 msgr2=0x7fd8b81f1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:10.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.254+0000 7fd8bd71f640 1 --2- 172.21.15.46:0/2930281624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8b80c8f60 0x7fd8b81f1fa0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd8a001afd0 tx=0x7fd8a00196c0 comp rx=0 tx=0).stop 2024-01-23T09:25:10.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.254+0000 7fd8bd71f640 1 -- 172.21.15.46:0/2930281624 shutdown_connections 2024-01-23T09:25:10.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.254+0000 7fd8bd71f640 1 --2- 172.21.15.46:0/2930281624 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd898066550 0x7fd898068a10 secure :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8000f70 tx=0x7fd8a8007a90 comp rx=0 tx=0).stop 2024-01-23T09:25:10.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.254+0000 7fd8bd71f640 1 --2- 172.21.15.46:0/2930281624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8b8151940 0x7fd8b81f24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:10.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.254+0000 7fd8bd71f640 1 --2- 172.21.15.46:0/2930281624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8b80c8f60 0x7fd8b81f1fa0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:10.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.254+0000 7fd8bd71f640 1 --2- 172.21.15.46:0/2930281624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8b80c8130 0x7fd8b80b2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:10.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.254+0000 7fd8bd71f640 1 -- 172.21.15.46:0/2930281624 >> 172.21.15.46:0/2930281624 conn(0x7fd8b806a660 msgr2=0x7fd8b814f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:10.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.254+0000 7fd8bd71f640 1 -- 172.21.15.46:0/2930281624 shutdown_connections 2024-01-23T09:25:10.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.254+0000 7fd8bd71f640 1 -- 172.21.15.46:0/2930281624 wait complete. 2024-01-23T09:25:10.282 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":962,"stamp":"2024-01-23T09:25:09.375872+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23779489,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":635,"num_read_kb":642,"num_write":7834,"num_write_kb":280431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9023,"ondisk_log_size":9023,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":302760,"kb_used_data":49192,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754671960,"statfs":{"total":773094113280,"available":772784087040,"internally_reserved":0,"allocated":50372608,"data_stored":48606202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10401,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":22,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004580"},"pg_stats":[{"pgid":"2.1f","version":"30'621","reported_seq":656,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:53.809154+0000","last_change":"2024-01-23T08:54:40.661700+0000","last_active":"2024-01-23T09:23:53.809154+0000","last_peered":"2024-01-23T09:23:53.809154+0000","last_clean":"2024-01-23T09:23:53.809154+0000","last_became_active":"2024-01-23T08:54:40.660901+0000","last_became_peered":"2024-01-23T08:54:40.660901+0000","last_unstale":"2024-01-23T09:23:53.809154+0000","last_undegraded":"2024-01-23T09:23:53.809154+0000","last_fullsized":"2024-01-23T09:23:53.809154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:59:22.804479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":621,"num_write_kb":4439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"30'17","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.608355+0000","last_change":"2024-01-23T08:54:42.159130+0000","last_active":"2024-01-23T09:25:03.608355+0000","last_peered":"2024-01-23T09:25:03.608355+0000","last_clean":"2024-01-23T09:25:03.608355+0000","last_became_active":"2024-01-23T08:54:42.158776+0000","last_became_peered":"2024-01-23T08:54:42.158776+0000","last_unstale":"2024-01-23T09:25:03.608355+0000","last_undegraded":"2024-01-23T09:25:03.608355+0000","last_fullsized":"2024-01-23T09:25:03.608355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:06.320845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"30'65","reported_seq":92,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:53.759886+0000","last_change":"2024-01-23T08:54:49.752558+0000","last_active":"2024-01-23T09:23:53.759886+0000","last_peered":"2024-01-23T09:23:53.759886+0000","last_clean":"2024-01-23T09:23:53.759886+0000","last_became_active":"2024-01-23T08:54:49.752077+0000","last_became_peered":"2024-01-23T08:54:49.752077+0000","last_unstale":"2024-01-23T09:23:53.759886+0000","last_undegraded":"2024-01-23T09:23:53.759886+0000","last_fullsized":"2024-01-23T09:23:53.759886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:20:50.653881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":3048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"30'229","reported_seq":265,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.245082+0000","last_change":"2024-01-23T08:54:40.700164+0000","last_active":"2024-01-23T09:25:03.245082+0000","last_peered":"2024-01-23T09:25:03.245082+0000","last_clean":"2024-01-23T09:25:03.245082+0000","last_became_active":"2024-01-23T08:54:40.699449+0000","last_became_peered":"2024-01-23T08:54:40.699449+0000","last_unstale":"2024-01-23T09:25:03.245082+0000","last_undegraded":"2024-01-23T09:25:03.245082+0000","last_fullsized":"2024-01-23T09:25:03.245082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:16:32.814250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2084932,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":2149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"30'24","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.647865+0000","last_change":"2024-01-23T08:54:42.092833+0000","last_active":"2024-01-23T09:25:03.647865+0000","last_peered":"2024-01-23T09:25:03.647865+0000","last_clean":"2024-01-23T09:25:03.647865+0000","last_became_active":"2024-01-23T08:54:42.091950+0000","last_became_peered":"2024-01-23T08:54:42.091950+0000","last_unstale":"2024-01-23T09:25:03.647865+0000","last_undegraded":"2024-01-23T09:25:03.647865+0000","last_fullsized":"2024-01-23T09:25:03.647865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:46.594970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"30'80","reported_seq":107,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:48.744170+0000","last_change":"2024-01-23T08:54:49.747131+0000","last_active":"2024-01-23T09:23:48.744170+0000","last_peered":"2024-01-23T09:23:48.744170+0000","last_clean":"2024-01-23T09:23:48.744170+0000","last_became_active":"2024-01-23T08:54:49.746481+0000","last_became_peered":"2024-01-23T08:54:49.746481+0000","last_unstale":"2024-01-23T09:23:48.744170+0000","last_undegraded":"2024-01-23T09:23:48.744170+0000","last_fullsized":"2024-01-23T09:23:48.744170+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:45:19.670524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":5137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"30'18","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:43.591688+0000","last_change":"2024-01-23T08:54:40.687614+0000","last_active":"2024-01-23T09:24:43.591688+0000","last_peered":"2024-01-23T09:24:43.591688+0000","last_clean":"2024-01-23T09:24:43.591688+0000","last_became_active":"2024-01-23T08:54:40.687234+0000","last_became_peered":"2024-01-23T08:54:40.687234+0000","last_unstale":"2024-01-23T09:24:43.591688+0000","last_undegraded":"2024-01-23T09:24:43.591688+0000","last_fullsized":"2024-01-23T09:24:43.591688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:54:17.627706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"30'21","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.689092+0000","last_change":"2024-01-23T08:55:47.540221+0000","last_active":"2024-01-23T09:25:03.689092+0000","last_peered":"2024-01-23T09:25:03.689092+0000","last_clean":"2024-01-23T09:25:03.689092+0000","last_became_active":"2024-01-23T08:55:47.539657+0000","last_became_peered":"2024-01-23T08:55:47.539657+0000","last_unstale":"2024-01-23T09:25:03.689092+0000","last_undegraded":"2024-01-23T09:25:03.689092+0000","last_fullsized":"2024-01-23T09:25:03.689092+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:19.147334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"30'86","reported_seq":113,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:56.638456+0000","last_change":"2024-01-23T08:54:49.747332+0000","last_active":"2024-01-23T09:23:56.638456+0000","last_peered":"2024-01-23T09:23:56.638456+0000","last_clean":"2024-01-23T09:23:56.638456+0000","last_became_active":"2024-01-23T08:54:49.746474+0000","last_became_peered":"2024-01-23T08:54:49.746474+0000","last_unstale":"2024-01-23T09:23:56.638456+0000","last_undegraded":"2024-01-23T09:23:56.638456+0000","last_fullsized":"2024-01-23T09:23:56.638456+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:28:57.975606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":12223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"30'8","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:48.167428+0000","last_change":"2024-01-23T08:54:40.687290+0000","last_active":"2024-01-23T09:24:48.167428+0000","last_peered":"2024-01-23T09:24:48.167428+0000","last_clean":"2024-01-23T09:24:48.167428+0000","last_became_active":"2024-01-23T08:54:40.686903+0000","last_became_peered":"2024-01-23T08:54:40.686903+0000","last_unstale":"2024-01-23T09:24:48.167428+0000","last_undegraded":"2024-01-23T09:24:48.167428+0000","last_fullsized":"2024-01-23T09:24:48.167428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:57:23.064188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"30'36","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.725842+0000","last_change":"2024-01-23T08:54:42.109485+0000","last_active":"2024-01-23T09:25:03.725842+0000","last_peered":"2024-01-23T09:25:03.725842+0000","last_clean":"2024-01-23T09:25:03.725842+0000","last_became_active":"2024-01-23T08:54:42.108182+0000","last_became_peered":"2024-01-23T08:54:42.108182+0000","last_unstale":"2024-01-23T09:25:03.725842+0000","last_undegraded":"2024-01-23T09:25:03.725842+0000","last_fullsized":"2024-01-23T09:25:03.725842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:51:12.417589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"30'61","reported_seq":88,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:55.602368+0000","last_change":"2024-01-23T08:54:49.747949+0000","last_active":"2024-01-23T09:23:55.602368+0000","last_peered":"2024-01-23T09:23:55.602368+0000","last_clean":"2024-01-23T09:23:55.602368+0000","last_became_active":"2024-01-23T08:54:49.746880+0000","last_became_peered":"2024-01-23T08:54:49.746880+0000","last_unstale":"2024-01-23T09:23:55.602368+0000","last_undegraded":"2024-01-23T09:23:55.602368+0000","last_fullsized":"2024-01-23T09:23:55.602368+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:54:26.728005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":7433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"30'19","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.725334+0000","last_change":"2024-01-23T08:54:42.088786+0000","last_active":"2024-01-23T09:25:03.725334+0000","last_peered":"2024-01-23T09:25:03.725334+0000","last_clean":"2024-01-23T09:25:03.725334+0000","last_became_active":"2024-01-23T08:54:42.088068+0000","last_became_peered":"2024-01-23T08:54:42.088068+0000","last_unstale":"2024-01-23T09:25:03.725334+0000","last_undegraded":"2024-01-23T09:25:03.725334+0000","last_fullsized":"2024-01-23T09:25:03.725334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:38:41.382732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"30'671","reported_seq":705,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:41.735844+0000","last_change":"2024-01-23T08:54:40.612044+0000","last_active":"2024-01-23T09:24:41.735844+0000","last_peered":"2024-01-23T09:24:41.735844+0000","last_clean":"2024-01-23T09:24:41.735844+0000","last_became_active":"2024-01-23T08:54:40.611589+0000","last_became_peered":"2024-01-23T08:54:40.611589+0000","last_unstale":"2024-01-23T09:24:41.735844+0000","last_undegraded":"2024-01-23T09:24:41.735844+0000","last_fullsized":"2024-01-23T09:24:41.735844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:36.177844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":666,"num_write_kb":4421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'70","reported_seq":98,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:57.942928+0000","last_change":"2024-01-23T08:54:49.716713+0000","last_active":"2024-01-23T09:23:57.942928+0000","last_peered":"2024-01-23T09:23:57.942928+0000","last_clean":"2024-01-23T09:23:57.942928+0000","last_became_active":"2024-01-23T08:54:49.715843+0000","last_became_peered":"2024-01-23T08:54:49.715843+0000","last_unstale":"2024-01-23T09:23:57.942928+0000","last_undegraded":"2024-01-23T09:23:57.942928+0000","last_fullsized":"2024-01-23T09:23:57.942928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:46:24.157230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":10371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"30'21","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.634669+0000","last_change":"2024-01-23T08:54:42.230199+0000","last_active":"2024-01-23T09:25:03.634669+0000","last_peered":"2024-01-23T09:25:03.634669+0000","last_clean":"2024-01-23T09:25:03.634669+0000","last_became_active":"2024-01-23T08:54:42.229547+0000","last_became_peered":"2024-01-23T08:54:42.229547+0000","last_unstale":"2024-01-23T09:25:03.634669+0000","last_undegraded":"2024-01-23T09:25:03.634669+0000","last_fullsized":"2024-01-23T09:25:03.634669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:07:07.781698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"30'4","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:22:56.793323+0000","last_change":"2024-01-23T08:54:40.688971+0000","last_active":"2024-01-23T09:22:56.793323+0000","last_peered":"2024-01-23T09:22:56.793323+0000","last_clean":"2024-01-23T09:22:56.793323+0000","last_became_active":"2024-01-23T08:54:40.688230+0000","last_became_peered":"2024-01-23T08:54:40.688230+0000","last_unstale":"2024-01-23T09:22:56.793323+0000","last_undegraded":"2024-01-23T09:22:56.793323+0000","last_fullsized":"2024-01-23T09:22:56.793323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:40:12.245110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"30'94","reported_seq":122,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:58.826706+0000","last_change":"2024-01-23T08:54:49.748471+0000","last_active":"2024-01-23T09:23:58.826706+0000","last_peered":"2024-01-23T09:23:58.826706+0000","last_clean":"2024-01-23T09:23:58.826706+0000","last_became_active":"2024-01-23T08:54:49.747958+0000","last_became_peered":"2024-01-23T08:54:49.747958+0000","last_unstale":"2024-01-23T09:23:58.826706+0000","last_undegraded":"2024-01-23T09:23:58.826706+0000","last_fullsized":"2024-01-23T09:23:58.826706+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:46:36.583078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":8657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"30'23","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.718611+0000","last_change":"2024-01-23T08:54:42.194148+0000","last_active":"2024-01-23T09:25:03.718611+0000","last_peered":"2024-01-23T09:25:03.718611+0000","last_clean":"2024-01-23T09:25:03.718611+0000","last_became_active":"2024-01-23T08:54:42.193403+0000","last_became_peered":"2024-01-23T08:54:42.193403+0000","last_unstale":"2024-01-23T09:25:03.718611+0000","last_undegraded":"2024-01-23T09:25:03.718611+0000","last_fullsized":"2024-01-23T09:25:03.718611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:38:42.543776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"30'11","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:48.195751+0000","last_change":"2024-01-23T08:54:40.688897+0000","last_active":"2024-01-23T09:24:48.195751+0000","last_peered":"2024-01-23T09:24:48.195751+0000","last_clean":"2024-01-23T09:24:48.195751+0000","last_became_active":"2024-01-23T08:54:40.688122+0000","last_became_peered":"2024-01-23T08:54:40.688122+0000","last_unstale":"2024-01-23T09:24:48.195751+0000","last_undegraded":"2024-01-23T09:24:48.195751+0000","last_fullsized":"2024-01-23T09:24:48.195751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:19:16.760424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'73","reported_seq":101,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:57.989453+0000","last_change":"2024-01-23T08:54:49.738331+0000","last_active":"2024-01-23T09:23:57.989453+0000","last_peered":"2024-01-23T09:23:57.989453+0000","last_clean":"2024-01-23T09:23:57.989453+0000","last_became_active":"2024-01-23T08:54:49.737442+0000","last_became_peered":"2024-01-23T08:54:49.737442+0000","last_unstale":"2024-01-23T09:23:57.989453+0000","last_undegraded":"2024-01-23T09:23:57.989453+0000","last_fullsized":"2024-01-23T09:23:57.989453+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:59:20.106849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":10395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"30'19","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.549005+0000","last_change":"2024-01-23T08:54:42.192681+0000","last_active":"2024-01-23T09:25:03.549005+0000","last_peered":"2024-01-23T09:25:03.549005+0000","last_clean":"2024-01-23T09:25:03.549005+0000","last_became_active":"2024-01-23T08:54:42.192225+0000","last_became_peered":"2024-01-23T08:54:42.192225+0000","last_unstale":"2024-01-23T09:25:03.549005+0000","last_undegraded":"2024-01-23T09:25:03.549005+0000","last_fullsized":"2024-01-23T09:25:03.549005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:20:26.263299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"30'7","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:41.715962+0000","last_change":"2024-01-23T08:54:40.686987+0000","last_active":"2024-01-23T09:24:41.715962+0000","last_peered":"2024-01-23T09:24:41.715962+0000","last_clean":"2024-01-23T09:24:41.715962+0000","last_became_active":"2024-01-23T08:54:40.686654+0000","last_became_peered":"2024-01-23T08:54:40.686654+0000","last_unstale":"2024-01-23T09:24:41.715962+0000","last_undegraded":"2024-01-23T09:24:41.715962+0000","last_fullsized":"2024-01-23T09:24:41.715962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:43:26.442461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"30'83","reported_seq":111,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:56.641319+0000","last_change":"2024-01-23T08:54:49.736471+0000","last_active":"2024-01-23T09:23:56.641319+0000","last_peered":"2024-01-23T09:23:56.641319+0000","last_clean":"2024-01-23T09:23:56.641319+0000","last_became_active":"2024-01-23T08:54:49.735971+0000","last_became_peered":"2024-01-23T08:54:49.735971+0000","last_unstale":"2024-01-23T09:23:56.641319+0000","last_undegraded":"2024-01-23T09:23:56.641319+0000","last_fullsized":"2024-01-23T09:23:56.641319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:18:10.354308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":6293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"30'30","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.734411+0000","last_change":"2024-01-23T08:54:42.195854+0000","last_active":"2024-01-23T09:25:03.734411+0000","last_peered":"2024-01-23T09:25:03.734411+0000","last_clean":"2024-01-23T09:25:03.734411+0000","last_became_active":"2024-01-23T08:54:42.195052+0000","last_became_peered":"2024-01-23T08:54:42.195052+0000","last_unstale":"2024-01-23T09:25:03.734411+0000","last_undegraded":"2024-01-23T09:25:03.734411+0000","last_fullsized":"2024-01-23T09:25:03.734411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:54:18.859903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"30'9","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:43.336973+0000","last_change":"2024-01-23T08:54:40.694194+0000","last_active":"2024-01-23T09:24:43.336973+0000","last_peered":"2024-01-23T09:24:43.336973+0000","last_clean":"2024-01-23T09:24:43.336973+0000","last_became_active":"2024-01-23T08:54:40.693610+0000","last_became_peered":"2024-01-23T08:54:40.693610+0000","last_unstale":"2024-01-23T09:24:43.336973+0000","last_undegraded":"2024-01-23T09:24:43.336973+0000","last_fullsized":"2024-01-23T09:24:43.336973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:47:30.746915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"30'40","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:51.975770+0000","last_change":"2024-01-23T08:54:49.747205+0000","last_active":"2024-01-23T09:23:51.975770+0000","last_peered":"2024-01-23T09:23:51.975770+0000","last_clean":"2024-01-23T09:23:51.975770+0000","last_became_active":"2024-01-23T08:54:49.746792+0000","last_became_peered":"2024-01-23T08:54:49.746792+0000","last_unstale":"2024-01-23T09:23:51.975770+0000","last_undegraded":"2024-01-23T09:23:51.975770+0000","last_fullsized":"2024-01-23T09:23:51.975770+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:58:42.245045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":6755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.751593+0000","last_change":"2024-01-23T08:54:42.233783+0000","last_active":"2024-01-23T09:25:03.751593+0000","last_peered":"2024-01-23T09:25:03.751593+0000","last_clean":"2024-01-23T09:25:03.751593+0000","last_became_active":"2024-01-23T08:54:42.233018+0000","last_became_peered":"2024-01-23T08:54:42.233018+0000","last_unstale":"2024-01-23T09:25:03.751593+0000","last_undegraded":"2024-01-23T09:25:03.751593+0000","last_fullsized":"2024-01-23T09:25:03.751593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:04:58.998914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"30'336","reported_seq":371,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:02.817611+0000","last_change":"2024-01-23T08:54:40.690385+0000","last_active":"2024-01-23T09:25:02.817611+0000","last_peered":"2024-01-23T09:25:02.817611+0000","last_clean":"2024-01-23T09:25:02.817611+0000","last_became_active":"2024-01-23T08:54:40.689528+0000","last_became_peered":"2024-01-23T08:54:40.689528+0000","last_unstale":"2024-01-23T09:25:02.817611+0000","last_undegraded":"2024-01-23T09:25:02.817611+0000","last_fullsized":"2024-01-23T09:25:02.817611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:59:11.006550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":906,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"30'90","reported_seq":120,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:56.578837+0000","last_change":"2024-01-23T08:54:49.731870+0000","last_active":"2024-01-23T09:23:56.578837+0000","last_peered":"2024-01-23T09:23:56.578837+0000","last_clean":"2024-01-23T09:23:56.578837+0000","last_became_active":"2024-01-23T08:54:49.731414+0000","last_became_peered":"2024-01-23T08:54:49.731414+0000","last_unstale":"2024-01-23T09:23:56.578837+0000","last_undegraded":"2024-01-23T09:23:56.578837+0000","last_fullsized":"2024-01-23T09:23:56.578837+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:30.315625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":11197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.581262+0000","last_change":"2024-01-23T08:54:42.227885+0000","last_active":"2024-01-23T09:25:03.581262+0000","last_peered":"2024-01-23T09:25:03.581262+0000","last_clean":"2024-01-23T09:25:03.581262+0000","last_became_active":"2024-01-23T08:54:42.227188+0000","last_became_peered":"2024-01-23T08:54:42.227188+0000","last_unstale":"2024-01-23T09:25:03.581262+0000","last_undegraded":"2024-01-23T09:25:03.581262+0000","last_fullsized":"2024-01-23T09:25:03.581262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:02:13.790208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"30'7","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:43.848650+0000","last_change":"2024-01-23T08:54:40.658365+0000","last_active":"2024-01-23T09:24:43.848650+0000","last_peered":"2024-01-23T09:24:43.848650+0000","last_clean":"2024-01-23T09:24:43.848650+0000","last_became_active":"2024-01-23T08:54:40.657616+0000","last_became_peered":"2024-01-23T08:54:40.657616+0000","last_unstale":"2024-01-23T09:24:43.848650+0000","last_undegraded":"2024-01-23T09:24:43.848650+0000","last_fullsized":"2024-01-23T09:24:43.848650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:23:50.053046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"30'59","reported_seq":88,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:58.800322+0000","last_change":"2024-01-23T08:54:49.739474+0000","last_active":"2024-01-23T09:23:58.800322+0000","last_peered":"2024-01-23T09:23:58.800322+0000","last_clean":"2024-01-23T09:23:58.800322+0000","last_became_active":"2024-01-23T08:54:49.738579+0000","last_became_peered":"2024-01-23T08:54:49.738579+0000","last_unstale":"2024-01-23T09:23:58.800322+0000","last_undegraded":"2024-01-23T09:23:58.800322+0000","last_fullsized":"2024-01-23T09:23:58.800322+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:23:32.238072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":6541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"30'19","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.748715+0000","last_change":"2024-01-23T08:54:42.228302+0000","last_active":"2024-01-23T09:25:03.748715+0000","last_peered":"2024-01-23T09:25:03.748715+0000","last_clean":"2024-01-23T09:25:03.748715+0000","last_became_active":"2024-01-23T08:54:42.227558+0000","last_became_peered":"2024-01-23T08:54:42.227558+0000","last_unstale":"2024-01-23T09:25:03.748715+0000","last_undegraded":"2024-01-23T09:25:03.748715+0000","last_fullsized":"2024-01-23T09:25:03.748715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:19:17.992621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:24.630053+0000","last_change":"2024-01-23T08:54:40.697453+0000","last_active":"2024-01-23T09:24:24.630053+0000","last_peered":"2024-01-23T09:24:24.630053+0000","last_clean":"2024-01-23T09:24:24.630053+0000","last_became_active":"2024-01-23T08:54:40.696688+0000","last_became_peered":"2024-01-23T08:54:40.696688+0000","last_unstale":"2024-01-23T09:24:24.630053+0000","last_undegraded":"2024-01-23T09:24:24.630053+0000","last_fullsized":"2024-01-23T09:24:24.630053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:59:22.804479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'81","reported_seq":110,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:57.989602+0000","last_change":"2024-01-23T08:54:49.726678+0000","last_active":"2024-01-23T09:23:57.989602+0000","last_peered":"2024-01-23T09:23:57.989602+0000","last_clean":"2024-01-23T09:23:57.989602+0000","last_became_active":"2024-01-23T08:54:49.725830+0000","last_became_peered":"2024-01-23T08:54:49.725830+0000","last_unstale":"2024-01-23T09:23:57.989602+0000","last_undegraded":"2024-01-23T09:23:57.989602+0000","last_fullsized":"2024-01-23T09:23:57.989602+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:12:34.009779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":6498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.867420+0000","last_change":"2024-01-23T08:54:42.149751+0000","last_active":"2024-01-23T09:25:03.867420+0000","last_peered":"2024-01-23T09:25:03.867420+0000","last_clean":"2024-01-23T09:25:03.867420+0000","last_became_active":"2024-01-23T08:54:42.149019+0000","last_became_peered":"2024-01-23T08:54:42.149019+0000","last_unstale":"2024-01-23T09:25:03.867420+0000","last_undegraded":"2024-01-23T09:25:03.867420+0000","last_fullsized":"2024-01-23T09:25:03.867420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:38:36.083606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"30'8","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:26.661016+0000","last_change":"2024-01-23T08:54:40.680243+0000","last_active":"2024-01-23T09:24:26.661016+0000","last_peered":"2024-01-23T09:24:26.661016+0000","last_clean":"2024-01-23T09:24:26.661016+0000","last_became_active":"2024-01-23T08:54:40.679839+0000","last_became_peered":"2024-01-23T08:54:40.679839+0000","last_unstale":"2024-01-23T09:24:26.661016+0000","last_undegraded":"2024-01-23T09:24:26.661016+0000","last_fullsized":"2024-01-23T09:24:26.661016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:38:34.851409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"30'52","reported_seq":90,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:54.728488+0000","last_change":"2024-01-23T08:55:47.750803+0000","last_active":"2024-01-23T09:23:54.728488+0000","last_peered":"2024-01-23T09:23:54.728488+0000","last_clean":"2024-01-23T09:23:54.728488+0000","last_became_active":"2024-01-23T08:55:47.749227+0000","last_became_peered":"2024-01-23T08:55:47.749227+0000","last_unstale":"2024-01-23T09:23:54.728488+0000","last_undegraded":"2024-01-23T09:23:54.728488+0000","last_fullsized":"2024-01-23T09:23:54.728488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:52:35.422787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":3470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,5],"acting":[6,7,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"30'22","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.609765+0000","last_change":"2024-01-23T08:54:42.108793+0000","last_active":"2024-01-23T09:25:03.609765+0000","last_peered":"2024-01-23T09:25:03.609765+0000","last_clean":"2024-01-23T09:25:03.609765+0000","last_became_active":"2024-01-23T08:54:42.108346+0000","last_became_peered":"2024-01-23T08:54:42.108346+0000","last_unstale":"2024-01-23T09:25:03.609765+0000","last_undegraded":"2024-01-23T09:25:03.609765+0000","last_fullsized":"2024-01-23T09:25:03.609765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:18:02.486206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"30'534","reported_seq":1088,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:00.345864+0000","last_change":"2024-01-23T08:54:40.708494+0000","last_active":"2024-01-23T09:25:00.345864+0000","last_peered":"2024-01-23T09:25:00.345864+0000","last_clean":"2024-01-23T09:25:00.345864+0000","last_became_active":"2024-01-23T08:54:40.707841+0000","last_became_peered":"2024-01-23T08:54:40.707841+0000","last_unstale":"2024-01-23T09:25:00.345864+0000","last_undegraded":"2024-01-23T09:25:00.345864+0000","last_fullsized":"2024-01-23T09:25:00.345864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":534,"log_dups_size":0,"ondisk_log_size":534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:53:17.764440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123944,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":519,"num_read_kb":542,"num_write":528,"num_write_kb":547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"30'72","reported_seq":100,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:53.728690+0000","last_change":"2024-01-23T08:54:49.738198+0000","last_active":"2024-01-23T09:23:53.728690+0000","last_peered":"2024-01-23T09:23:53.728690+0000","last_clean":"2024-01-23T09:23:53.728690+0000","last_became_active":"2024-01-23T08:54:49.737677+0000","last_became_peered":"2024-01-23T08:54:49.737677+0000","last_unstale":"2024-01-23T09:23:53.728690+0000","last_undegraded":"2024-01-23T09:23:53.728690+0000","last_fullsized":"2024-01-23T09:23:53.728690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:57:26.436916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"30'12","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.591042+0000","last_change":"2024-01-23T08:54:42.228222+0000","last_active":"2024-01-23T09:25:03.591042+0000","last_peered":"2024-01-23T09:25:03.591042+0000","last_clean":"2024-01-23T09:25:03.591042+0000","last_became_active":"2024-01-23T08:54:42.227335+0000","last_became_peered":"2024-01-23T08:54:42.227335+0000","last_unstale":"2024-01-23T09:25:03.591042+0000","last_undegraded":"2024-01-23T09:25:03.591042+0000","last_fullsized":"2024-01-23T09:25:03.591042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:29:51.842390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"30'11","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:52.504714+0000","last_change":"2024-01-23T08:54:40.679852+0000","last_active":"2024-01-23T09:24:52.504714+0000","last_peered":"2024-01-23T09:24:52.504714+0000","last_clean":"2024-01-23T09:24:52.504714+0000","last_became_active":"2024-01-23T08:54:40.679467+0000","last_became_peered":"2024-01-23T08:54:40.679467+0000","last_unstale":"2024-01-23T09:24:52.504714+0000","last_undegraded":"2024-01-23T09:24:52.504714+0000","last_fullsized":"2024-01-23T09:24:52.504714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:17.915137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"30'96","reported_seq":125,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:57.955841+0000","last_change":"2024-01-23T08:54:49.730538+0000","last_active":"2024-01-23T09:23:57.955841+0000","last_peered":"2024-01-23T09:23:57.955841+0000","last_clean":"2024-01-23T09:23:57.955841+0000","last_became_active":"2024-01-23T08:54:49.729861+0000","last_became_peered":"2024-01-23T08:54:49.729861+0000","last_unstale":"2024-01-23T09:23:57.955841+0000","last_undegraded":"2024-01-23T09:23:57.955841+0000","last_fullsized":"2024-01-23T09:23:57.955841+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:46:36.583078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":9432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.718567+0000","last_change":"2024-01-23T08:54:42.196505+0000","last_active":"2024-01-23T09:25:03.718567+0000","last_peered":"2024-01-23T09:25:03.718567+0000","last_clean":"2024-01-23T09:25:03.718567+0000","last_became_active":"2024-01-23T08:54:42.195555+0000","last_became_peered":"2024-01-23T08:54:42.195555+0000","last_unstale":"2024-01-23T09:25:03.718567+0000","last_undegraded":"2024-01-23T09:25:03.718567+0000","last_fullsized":"2024-01-23T09:25:03.718567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:57:24.296384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"30'8","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:20.572206+0000","last_change":"2024-01-23T08:54:40.612594+0000","last_active":"2024-01-23T09:24:20.572206+0000","last_peered":"2024-01-23T09:24:20.572206+0000","last_clean":"2024-01-23T09:24:20.572206+0000","last_became_active":"2024-01-23T08:54:40.611932+0000","last_became_peered":"2024-01-23T08:54:40.611932+0000","last_unstale":"2024-01-23T09:24:20.572206+0000","last_undegraded":"2024-01-23T09:24:20.572206+0000","last_fullsized":"2024-01-23T09:24:20.572206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:05.088648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:22:08.761197+0000","last_change":"2024-01-23T08:54:01.491195+0000","last_active":"2024-01-23T09:22:08.761197+0000","last_peered":"2024-01-23T09:22:08.761197+0000","last_clean":"2024-01-23T09:22:08.761197+0000","last_became_active":"2024-01-23T08:54:01.490869+0000","last_became_peered":"2024-01-23T08:54:01.490869+0000","last_unstale":"2024-01-23T09:22:08.761197+0000","last_undegraded":"2024-01-23T09:22:08.761197+0000","last_fullsized":"2024-01-23T09:22:08.761197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:53:59.492955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:53:59.492955+0000","last_clean_scrub_stamp":"2024-01-23T08:53:59.492955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:18:58.446726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"30'73","reported_seq":102,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:58.745460+0000","last_change":"2024-01-23T08:54:49.716297+0000","last_active":"2024-01-23T09:23:58.745460+0000","last_peered":"2024-01-23T09:23:58.745460+0000","last_clean":"2024-01-23T09:23:58.745460+0000","last_became_active":"2024-01-23T08:54:49.715231+0000","last_became_peered":"2024-01-23T08:54:49.715231+0000","last_unstale":"2024-01-23T09:23:58.745460+0000","last_undegraded":"2024-01-23T09:23:58.745460+0000","last_fullsized":"2024-01-23T09:23:58.745460+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:17:59.837409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.725996+0000","last_change":"2024-01-23T08:54:42.089174+0000","last_active":"2024-01-23T09:25:03.725996+0000","last_peered":"2024-01-23T09:25:03.725996+0000","last_clean":"2024-01-23T09:25:03.725996+0000","last_became_active":"2024-01-23T08:54:42.088303+0000","last_became_peered":"2024-01-23T08:54:42.088303+0000","last_unstale":"2024-01-23T09:25:03.725996+0000","last_undegraded":"2024-01-23T09:25:03.725996+0000","last_fullsized":"2024-01-23T09:25:03.725996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:06:49.326117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"30'9","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:53.537619+0000","last_change":"2024-01-23T08:54:40.690720+0000","last_active":"2024-01-23T09:24:53.537619+0000","last_peered":"2024-01-23T09:24:53.537619+0000","last_clean":"2024-01-23T09:24:53.537619+0000","last_became_active":"2024-01-23T08:54:40.689895+0000","last_became_peered":"2024-01-23T08:54:40.689895+0000","last_unstale":"2024-01-23T09:24:53.537619+0000","last_undegraded":"2024-01-23T09:24:53.537619+0000","last_fullsized":"2024-01-23T09:24:53.537619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:33:12.542607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1751,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"30'84","reported_seq":112,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:52.014886+0000","last_change":"2024-01-23T08:54:49.736539+0000","last_active":"2024-01-23T09:23:52.014886+0000","last_peered":"2024-01-23T09:23:52.014886+0000","last_clean":"2024-01-23T09:23:52.014886+0000","last_became_active":"2024-01-23T08:54:49.735777+0000","last_became_peered":"2024-01-23T08:54:49.735777+0000","last_unstale":"2024-01-23T09:23:52.014886+0000","last_undegraded":"2024-01-23T09:23:52.014886+0000","last_fullsized":"2024-01-23T09:23:52.014886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:05:06.867017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":8939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'22","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.866868+0000","last_change":"2024-01-23T08:54:42.107066+0000","last_active":"2024-01-23T09:25:03.866868+0000","last_peered":"2024-01-23T09:25:03.866868+0000","last_clean":"2024-01-23T09:25:03.866868+0000","last_became_active":"2024-01-23T08:54:42.106757+0000","last_became_peered":"2024-01-23T08:54:42.106757+0000","last_unstale":"2024-01-23T09:25:03.866868+0000","last_undegraded":"2024-01-23T09:25:03.866868+0000","last_fullsized":"2024-01-23T09:25:03.866868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:47:31.979111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"30'7","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:46.123009+0000","last_change":"2024-01-23T08:54:40.687942+0000","last_active":"2024-01-23T09:24:46.123009+0000","last_peered":"2024-01-23T09:24:46.123009+0000","last_clean":"2024-01-23T09:24:46.123009+0000","last_became_active":"2024-01-23T08:54:40.686860+0000","last_became_peered":"2024-01-23T08:54:40.686860+0000","last_unstale":"2024-01-23T09:24:46.123009+0000","last_undegraded":"2024-01-23T09:24:46.123009+0000","last_fullsized":"2024-01-23T09:24:46.123009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:04:57.766717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'92","reported_seq":120,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:55.592422+0000","last_change":"2024-01-23T08:54:49.727416+0000","last_active":"2024-01-23T09:23:55.592422+0000","last_peered":"2024-01-23T09:23:55.592422+0000","last_clean":"2024-01-23T09:23:55.592422+0000","last_became_active":"2024-01-23T08:54:49.721494+0000","last_became_peered":"2024-01-23T08:54:49.721494+0000","last_unstale":"2024-01-23T09:23:55.592422+0000","last_undegraded":"2024-01-23T09:23:55.592422+0000","last_fullsized":"2024-01-23T09:23:55.592422+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:52:20.767279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":9285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"30'25","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.873759+0000","last_change":"2024-01-23T08:54:42.117785+0000","last_active":"2024-01-23T09:25:03.873759+0000","last_peered":"2024-01-23T09:25:03.873759+0000","last_clean":"2024-01-23T09:25:03.873759+0000","last_became_active":"2024-01-23T08:54:42.117317+0000","last_became_peered":"2024-01-23T08:54:42.117317+0000","last_unstale":"2024-01-23T09:25:03.873759+0000","last_undegraded":"2024-01-23T09:25:03.873759+0000","last_fullsized":"2024-01-23T09:25:03.873759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:48:28.943781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"30'7","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:19.375993+0000","last_change":"2024-01-23T08:54:40.682656+0000","last_active":"2024-01-23T09:24:19.375993+0000","last_peered":"2024-01-23T09:24:19.375993+0000","last_clean":"2024-01-23T09:24:19.375993+0000","last_became_active":"2024-01-23T08:54:40.681954+0000","last_became_peered":"2024-01-23T08:54:40.681954+0000","last_unstale":"2024-01-23T09:24:19.375993+0000","last_undegraded":"2024-01-23T09:24:19.375993+0000","last_fullsized":"2024-01-23T09:24:19.375993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:20:41.553582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"30'57","reported_seq":86,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:58.796561+0000","last_change":"2024-01-23T08:54:49.716316+0000","last_active":"2024-01-23T09:23:58.796561+0000","last_peered":"2024-01-23T09:23:58.796561+0000","last_clean":"2024-01-23T09:23:58.796561+0000","last_became_active":"2024-01-23T08:54:49.715917+0000","last_became_peered":"2024-01-23T08:54:49.715917+0000","last_unstale":"2024-01-23T09:23:58.796561+0000","last_undegraded":"2024-01-23T09:23:58.796561+0000","last_fullsized":"2024-01-23T09:23:58.796561+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:56:01.803823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":5210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"30'17","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.754214+0000","last_change":"2024-01-23T08:54:42.158814+0000","last_active":"2024-01-23T09:25:03.754214+0000","last_peered":"2024-01-23T09:25:03.754214+0000","last_clean":"2024-01-23T09:25:03.754214+0000","last_became_active":"2024-01-23T08:54:42.155411+0000","last_became_peered":"2024-01-23T08:54:42.155411+0000","last_unstale":"2024-01-23T09:25:03.754214+0000","last_undegraded":"2024-01-23T09:25:03.754214+0000","last_fullsized":"2024-01-23T09:25:03.754214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:28:02.074838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"30'5","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:30.102947+0000","last_change":"2024-01-23T08:54:40.696522+0000","last_active":"2024-01-23T09:24:30.102947+0000","last_peered":"2024-01-23T09:24:30.102947+0000","last_clean":"2024-01-23T09:24:30.102947+0000","last_became_active":"2024-01-23T08:54:40.696128+0000","last_became_peered":"2024-01-23T08:54:40.696128+0000","last_unstale":"2024-01-23T09:24:30.102947+0000","last_undegraded":"2024-01-23T09:24:30.102947+0000","last_fullsized":"2024-01-23T09:24:30.102947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:18:01.254009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"30'112","reported_seq":141,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:58.805307+0000","last_change":"2024-01-23T08:54:49.724660+0000","last_active":"2024-01-23T09:23:58.805307+0000","last_peered":"2024-01-23T09:23:58.805307+0000","last_clean":"2024-01-23T09:23:58.805307+0000","last_became_active":"2024-01-23T08:54:49.723038+0000","last_became_peered":"2024-01-23T08:54:49.723038+0000","last_unstale":"2024-01-23T09:23:58.805307+0000","last_undegraded":"2024-01-23T09:23:58.805307+0000","last_fullsized":"2024-01-23T09:23:58.805307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:20:50.653881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":12618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"30'22","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.725027+0000","last_change":"2024-01-23T08:54:42.149978+0000","last_active":"2024-01-23T09:25:03.725027+0000","last_peered":"2024-01-23T09:25:03.725027+0000","last_clean":"2024-01-23T09:25:03.725027+0000","last_became_active":"2024-01-23T08:54:42.149180+0000","last_became_peered":"2024-01-23T08:54:42.149180+0000","last_unstale":"2024-01-23T09:25:03.725027+0000","last_undegraded":"2024-01-23T09:25:03.725027+0000","last_fullsized":"2024-01-23T09:25:03.725027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:52:12.899176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"30'22","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:00.353895+0000","last_change":"2024-01-23T08:54:40.699997+0000","last_active":"2024-01-23T09:25:00.353895+0000","last_peered":"2024-01-23T09:25:00.353895+0000","last_clean":"2024-01-23T09:25:00.353895+0000","last_became_active":"2024-01-23T08:54:40.699246+0000","last_became_peered":"2024-01-23T08:54:40.699246+0000","last_unstale":"2024-01-23T09:25:00.353895+0000","last_undegraded":"2024-01-23T09:25:00.353895+0000","last_fullsized":"2024-01-23T09:25:00.353895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:19:24.486048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"30'97","reported_seq":124,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:54.636016+0000","last_change":"2024-01-23T08:54:49.729218+0000","last_active":"2024-01-23T09:23:54.636016+0000","last_peered":"2024-01-23T09:23:54.636016+0000","last_clean":"2024-01-23T09:23:54.636016+0000","last_became_active":"2024-01-23T08:54:49.728448+0000","last_became_peered":"2024-01-23T08:54:49.728448+0000","last_unstale":"2024-01-23T09:23:54.636016+0000","last_undegraded":"2024-01-23T09:23:54.636016+0000","last_fullsized":"2024-01-23T09:23:54.636016+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:56:52.671943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":7067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"30'23","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.687551+0000","last_change":"2024-01-23T08:54:42.087980+0000","last_active":"2024-01-23T09:25:03.687551+0000","last_peered":"2024-01-23T09:25:03.687551+0000","last_clean":"2024-01-23T09:25:03.687551+0000","last_became_active":"2024-01-23T08:54:42.087328+0000","last_became_peered":"2024-01-23T08:54:42.087328+0000","last_unstale":"2024-01-23T09:25:03.687551+0000","last_undegraded":"2024-01-23T09:25:03.687551+0000","last_fullsized":"2024-01-23T09:25:03.687551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:07:07.781698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"30'11","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.251016+0000","last_change":"2024-01-23T08:54:40.693906+0000","last_active":"2024-01-23T09:25:03.251016+0000","last_peered":"2024-01-23T09:25:03.251016+0000","last_clean":"2024-01-23T09:25:03.251016+0000","last_became_active":"2024-01-23T08:54:40.693530+0000","last_became_peered":"2024-01-23T08:54:40.693530+0000","last_unstale":"2024-01-23T09:25:03.251016+0000","last_undegraded":"2024-01-23T09:25:03.251016+0000","last_fullsized":"2024-01-23T09:25:03.251016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:59:11.006550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"30'73","reported_seq":109,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:54.780082+0000","last_change":"2024-01-23T08:55:47.750297+0000","last_active":"2024-01-23T09:23:54.780082+0000","last_peered":"2024-01-23T09:23:54.780082+0000","last_clean":"2024-01-23T09:23:54.780082+0000","last_became_active":"2024-01-23T08:55:47.749074+0000","last_became_peered":"2024-01-23T08:55:47.749074+0000","last_unstale":"2024-01-23T09:23:54.780082+0000","last_undegraded":"2024-01-23T09:23:54.780082+0000","last_fullsized":"2024-01-23T09:23:54.780082+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:29:47.219931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":8234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,6,4],"acting":[5,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'36","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.725572+0000","last_change":"2024-01-23T08:54:42.108919+0000","last_active":"2024-01-23T09:25:03.725572+0000","last_peered":"2024-01-23T09:25:03.725572+0000","last_clean":"2024-01-23T09:25:03.725572+0000","last_became_active":"2024-01-23T08:54:42.108253+0000","last_became_peered":"2024-01-23T08:54:42.108253+0000","last_unstale":"2024-01-23T09:25:03.725572+0000","last_undegraded":"2024-01-23T09:25:03.725572+0000","last_fullsized":"2024-01-23T09:25:03.725572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:46:28.714976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"30'11","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:54.291823+0000","last_change":"2024-01-23T08:54:40.696080+0000","last_active":"2024-01-23T09:24:54.291823+0000","last_peered":"2024-01-23T09:24:54.291823+0000","last_clean":"2024-01-23T09:24:54.291823+0000","last_became_active":"2024-01-23T08:54:40.695699+0000","last_became_peered":"2024-01-23T08:54:40.695699+0000","last_unstale":"2024-01-23T09:24:54.291823+0000","last_undegraded":"2024-01-23T09:24:54.291823+0000","last_fullsized":"2024-01-23T09:24:54.291823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:21.215326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"30'63","reported_seq":90,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:51.986229+0000","last_change":"2024-01-23T08:54:49.740480+0000","last_active":"2024-01-23T09:23:51.986229+0000","last_peered":"2024-01-23T09:23:51.986229+0000","last_clean":"2024-01-23T09:23:51.986229+0000","last_became_active":"2024-01-23T08:54:49.739524+0000","last_became_peered":"2024-01-23T08:54:49.739524+0000","last_unstale":"2024-01-23T09:23:51.986229+0000","last_undegraded":"2024-01-23T09:23:51.986229+0000","last_fullsized":"2024-01-23T09:23:51.986229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:45:25.447987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":7121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.588272+0000","last_change":"2024-01-23T08:54:42.230659+0000","last_active":"2024-01-23T09:25:03.588272+0000","last_peered":"2024-01-23T09:25:03.588272+0000","last_clean":"2024-01-23T09:25:03.588272+0000","last_became_active":"2024-01-23T08:54:42.229952+0000","last_became_peered":"2024-01-23T08:54:42.229952+0000","last_unstale":"2024-01-23T09:25:03.588272+0000","last_undegraded":"2024-01-23T09:25:03.588272+0000","last_fullsized":"2024-01-23T09:25:03.588272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:41:53.265527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"30'14","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:30.107136+0000","last_change":"2024-01-23T08:54:40.698779+0000","last_active":"2024-01-23T09:24:30.107136+0000","last_peered":"2024-01-23T09:24:30.107136+0000","last_clean":"2024-01-23T09:24:30.107136+0000","last_became_active":"2024-01-23T08:54:40.698059+0000","last_became_peered":"2024-01-23T08:54:40.698059+0000","last_unstale":"2024-01-23T09:24:30.107136+0000","last_undegraded":"2024-01-23T09:24:30.107136+0000","last_fullsized":"2024-01-23T09:24:30.107136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:24:40.655839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"30'67","reported_seq":94,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:53.764913+0000","last_change":"2024-01-23T08:54:49.708388+0000","last_active":"2024-01-23T09:23:53.764913+0000","last_peered":"2024-01-23T09:23:53.764913+0000","last_clean":"2024-01-23T09:23:53.764913+0000","last_became_active":"2024-01-23T08:54:49.707837+0000","last_became_peered":"2024-01-23T08:54:49.707837+0000","last_unstale":"2024-01-23T09:23:53.764913+0000","last_undegraded":"2024-01-23T09:23:53.764913+0000","last_fullsized":"2024-01-23T09:23:53.764913+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:49:25.509880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":5283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'21","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.867783+0000","last_change":"2024-01-23T08:54:42.229836+0000","last_active":"2024-01-23T09:25:03.867783+0000","last_peered":"2024-01-23T09:25:03.867783+0000","last_clean":"2024-01-23T09:25:03.867783+0000","last_became_active":"2024-01-23T08:54:42.229252+0000","last_became_peered":"2024-01-23T08:54:42.229252+0000","last_unstale":"2024-01-23T09:25:03.867783+0000","last_undegraded":"2024-01-23T09:25:03.867783+0000","last_fullsized":"2024-01-23T09:25:03.867783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:23:51.285243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"30'833","reported_seq":866,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:47.846700+0000","last_change":"2024-01-23T08:54:40.658490+0000","last_active":"2024-01-23T09:24:47.846700+0000","last_peered":"2024-01-23T09:24:47.846700+0000","last_clean":"2024-01-23T09:24:47.846700+0000","last_became_active":"2024-01-23T08:54:40.657711+0000","last_became_peered":"2024-01-23T08:54:40.657711+0000","last_unstale":"2024-01-23T09:24:47.846700+0000","last_undegraded":"2024-01-23T09:24:47.846700+0000","last_fullsized":"2024-01-23T09:24:47.846700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:37:29.479181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":833,"num_write_kb":4568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"30'86","reported_seq":114,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:58.839813+0000","last_change":"2024-01-23T08:54:49.737210+0000","last_active":"2024-01-23T09:23:58.839813+0000","last_peered":"2024-01-23T09:23:58.839813+0000","last_clean":"2024-01-23T09:23:58.839813+0000","last_became_active":"2024-01-23T08:54:49.735023+0000","last_became_peered":"2024-01-23T08:54:49.735023+0000","last_unstale":"2024-01-23T09:23:58.839813+0000","last_undegraded":"2024-01-23T09:23:58.839813+0000","last_fullsized":"2024-01-23T09:23:58.839813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:27.015436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":9278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"30'25","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.726970+0000","last_change":"2024-01-23T08:54:42.154453+0000","last_active":"2024-01-23T09:25:03.726970+0000","last_peered":"2024-01-23T09:25:03.726970+0000","last_clean":"2024-01-23T09:25:03.726970+0000","last_became_active":"2024-01-23T08:54:42.153735+0000","last_became_peered":"2024-01-23T08:54:42.153735+0000","last_unstale":"2024-01-23T09:25:03.726970+0000","last_undegraded":"2024-01-23T09:25:03.726970+0000","last_fullsized":"2024-01-23T09:25:03.726970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:54:39.173058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"30'361","reported_seq":394,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:54.303102+0000","last_change":"2024-01-23T08:54:40.702888+0000","last_active":"2024-01-23T09:24:54.303102+0000","last_peered":"2024-01-23T09:24:54.303102+0000","last_clean":"2024-01-23T09:24:54.303102+0000","last_became_active":"2024-01-23T08:54:40.701827+0000","last_became_peered":"2024-01-23T08:54:40.701827+0000","last_unstale":"2024-01-23T09:24:54.303102+0000","last_undegraded":"2024-01-23T09:24:54.303102+0000","last_fullsized":"2024-01-23T09:24:54.303102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:18:17.748052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"30'124","reported_seq":152,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:58.901371+0000","last_change":"2024-01-23T08:54:49.736262+0000","last_active":"2024-01-23T09:23:58.901371+0000","last_peered":"2024-01-23T09:23:58.901371+0000","last_clean":"2024-01-23T09:23:58.901371+0000","last_became_active":"2024-01-23T08:54:49.735765+0000","last_became_peered":"2024-01-23T08:54:49.735765+0000","last_unstale":"2024-01-23T09:23:58.901371+0000","last_undegraded":"2024-01-23T09:23:58.901371+0000","last_fullsized":"2024-01-23T09:23:58.901371+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:29:59.191326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":11379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"30'28","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.616372+0000","last_change":"2024-01-23T08:54:42.071292+0000","last_active":"2024-01-23T09:25:03.616372+0000","last_peered":"2024-01-23T09:25:03.616372+0000","last_clean":"2024-01-23T09:25:03.616372+0000","last_became_active":"2024-01-23T08:54:42.070703+0000","last_became_peered":"2024-01-23T08:54:42.070703+0000","last_unstale":"2024-01-23T09:25:03.616372+0000","last_undegraded":"2024-01-23T09:25:03.616372+0000","last_fullsized":"2024-01-23T09:25:03.616372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:37.410041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"30'6","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:04.273279+0000","last_change":"2024-01-23T08:54:40.687946+0000","last_active":"2024-01-23T09:24:04.273279+0000","last_peered":"2024-01-23T09:24:04.273279+0000","last_clean":"2024-01-23T09:24:04.273279+0000","last_became_active":"2024-01-23T08:54:40.687656+0000","last_became_peered":"2024-01-23T08:54:40.687656+0000","last_unstale":"2024-01-23T09:24:04.273279+0000","last_undegraded":"2024-01-23T09:24:04.273279+0000","last_fullsized":"2024-01-23T09:24:04.273279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:29:50.091026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'70","reported_seq":98,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:41.205524+0000","last_change":"2024-01-23T08:54:49.729434+0000","last_active":"2024-01-23T09:23:41.205524+0000","last_peered":"2024-01-23T09:23:41.205524+0000","last_clean":"2024-01-23T09:23:41.205524+0000","last_became_active":"2024-01-23T08:54:49.728191+0000","last_became_peered":"2024-01-23T08:54:49.728191+0000","last_unstale":"2024-01-23T09:23:41.205524+0000","last_undegraded":"2024-01-23T09:23:41.205524+0000","last_fullsized":"2024-01-23T09:23:41.205524+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:30:27.390400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":6489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"30'28","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.757845+0000","last_change":"2024-01-23T08:54:42.155857+0000","last_active":"2024-01-23T09:25:03.757845+0000","last_peered":"2024-01-23T09:25:03.757845+0000","last_clean":"2024-01-23T09:25:03.757845+0000","last_became_active":"2024-01-23T08:54:42.153539+0000","last_became_peered":"2024-01-23T08:54:42.153539+0000","last_unstale":"2024-01-23T09:25:03.757845+0000","last_undegraded":"2024-01-23T09:25:03.757845+0000","last_fullsized":"2024-01-23T09:25:03.757845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:27:34.618270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"30'12","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.241284+0000","last_change":"2024-01-23T08:54:40.683174+0000","last_active":"2024-01-23T09:25:03.241284+0000","last_peered":"2024-01-23T09:25:03.241284+0000","last_clean":"2024-01-23T09:25:03.241284+0000","last_became_active":"2024-01-23T08:54:40.682765+0000","last_became_peered":"2024-01-23T08:54:40.682765+0000","last_unstale":"2024-01-23T09:25:03.241284+0000","last_undegraded":"2024-01-23T09:25:03.241284+0000","last_fullsized":"2024-01-23T09:25:03.241284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:13:10.191082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"30'72","reported_seq":100,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:57.975282+0000","last_change":"2024-01-23T08:54:49.728962+0000","last_active":"2024-01-23T09:23:57.975282+0000","last_peered":"2024-01-23T09:23:57.975282+0000","last_clean":"2024-01-23T09:23:57.975282+0000","last_became_active":"2024-01-23T08:54:49.724121+0000","last_became_peered":"2024-01-23T08:54:49.724121+0000","last_unstale":"2024-01-23T09:23:57.975282+0000","last_undegraded":"2024-01-23T09:23:57.975282+0000","last_fullsized":"2024-01-23T09:23:57.975282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:14.188947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":8509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"30'65","reported_seq":95,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:54.910192+0000","last_change":"2024-01-23T08:54:49.735678+0000","last_active":"2024-01-23T09:23:54.910192+0000","last_peered":"2024-01-23T09:23:54.910192+0000","last_clean":"2024-01-23T09:23:54.910192+0000","last_became_active":"2024-01-23T08:54:49.732632+0000","last_became_peered":"2024-01-23T08:54:49.732632+0000","last_unstale":"2024-01-23T09:23:54.910192+0000","last_undegraded":"2024-01-23T09:23:54.910192+0000","last_fullsized":"2024-01-23T09:23:54.910192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:54.463072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":5816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"30'26","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.753551+0000","last_change":"2024-01-23T08:54:42.196434+0000","last_active":"2024-01-23T09:25:03.753551+0000","last_peered":"2024-01-23T09:25:03.753551+0000","last_clean":"2024-01-23T09:25:03.753551+0000","last_became_active":"2024-01-23T08:54:42.195570+0000","last_became_peered":"2024-01-23T08:54:42.195570+0000","last_unstale":"2024-01-23T09:25:03.753551+0000","last_undegraded":"2024-01-23T09:25:03.753551+0000","last_fullsized":"2024-01-23T09:25:03.753551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:04:44.856358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"30'6","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:31.167629+0000","last_change":"2024-01-23T08:54:40.678920+0000","last_active":"2024-01-23T09:24:31.167629+0000","last_peered":"2024-01-23T09:24:31.167629+0000","last_clean":"2024-01-23T09:24:31.167629+0000","last_became_active":"2024-01-23T08:54:40.678527+0000","last_became_peered":"2024-01-23T08:54:40.678527+0000","last_unstale":"2024-01-23T09:24:31.167629+0000","last_undegraded":"2024-01-23T09:24:31.167629+0000","last_fullsized":"2024-01-23T09:24:31.167629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:48:02.807942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'89","reported_seq":118,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:55.557591+0000","last_change":"2024-01-23T08:54:49.719401+0000","last_active":"2024-01-23T09:23:55.557591+0000","last_peered":"2024-01-23T09:23:55.557591+0000","last_clean":"2024-01-23T09:23:55.557591+0000","last_became_active":"2024-01-23T08:54:49.717116+0000","last_became_peered":"2024-01-23T08:54:49.717116+0000","last_unstale":"2024-01-23T09:23:55.557591+0000","last_undegraded":"2024-01-23T09:23:55.557591+0000","last_fullsized":"2024-01-23T09:23:55.557591+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:58:50.143993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":12319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"30'30","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.632552+0000","last_change":"2024-01-23T08:54:42.235843+0000","last_active":"2024-01-23T09:25:03.632552+0000","last_peered":"2024-01-23T09:25:03.632552+0000","last_clean":"2024-01-23T09:25:03.632552+0000","last_became_active":"2024-01-23T08:54:42.235116+0000","last_became_peered":"2024-01-23T08:54:42.235116+0000","last_unstale":"2024-01-23T09:25:03.632552+0000","last_undegraded":"2024-01-23T09:25:03.632552+0000","last_fullsized":"2024-01-23T09:25:03.632552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:43:27.674658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"30'7","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:31.174876+0000","last_change":"2024-01-23T08:54:40.690150+0000","last_active":"2024-01-23T09:24:31.174876+0000","last_peered":"2024-01-23T09:24:31.174876+0000","last_clean":"2024-01-23T09:24:31.174876+0000","last_became_active":"2024-01-23T08:54:40.689433+0000","last_became_peered":"2024-01-23T08:54:40.689433+0000","last_unstale":"2024-01-23T09:24:31.174876+0000","last_undegraded":"2024-01-23T09:24:31.174876+0000","last_fullsized":"2024-01-23T09:24:31.174876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:35:11.315349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"30'511","reported_seq":544,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:37.442027+0000","last_change":"2024-01-23T08:54:40.686731+0000","last_active":"2024-01-23T09:24:37.442027+0000","last_peered":"2024-01-23T09:24:37.442027+0000","last_clean":"2024-01-23T09:24:37.442027+0000","last_became_active":"2024-01-23T08:54:40.686371+0000","last_became_peered":"2024-01-23T08:54:40.686371+0000","last_unstale":"2024-01-23T09:24:37.442027+0000","last_undegraded":"2024-01-23T09:24:37.442027+0000","last_fullsized":"2024-01-23T09:24:37.442027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:45.362773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":507,"num_write_kb":4372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"30'22","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.736889+0000","last_change":"2024-01-23T08:54:42.200428+0000","last_active":"2024-01-23T09:25:03.736889+0000","last_peered":"2024-01-23T09:25:03.736889+0000","last_clean":"2024-01-23T09:25:03.736889+0000","last_became_active":"2024-01-23T08:54:42.198648+0000","last_became_peered":"2024-01-23T08:54:42.198648+0000","last_unstale":"2024-01-23T09:25:03.736889+0000","last_undegraded":"2024-01-23T09:25:03.736889+0000","last_fullsized":"2024-01-23T09:25:03.736889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:45:11.802421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"30'54","reported_seq":81,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:54.793810+0000","last_change":"2024-01-23T08:54:49.742269+0000","last_active":"2024-01-23T09:23:54.793810+0000","last_peered":"2024-01-23T09:23:54.793810+0000","last_clean":"2024-01-23T09:23:54.793810+0000","last_became_active":"2024-01-23T08:54:49.741692+0000","last_became_peered":"2024-01-23T08:54:49.741692+0000","last_unstale":"2024-01-23T09:23:54.793810+0000","last_undegraded":"2024-01-23T09:23:54.793810+0000","last_fullsized":"2024-01-23T09:23:54.793810+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:45.278144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":4034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"30'585","reported_seq":618,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:47.051020+0000","last_change":"2024-01-23T08:54:40.687352+0000","last_active":"2024-01-23T09:24:47.051020+0000","last_peered":"2024-01-23T09:24:47.051020+0000","last_clean":"2024-01-23T09:24:47.051020+0000","last_became_active":"2024-01-23T08:54:40.686125+0000","last_became_peered":"2024-01-23T08:54:40.686125+0000","last_unstale":"2024-01-23T09:24:47.051020+0000","last_undegraded":"2024-01-23T09:24:47.051020+0000","last_fullsized":"2024-01-23T09:24:47.051020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:38:41.311580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195507,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":4397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"30'19","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.698551+0000","last_change":"2024-01-23T08:54:42.090249+0000","last_active":"2024-01-23T09:25:03.698551+0000","last_peered":"2024-01-23T09:25:03.698551+0000","last_clean":"2024-01-23T09:25:03.698551+0000","last_became_active":"2024-01-23T08:54:42.089826+0000","last_became_peered":"2024-01-23T08:54:42.089826+0000","last_unstale":"2024-01-23T09:25:03.698551+0000","last_undegraded":"2024-01-23T09:25:03.698551+0000","last_fullsized":"2024-01-23T09:25:03.698551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:07:39.007667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"30'96","reported_seq":119,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:49.097776+0000","last_change":"2024-01-23T08:55:47.749137+0000","last_active":"2024-01-23T09:23:49.097776+0000","last_peered":"2024-01-23T09:23:49.097776+0000","last_clean":"2024-01-23T09:23:49.097776+0000","last_became_active":"2024-01-23T08:55:47.747327+0000","last_became_peered":"2024-01-23T08:55:47.747327+0000","last_unstale":"2024-01-23T09:23:49.097776+0000","last_undegraded":"2024-01-23T09:23:49.097776+0000","last_fullsized":"2024-01-23T09:23:49.097776+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:51:20.285692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":8062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"30'35","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.752906+0000","last_change":"2024-01-23T08:54:42.228128+0000","last_active":"2024-01-23T09:25:03.752906+0000","last_peered":"2024-01-23T09:25:03.752906+0000","last_clean":"2024-01-23T09:25:03.752906+0000","last_became_active":"2024-01-23T08:54:42.227421+0000","last_became_peered":"2024-01-23T08:54:42.227421+0000","last_unstale":"2024-01-23T09:25:03.752906+0000","last_undegraded":"2024-01-23T09:25:03.752906+0000","last_fullsized":"2024-01-23T09:25:03.752906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:47:09.171802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"30'25","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.639997+0000","last_change":"2024-01-23T08:54:42.112162+0000","last_active":"2024-01-23T09:25:03.639997+0000","last_peered":"2024-01-23T09:25:03.639997+0000","last_clean":"2024-01-23T09:25:03.639997+0000","last_became_active":"2024-01-23T08:54:42.111635+0000","last_became_peered":"2024-01-23T08:54:42.111635+0000","last_unstale":"2024-01-23T09:25:03.639997+0000","last_undegraded":"2024-01-23T09:25:03.639997+0000","last_fullsized":"2024-01-23T09:25:03.639997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:13:11.423278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"30'28","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.713263+0000","last_change":"2024-01-23T08:54:42.069982+0000","last_active":"2024-01-23T09:25:03.713263+0000","last_peered":"2024-01-23T09:25:03.713263+0000","last_clean":"2024-01-23T09:25:03.713263+0000","last_became_active":"2024-01-23T08:54:42.069262+0000","last_became_peered":"2024-01-23T08:54:42.069262+0000","last_unstale":"2024-01-23T09:25:03.713263+0000","last_undegraded":"2024-01-23T09:25:03.713263+0000","last_fullsized":"2024-01-23T09:25:03.713263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:56:44.803841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"30'23","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.630718+0000","last_change":"2024-01-23T08:54:42.108709+0000","last_active":"2024-01-23T09:25:03.630718+0000","last_peered":"2024-01-23T09:25:03.630718+0000","last_clean":"2024-01-23T09:25:03.630718+0000","last_became_active":"2024-01-23T08:54:42.107985+0000","last_became_peered":"2024-01-23T08:54:42.107985+0000","last_unstale":"2024-01-23T09:25:03.630718+0000","last_undegraded":"2024-01-23T09:25:03.630718+0000","last_fullsized":"2024-01-23T09:25:03.630718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:27:28.770059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"30'17","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.599762+0000","last_change":"2024-01-23T08:54:42.229100+0000","last_active":"2024-01-23T09:25:03.599762+0000","last_peered":"2024-01-23T09:25:03.599762+0000","last_clean":"2024-01-23T09:25:03.599762+0000","last_became_active":"2024-01-23T08:54:42.227918+0000","last_became_peered":"2024-01-23T08:54:42.227918+0000","last_unstale":"2024-01-23T09:25:03.599762+0000","last_undegraded":"2024-01-23T09:25:03.599762+0000","last_fullsized":"2024-01-23T09:25:03.599762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:54:47.705445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"30'20","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.584500+0000","last_change":"2024-01-23T08:54:42.231357+0000","last_active":"2024-01-23T09:25:03.584500+0000","last_peered":"2024-01-23T09:25:03.584500+0000","last_clean":"2024-01-23T09:25:03.584500+0000","last_became_active":"2024-01-23T08:54:42.230615+0000","last_became_peered":"2024-01-23T08:54:42.230615+0000","last_unstale":"2024-01-23T09:25:03.584500+0000","last_undegraded":"2024-01-23T09:25:03.584500+0000","last_fullsized":"2024-01-23T09:25:03.584500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:12:12.757498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"30'35","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.755743+0000","last_change":"2024-01-23T08:54:42.158739+0000","last_active":"2024-01-23T09:25:03.755743+0000","last_peered":"2024-01-23T09:25:03.755743+0000","last_clean":"2024-01-23T09:25:03.755743+0000","last_became_active":"2024-01-23T08:54:42.157106+0000","last_became_peered":"2024-01-23T08:54:42.157106+0000","last_unstale":"2024-01-23T09:25:03.755743+0000","last_undegraded":"2024-01-23T09:25:03.755743+0000","last_fullsized":"2024-01-23T09:25:03.755743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:32:37.961458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"30'20","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.609816+0000","last_change":"2024-01-23T08:54:42.092942+0000","last_active":"2024-01-23T09:25:03.609816+0000","last_peered":"2024-01-23T09:25:03.609816+0000","last_clean":"2024-01-23T09:25:03.609816+0000","last_became_active":"2024-01-23T08:54:42.092149+0000","last_became_peered":"2024-01-23T08:54:42.092149+0000","last_unstale":"2024-01-23T09:25:03.609816+0000","last_undegraded":"2024-01-23T09:25:03.609816+0000","last_fullsized":"2024-01-23T09:25:03.609816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:19.147334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"30'19","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.725472+0000","last_change":"2024-01-23T08:54:42.069948+0000","last_active":"2024-01-23T09:25:03.725472+0000","last_peered":"2024-01-23T09:25:03.725472+0000","last_clean":"2024-01-23T09:25:03.725472+0000","last_became_active":"2024-01-23T08:54:42.069305+0000","last_became_peered":"2024-01-23T08:54:42.069305+0000","last_unstale":"2024-01-23T09:25:03.725472+0000","last_undegraded":"2024-01-23T09:25:03.725472+0000","last_fullsized":"2024-01-23T09:25:03.725472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:21:50.684517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.626304+0000","last_change":"2024-01-23T08:54:42.158120+0000","last_active":"2024-01-23T09:25:03.626304+0000","last_peered":"2024-01-23T09:25:03.626304+0000","last_clean":"2024-01-23T09:25:03.626304+0000","last_became_active":"2024-01-23T08:54:42.157647+0000","last_became_peered":"2024-01-23T08:54:42.157647+0000","last_unstale":"2024-01-23T09:25:03.626304+0000","last_undegraded":"2024-01-23T09:25:03.626304+0000","last_fullsized":"2024-01-23T09:25:03.626304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:28:50.107504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.697797+0000","last_change":"2024-01-23T08:54:42.119253+0000","last_active":"2024-01-23T09:25:03.697797+0000","last_peered":"2024-01-23T09:25:03.697797+0000","last_clean":"2024-01-23T09:25:03.697797+0000","last_became_active":"2024-01-23T08:54:42.118528+0000","last_became_peered":"2024-01-23T08:54:42.118528+0000","last_unstale":"2024-01-23T09:25:03.697797+0000","last_undegraded":"2024-01-23T09:25:03.697797+0000","last_fullsized":"2024-01-23T09:25:03.697797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:47:09.171802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"30'35","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.736189+0000","last_change":"2024-01-23T08:54:42.197561+0000","last_active":"2024-01-23T09:25:03.736189+0000","last_peered":"2024-01-23T09:25:03.736189+0000","last_clean":"2024-01-23T09:25:03.736189+0000","last_became_active":"2024-01-23T08:54:42.196809+0000","last_became_peered":"2024-01-23T08:54:42.196809+0000","last_unstale":"2024-01-23T09:25:03.736189+0000","last_undegraded":"2024-01-23T09:25:03.736189+0000","last_fullsized":"2024-01-23T09:25:03.736189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:16:34.046447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"30'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.871563+0000","last_change":"2024-01-23T08:54:42.112093+0000","last_active":"2024-01-23T09:25:03.871563+0000","last_peered":"2024-01-23T09:25:03.871563+0000","last_clean":"2024-01-23T09:25:03.871563+0000","last_became_active":"2024-01-23T08:54:42.111207+0000","last_became_peered":"2024-01-23T08:54:42.111207+0000","last_unstale":"2024-01-23T09:25:03.871563+0000","last_undegraded":"2024-01-23T09:25:03.871563+0000","last_fullsized":"2024-01-23T09:25:03.871563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:37.410041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"30'22","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.724979+0000","last_change":"2024-01-23T08:54:42.195803+0000","last_active":"2024-01-23T09:25:03.724979+0000","last_peered":"2024-01-23T09:25:03.724979+0000","last_clean":"2024-01-23T09:25:03.724979+0000","last_became_active":"2024-01-23T08:54:42.194562+0000","last_became_peered":"2024-01-23T08:54:42.194562+0000","last_unstale":"2024-01-23T09:25:03.724979+0000","last_undegraded":"2024-01-23T09:25:03.724979+0000","last_fullsized":"2024-01-23T09:25:03.724979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:53:56.379892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"30'33","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.641853+0000","last_change":"2024-01-23T08:54:42.161219+0000","last_active":"2024-01-23T09:25:03.641853+0000","last_peered":"2024-01-23T09:25:03.641853+0000","last_clean":"2024-01-23T09:25:03.641853+0000","last_became_active":"2024-01-23T08:54:42.160570+0000","last_became_peered":"2024-01-23T08:54:42.160570+0000","last_unstale":"2024-01-23T09:25:03.641853+0000","last_undegraded":"2024-01-23T09:25:03.641853+0000","last_fullsized":"2024-01-23T09:25:03.641853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:47:09.171802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.722516+0000","last_change":"2024-01-23T08:54:42.115468+0000","last_active":"2024-01-23T09:25:03.722516+0000","last_peered":"2024-01-23T09:25:03.722516+0000","last_clean":"2024-01-23T09:25:03.722516+0000","last_became_active":"2024-01-23T08:54:42.114759+0000","last_became_peered":"2024-01-23T08:54:42.114759+0000","last_unstale":"2024-01-23T09:25:03.722516+0000","last_undegraded":"2024-01-23T09:25:03.722516+0000","last_fullsized":"2024-01-23T09:25:03.722516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:00:35.095097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.726671+0000","last_change":"2024-01-23T08:54:42.150054+0000","last_active":"2024-01-23T09:25:03.726671+0000","last_peered":"2024-01-23T09:25:03.726671+0000","last_clean":"2024-01-23T09:25:03.726671+0000","last_became_active":"2024-01-23T08:54:42.149278+0000","last_became_peered":"2024-01-23T08:54:42.149278+0000","last_unstale":"2024-01-23T09:25:03.726671+0000","last_undegraded":"2024-01-23T09:25:03.726671+0000","last_fullsized":"2024-01-23T09:25:03.726671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:16:33.710981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.618372+0000","last_change":"2024-01-23T08:54:42.110442+0000","last_active":"2024-01-23T09:25:03.618372+0000","last_peered":"2024-01-23T09:25:03.618372+0000","last_clean":"2024-01-23T09:25:03.618372+0000","last_became_active":"2024-01-23T08:54:42.109743+0000","last_became_peered":"2024-01-23T08:54:42.109743+0000","last_unstale":"2024-01-23T09:25:03.618372+0000","last_undegraded":"2024-01-23T09:25:03.618372+0000","last_fullsized":"2024-01-23T09:25:03.618372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:58:34.376942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"30'25","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.588171+0000","last_change":"2024-01-23T08:54:42.228264+0000","last_active":"2024-01-23T09:25:03.588171+0000","last_peered":"2024-01-23T09:25:03.588171+0000","last_clean":"2024-01-23T09:25:03.588171+0000","last_became_active":"2024-01-23T08:54:42.227537+0000","last_became_peered":"2024-01-23T08:54:42.227537+0000","last_unstale":"2024-01-23T09:25:03.588171+0000","last_undegraded":"2024-01-23T09:25:03.588171+0000","last_fullsized":"2024-01-23T09:25:03.588171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:54:25.960679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"30'33","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.599333+0000","last_change":"2024-01-23T08:54:42.225968+0000","last_active":"2024-01-23T09:25:03.599333+0000","last_peered":"2024-01-23T09:25:03.599333+0000","last_clean":"2024-01-23T09:25:03.599333+0000","last_became_active":"2024-01-23T08:54:42.224541+0000","last_became_peered":"2024-01-23T08:54:42.224541+0000","last_unstale":"2024-01-23T09:25:03.599333+0000","last_undegraded":"2024-01-23T09:25:03.599333+0000","last_fullsized":"2024-01-23T09:25:03.599333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:04:03.310087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"30'18","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.873515+0000","last_change":"2024-01-23T08:54:42.111363+0000","last_active":"2024-01-23T09:25:03.873515+0000","last_peered":"2024-01-23T09:25:03.873515+0000","last_clean":"2024-01-23T09:25:03.873515+0000","last_became_active":"2024-01-23T08:54:42.111043+0000","last_became_peered":"2024-01-23T08:54:42.111043+0000","last_unstale":"2024-01-23T09:25:03.873515+0000","last_undegraded":"2024-01-23T09:25:03.873515+0000","last_fullsized":"2024-01-23T09:25:03.873515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:22.447523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"30'19","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.867266+0000","last_change":"2024-01-23T08:54:42.116234+0000","last_active":"2024-01-23T09:25:03.867266+0000","last_peered":"2024-01-23T09:25:03.867266+0000","last_clean":"2024-01-23T09:25:03.867266+0000","last_became_active":"2024-01-23T08:54:42.115911+0000","last_became_peered":"2024-01-23T08:54:42.115911+0000","last_unstale":"2024-01-23T09:25:03.867266+0000","last_undegraded":"2024-01-23T09:25:03.867266+0000","last_fullsized":"2024-01-23T09:25:03.867266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:06.320845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"30'33","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.871125+0000","last_change":"2024-01-23T08:54:42.158134+0000","last_active":"2024-01-23T09:25:03.871125+0000","last_peered":"2024-01-23T09:25:03.871125+0000","last_clean":"2024-01-23T09:25:03.871125+0000","last_became_active":"2024-01-23T08:54:42.157331+0000","last_became_peered":"2024-01-23T08:54:42.157331+0000","last_unstale":"2024-01-23T09:25:03.871125+0000","last_undegraded":"2024-01-23T09:25:03.871125+0000","last_fullsized":"2024-01-23T09:25:03.871125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:46.594970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"30'28","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.704939+0000","last_change":"2024-01-23T08:54:42.092495+0000","last_active":"2024-01-23T09:25:03.704939+0000","last_peered":"2024-01-23T09:25:03.704939+0000","last_clean":"2024-01-23T09:25:03.704939+0000","last_became_active":"2024-01-23T08:54:42.091726+0000","last_became_peered":"2024-01-23T08:54:42.091726+0000","last_unstale":"2024-01-23T09:25:03.704939+0000","last_undegraded":"2024-01-23T09:25:03.704939+0000","last_fullsized":"2024-01-23T09:25:03.704939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:19:17.992621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"30'19","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.647706+0000","last_change":"2024-01-23T08:54:42.120617+0000","last_active":"2024-01-23T09:25:03.647706+0000","last_peered":"2024-01-23T09:25:03.647706+0000","last_clean":"2024-01-23T09:25:03.647706+0000","last_became_active":"2024-01-23T08:54:42.119847+0000","last_became_peered":"2024-01-23T08:54:42.119847+0000","last_unstale":"2024-01-23T09:25:03.647706+0000","last_undegraded":"2024-01-23T09:25:03.647706+0000","last_fullsized":"2024-01-23T09:25:03.647706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:29:51.323223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"30'18","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.866794+0000","last_change":"2024-01-23T08:54:42.197133+0000","last_active":"2024-01-23T09:25:03.866794+0000","last_peered":"2024-01-23T09:25:03.866794+0000","last_clean":"2024-01-23T09:25:03.866794+0000","last_became_active":"2024-01-23T08:54:42.195743+0000","last_became_peered":"2024-01-23T08:54:42.195743+0000","last_unstale":"2024-01-23T09:25:03.866794+0000","last_undegraded":"2024-01-23T09:25:03.866794+0000","last_fullsized":"2024-01-23T09:25:03.866794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:48:04.040139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"30'24","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.751801+0000","last_change":"2024-01-23T08:54:42.195979+0000","last_active":"2024-01-23T09:25:03.751801+0000","last_peered":"2024-01-23T09:25:03.751801+0000","last_clean":"2024-01-23T09:25:03.751801+0000","last_became_active":"2024-01-23T08:54:42.194846+0000","last_became_peered":"2024-01-23T08:54:42.194846+0000","last_unstale":"2024-01-23T09:25:03.751801+0000","last_undegraded":"2024-01-23T09:25:03.751801+0000","last_fullsized":"2024-01-23T09:25:03.751801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:07:39.007667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"30'23","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.862699+0000","last_change":"2024-01-23T08:54:42.118056+0000","last_active":"2024-01-23T09:25:03.862699+0000","last_peered":"2024-01-23T09:25:03.862699+0000","last_clean":"2024-01-23T09:25:03.862699+0000","last_became_active":"2024-01-23T08:54:42.117735+0000","last_became_peered":"2024-01-23T08:54:42.117735+0000","last_unstale":"2024-01-23T09:25:03.862699+0000","last_undegraded":"2024-01-23T09:25:03.862699+0000","last_fullsized":"2024-01-23T09:25:03.862699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:19.147334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"30'16","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.752663+0000","last_change":"2024-01-23T08:54:42.195159+0000","last_active":"2024-01-23T09:25:03.752663+0000","last_peered":"2024-01-23T09:25:03.752663+0000","last_clean":"2024-01-23T09:25:03.752663+0000","last_became_active":"2024-01-23T08:54:42.194331+0000","last_became_peered":"2024-01-23T08:54:42.194331+0000","last_unstale":"2024-01-23T09:25:03.752663+0000","last_undegraded":"2024-01-23T09:25:03.752663+0000","last_fullsized":"2024-01-23T09:25:03.752663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:19:25.718244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"30'25","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.634628+0000","last_change":"2024-01-23T08:54:42.197096+0000","last_active":"2024-01-23T09:25:03.634628+0000","last_peered":"2024-01-23T09:25:03.634628+0000","last_clean":"2024-01-23T09:25:03.634628+0000","last_became_active":"2024-01-23T08:54:42.196391+0000","last_became_peered":"2024-01-23T08:54:42.196391+0000","last_unstale":"2024-01-23T09:25:03.634628+0000","last_undegraded":"2024-01-23T09:25:03.634628+0000","last_fullsized":"2024-01-23T09:25:03.634628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:22.447523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"30'18","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.601398+0000","last_change":"2024-01-23T08:54:42.231430+0000","last_active":"2024-01-23T09:25:03.601398+0000","last_peered":"2024-01-23T09:25:03.601398+0000","last_clean":"2024-01-23T09:25:03.601398+0000","last_became_active":"2024-01-23T08:54:42.229220+0000","last_became_peered":"2024-01-23T08:54:42.229220+0000","last_unstale":"2024-01-23T09:25:03.601398+0000","last_undegraded":"2024-01-23T09:25:03.601398+0000","last_fullsized":"2024-01-23T09:25:03.601398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:48:04.040139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"30'24","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.870352+0000","last_change":"2024-01-23T08:54:42.118613+0000","last_active":"2024-01-23T09:25:03.870352+0000","last_peered":"2024-01-23T09:25:03.870352+0000","last_clean":"2024-01-23T09:25:03.870352+0000","last_became_active":"2024-01-23T08:54:42.118233+0000","last_became_peered":"2024-01-23T08:54:42.118233+0000","last_unstale":"2024-01-23T09:25:03.870352+0000","last_undegraded":"2024-01-23T09:25:03.870352+0000","last_fullsized":"2024-01-23T09:25:03.870352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:16:33.710981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2304,"num_write_kb":252373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2476,"ondisk_log_size":2476,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1536,"ondisk_log_size":1536,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":23189121,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":519,"num_read_kb":542,"num_write":5371,"num_write_kb":25642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":46628864,"data_stored":46378242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4894,"ondisk_log_size":4894,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509819,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29528,"kb_used_data":2512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342312,"statfs":{"total":96636764160,"available":96606527488,"internally_reserved":0,"allocated":2572288,"data_stored":2340721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.89200000000000002,"15min":0.88200000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.46100000000000002},"max":{"1min":1.4039999999999999,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.93500000000000005,"15min":0.91400000000000003},"min":{"1min":0.61799999999999999,"5min":0.56599999999999995,"15min":0.46300000000000002},"max":{"1min":1.3999999999999999,"5min":1.456,"15min":1.456},"last":1.2789999999999999}]},{"osd":1,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.97599999999999998,"15min":0.95499999999999996},"min":{"1min":0.66100000000000003,"5min":0.52900000000000003,"15min":0.49399999999999999},"max":{"1min":1.419,"5min":1.425,"15min":1.754},"last":1.1659999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.97499999999999998,"15min":0.97299999999999998},"min":{"1min":0.67900000000000005,"5min":0.54400000000000004,"15min":0.51900000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.597},"last":0.98399999999999999}]},{"osd":2,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.96999999999999997,"15min":0.93400000000000005},"min":{"1min":0.66700000000000004,"5min":0.53000000000000003,"15min":0.47099999999999997},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0369999999999999,"15min":1.014},"min":{"1min":0.73599999999999999,"5min":0.59999999999999998,"15min":0.55000000000000004},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.03}]},{"osd":3,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0069999999999999,"15min":0.99099999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.7190000000000001},"last":1.073},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.052,"15min":1.073},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57099999999999995},"max":{"1min":1.587,"5min":1.587,"15min":1.889},"last":1.244}]},{"osd":4,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":0.97099999999999997,"15min":0.97199999999999998},"min":{"1min":0.68200000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.645},"last":1.206},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.99199999999999999,"15min":0.98999999999999999},"min":{"1min":0.60699999999999998,"5min":0.48899999999999999,"15min":0.46800000000000003},"max":{"1min":1.4259999999999999,"5min":1.621,"15min":1.982},"last":0.878}]},{"osd":5,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0760000000000001,"15min":1.0820000000000001},"min":{"1min":0.71099999999999997,"5min":0.63,"15min":0.57299999999999995},"max":{"1min":1.4570000000000001,"5min":1.613,"15min":1.9710000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.115,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.72299999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.8260000000000001},"last":0.78200000000000003}]},{"osd":6,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.147,"15min":1.1399999999999999},"min":{"1min":0.86499999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.613,"5min":1.613,"15min":1.9399999999999999},"last":1.103},{"interface":"front","average":{"1min":1.123,"5min":1.131,"15min":1.1319999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.752,"5min":1.752,"15min":1.883},"last":1.131}]}]},{"osd":5,"up_from":15,"seq":64424509818,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38352,"kb_used_data":7176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333488,"statfs":{"total":96636764160,"available":96597491712,"internally_reserved":0,"allocated":7348224,"data_stored":7125746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.89100000000000001,"15min":0.88300000000000001},"min":{"1min":0.54300000000000004,"5min":0.51500000000000001,"15min":0.501},"max":{"1min":1.296,"5min":1.3919999999999999,"15min":1.5269999999999999},"last":1.153},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.99399999999999999,"15min":0.98099999999999998},"min":{"1min":0.60899999999999999,"5min":0.58899999999999997,"15min":0.53100000000000003},"max":{"1min":1.3109999999999999,"5min":1.552,"15min":1.552},"last":0.97899999999999998}]},{"osd":1,"last update":"Tue Jan 23 09:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.96599999999999997,"15min":0.95599999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.498},"max":{"1min":1.3,"5min":1.4019999999999999,"15min":1.413},"last":0.871},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.96499999999999997,"15min":0.93799999999999994},"min":{"1min":0.625,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2470000000000001,"5min":1.405,"15min":1.542},"last":1.105}]},{"osd":2,"last update":"Tue Jan 23 09:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.94299999999999995,"15min":0.92100000000000004},"min":{"1min":0.63900000000000001,"5min":0.55300000000000005,"15min":0.51100000000000001},"max":{"1min":1.2709999999999999,"5min":1.421,"15min":1.46},"last":1.014},{"interface":"front","average":{"1min":1.012,"5min":1.03,"15min":1.0189999999999999},"min":{"1min":0.64400000000000002,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.385,"5min":1.456,"15min":1.53},"last":1.421}]},{"osd":3,"last update":"Tue Jan 23 09:24:08 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.026,"15min":1.028},"min":{"1min":0.72999999999999998,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.431,"5min":1.4570000000000001,"15min":1.677},"last":1.056},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.0640000000000001,"15min":1.0489999999999999},"min":{"1min":0.76300000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.3109999999999999}]},{"osd":4,"last update":"Tue Jan 23 09:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.97299999999999998,"15min":0.98899999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.48599999999999999},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.8779999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.046,"5min":1.0069999999999999,"15min":1.0109999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.2669999999999999}]},{"osd":6,"last update":"Tue Jan 23 09:24:08 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0309999999999999,"15min":1.044},"min":{"1min":0.71299999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.349,"5min":1.4690000000000001,"15min":1.823},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.1120000000000001,"15min":1.1060000000000001},"min":{"1min":0.76100000000000001,"5min":0.72299999999999998,"15min":0.42599999999999999},"max":{"1min":1.3959999999999999,"5min":1.532,"15min":1.6759999999999999},"last":1.4610000000000001}]},{"osd":7,"last update":"Tue Jan 23 09:24:08 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.1000000000000001,"15min":1.1339999999999999},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.518,"5min":1.518,"15min":1.919},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.163,"15min":1.1659999999999999},"min":{"1min":0.93400000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4670000000000001,"5min":1.5489999999999999,"15min":1.8140000000000001},"last":1.3879999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509817,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39732,"kb_used_data":8556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332108,"statfs":{"total":96636764160,"available":96596078592,"internally_reserved":0,"allocated":8761344,"data_stored":8522021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.92400000000000004,"15min":0.91300000000000003},"min":{"1min":0.56599999999999995,"5min":0.50700000000000001,"15min":0.46600000000000003},"max":{"1min":1.3129999999999999,"5min":1.3799999999999999,"15min":1.583},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.95499999999999996,"15min":0.91800000000000004},"min":{"1min":0.60499999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.282,"5min":1.329,"15min":1.5629999999999999},"last":0.89600000000000002}]},{"osd":1,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.97699999999999998,"15min":0.93000000000000005},"min":{"1min":0.74099999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3640000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.94099999999999995,"15min":0.95299999999999996},"min":{"1min":0.66100000000000003,"5min":0.59999999999999998,"15min":0.5},"max":{"1min":1.232,"5min":1.415,"15min":1.415},"last":0.85699999999999998}]},{"osd":2,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.96099999999999997,"15min":0.93700000000000006},"min":{"1min":0.625,"5min":0.56599999999999995,"15min":0.54000000000000004},"max":{"1min":1.3460000000000001,"5min":1.387,"15min":1.387},"last":0.999},{"interface":"front","average":{"1min":1,"5min":1.0589999999999999,"15min":1.0329999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.498},"max":{"1min":1.296,"5min":1.411,"15min":1.736},"last":1.169}]},{"osd":3,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0009999999999999,"15min":0.98199999999999998},"min":{"1min":0.70199999999999996,"5min":0.58899999999999997,"15min":0.55300000000000005},"max":{"1min":1.3720000000000001,"5min":1.3779999999999999,"15min":1.7509999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.101,"5min":1.0840000000000001,"15min":1.0680000000000001},"min":{"1min":0.78800000000000003,"5min":0.77100000000000002,"15min":0.60799999999999998},"max":{"1min":1.349,"5min":1.3859999999999999,"15min":1.482},"last":0.92600000000000005}]},{"osd":5,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.96599999999999997,"15min":0.98299999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3100000000000001,"5min":1.5549999999999999,"15min":1.643},"last":1.121},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.98699999999999999,"15min":0.98899999999999999},"min":{"1min":0.64300000000000002,"5min":0.57999999999999996,"15min":0.52300000000000002},"max":{"1min":1.417,"5min":1.4330000000000001,"15min":1.986},"last":0.81599999999999995}]},{"osd":6,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.0289999999999999,"15min":1.0309999999999999},"min":{"1min":0.64900000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.4279999999999999,"5min":1.446,"15min":1.825},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.139,"5min":1.1160000000000001,"15min":1.1180000000000001},"min":{"1min":0.86599999999999999,"5min":0.77000000000000002,"15min":0.45700000000000002},"max":{"1min":1.373,"5min":1.5049999999999999,"15min":1.7749999999999999},"last":1.024}]},{"osd":7,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.0549999999999999,"15min":1.0629999999999999},"min":{"1min":0.72999999999999998,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.573,"5min":1.573,"15min":1.673},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.1950000000000001,"15min":1.173},"min":{"1min":0.94399999999999995,"5min":0.71099999999999997,"15min":0.69399999999999995},"max":{"1min":1.4850000000000001,"5min":1.5369999999999999,"15min":1.5629999999999999},"last":1.097}]}]},{"osd":2,"up_from":15,"seq":64424509819,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39696,"kb_used_data":8520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332144,"statfs":{"total":96636764160,"available":96596115456,"internally_reserved":0,"allocated":8724480,"data_stored":8520251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.74299999999999999,"15min":0.72899999999999998},"min":{"1min":0.44600000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.1890000000000001,"5min":1.528,"15min":1.5820000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.877,"15min":0.82499999999999996},"min":{"1min":0.54000000000000004,"5min":0.40200000000000002,"15min":0.248},"max":{"1min":1.534,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":0.69299999999999995}]},{"osd":1,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90800000000000003,"15min":0.88900000000000001},"min":{"1min":0.51900000000000002,"5min":0.42799999999999999,"15min":0.376},"max":{"1min":1.401,"5min":1.974,"15min":1.974},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.995,"5min":0.89800000000000002,"15min":0.88600000000000001},"min":{"1min":0.61399999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.393,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.84899999999999998}]},{"osd":3,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.86299999999999999,"15min":0.85199999999999998},"min":{"1min":0.55800000000000005,"5min":0.36499999999999999,"15min":0.36199999999999999},"max":{"1min":1.7310000000000001,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0549999999999999,"15min":1.0109999999999999},"min":{"1min":0.67100000000000004,"5min":0.38,"15min":0.38},"max":{"1min":1.591,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.98799999999999999}]},{"osd":4,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.1499999999999999,"15min":1.123},"min":{"1min":0.78900000000000003,"5min":0.59699999999999998,"15min":0.55000000000000004},"max":{"1min":1.446,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.048},{"interface":"front","average":{"1min":1.23,"5min":1.1559999999999999,"15min":1.153},"min":{"1min":0.82499999999999996,"5min":0.61599999999999999,"15min":0.60399999999999998},"max":{"1min":1.754,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.93400000000000005}]},{"osd":5,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1020000000000001,"15min":1.091},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53700000000000003},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.9379999999999999},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.26,"5min":1.2430000000000001,"15min":1.2130000000000001},"min":{"1min":0.79300000000000004,"5min":0.68899999999999995,"15min":0.624},"max":{"1min":1.681,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.163}]},{"osd":6,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.202,"15min":1.198},"min":{"1min":0.71499999999999997,"5min":0.60899999999999999,"15min":0.59499999999999997},"max":{"1min":1.796,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.202},{"interface":"front","average":{"1min":1.2,"5min":1.1919999999999999,"15min":1.175},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.577,"5min":1.6519999999999999,"15min":1.843},"last":1.369}]},{"osd":7,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.2849999999999999,"15min":1.262},"min":{"1min":0.79600000000000004,"5min":0.77100000000000002,"15min":0.59499999999999997},"max":{"1min":2,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.26,"15min":1.2370000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.4550000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509818,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":933888,"data_stored":722685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.56200000000000006,"5min":0.36599999999999999,"15min":0.28599999999999998},"max":{"1min":1.371,"5min":1.371,"15min":1.681},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.83699999999999997,"15min":0.80900000000000005},"min":{"1min":0.51500000000000001,"5min":0.42499999999999999,"15min":0.36399999999999999},"max":{"1min":1.246,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.59699999999999998}]},{"osd":2,"last update":"Tue Jan 23 09:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76200000000000001,"15min":0.73299999999999998},"min":{"1min":0.55000000000000004,"5min":0.38400000000000001,"15min":0.375},"max":{"1min":1.1499999999999999,"5min":1.262,"15min":1.5960000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.94399999999999995,"15min":0.92200000000000004},"min":{"1min":0.70199999999999996,"5min":0.48099999999999998,"15min":0.30499999999999999},"max":{"1min":1.425,"5min":1.4470000000000001,"15min":1.6919999999999999},"last":1.0149999999999999}]},{"osd":3,"last update":"Tue Jan 23 09:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.96099999999999997,"15min":0.93400000000000005},"min":{"1min":0.60899999999999999,"5min":0.50900000000000001,"15min":0.40400000000000003},"max":{"1min":1.4119999999999999,"5min":1.569,"15min":1.8069999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.97799999999999998,"15min":0.96799999999999997},"min":{"1min":0.51200000000000001,"5min":0.496,"15min":0.35599999999999998},"max":{"1min":1.4930000000000001,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.80800000000000005}]},{"osd":4,"last update":"Tue Jan 23 09:24:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0820000000000001,"15min":1.0780000000000001},"min":{"1min":0.75600000000000001,"5min":0.63,"15min":0.54300000000000004},"max":{"1min":1.357,"5min":1.601,"15min":1.6799999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.196,"15min":1.177},"min":{"1min":1.0149999999999999,"5min":0.64000000000000001,"15min":0.50600000000000001},"max":{"1min":1.5720000000000001,"5min":1.6910000000000001,"15min":2.2450000000000001},"last":1.2110000000000001}]},{"osd":5,"last update":"Tue Jan 23 09:24:07 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.1950000000000001,"15min":1.175},"min":{"1min":0.73899999999999999,"5min":0.66200000000000003,"15min":0.63},"max":{"1min":1.8260000000000001,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.21,"5min":1.1679999999999999,"15min":1.1559999999999999},"min":{"1min":0.79500000000000004,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.6120000000000001,"5min":1.802,"15min":1.802},"last":1.0600000000000001}]},{"osd":6,"last update":"Tue Jan 23 09:24:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.262,"15min":1.234},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.58699999999999997},"max":{"1min":1.7330000000000001,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.232,"5min":1.2130000000000001,"15min":1.2},"min":{"1min":0.78300000000000003,"5min":0.68600000000000005,"15min":0.66700000000000004},"max":{"1min":1.577,"5min":1.857,"15min":1.857},"last":0.95099999999999996}]},{"osd":7,"last update":"Tue Jan 23 09:24:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.292,"15min":1.2809999999999999},"min":{"1min":1.0309999999999999,"5min":0.77600000000000002,"15min":0.65500000000000003},"max":{"1min":1.6719999999999999,"5min":1.913,"15min":2.1110000000000002},"last":1.127},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.3029999999999999,"15min":1.29},"min":{"1min":0.90800000000000003,"5min":0.872,"15min":0.72099999999999997},"max":{"1min":1.595,"5min":2.238,"15min":2.238},"last":1.0940000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509818,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":4444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":4550656,"data_stored":4328911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 23 09:24:16 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70999999999999996,"15min":0.71299999999999997},"min":{"1min":0.32800000000000001,"5min":0.308,"15min":0.29499999999999998},"max":{"1min":0.97599999999999998,"5min":1.28,"15min":1.8280000000000001},"last":9.5459999999999994},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.85399999999999998,"15min":0.84299999999999997},"min":{"1min":0.56899999999999995,"5min":0.38,"15min":0.26500000000000001},"max":{"1min":1.407,"5min":1.407,"15min":2.21},"last":0.74299999999999999}]},{"osd":2,"last update":"Tue Jan 23 09:24:16 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.81999999999999995,"15min":0.79300000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.312},"max":{"1min":1.1819999999999999,"5min":1.343,"15min":3.8130000000000002},"last":5.5199999999999996},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90900000000000003,"15min":0.89600000000000002},"min":{"1min":0.54000000000000004,"5min":0.46800000000000003,"15min":0.40400000000000003},"max":{"1min":1.2110000000000001,"5min":1.5309999999999999,"15min":2.1440000000000001},"last":0.84099999999999997}]},{"osd":3,"last update":"Tue Jan 23 09:24:16 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.91000000000000003,"15min":0.91300000000000003},"min":{"1min":0.433,"5min":0.432,"15min":0.32200000000000001},"max":{"1min":1.2789999999999999,"5min":1.593,"15min":1.7150000000000001},"last":9.6470000000000002},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.97699999999999998,"15min":0.94399999999999995},"min":{"1min":0.51000000000000001,"5min":0.50800000000000001,"15min":0.42899999999999999},"max":{"1min":1.3819999999999999,"5min":1.583,"15min":1.583},"last":42.942}]},{"osd":4,"last update":"Tue Jan 23 09:24:16 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.115,"15min":1.105},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.47299999999999998},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":2.3050000000000002},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.101,"5min":1.1539999999999999,"15min":1.1459999999999999},"min":{"1min":0.82599999999999996,"5min":0.72399999999999998,"15min":0.60099999999999998},"max":{"1min":1.3899999999999999,"5min":1.899,"15min":1.982},"last":3.6619999999999999}]},{"osd":5,"last update":"Tue Jan 23 09:24:16 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.1439999999999999,"15min":1.1240000000000001},"min":{"1min":0.749,"5min":0.63800000000000001,"15min":0.5},"max":{"1min":1.466,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":5.6210000000000004},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.244,"15min":1.236},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.51700000000000002},"max":{"1min":1.796,"5min":1.8460000000000001,"15min":2.1080000000000001},"last":1.2450000000000001}]},{"osd":6,"last update":"Tue Jan 23 09:24:16 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.242,"15min":1.24},"min":{"1min":0.66700000000000004,"5min":0.60999999999999999,"15min":0.59599999999999997},"max":{"1min":1.6859999999999999,"5min":2.0150000000000001,"15min":2.036},"last":3.5609999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2410000000000001,"15min":1.2250000000000001},"min":{"1min":0.754,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.6830000000000001,"5min":1.821,"15min":2.0070000000000001},"last":3.4359999999999999}]},{"osd":7,"last update":"Tue Jan 23 09:24:16 2024","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.298,"15min":1.3049999999999999},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.54400000000000004},"max":{"1min":1.98,"5min":1.98,"15min":2.2160000000000002},"last":1.397},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.306,"15min":1.304},"min":{"1min":0.84899999999999998,"5min":0.65700000000000003,"15min":0.57699999999999996},"max":{"1min":1.6200000000000001,"5min":1.7869999999999999,"15min":1.9139999999999999},"last":4.3330000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509820,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47980,"kb_used_data":12644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323860,"statfs":{"total":96636764160,"available":96587632640,"internally_reserved":0,"allocated":12947456,"data_stored":12717118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.755,"15min":0.73699999999999999},"min":{"1min":0.54400000000000004,"5min":0.434,"15min":0.28100000000000003},"max":{"1min":1.1850000000000001,"5min":1.492,"15min":1.514},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.78100000000000003,"15min":0.751},"min":{"1min":0.51800000000000002,"5min":0.45800000000000002,"15min":0.34799999999999998},"max":{"1min":1.155,"5min":1.2450000000000001,"15min":1.641},"last":1.0489999999999999}]},{"osd":1,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.83899999999999997,"15min":0.79700000000000004},"min":{"1min":0.53600000000000003,"5min":0.42099999999999999,"15min":0.309},"max":{"1min":1.0820000000000001,"5min":1.782,"15min":1.782},"last":0.63500000000000001},{"interface":"front","average":{"1min":1.026,"5min":0.95999999999999996,"15min":0.90500000000000003},"min":{"1min":0.70199999999999996,"5min":0.437,"15min":0.32900000000000001},"max":{"1min":1.367,"5min":2.698,"15min":2.698},"last":0.84099999999999997}]},{"osd":2,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.95899999999999996,"15min":0.91200000000000003},"min":{"1min":0.67600000000000005,"5min":0.54800000000000004,"15min":0.379},"max":{"1min":1.3879999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.018,"15min":0.96499999999999997},"min":{"1min":0.56100000000000005,"5min":0.49399999999999999,"15min":0.312},"max":{"1min":1.405,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":1.1899999999999999}]},{"osd":4,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.093,"15min":1.0720000000000001},"min":{"1min":0.85399999999999998,"5min":0.624,"15min":0.57099999999999995},"max":{"1min":1.53,"5min":1.53,"15min":1.736},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1439999999999999,"15min":1.1000000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.499},"max":{"1min":1.4419999999999999,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":0.90700000000000003}]},{"osd":5,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1890000000000001,"15min":1.1499999999999999},"min":{"1min":0.873,"5min":0.72199999999999998,"15min":0.51800000000000002},"max":{"1min":1.5800000000000001,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.093},{"interface":"front","average":{"1min":1.256,"5min":1.284,"15min":1.24},"min":{"1min":0.88700000000000001,"5min":0.69399999999999995,"15min":0.47999999999999998},"max":{"1min":1.7549999999999999,"5min":2.794,"15min":2.794},"last":1.3109999999999999}]},{"osd":6,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3160000000000001,"15min":1.2669999999999999},"min":{"1min":0.94499999999999995,"5min":0.77200000000000002,"15min":0.61399999999999999},"max":{"1min":1.877,"5min":2.8730000000000002,"15min":2.8730000000000002},"last":1.012},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.1970000000000001,"15min":1.1859999999999999},"min":{"1min":0.87,"5min":0.68000000000000005,"15min":0.60699999999999998},"max":{"1min":1.577,"5min":1.5880000000000001,"15min":2.3170000000000002},"last":1.343}]},{"osd":7,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.258,"15min":1.224},"min":{"1min":1.1319999999999999,"5min":0.91100000000000003,"15min":0.68000000000000005},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":2.1960000000000002},"last":1.28},{"interface":"front","average":{"1min":1.331,"5min":1.2969999999999999,"15min":1.262},"min":{"1min":1.004,"5min":0.90700000000000003,"15min":0.63400000000000001},"max":{"1min":1.679,"5min":1.9330000000000001,"15min":2.0910000000000002},"last":1.246}]}]},{"osd":6,"up_from":14,"seq":60129542522,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43924,"kb_used_data":4428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327916,"statfs":{"total":96636764160,"available":96591785984,"internally_reserved":0,"allocated":4534272,"data_stored":4328749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.90200000000000002,"15min":0.87},"min":{"1min":0.56999999999999995,"5min":0.48099999999999998,"15min":0.44},"max":{"1min":1.274,"5min":1.3520000000000001,"15min":1.4199999999999999},"last":0.871},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.88900000000000001,"15min":0.89500000000000002},"min":{"1min":0.61599999999999999,"5min":0.501,"15min":0.39600000000000002},"max":{"1min":1.141,"5min":1.575,"15min":1.575},"last":0.89400000000000002}]},{"osd":1,"last update":"Tue Jan 23 09:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.94699999999999995,"15min":0.93500000000000005},"min":{"1min":0.623,"5min":0.55500000000000005,"15min":0.53500000000000003},"max":{"1min":1.2669999999999999,"5min":1.3169999999999999,"15min":1.3400000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0209999999999999,"15min":0.98499999999999999},"min":{"1min":0.67800000000000005,"5min":0.57699999999999996,"15min":0.48399999999999999},"max":{"1min":1.359,"5min":1.5209999999999999,"15min":1.548},"last":0.70199999999999996}]},{"osd":2,"last update":"Tue Jan 23 09:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.93600000000000005,"15min":0.92400000000000004},"min":{"1min":0.55300000000000005,"5min":0.502,"15min":0.502},"max":{"1min":1.302,"5min":1.484,"15min":2.1219999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.93000000000000005,"15min":0.93100000000000005},"min":{"1min":0.68300000000000005,"5min":0.58599999999999997,"15min":0.46700000000000003},"max":{"1min":1.2529999999999999,"5min":1.3180000000000001,"15min":1.429},"last":1.1699999999999999}]},{"osd":3,"last update":"Tue Jan 23 09:24:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.042,"15min":1.044},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.625},"max":{"1min":1.4119999999999999,"5min":1.4390000000000001,"15min":1.4850000000000001},"last":1.097},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.022,"15min":1.0209999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.53900000000000003},"max":{"1min":1.2130000000000001,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.93700000000000006}]},{"osd":4,"last update":"Tue Jan 23 09:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.95799999999999996,"15min":0.95299999999999996},"min":{"1min":0.64800000000000002,"5min":0.57699999999999996,"15min":0.53800000000000003},"max":{"1min":1.21,"5min":1.4419999999999999,"15min":1.518},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0880000000000001,"15min":1.1000000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3540000000000001,"5min":1.4790000000000001,"15min":1.5680000000000001},"last":0.73399999999999999}]},{"osd":5,"last update":"Tue Jan 23 09:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.95399999999999996,"15min":0.95499999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.497},"max":{"1min":1.339,"5min":1.4299999999999999,"15min":1.734},"last":0.59999999999999998},{"interface":"front","average":{"1min":1.081,"5min":1.145,"15min":1.1379999999999999},"min":{"1min":0.78500000000000003,"5min":0.63800000000000001,"15min":0.57599999999999996},"max":{"1min":1.3899999999999999,"5min":1.601,"15min":2.278},"last":0.50600000000000001}]},{"osd":7,"last update":"Tue Jan 23 09:24:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.034,"15min":1.042},"min":{"1min":0.71499999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3919999999999999,"5min":1.659,"15min":1.659},"last":1.018},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0629999999999999,"15min":1.075},"min":{"1min":0.66900000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.2969999999999999,"5min":1.5289999999999999,"15min":1.6599999999999999},"last":0.83999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4231168,"data_stored":4198008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12627968,"data_stored":12586215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8441856,"data_stored":8391118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6434816,"data_stored":6404475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4214784,"data_stored":4197846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2252800,"data_stored":2209818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-23T09:25:10.288 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-23T09:25:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.446+0000 7f05c5006640 1 Processor -- start 2024-01-23T09:25:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.446+0000 7f05c5006640 1 -- start start 2024-01-23T09:25:10.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.446+0000 7f05c5006640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05c0151600 0x7f05c015b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:10.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.446+0000 7f05c5006640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f05c01519e0 0x7f05c00c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:10.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.446+0000 7f05c5006640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f05c006f350 0x7f05c0157460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:10.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.446+0000 7f05c5006640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c0158390 con 0x7f05c01519e0 2024-01-23T09:25:10.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.446+0000 7f05c5006640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c015b0e0 con 0x7f05c006f350 2024-01-23T09:25:10.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.446+0000 7f05c5006640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c0157dd0 con 0x7f05c0151600 2024-01-23T09:25:10.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.446+0000 7f05be59c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f05c01519e0 0x7f05c00c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:10.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.446+0000 7f05be59c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f05c01519e0 0x7f05c00c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51968/0 (socket says 172.21.15.46:51968) 2024-01-23T09:25:10.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.446+0000 7f05be59c640 1 -- 172.21.15.46:0/2648925662 learned_addr learned my addr 172.21.15.46:0/2648925662 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:10.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.450+0000 7f05be59c640 1 -- 172.21.15.46:0/2648925662 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05c0151600 msgr2=0x7f05c015b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:10.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.450+0000 7f05be59c640 1 --2- 172.21.15.46:0/2648925662 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05c0151600 0x7f05c015b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:10.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.450+0000 7f05be59c640 1 -- 172.21.15.46:0/2648925662 >> v2:172.21.15.175:3300/0 conn(0x7f05c006f350 msgr2=0x7f05c0157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:10.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.450+0000 7f05be59c640 1 --2- 172.21.15.46:0/2648925662 >> v2:172.21.15.175:3300/0 conn(0x7f05c006f350 0x7f05c0157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:10.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.450+0000 7f05be59c640 1 -- 172.21.15.46:0/2648925662 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c01580b0 con 0x7f05c01519e0 2024-01-23T09:25:10.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.454+0000 7f05be59c640 1 --2- 172.21.15.46:0/2648925662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05c01519e0 0x7f05c00c7660 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f05c00c8c60 tx=0x7f05b401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c912753a93388e server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:10.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.462+0000 7f05bdd9b640 1 -- 172.21.15.46:0/2648925662 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b40ac410 con 0x7f05c01519e0 2024-01-23T09:25:10.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.462+0000 7f05bdd9b640 1 -- 172.21.15.46:0/2648925662 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b40ac570 con 0x7f05c01519e0 2024-01-23T09:25:10.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.462+0000 7f05bdd9b640 1 -- 172.21.15.46:0/2648925662 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b40ac900 con 0x7f05c01519e0 2024-01-23T09:25:10.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.462+0000 7f05c5006640 1 -- 172.21.15.46:0/2648925662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05c01519e0 msgr2=0x7f05c00c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:10.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.462+0000 7f05c5006640 1 --2- 172.21.15.46:0/2648925662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05c01519e0 0x7f05c00c7660 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f05c00c8c60 tx=0x7f05b401c500 comp rx=0 tx=0).stop 2024-01-23T09:25:10.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.462+0000 7f05c5006640 1 -- 172.21.15.46:0/2648925662 shutdown_connections 2024-01-23T09:25:10.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.462+0000 7f05c5006640 1 --2- 172.21.15.46:0/2648925662 >> v2:172.21.15.175:3300/0 conn(0x7f05c006f350 0x7f05c0157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:10.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.462+0000 7f05c5006640 1 --2- 172.21.15.46:0/2648925662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05c01519e0 0x7f05c00c7660 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:10.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.462+0000 7f05c5006640 1 --2- 172.21.15.46:0/2648925662 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05c0151600 0x7f05c015b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:10.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.462+0000 7f05c5006640 1 -- 172.21.15.46:0/2648925662 >> 172.21.15.46:0/2648925662 conn(0x7f05c006d590 msgr2=0x7f05c0066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:10.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.462+0000 7f05c5006640 1 -- 172.21.15.46:0/2648925662 shutdown_connections 2024-01-23T09:25:10.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.462+0000 7f05c5006640 1 -- 172.21.15.46:0/2648925662 wait complete. 2024-01-23T09:25:10.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.466+0000 7f05c5006640 1 Processor -- start 2024-01-23T09:25:10.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.466+0000 7f05c5006640 1 -- start start 2024-01-23T09:25:10.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.466+0000 7f05c5006640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05c006f350 0x7f05c014b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:10.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.466+0000 7f05c5006640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05c0151600 0x7f05c00c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:10.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.466+0000 7f05c5006640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05c00c9910 0x7f05c013f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:10.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.466+0000 7f05c5006640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c00ca0e0 con 0x7f05c006f350 2024-01-23T09:25:10.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.466+0000 7f05c5006640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c014b640 con 0x7f05c00c9910 2024-01-23T09:25:10.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.466+0000 7f05c5006640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c00c9e00 con 0x7f05c0151600 2024-01-23T09:25:10.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.466+0000 7f05be59c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05c0151600 0x7f05c00c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:10.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.470+0000 7f05bf59e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05c00c9910 0x7f05c013f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:10.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.470+0000 7f05be59c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05c0151600 0x7f05c00c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:47942/0 (socket says 172.21.15.46:47942) 2024-01-23T09:25:10.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.470+0000 7f05be59c640 1 -- 172.21.15.46:0/134073771 learned_addr learned my addr 172.21.15.46:0/134073771 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:10.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.474+0000 7f05bed9d640 1 --2- 172.21.15.46:0/134073771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05c006f350 0x7f05c014b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:10.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.474+0000 7f05bed9d640 1 -- 172.21.15.46:0/134073771 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05c0151600 msgr2=0x7f05c00c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:10.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.478+0000 7f05bed9d640 1 --2- 172.21.15.46:0/134073771 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05c0151600 0x7f05c00c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:10.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.478+0000 7f05bed9d640 1 -- 172.21.15.46:0/134073771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05c00c9910 msgr2=0x7f05c013f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:10.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.478+0000 7f05bed9d640 1 --2- 172.21.15.46:0/134073771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05c00c9910 0x7f05c013f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:10.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.478+0000 7f05bed9d640 1 -- 172.21.15.46:0/134073771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b40094d0 con 0x7f05c006f350 2024-01-23T09:25:10.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.478+0000 7f05bed9d640 1 --2- 172.21.15.46:0/134073771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05c006f350 0x7f05c014b100 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f05b000bd70 tx=0x7f05b000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:10.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.482+0000 7f05a77fe640 1 -- 172.21.15.46:0/134073771 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b0014440 con 0x7f05c006f350 2024-01-23T09:25:10.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.482+0000 7f05a77fe640 1 -- 172.21.15.46:0/134073771 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b00145c0 con 0x7f05c006f350 2024-01-23T09:25:10.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.482+0000 7f05c5006640 1 -- 172.21.15.46:0/134073771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c0145000 con 0x7f05c006f350 2024-01-23T09:25:10.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.482+0000 7f05a77fe640 1 -- 172.21.15.46:0/134073771 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b0014970 con 0x7f05c006f350 2024-01-23T09:25:10.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.482+0000 7f05c5006640 1 -- 172.21.15.46:0/134073771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c01455c0 con 0x7f05c006f350 2024-01-23T09:25:10.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.482+0000 7f05c5006640 1 -- 172.21.15.46:0/134073771 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c0070f00 con 0x7f05c006f350 2024-01-23T09:25:10.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.518+0000 7f05a77fe640 1 -- 172.21.15.46:0/134073771 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f05b001d3b0 con 0x7f05c006f350 2024-01-23T09:25:10.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.518+0000 7f05a77fe640 1 --2- 172.21.15.46:0/134073771 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f05ac066550 0x7f05ac068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:10.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.518+0000 7f05be59c640 1 --2- 172.21.15.46:0/134073771 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f05ac066550 0x7f05ac068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:10.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.518+0000 7f05be59c640 1 --2- 172.21.15.46:0/134073771 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f05ac066550 0x7f05ac068a10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f05b4000c10 tx=0x7f05b40a6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:10.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.850+0000 7f05a77fe640 1 -- 172.21.15.46:0/134073771 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f05b00552e0 con 0x7f05c006f350 2024-01-23T09:25:10.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:10.850+0000 7f05a77fe640 1 -- 172.21.15.46:0/134073771 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f05b0051620 con 0x7f05c006f350 2024-01-23T09:25:11.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.042+0000 7f05c5006640 1 -- 172.21.15.46:0/134073771 --> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f05c0070f00 con 0x7f05ac066550 2024-01-23T09:25:11.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.070+0000 7f05a77fe640 1 -- 172.21.15.46:0/134073771 <== mgr.4107 v2:172.21.15.46:6800/2324478006 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368657 (secure 0 0 0) 0x7f05c0070f00 con 0x7f05ac066550 2024-01-23T09:25:11.075 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T09:25:11.079 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-01-23T09:25:11.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.074+0000 7f05c5006640 1 -- 172.21.15.46:0/134073771 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f05ac066550 msgr2=0x7f05ac068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:11.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.074+0000 7f05c5006640 1 --2- 172.21.15.46:0/134073771 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f05ac066550 0x7f05ac068a10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f05b4000c10 tx=0x7f05b40a6040 comp rx=0 tx=0).stop 2024-01-23T09:25:11.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.074+0000 7f05c5006640 1 -- 172.21.15.46:0/134073771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05c006f350 msgr2=0x7f05c014b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:11.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.074+0000 7f05c5006640 1 --2- 172.21.15.46:0/134073771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05c006f350 0x7f05c014b100 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f05b000bd70 tx=0x7f05b000be60 comp rx=0 tx=0).stop 2024-01-23T09:25:11.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.074+0000 7f05c5006640 1 -- 172.21.15.46:0/134073771 shutdown_connections 2024-01-23T09:25:11.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.074+0000 7f05c5006640 1 --2- 172.21.15.46:0/134073771 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f05ac066550 0x7f05ac068a10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:11.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.074+0000 7f05c5006640 1 --2- 172.21.15.46:0/134073771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05c00c9910 0x7f05c013f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:11.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.074+0000 7f05c5006640 1 --2- 172.21.15.46:0/134073771 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05c0151600 0x7f05c00c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:11.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.074+0000 7f05c5006640 1 --2- 172.21.15.46:0/134073771 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05c006f350 0x7f05c014b100 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:11.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.074+0000 7f05c5006640 1 -- 172.21.15.46:0/134073771 >> 172.21.15.46:0/134073771 conn(0x7f05c006d590 msgr2=0x7f05c00c54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:11.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.074+0000 7f05c5006640 1 -- 172.21.15.46:0/134073771 shutdown_connections 2024-01-23T09:25:11.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.074+0000 7f05c5006640 1 -- 172.21.15.46:0/134073771 wait complete. 2024-01-23T09:25:11.103 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":962,"stamp":"2024-01-23T09:25:09.375872+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23779489,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":635,"num_read_kb":642,"num_write":7834,"num_write_kb":280431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9023,"ondisk_log_size":9023,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":302760,"kb_used_data":49192,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754671960,"statfs":{"total":773094113280,"available":772784087040,"internally_reserved":0,"allocated":50372608,"data_stored":48606202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10401,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":22,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004580"},"pg_stats":[{"pgid":"2.1f","version":"30'621","reported_seq":656,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:53.809154+0000","last_change":"2024-01-23T08:54:40.661700+0000","last_active":"2024-01-23T09:23:53.809154+0000","last_peered":"2024-01-23T09:23:53.809154+0000","last_clean":"2024-01-23T09:23:53.809154+0000","last_became_active":"2024-01-23T08:54:40.660901+0000","last_became_peered":"2024-01-23T08:54:40.660901+0000","last_unstale":"2024-01-23T09:23:53.809154+0000","last_undegraded":"2024-01-23T09:23:53.809154+0000","last_fullsized":"2024-01-23T09:23:53.809154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:59:22.804479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":621,"num_write_kb":4439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"30'17","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.608355+0000","last_change":"2024-01-23T08:54:42.159130+0000","last_active":"2024-01-23T09:25:03.608355+0000","last_peered":"2024-01-23T09:25:03.608355+0000","last_clean":"2024-01-23T09:25:03.608355+0000","last_became_active":"2024-01-23T08:54:42.158776+0000","last_became_peered":"2024-01-23T08:54:42.158776+0000","last_unstale":"2024-01-23T09:25:03.608355+0000","last_undegraded":"2024-01-23T09:25:03.608355+0000","last_fullsized":"2024-01-23T09:25:03.608355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:06.320845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"30'65","reported_seq":92,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:53.759886+0000","last_change":"2024-01-23T08:54:49.752558+0000","last_active":"2024-01-23T09:23:53.759886+0000","last_peered":"2024-01-23T09:23:53.759886+0000","last_clean":"2024-01-23T09:23:53.759886+0000","last_became_active":"2024-01-23T08:54:49.752077+0000","last_became_peered":"2024-01-23T08:54:49.752077+0000","last_unstale":"2024-01-23T09:23:53.759886+0000","last_undegraded":"2024-01-23T09:23:53.759886+0000","last_fullsized":"2024-01-23T09:23:53.759886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:20:50.653881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":3048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"30'229","reported_seq":265,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.245082+0000","last_change":"2024-01-23T08:54:40.700164+0000","last_active":"2024-01-23T09:25:03.245082+0000","last_peered":"2024-01-23T09:25:03.245082+0000","last_clean":"2024-01-23T09:25:03.245082+0000","last_became_active":"2024-01-23T08:54:40.699449+0000","last_became_peered":"2024-01-23T08:54:40.699449+0000","last_unstale":"2024-01-23T09:25:03.245082+0000","last_undegraded":"2024-01-23T09:25:03.245082+0000","last_fullsized":"2024-01-23T09:25:03.245082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:16:32.814250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2084932,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":2149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"30'24","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.647865+0000","last_change":"2024-01-23T08:54:42.092833+0000","last_active":"2024-01-23T09:25:03.647865+0000","last_peered":"2024-01-23T09:25:03.647865+0000","last_clean":"2024-01-23T09:25:03.647865+0000","last_became_active":"2024-01-23T08:54:42.091950+0000","last_became_peered":"2024-01-23T08:54:42.091950+0000","last_unstale":"2024-01-23T09:25:03.647865+0000","last_undegraded":"2024-01-23T09:25:03.647865+0000","last_fullsized":"2024-01-23T09:25:03.647865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:46.594970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"30'80","reported_seq":107,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:48.744170+0000","last_change":"2024-01-23T08:54:49.747131+0000","last_active":"2024-01-23T09:23:48.744170+0000","last_peered":"2024-01-23T09:23:48.744170+0000","last_clean":"2024-01-23T09:23:48.744170+0000","last_became_active":"2024-01-23T08:54:49.746481+0000","last_became_peered":"2024-01-23T08:54:49.746481+0000","last_unstale":"2024-01-23T09:23:48.744170+0000","last_undegraded":"2024-01-23T09:23:48.744170+0000","last_fullsized":"2024-01-23T09:23:48.744170+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:45:19.670524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":5137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"30'18","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:43.591688+0000","last_change":"2024-01-23T08:54:40.687614+0000","last_active":"2024-01-23T09:24:43.591688+0000","last_peered":"2024-01-23T09:24:43.591688+0000","last_clean":"2024-01-23T09:24:43.591688+0000","last_became_active":"2024-01-23T08:54:40.687234+0000","last_became_peered":"2024-01-23T08:54:40.687234+0000","last_unstale":"2024-01-23T09:24:43.591688+0000","last_undegraded":"2024-01-23T09:24:43.591688+0000","last_fullsized":"2024-01-23T09:24:43.591688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:54:17.627706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"30'21","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.689092+0000","last_change":"2024-01-23T08:55:47.540221+0000","last_active":"2024-01-23T09:25:03.689092+0000","last_peered":"2024-01-23T09:25:03.689092+0000","last_clean":"2024-01-23T09:25:03.689092+0000","last_became_active":"2024-01-23T08:55:47.539657+0000","last_became_peered":"2024-01-23T08:55:47.539657+0000","last_unstale":"2024-01-23T09:25:03.689092+0000","last_undegraded":"2024-01-23T09:25:03.689092+0000","last_fullsized":"2024-01-23T09:25:03.689092+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:19.147334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"30'86","reported_seq":113,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:56.638456+0000","last_change":"2024-01-23T08:54:49.747332+0000","last_active":"2024-01-23T09:23:56.638456+0000","last_peered":"2024-01-23T09:23:56.638456+0000","last_clean":"2024-01-23T09:23:56.638456+0000","last_became_active":"2024-01-23T08:54:49.746474+0000","last_became_peered":"2024-01-23T08:54:49.746474+0000","last_unstale":"2024-01-23T09:23:56.638456+0000","last_undegraded":"2024-01-23T09:23:56.638456+0000","last_fullsized":"2024-01-23T09:23:56.638456+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:28:57.975606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":12223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"30'8","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:48.167428+0000","last_change":"2024-01-23T08:54:40.687290+0000","last_active":"2024-01-23T09:24:48.167428+0000","last_peered":"2024-01-23T09:24:48.167428+0000","last_clean":"2024-01-23T09:24:48.167428+0000","last_became_active":"2024-01-23T08:54:40.686903+0000","last_became_peered":"2024-01-23T08:54:40.686903+0000","last_unstale":"2024-01-23T09:24:48.167428+0000","last_undegraded":"2024-01-23T09:24:48.167428+0000","last_fullsized":"2024-01-23T09:24:48.167428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:57:23.064188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"30'36","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.725842+0000","last_change":"2024-01-23T08:54:42.109485+0000","last_active":"2024-01-23T09:25:03.725842+0000","last_peered":"2024-01-23T09:25:03.725842+0000","last_clean":"2024-01-23T09:25:03.725842+0000","last_became_active":"2024-01-23T08:54:42.108182+0000","last_became_peered":"2024-01-23T08:54:42.108182+0000","last_unstale":"2024-01-23T09:25:03.725842+0000","last_undegraded":"2024-01-23T09:25:03.725842+0000","last_fullsized":"2024-01-23T09:25:03.725842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:51:12.417589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"30'61","reported_seq":88,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:55.602368+0000","last_change":"2024-01-23T08:54:49.747949+0000","last_active":"2024-01-23T09:23:55.602368+0000","last_peered":"2024-01-23T09:23:55.602368+0000","last_clean":"2024-01-23T09:23:55.602368+0000","last_became_active":"2024-01-23T08:54:49.746880+0000","last_became_peered":"2024-01-23T08:54:49.746880+0000","last_unstale":"2024-01-23T09:23:55.602368+0000","last_undegraded":"2024-01-23T09:23:55.602368+0000","last_fullsized":"2024-01-23T09:23:55.602368+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:54:26.728005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":7433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"30'19","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.725334+0000","last_change":"2024-01-23T08:54:42.088786+0000","last_active":"2024-01-23T09:25:03.725334+0000","last_peered":"2024-01-23T09:25:03.725334+0000","last_clean":"2024-01-23T09:25:03.725334+0000","last_became_active":"2024-01-23T08:54:42.088068+0000","last_became_peered":"2024-01-23T08:54:42.088068+0000","last_unstale":"2024-01-23T09:25:03.725334+0000","last_undegraded":"2024-01-23T09:25:03.725334+0000","last_fullsized":"2024-01-23T09:25:03.725334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:38:41.382732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"30'671","reported_seq":705,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:41.735844+0000","last_change":"2024-01-23T08:54:40.612044+0000","last_active":"2024-01-23T09:24:41.735844+0000","last_peered":"2024-01-23T09:24:41.735844+0000","last_clean":"2024-01-23T09:24:41.735844+0000","last_became_active":"2024-01-23T08:54:40.611589+0000","last_became_peered":"2024-01-23T08:54:40.611589+0000","last_unstale":"2024-01-23T09:24:41.735844+0000","last_undegraded":"2024-01-23T09:24:41.735844+0000","last_fullsized":"2024-01-23T09:24:41.735844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:36.177844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":666,"num_write_kb":4421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'70","reported_seq":98,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:57.942928+0000","last_change":"2024-01-23T08:54:49.716713+0000","last_active":"2024-01-23T09:23:57.942928+0000","last_peered":"2024-01-23T09:23:57.942928+0000","last_clean":"2024-01-23T09:23:57.942928+0000","last_became_active":"2024-01-23T08:54:49.715843+0000","last_became_peered":"2024-01-23T08:54:49.715843+0000","last_unstale":"2024-01-23T09:23:57.942928+0000","last_undegraded":"2024-01-23T09:23:57.942928+0000","last_fullsized":"2024-01-23T09:23:57.942928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:46:24.157230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":10371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"30'21","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.634669+0000","last_change":"2024-01-23T08:54:42.230199+0000","last_active":"2024-01-23T09:25:03.634669+0000","last_peered":"2024-01-23T09:25:03.634669+0000","last_clean":"2024-01-23T09:25:03.634669+0000","last_became_active":"2024-01-23T08:54:42.229547+0000","last_became_peered":"2024-01-23T08:54:42.229547+0000","last_unstale":"2024-01-23T09:25:03.634669+0000","last_undegraded":"2024-01-23T09:25:03.634669+0000","last_fullsized":"2024-01-23T09:25:03.634669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:07:07.781698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"30'4","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:22:56.793323+0000","last_change":"2024-01-23T08:54:40.688971+0000","last_active":"2024-01-23T09:22:56.793323+0000","last_peered":"2024-01-23T09:22:56.793323+0000","last_clean":"2024-01-23T09:22:56.793323+0000","last_became_active":"2024-01-23T08:54:40.688230+0000","last_became_peered":"2024-01-23T08:54:40.688230+0000","last_unstale":"2024-01-23T09:22:56.793323+0000","last_undegraded":"2024-01-23T09:22:56.793323+0000","last_fullsized":"2024-01-23T09:22:56.793323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:40:12.245110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"30'94","reported_seq":122,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:58.826706+0000","last_change":"2024-01-23T08:54:49.748471+0000","last_active":"2024-01-23T09:23:58.826706+0000","last_peered":"2024-01-23T09:23:58.826706+0000","last_clean":"2024-01-23T09:23:58.826706+0000","last_became_active":"2024-01-23T08:54:49.747958+0000","last_became_peered":"2024-01-23T08:54:49.747958+0000","last_unstale":"2024-01-23T09:23:58.826706+0000","last_undegraded":"2024-01-23T09:23:58.826706+0000","last_fullsized":"2024-01-23T09:23:58.826706+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:46:36.583078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":8657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"30'23","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.718611+0000","last_change":"2024-01-23T08:54:42.194148+0000","last_active":"2024-01-23T09:25:03.718611+0000","last_peered":"2024-01-23T09:25:03.718611+0000","last_clean":"2024-01-23T09:25:03.718611+0000","last_became_active":"2024-01-23T08:54:42.193403+0000","last_became_peered":"2024-01-23T08:54:42.193403+0000","last_unstale":"2024-01-23T09:25:03.718611+0000","last_undegraded":"2024-01-23T09:25:03.718611+0000","last_fullsized":"2024-01-23T09:25:03.718611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:38:42.543776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"30'11","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:48.195751+0000","last_change":"2024-01-23T08:54:40.688897+0000","last_active":"2024-01-23T09:24:48.195751+0000","last_peered":"2024-01-23T09:24:48.195751+0000","last_clean":"2024-01-23T09:24:48.195751+0000","last_became_active":"2024-01-23T08:54:40.688122+0000","last_became_peered":"2024-01-23T08:54:40.688122+0000","last_unstale":"2024-01-23T09:24:48.195751+0000","last_undegraded":"2024-01-23T09:24:48.195751+0000","last_fullsized":"2024-01-23T09:24:48.195751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:19:16.760424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'73","reported_seq":101,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:57.989453+0000","last_change":"2024-01-23T08:54:49.738331+0000","last_active":"2024-01-23T09:23:57.989453+0000","last_peered":"2024-01-23T09:23:57.989453+0000","last_clean":"2024-01-23T09:23:57.989453+0000","last_became_active":"2024-01-23T08:54:49.737442+0000","last_became_peered":"2024-01-23T08:54:49.737442+0000","last_unstale":"2024-01-23T09:23:57.989453+0000","last_undegraded":"2024-01-23T09:23:57.989453+0000","last_fullsized":"2024-01-23T09:23:57.989453+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:59:20.106849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":10395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"30'19","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.549005+0000","last_change":"2024-01-23T08:54:42.192681+0000","last_active":"2024-01-23T09:25:03.549005+0000","last_peered":"2024-01-23T09:25:03.549005+0000","last_clean":"2024-01-23T09:25:03.549005+0000","last_became_active":"2024-01-23T08:54:42.192225+0000","last_became_peered":"2024-01-23T08:54:42.192225+0000","last_unstale":"2024-01-23T09:25:03.549005+0000","last_undegraded":"2024-01-23T09:25:03.549005+0000","last_fullsized":"2024-01-23T09:25:03.549005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:20:26.263299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"30'7","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:41.715962+0000","last_change":"2024-01-23T08:54:40.686987+0000","last_active":"2024-01-23T09:24:41.715962+0000","last_peered":"2024-01-23T09:24:41.715962+0000","last_clean":"2024-01-23T09:24:41.715962+0000","last_became_active":"2024-01-23T08:54:40.686654+0000","last_became_peered":"2024-01-23T08:54:40.686654+0000","last_unstale":"2024-01-23T09:24:41.715962+0000","last_undegraded":"2024-01-23T09:24:41.715962+0000","last_fullsized":"2024-01-23T09:24:41.715962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:43:26.442461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"30'83","reported_seq":111,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:56.641319+0000","last_change":"2024-01-23T08:54:49.736471+0000","last_active":"2024-01-23T09:23:56.641319+0000","last_peered":"2024-01-23T09:23:56.641319+0000","last_clean":"2024-01-23T09:23:56.641319+0000","last_became_active":"2024-01-23T08:54:49.735971+0000","last_became_peered":"2024-01-23T08:54:49.735971+0000","last_unstale":"2024-01-23T09:23:56.641319+0000","last_undegraded":"2024-01-23T09:23:56.641319+0000","last_fullsized":"2024-01-23T09:23:56.641319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:18:10.354308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":6293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"30'30","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.734411+0000","last_change":"2024-01-23T08:54:42.195854+0000","last_active":"2024-01-23T09:25:03.734411+0000","last_peered":"2024-01-23T09:25:03.734411+0000","last_clean":"2024-01-23T09:25:03.734411+0000","last_became_active":"2024-01-23T08:54:42.195052+0000","last_became_peered":"2024-01-23T08:54:42.195052+0000","last_unstale":"2024-01-23T09:25:03.734411+0000","last_undegraded":"2024-01-23T09:25:03.734411+0000","last_fullsized":"2024-01-23T09:25:03.734411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:54:18.859903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"30'9","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:43.336973+0000","last_change":"2024-01-23T08:54:40.694194+0000","last_active":"2024-01-23T09:24:43.336973+0000","last_peered":"2024-01-23T09:24:43.336973+0000","last_clean":"2024-01-23T09:24:43.336973+0000","last_became_active":"2024-01-23T08:54:40.693610+0000","last_became_peered":"2024-01-23T08:54:40.693610+0000","last_unstale":"2024-01-23T09:24:43.336973+0000","last_undegraded":"2024-01-23T09:24:43.336973+0000","last_fullsized":"2024-01-23T09:24:43.336973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:47:30.746915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"30'40","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:51.975770+0000","last_change":"2024-01-23T08:54:49.747205+0000","last_active":"2024-01-23T09:23:51.975770+0000","last_peered":"2024-01-23T09:23:51.975770+0000","last_clean":"2024-01-23T09:23:51.975770+0000","last_became_active":"2024-01-23T08:54:49.746792+0000","last_became_peered":"2024-01-23T08:54:49.746792+0000","last_unstale":"2024-01-23T09:23:51.975770+0000","last_undegraded":"2024-01-23T09:23:51.975770+0000","last_fullsized":"2024-01-23T09:23:51.975770+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:58:42.245045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":6755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.751593+0000","last_change":"2024-01-23T08:54:42.233783+0000","last_active":"2024-01-23T09:25:03.751593+0000","last_peered":"2024-01-23T09:25:03.751593+0000","last_clean":"2024-01-23T09:25:03.751593+0000","last_became_active":"2024-01-23T08:54:42.233018+0000","last_became_peered":"2024-01-23T08:54:42.233018+0000","last_unstale":"2024-01-23T09:25:03.751593+0000","last_undegraded":"2024-01-23T09:25:03.751593+0000","last_fullsized":"2024-01-23T09:25:03.751593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:04:58.998914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"30'336","reported_seq":371,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:02.817611+0000","last_change":"2024-01-23T08:54:40.690385+0000","last_active":"2024-01-23T09:25:02.817611+0000","last_peered":"2024-01-23T09:25:02.817611+0000","last_clean":"2024-01-23T09:25:02.817611+0000","last_became_active":"2024-01-23T08:54:40.689528+0000","last_became_peered":"2024-01-23T08:54:40.689528+0000","last_unstale":"2024-01-23T09:25:02.817611+0000","last_undegraded":"2024-01-23T09:25:02.817611+0000","last_fullsized":"2024-01-23T09:25:02.817611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:59:11.006550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":906,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"30'90","reported_seq":120,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:56.578837+0000","last_change":"2024-01-23T08:54:49.731870+0000","last_active":"2024-01-23T09:23:56.578837+0000","last_peered":"2024-01-23T09:23:56.578837+0000","last_clean":"2024-01-23T09:23:56.578837+0000","last_became_active":"2024-01-23T08:54:49.731414+0000","last_became_peered":"2024-01-23T08:54:49.731414+0000","last_unstale":"2024-01-23T09:23:56.578837+0000","last_undegraded":"2024-01-23T09:23:56.578837+0000","last_fullsized":"2024-01-23T09:23:56.578837+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:30.315625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":11197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.581262+0000","last_change":"2024-01-23T08:54:42.227885+0000","last_active":"2024-01-23T09:25:03.581262+0000","last_peered":"2024-01-23T09:25:03.581262+0000","last_clean":"2024-01-23T09:25:03.581262+0000","last_became_active":"2024-01-23T08:54:42.227188+0000","last_became_peered":"2024-01-23T08:54:42.227188+0000","last_unstale":"2024-01-23T09:25:03.581262+0000","last_undegraded":"2024-01-23T09:25:03.581262+0000","last_fullsized":"2024-01-23T09:25:03.581262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:02:13.790208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"30'7","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:43.848650+0000","last_change":"2024-01-23T08:54:40.658365+0000","last_active":"2024-01-23T09:24:43.848650+0000","last_peered":"2024-01-23T09:24:43.848650+0000","last_clean":"2024-01-23T09:24:43.848650+0000","last_became_active":"2024-01-23T08:54:40.657616+0000","last_became_peered":"2024-01-23T08:54:40.657616+0000","last_unstale":"2024-01-23T09:24:43.848650+0000","last_undegraded":"2024-01-23T09:24:43.848650+0000","last_fullsized":"2024-01-23T09:24:43.848650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:23:50.053046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"30'59","reported_seq":88,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:58.800322+0000","last_change":"2024-01-23T08:54:49.739474+0000","last_active":"2024-01-23T09:23:58.800322+0000","last_peered":"2024-01-23T09:23:58.800322+0000","last_clean":"2024-01-23T09:23:58.800322+0000","last_became_active":"2024-01-23T08:54:49.738579+0000","last_became_peered":"2024-01-23T08:54:49.738579+0000","last_unstale":"2024-01-23T09:23:58.800322+0000","last_undegraded":"2024-01-23T09:23:58.800322+0000","last_fullsized":"2024-01-23T09:23:58.800322+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:23:32.238072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":6541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"30'19","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.748715+0000","last_change":"2024-01-23T08:54:42.228302+0000","last_active":"2024-01-23T09:25:03.748715+0000","last_peered":"2024-01-23T09:25:03.748715+0000","last_clean":"2024-01-23T09:25:03.748715+0000","last_became_active":"2024-01-23T08:54:42.227558+0000","last_became_peered":"2024-01-23T08:54:42.227558+0000","last_unstale":"2024-01-23T09:25:03.748715+0000","last_undegraded":"2024-01-23T09:25:03.748715+0000","last_fullsized":"2024-01-23T09:25:03.748715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:19:17.992621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:24.630053+0000","last_change":"2024-01-23T08:54:40.697453+0000","last_active":"2024-01-23T09:24:24.630053+0000","last_peered":"2024-01-23T09:24:24.630053+0000","last_clean":"2024-01-23T09:24:24.630053+0000","last_became_active":"2024-01-23T08:54:40.696688+0000","last_became_peered":"2024-01-23T08:54:40.696688+0000","last_unstale":"2024-01-23T09:24:24.630053+0000","last_undegraded":"2024-01-23T09:24:24.630053+0000","last_fullsized":"2024-01-23T09:24:24.630053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:59:22.804479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'81","reported_seq":110,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:57.989602+0000","last_change":"2024-01-23T08:54:49.726678+0000","last_active":"2024-01-23T09:23:57.989602+0000","last_peered":"2024-01-23T09:23:57.989602+0000","last_clean":"2024-01-23T09:23:57.989602+0000","last_became_active":"2024-01-23T08:54:49.725830+0000","last_became_peered":"2024-01-23T08:54:49.725830+0000","last_unstale":"2024-01-23T09:23:57.989602+0000","last_undegraded":"2024-01-23T09:23:57.989602+0000","last_fullsized":"2024-01-23T09:23:57.989602+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:12:34.009779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":6498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.867420+0000","last_change":"2024-01-23T08:54:42.149751+0000","last_active":"2024-01-23T09:25:03.867420+0000","last_peered":"2024-01-23T09:25:03.867420+0000","last_clean":"2024-01-23T09:25:03.867420+0000","last_became_active":"2024-01-23T08:54:42.149019+0000","last_became_peered":"2024-01-23T08:54:42.149019+0000","last_unstale":"2024-01-23T09:25:03.867420+0000","last_undegraded":"2024-01-23T09:25:03.867420+0000","last_fullsized":"2024-01-23T09:25:03.867420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:38:36.083606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"30'8","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:26.661016+0000","last_change":"2024-01-23T08:54:40.680243+0000","last_active":"2024-01-23T09:24:26.661016+0000","last_peered":"2024-01-23T09:24:26.661016+0000","last_clean":"2024-01-23T09:24:26.661016+0000","last_became_active":"2024-01-23T08:54:40.679839+0000","last_became_peered":"2024-01-23T08:54:40.679839+0000","last_unstale":"2024-01-23T09:24:26.661016+0000","last_undegraded":"2024-01-23T09:24:26.661016+0000","last_fullsized":"2024-01-23T09:24:26.661016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:38:34.851409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"30'52","reported_seq":90,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:54.728488+0000","last_change":"2024-01-23T08:55:47.750803+0000","last_active":"2024-01-23T09:23:54.728488+0000","last_peered":"2024-01-23T09:23:54.728488+0000","last_clean":"2024-01-23T09:23:54.728488+0000","last_became_active":"2024-01-23T08:55:47.749227+0000","last_became_peered":"2024-01-23T08:55:47.749227+0000","last_unstale":"2024-01-23T09:23:54.728488+0000","last_undegraded":"2024-01-23T09:23:54.728488+0000","last_fullsized":"2024-01-23T09:23:54.728488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:52:35.422787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":3470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,5],"acting":[6,7,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"30'22","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.609765+0000","last_change":"2024-01-23T08:54:42.108793+0000","last_active":"2024-01-23T09:25:03.609765+0000","last_peered":"2024-01-23T09:25:03.609765+0000","last_clean":"2024-01-23T09:25:03.609765+0000","last_became_active":"2024-01-23T08:54:42.108346+0000","last_became_peered":"2024-01-23T08:54:42.108346+0000","last_unstale":"2024-01-23T09:25:03.609765+0000","last_undegraded":"2024-01-23T09:25:03.609765+0000","last_fullsized":"2024-01-23T09:25:03.609765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:18:02.486206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"30'534","reported_seq":1088,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:00.345864+0000","last_change":"2024-01-23T08:54:40.708494+0000","last_active":"2024-01-23T09:25:00.345864+0000","last_peered":"2024-01-23T09:25:00.345864+0000","last_clean":"2024-01-23T09:25:00.345864+0000","last_became_active":"2024-01-23T08:54:40.707841+0000","last_became_peered":"2024-01-23T08:54:40.707841+0000","last_unstale":"2024-01-23T09:25:00.345864+0000","last_undegraded":"2024-01-23T09:25:00.345864+0000","last_fullsized":"2024-01-23T09:25:00.345864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":534,"log_dups_size":0,"ondisk_log_size":534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:53:17.764440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123944,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":519,"num_read_kb":542,"num_write":528,"num_write_kb":547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"30'72","reported_seq":100,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:53.728690+0000","last_change":"2024-01-23T08:54:49.738198+0000","last_active":"2024-01-23T09:23:53.728690+0000","last_peered":"2024-01-23T09:23:53.728690+0000","last_clean":"2024-01-23T09:23:53.728690+0000","last_became_active":"2024-01-23T08:54:49.737677+0000","last_became_peered":"2024-01-23T08:54:49.737677+0000","last_unstale":"2024-01-23T09:23:53.728690+0000","last_undegraded":"2024-01-23T09:23:53.728690+0000","last_fullsized":"2024-01-23T09:23:53.728690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:57:26.436916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"30'12","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.591042+0000","last_change":"2024-01-23T08:54:42.228222+0000","last_active":"2024-01-23T09:25:03.591042+0000","last_peered":"2024-01-23T09:25:03.591042+0000","last_clean":"2024-01-23T09:25:03.591042+0000","last_became_active":"2024-01-23T08:54:42.227335+0000","last_became_peered":"2024-01-23T08:54:42.227335+0000","last_unstale":"2024-01-23T09:25:03.591042+0000","last_undegraded":"2024-01-23T09:25:03.591042+0000","last_fullsized":"2024-01-23T09:25:03.591042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:29:51.842390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"30'11","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:52.504714+0000","last_change":"2024-01-23T08:54:40.679852+0000","last_active":"2024-01-23T09:24:52.504714+0000","last_peered":"2024-01-23T09:24:52.504714+0000","last_clean":"2024-01-23T09:24:52.504714+0000","last_became_active":"2024-01-23T08:54:40.679467+0000","last_became_peered":"2024-01-23T08:54:40.679467+0000","last_unstale":"2024-01-23T09:24:52.504714+0000","last_undegraded":"2024-01-23T09:24:52.504714+0000","last_fullsized":"2024-01-23T09:24:52.504714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:17.915137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"30'96","reported_seq":125,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:57.955841+0000","last_change":"2024-01-23T08:54:49.730538+0000","last_active":"2024-01-23T09:23:57.955841+0000","last_peered":"2024-01-23T09:23:57.955841+0000","last_clean":"2024-01-23T09:23:57.955841+0000","last_became_active":"2024-01-23T08:54:49.729861+0000","last_became_peered":"2024-01-23T08:54:49.729861+0000","last_unstale":"2024-01-23T09:23:57.955841+0000","last_undegraded":"2024-01-23T09:23:57.955841+0000","last_fullsized":"2024-01-23T09:23:57.955841+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:46:36.583078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":9432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.718567+0000","last_change":"2024-01-23T08:54:42.196505+0000","last_active":"2024-01-23T09:25:03.718567+0000","last_peered":"2024-01-23T09:25:03.718567+0000","last_clean":"2024-01-23T09:25:03.718567+0000","last_became_active":"2024-01-23T08:54:42.195555+0000","last_became_peered":"2024-01-23T08:54:42.195555+0000","last_unstale":"2024-01-23T09:25:03.718567+0000","last_undegraded":"2024-01-23T09:25:03.718567+0000","last_fullsized":"2024-01-23T09:25:03.718567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:57:24.296384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"30'8","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:20.572206+0000","last_change":"2024-01-23T08:54:40.612594+0000","last_active":"2024-01-23T09:24:20.572206+0000","last_peered":"2024-01-23T09:24:20.572206+0000","last_clean":"2024-01-23T09:24:20.572206+0000","last_became_active":"2024-01-23T08:54:40.611932+0000","last_became_peered":"2024-01-23T08:54:40.611932+0000","last_unstale":"2024-01-23T09:24:20.572206+0000","last_undegraded":"2024-01-23T09:24:20.572206+0000","last_fullsized":"2024-01-23T09:24:20.572206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:05.088648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:22:08.761197+0000","last_change":"2024-01-23T08:54:01.491195+0000","last_active":"2024-01-23T09:22:08.761197+0000","last_peered":"2024-01-23T09:22:08.761197+0000","last_clean":"2024-01-23T09:22:08.761197+0000","last_became_active":"2024-01-23T08:54:01.490869+0000","last_became_peered":"2024-01-23T08:54:01.490869+0000","last_unstale":"2024-01-23T09:22:08.761197+0000","last_undegraded":"2024-01-23T09:22:08.761197+0000","last_fullsized":"2024-01-23T09:22:08.761197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:53:59.492955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:53:59.492955+0000","last_clean_scrub_stamp":"2024-01-23T08:53:59.492955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:18:58.446726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"30'73","reported_seq":102,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:58.745460+0000","last_change":"2024-01-23T08:54:49.716297+0000","last_active":"2024-01-23T09:23:58.745460+0000","last_peered":"2024-01-23T09:23:58.745460+0000","last_clean":"2024-01-23T09:23:58.745460+0000","last_became_active":"2024-01-23T08:54:49.715231+0000","last_became_peered":"2024-01-23T08:54:49.715231+0000","last_unstale":"2024-01-23T09:23:58.745460+0000","last_undegraded":"2024-01-23T09:23:58.745460+0000","last_fullsized":"2024-01-23T09:23:58.745460+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:17:59.837409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.725996+0000","last_change":"2024-01-23T08:54:42.089174+0000","last_active":"2024-01-23T09:25:03.725996+0000","last_peered":"2024-01-23T09:25:03.725996+0000","last_clean":"2024-01-23T09:25:03.725996+0000","last_became_active":"2024-01-23T08:54:42.088303+0000","last_became_peered":"2024-01-23T08:54:42.088303+0000","last_unstale":"2024-01-23T09:25:03.725996+0000","last_undegraded":"2024-01-23T09:25:03.725996+0000","last_fullsized":"2024-01-23T09:25:03.725996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:06:49.326117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"30'9","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:53.537619+0000","last_change":"2024-01-23T08:54:40.690720+0000","last_active":"2024-01-23T09:24:53.537619+0000","last_peered":"2024-01-23T09:24:53.537619+0000","last_clean":"2024-01-23T09:24:53.537619+0000","last_became_active":"2024-01-23T08:54:40.689895+0000","last_became_peered":"2024-01-23T08:54:40.689895+0000","last_unstale":"2024-01-23T09:24:53.537619+0000","last_undegraded":"2024-01-23T09:24:53.537619+0000","last_fullsized":"2024-01-23T09:24:53.537619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:33:12.542607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1751,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"30'84","reported_seq":112,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:52.014886+0000","last_change":"2024-01-23T08:54:49.736539+0000","last_active":"2024-01-23T09:23:52.014886+0000","last_peered":"2024-01-23T09:23:52.014886+0000","last_clean":"2024-01-23T09:23:52.014886+0000","last_became_active":"2024-01-23T08:54:49.735777+0000","last_became_peered":"2024-01-23T08:54:49.735777+0000","last_unstale":"2024-01-23T09:23:52.014886+0000","last_undegraded":"2024-01-23T09:23:52.014886+0000","last_fullsized":"2024-01-23T09:23:52.014886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:05:06.867017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":8939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'22","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.866868+0000","last_change":"2024-01-23T08:54:42.107066+0000","last_active":"2024-01-23T09:25:03.866868+0000","last_peered":"2024-01-23T09:25:03.866868+0000","last_clean":"2024-01-23T09:25:03.866868+0000","last_became_active":"2024-01-23T08:54:42.106757+0000","last_became_peered":"2024-01-23T08:54:42.106757+0000","last_unstale":"2024-01-23T09:25:03.866868+0000","last_undegraded":"2024-01-23T09:25:03.866868+0000","last_fullsized":"2024-01-23T09:25:03.866868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:47:31.979111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"30'7","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:46.123009+0000","last_change":"2024-01-23T08:54:40.687942+0000","last_active":"2024-01-23T09:24:46.123009+0000","last_peered":"2024-01-23T09:24:46.123009+0000","last_clean":"2024-01-23T09:24:46.123009+0000","last_became_active":"2024-01-23T08:54:40.686860+0000","last_became_peered":"2024-01-23T08:54:40.686860+0000","last_unstale":"2024-01-23T09:24:46.123009+0000","last_undegraded":"2024-01-23T09:24:46.123009+0000","last_fullsized":"2024-01-23T09:24:46.123009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:04:57.766717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'92","reported_seq":120,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:55.592422+0000","last_change":"2024-01-23T08:54:49.727416+0000","last_active":"2024-01-23T09:23:55.592422+0000","last_peered":"2024-01-23T09:23:55.592422+0000","last_clean":"2024-01-23T09:23:55.592422+0000","last_became_active":"2024-01-23T08:54:49.721494+0000","last_became_peered":"2024-01-23T08:54:49.721494+0000","last_unstale":"2024-01-23T09:23:55.592422+0000","last_undegraded":"2024-01-23T09:23:55.592422+0000","last_fullsized":"2024-01-23T09:23:55.592422+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:52:20.767279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":9285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"30'25","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.873759+0000","last_change":"2024-01-23T08:54:42.117785+0000","last_active":"2024-01-23T09:25:03.873759+0000","last_peered":"2024-01-23T09:25:03.873759+0000","last_clean":"2024-01-23T09:25:03.873759+0000","last_became_active":"2024-01-23T08:54:42.117317+0000","last_became_peered":"2024-01-23T08:54:42.117317+0000","last_unstale":"2024-01-23T09:25:03.873759+0000","last_undegraded":"2024-01-23T09:25:03.873759+0000","last_fullsized":"2024-01-23T09:25:03.873759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:48:28.943781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"30'7","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:19.375993+0000","last_change":"2024-01-23T08:54:40.682656+0000","last_active":"2024-01-23T09:24:19.375993+0000","last_peered":"2024-01-23T09:24:19.375993+0000","last_clean":"2024-01-23T09:24:19.375993+0000","last_became_active":"2024-01-23T08:54:40.681954+0000","last_became_peered":"2024-01-23T08:54:40.681954+0000","last_unstale":"2024-01-23T09:24:19.375993+0000","last_undegraded":"2024-01-23T09:24:19.375993+0000","last_fullsized":"2024-01-23T09:24:19.375993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:20:41.553582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"30'57","reported_seq":86,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:58.796561+0000","last_change":"2024-01-23T08:54:49.716316+0000","last_active":"2024-01-23T09:23:58.796561+0000","last_peered":"2024-01-23T09:23:58.796561+0000","last_clean":"2024-01-23T09:23:58.796561+0000","last_became_active":"2024-01-23T08:54:49.715917+0000","last_became_peered":"2024-01-23T08:54:49.715917+0000","last_unstale":"2024-01-23T09:23:58.796561+0000","last_undegraded":"2024-01-23T09:23:58.796561+0000","last_fullsized":"2024-01-23T09:23:58.796561+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:56:01.803823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":5210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"30'17","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.754214+0000","last_change":"2024-01-23T08:54:42.158814+0000","last_active":"2024-01-23T09:25:03.754214+0000","last_peered":"2024-01-23T09:25:03.754214+0000","last_clean":"2024-01-23T09:25:03.754214+0000","last_became_active":"2024-01-23T08:54:42.155411+0000","last_became_peered":"2024-01-23T08:54:42.155411+0000","last_unstale":"2024-01-23T09:25:03.754214+0000","last_undegraded":"2024-01-23T09:25:03.754214+0000","last_fullsized":"2024-01-23T09:25:03.754214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:28:02.074838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"30'5","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:30.102947+0000","last_change":"2024-01-23T08:54:40.696522+0000","last_active":"2024-01-23T09:24:30.102947+0000","last_peered":"2024-01-23T09:24:30.102947+0000","last_clean":"2024-01-23T09:24:30.102947+0000","last_became_active":"2024-01-23T08:54:40.696128+0000","last_became_peered":"2024-01-23T08:54:40.696128+0000","last_unstale":"2024-01-23T09:24:30.102947+0000","last_undegraded":"2024-01-23T09:24:30.102947+0000","last_fullsized":"2024-01-23T09:24:30.102947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:18:01.254009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"30'112","reported_seq":141,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:58.805307+0000","last_change":"2024-01-23T08:54:49.724660+0000","last_active":"2024-01-23T09:23:58.805307+0000","last_peered":"2024-01-23T09:23:58.805307+0000","last_clean":"2024-01-23T09:23:58.805307+0000","last_became_active":"2024-01-23T08:54:49.723038+0000","last_became_peered":"2024-01-23T08:54:49.723038+0000","last_unstale":"2024-01-23T09:23:58.805307+0000","last_undegraded":"2024-01-23T09:23:58.805307+0000","last_fullsized":"2024-01-23T09:23:58.805307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:20:50.653881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":12618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"30'22","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.725027+0000","last_change":"2024-01-23T08:54:42.149978+0000","last_active":"2024-01-23T09:25:03.725027+0000","last_peered":"2024-01-23T09:25:03.725027+0000","last_clean":"2024-01-23T09:25:03.725027+0000","last_became_active":"2024-01-23T08:54:42.149180+0000","last_became_peered":"2024-01-23T08:54:42.149180+0000","last_unstale":"2024-01-23T09:25:03.725027+0000","last_undegraded":"2024-01-23T09:25:03.725027+0000","last_fullsized":"2024-01-23T09:25:03.725027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:52:12.899176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"30'22","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:00.353895+0000","last_change":"2024-01-23T08:54:40.699997+0000","last_active":"2024-01-23T09:25:00.353895+0000","last_peered":"2024-01-23T09:25:00.353895+0000","last_clean":"2024-01-23T09:25:00.353895+0000","last_became_active":"2024-01-23T08:54:40.699246+0000","last_became_peered":"2024-01-23T08:54:40.699246+0000","last_unstale":"2024-01-23T09:25:00.353895+0000","last_undegraded":"2024-01-23T09:25:00.353895+0000","last_fullsized":"2024-01-23T09:25:00.353895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:19:24.486048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"30'97","reported_seq":124,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:54.636016+0000","last_change":"2024-01-23T08:54:49.729218+0000","last_active":"2024-01-23T09:23:54.636016+0000","last_peered":"2024-01-23T09:23:54.636016+0000","last_clean":"2024-01-23T09:23:54.636016+0000","last_became_active":"2024-01-23T08:54:49.728448+0000","last_became_peered":"2024-01-23T08:54:49.728448+0000","last_unstale":"2024-01-23T09:23:54.636016+0000","last_undegraded":"2024-01-23T09:23:54.636016+0000","last_fullsized":"2024-01-23T09:23:54.636016+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:56:52.671943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":7067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"30'23","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.687551+0000","last_change":"2024-01-23T08:54:42.087980+0000","last_active":"2024-01-23T09:25:03.687551+0000","last_peered":"2024-01-23T09:25:03.687551+0000","last_clean":"2024-01-23T09:25:03.687551+0000","last_became_active":"2024-01-23T08:54:42.087328+0000","last_became_peered":"2024-01-23T08:54:42.087328+0000","last_unstale":"2024-01-23T09:25:03.687551+0000","last_undegraded":"2024-01-23T09:25:03.687551+0000","last_fullsized":"2024-01-23T09:25:03.687551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:07:07.781698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"30'11","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.251016+0000","last_change":"2024-01-23T08:54:40.693906+0000","last_active":"2024-01-23T09:25:03.251016+0000","last_peered":"2024-01-23T09:25:03.251016+0000","last_clean":"2024-01-23T09:25:03.251016+0000","last_became_active":"2024-01-23T08:54:40.693530+0000","last_became_peered":"2024-01-23T08:54:40.693530+0000","last_unstale":"2024-01-23T09:25:03.251016+0000","last_undegraded":"2024-01-23T09:25:03.251016+0000","last_fullsized":"2024-01-23T09:25:03.251016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:59:11.006550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"30'73","reported_seq":109,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:54.780082+0000","last_change":"2024-01-23T08:55:47.750297+0000","last_active":"2024-01-23T09:23:54.780082+0000","last_peered":"2024-01-23T09:23:54.780082+0000","last_clean":"2024-01-23T09:23:54.780082+0000","last_became_active":"2024-01-23T08:55:47.749074+0000","last_became_peered":"2024-01-23T08:55:47.749074+0000","last_unstale":"2024-01-23T09:23:54.780082+0000","last_undegraded":"2024-01-23T09:23:54.780082+0000","last_fullsized":"2024-01-23T09:23:54.780082+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:29:47.219931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":8234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,6,4],"acting":[5,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'36","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.725572+0000","last_change":"2024-01-23T08:54:42.108919+0000","last_active":"2024-01-23T09:25:03.725572+0000","last_peered":"2024-01-23T09:25:03.725572+0000","last_clean":"2024-01-23T09:25:03.725572+0000","last_became_active":"2024-01-23T08:54:42.108253+0000","last_became_peered":"2024-01-23T08:54:42.108253+0000","last_unstale":"2024-01-23T09:25:03.725572+0000","last_undegraded":"2024-01-23T09:25:03.725572+0000","last_fullsized":"2024-01-23T09:25:03.725572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:46:28.714976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"30'11","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:54.291823+0000","last_change":"2024-01-23T08:54:40.696080+0000","last_active":"2024-01-23T09:24:54.291823+0000","last_peered":"2024-01-23T09:24:54.291823+0000","last_clean":"2024-01-23T09:24:54.291823+0000","last_became_active":"2024-01-23T08:54:40.695699+0000","last_became_peered":"2024-01-23T08:54:40.695699+0000","last_unstale":"2024-01-23T09:24:54.291823+0000","last_undegraded":"2024-01-23T09:24:54.291823+0000","last_fullsized":"2024-01-23T09:24:54.291823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:21.215326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"30'63","reported_seq":90,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:51.986229+0000","last_change":"2024-01-23T08:54:49.740480+0000","last_active":"2024-01-23T09:23:51.986229+0000","last_peered":"2024-01-23T09:23:51.986229+0000","last_clean":"2024-01-23T09:23:51.986229+0000","last_became_active":"2024-01-23T08:54:49.739524+0000","last_became_peered":"2024-01-23T08:54:49.739524+0000","last_unstale":"2024-01-23T09:23:51.986229+0000","last_undegraded":"2024-01-23T09:23:51.986229+0000","last_fullsized":"2024-01-23T09:23:51.986229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:45:25.447987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":7121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.588272+0000","last_change":"2024-01-23T08:54:42.230659+0000","last_active":"2024-01-23T09:25:03.588272+0000","last_peered":"2024-01-23T09:25:03.588272+0000","last_clean":"2024-01-23T09:25:03.588272+0000","last_became_active":"2024-01-23T08:54:42.229952+0000","last_became_peered":"2024-01-23T08:54:42.229952+0000","last_unstale":"2024-01-23T09:25:03.588272+0000","last_undegraded":"2024-01-23T09:25:03.588272+0000","last_fullsized":"2024-01-23T09:25:03.588272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:41:53.265527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"30'14","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:30.107136+0000","last_change":"2024-01-23T08:54:40.698779+0000","last_active":"2024-01-23T09:24:30.107136+0000","last_peered":"2024-01-23T09:24:30.107136+0000","last_clean":"2024-01-23T09:24:30.107136+0000","last_became_active":"2024-01-23T08:54:40.698059+0000","last_became_peered":"2024-01-23T08:54:40.698059+0000","last_unstale":"2024-01-23T09:24:30.107136+0000","last_undegraded":"2024-01-23T09:24:30.107136+0000","last_fullsized":"2024-01-23T09:24:30.107136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:24:40.655839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"30'67","reported_seq":94,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:53.764913+0000","last_change":"2024-01-23T08:54:49.708388+0000","last_active":"2024-01-23T09:23:53.764913+0000","last_peered":"2024-01-23T09:23:53.764913+0000","last_clean":"2024-01-23T09:23:53.764913+0000","last_became_active":"2024-01-23T08:54:49.707837+0000","last_became_peered":"2024-01-23T08:54:49.707837+0000","last_unstale":"2024-01-23T09:23:53.764913+0000","last_undegraded":"2024-01-23T09:23:53.764913+0000","last_fullsized":"2024-01-23T09:23:53.764913+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:49:25.509880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":5283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'21","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.867783+0000","last_change":"2024-01-23T08:54:42.229836+0000","last_active":"2024-01-23T09:25:03.867783+0000","last_peered":"2024-01-23T09:25:03.867783+0000","last_clean":"2024-01-23T09:25:03.867783+0000","last_became_active":"2024-01-23T08:54:42.229252+0000","last_became_peered":"2024-01-23T08:54:42.229252+0000","last_unstale":"2024-01-23T09:25:03.867783+0000","last_undegraded":"2024-01-23T09:25:03.867783+0000","last_fullsized":"2024-01-23T09:25:03.867783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:23:51.285243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"30'833","reported_seq":866,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:47.846700+0000","last_change":"2024-01-23T08:54:40.658490+0000","last_active":"2024-01-23T09:24:47.846700+0000","last_peered":"2024-01-23T09:24:47.846700+0000","last_clean":"2024-01-23T09:24:47.846700+0000","last_became_active":"2024-01-23T08:54:40.657711+0000","last_became_peered":"2024-01-23T08:54:40.657711+0000","last_unstale":"2024-01-23T09:24:47.846700+0000","last_undegraded":"2024-01-23T09:24:47.846700+0000","last_fullsized":"2024-01-23T09:24:47.846700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:37:29.479181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":833,"num_write_kb":4568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"30'86","reported_seq":114,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:58.839813+0000","last_change":"2024-01-23T08:54:49.737210+0000","last_active":"2024-01-23T09:23:58.839813+0000","last_peered":"2024-01-23T09:23:58.839813+0000","last_clean":"2024-01-23T09:23:58.839813+0000","last_became_active":"2024-01-23T08:54:49.735023+0000","last_became_peered":"2024-01-23T08:54:49.735023+0000","last_unstale":"2024-01-23T09:23:58.839813+0000","last_undegraded":"2024-01-23T09:23:58.839813+0000","last_fullsized":"2024-01-23T09:23:58.839813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:27.015436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":9278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"30'25","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.726970+0000","last_change":"2024-01-23T08:54:42.154453+0000","last_active":"2024-01-23T09:25:03.726970+0000","last_peered":"2024-01-23T09:25:03.726970+0000","last_clean":"2024-01-23T09:25:03.726970+0000","last_became_active":"2024-01-23T08:54:42.153735+0000","last_became_peered":"2024-01-23T08:54:42.153735+0000","last_unstale":"2024-01-23T09:25:03.726970+0000","last_undegraded":"2024-01-23T09:25:03.726970+0000","last_fullsized":"2024-01-23T09:25:03.726970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:54:39.173058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"30'361","reported_seq":394,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:54.303102+0000","last_change":"2024-01-23T08:54:40.702888+0000","last_active":"2024-01-23T09:24:54.303102+0000","last_peered":"2024-01-23T09:24:54.303102+0000","last_clean":"2024-01-23T09:24:54.303102+0000","last_became_active":"2024-01-23T08:54:40.701827+0000","last_became_peered":"2024-01-23T08:54:40.701827+0000","last_unstale":"2024-01-23T09:24:54.303102+0000","last_undegraded":"2024-01-23T09:24:54.303102+0000","last_fullsized":"2024-01-23T09:24:54.303102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:18:17.748052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"30'124","reported_seq":152,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:58.901371+0000","last_change":"2024-01-23T08:54:49.736262+0000","last_active":"2024-01-23T09:23:58.901371+0000","last_peered":"2024-01-23T09:23:58.901371+0000","last_clean":"2024-01-23T09:23:58.901371+0000","last_became_active":"2024-01-23T08:54:49.735765+0000","last_became_peered":"2024-01-23T08:54:49.735765+0000","last_unstale":"2024-01-23T09:23:58.901371+0000","last_undegraded":"2024-01-23T09:23:58.901371+0000","last_fullsized":"2024-01-23T09:23:58.901371+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:29:59.191326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":11379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"30'28","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.616372+0000","last_change":"2024-01-23T08:54:42.071292+0000","last_active":"2024-01-23T09:25:03.616372+0000","last_peered":"2024-01-23T09:25:03.616372+0000","last_clean":"2024-01-23T09:25:03.616372+0000","last_became_active":"2024-01-23T08:54:42.070703+0000","last_became_peered":"2024-01-23T08:54:42.070703+0000","last_unstale":"2024-01-23T09:25:03.616372+0000","last_undegraded":"2024-01-23T09:25:03.616372+0000","last_fullsized":"2024-01-23T09:25:03.616372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:37.410041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"30'6","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:04.273279+0000","last_change":"2024-01-23T08:54:40.687946+0000","last_active":"2024-01-23T09:24:04.273279+0000","last_peered":"2024-01-23T09:24:04.273279+0000","last_clean":"2024-01-23T09:24:04.273279+0000","last_became_active":"2024-01-23T08:54:40.687656+0000","last_became_peered":"2024-01-23T08:54:40.687656+0000","last_unstale":"2024-01-23T09:24:04.273279+0000","last_undegraded":"2024-01-23T09:24:04.273279+0000","last_fullsized":"2024-01-23T09:24:04.273279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:29:50.091026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'70","reported_seq":98,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:41.205524+0000","last_change":"2024-01-23T08:54:49.729434+0000","last_active":"2024-01-23T09:23:41.205524+0000","last_peered":"2024-01-23T09:23:41.205524+0000","last_clean":"2024-01-23T09:23:41.205524+0000","last_became_active":"2024-01-23T08:54:49.728191+0000","last_became_peered":"2024-01-23T08:54:49.728191+0000","last_unstale":"2024-01-23T09:23:41.205524+0000","last_undegraded":"2024-01-23T09:23:41.205524+0000","last_fullsized":"2024-01-23T09:23:41.205524+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:30:27.390400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":6489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"30'28","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.757845+0000","last_change":"2024-01-23T08:54:42.155857+0000","last_active":"2024-01-23T09:25:03.757845+0000","last_peered":"2024-01-23T09:25:03.757845+0000","last_clean":"2024-01-23T09:25:03.757845+0000","last_became_active":"2024-01-23T08:54:42.153539+0000","last_became_peered":"2024-01-23T08:54:42.153539+0000","last_unstale":"2024-01-23T09:25:03.757845+0000","last_undegraded":"2024-01-23T09:25:03.757845+0000","last_fullsized":"2024-01-23T09:25:03.757845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:27:34.618270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"30'12","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.241284+0000","last_change":"2024-01-23T08:54:40.683174+0000","last_active":"2024-01-23T09:25:03.241284+0000","last_peered":"2024-01-23T09:25:03.241284+0000","last_clean":"2024-01-23T09:25:03.241284+0000","last_became_active":"2024-01-23T08:54:40.682765+0000","last_became_peered":"2024-01-23T08:54:40.682765+0000","last_unstale":"2024-01-23T09:25:03.241284+0000","last_undegraded":"2024-01-23T09:25:03.241284+0000","last_fullsized":"2024-01-23T09:25:03.241284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:13:10.191082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"30'72","reported_seq":100,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:57.975282+0000","last_change":"2024-01-23T08:54:49.728962+0000","last_active":"2024-01-23T09:23:57.975282+0000","last_peered":"2024-01-23T09:23:57.975282+0000","last_clean":"2024-01-23T09:23:57.975282+0000","last_became_active":"2024-01-23T08:54:49.724121+0000","last_became_peered":"2024-01-23T08:54:49.724121+0000","last_unstale":"2024-01-23T09:23:57.975282+0000","last_undegraded":"2024-01-23T09:23:57.975282+0000","last_fullsized":"2024-01-23T09:23:57.975282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:14.188947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":8509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"30'65","reported_seq":95,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:54.910192+0000","last_change":"2024-01-23T08:54:49.735678+0000","last_active":"2024-01-23T09:23:54.910192+0000","last_peered":"2024-01-23T09:23:54.910192+0000","last_clean":"2024-01-23T09:23:54.910192+0000","last_became_active":"2024-01-23T08:54:49.732632+0000","last_became_peered":"2024-01-23T08:54:49.732632+0000","last_unstale":"2024-01-23T09:23:54.910192+0000","last_undegraded":"2024-01-23T09:23:54.910192+0000","last_fullsized":"2024-01-23T09:23:54.910192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:54.463072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":5816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"30'26","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.753551+0000","last_change":"2024-01-23T08:54:42.196434+0000","last_active":"2024-01-23T09:25:03.753551+0000","last_peered":"2024-01-23T09:25:03.753551+0000","last_clean":"2024-01-23T09:25:03.753551+0000","last_became_active":"2024-01-23T08:54:42.195570+0000","last_became_peered":"2024-01-23T08:54:42.195570+0000","last_unstale":"2024-01-23T09:25:03.753551+0000","last_undegraded":"2024-01-23T09:25:03.753551+0000","last_fullsized":"2024-01-23T09:25:03.753551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:04:44.856358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"30'6","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:31.167629+0000","last_change":"2024-01-23T08:54:40.678920+0000","last_active":"2024-01-23T09:24:31.167629+0000","last_peered":"2024-01-23T09:24:31.167629+0000","last_clean":"2024-01-23T09:24:31.167629+0000","last_became_active":"2024-01-23T08:54:40.678527+0000","last_became_peered":"2024-01-23T08:54:40.678527+0000","last_unstale":"2024-01-23T09:24:31.167629+0000","last_undegraded":"2024-01-23T09:24:31.167629+0000","last_fullsized":"2024-01-23T09:24:31.167629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:48:02.807942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'89","reported_seq":118,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:55.557591+0000","last_change":"2024-01-23T08:54:49.719401+0000","last_active":"2024-01-23T09:23:55.557591+0000","last_peered":"2024-01-23T09:23:55.557591+0000","last_clean":"2024-01-23T09:23:55.557591+0000","last_became_active":"2024-01-23T08:54:49.717116+0000","last_became_peered":"2024-01-23T08:54:49.717116+0000","last_unstale":"2024-01-23T09:23:55.557591+0000","last_undegraded":"2024-01-23T09:23:55.557591+0000","last_fullsized":"2024-01-23T09:23:55.557591+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:58:50.143993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":12319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"30'30","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.632552+0000","last_change":"2024-01-23T08:54:42.235843+0000","last_active":"2024-01-23T09:25:03.632552+0000","last_peered":"2024-01-23T09:25:03.632552+0000","last_clean":"2024-01-23T09:25:03.632552+0000","last_became_active":"2024-01-23T08:54:42.235116+0000","last_became_peered":"2024-01-23T08:54:42.235116+0000","last_unstale":"2024-01-23T09:25:03.632552+0000","last_undegraded":"2024-01-23T09:25:03.632552+0000","last_fullsized":"2024-01-23T09:25:03.632552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:43:27.674658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"30'7","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:31.174876+0000","last_change":"2024-01-23T08:54:40.690150+0000","last_active":"2024-01-23T09:24:31.174876+0000","last_peered":"2024-01-23T09:24:31.174876+0000","last_clean":"2024-01-23T09:24:31.174876+0000","last_became_active":"2024-01-23T08:54:40.689433+0000","last_became_peered":"2024-01-23T08:54:40.689433+0000","last_unstale":"2024-01-23T09:24:31.174876+0000","last_undegraded":"2024-01-23T09:24:31.174876+0000","last_fullsized":"2024-01-23T09:24:31.174876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:35:11.315349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"30'511","reported_seq":544,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:37.442027+0000","last_change":"2024-01-23T08:54:40.686731+0000","last_active":"2024-01-23T09:24:37.442027+0000","last_peered":"2024-01-23T09:24:37.442027+0000","last_clean":"2024-01-23T09:24:37.442027+0000","last_became_active":"2024-01-23T08:54:40.686371+0000","last_became_peered":"2024-01-23T08:54:40.686371+0000","last_unstale":"2024-01-23T09:24:37.442027+0000","last_undegraded":"2024-01-23T09:24:37.442027+0000","last_fullsized":"2024-01-23T09:24:37.442027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:45.362773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":507,"num_write_kb":4372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"30'22","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.736889+0000","last_change":"2024-01-23T08:54:42.200428+0000","last_active":"2024-01-23T09:25:03.736889+0000","last_peered":"2024-01-23T09:25:03.736889+0000","last_clean":"2024-01-23T09:25:03.736889+0000","last_became_active":"2024-01-23T08:54:42.198648+0000","last_became_peered":"2024-01-23T08:54:42.198648+0000","last_unstale":"2024-01-23T09:25:03.736889+0000","last_undegraded":"2024-01-23T09:25:03.736889+0000","last_fullsized":"2024-01-23T09:25:03.736889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:45:11.802421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"30'54","reported_seq":81,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:54.793810+0000","last_change":"2024-01-23T08:54:49.742269+0000","last_active":"2024-01-23T09:23:54.793810+0000","last_peered":"2024-01-23T09:23:54.793810+0000","last_clean":"2024-01-23T09:23:54.793810+0000","last_became_active":"2024-01-23T08:54:49.741692+0000","last_became_peered":"2024-01-23T08:54:49.741692+0000","last_unstale":"2024-01-23T09:23:54.793810+0000","last_undegraded":"2024-01-23T09:23:54.793810+0000","last_fullsized":"2024-01-23T09:23:54.793810+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:45.278144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":4034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"30'585","reported_seq":618,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:47.051020+0000","last_change":"2024-01-23T08:54:40.687352+0000","last_active":"2024-01-23T09:24:47.051020+0000","last_peered":"2024-01-23T09:24:47.051020+0000","last_clean":"2024-01-23T09:24:47.051020+0000","last_became_active":"2024-01-23T08:54:40.686125+0000","last_became_peered":"2024-01-23T08:54:40.686125+0000","last_unstale":"2024-01-23T09:24:47.051020+0000","last_undegraded":"2024-01-23T09:24:47.051020+0000","last_fullsized":"2024-01-23T09:24:47.051020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:38:41.311580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195507,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":4397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"30'19","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.698551+0000","last_change":"2024-01-23T08:54:42.090249+0000","last_active":"2024-01-23T09:25:03.698551+0000","last_peered":"2024-01-23T09:25:03.698551+0000","last_clean":"2024-01-23T09:25:03.698551+0000","last_became_active":"2024-01-23T08:54:42.089826+0000","last_became_peered":"2024-01-23T08:54:42.089826+0000","last_unstale":"2024-01-23T09:25:03.698551+0000","last_undegraded":"2024-01-23T09:25:03.698551+0000","last_fullsized":"2024-01-23T09:25:03.698551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:07:39.007667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"30'96","reported_seq":119,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:49.097776+0000","last_change":"2024-01-23T08:55:47.749137+0000","last_active":"2024-01-23T09:23:49.097776+0000","last_peered":"2024-01-23T09:23:49.097776+0000","last_clean":"2024-01-23T09:23:49.097776+0000","last_became_active":"2024-01-23T08:55:47.747327+0000","last_became_peered":"2024-01-23T08:55:47.747327+0000","last_unstale":"2024-01-23T09:23:49.097776+0000","last_undegraded":"2024-01-23T09:23:49.097776+0000","last_fullsized":"2024-01-23T09:23:49.097776+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:51:20.285692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":8062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"30'35","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.752906+0000","last_change":"2024-01-23T08:54:42.228128+0000","last_active":"2024-01-23T09:25:03.752906+0000","last_peered":"2024-01-23T09:25:03.752906+0000","last_clean":"2024-01-23T09:25:03.752906+0000","last_became_active":"2024-01-23T08:54:42.227421+0000","last_became_peered":"2024-01-23T08:54:42.227421+0000","last_unstale":"2024-01-23T09:25:03.752906+0000","last_undegraded":"2024-01-23T09:25:03.752906+0000","last_fullsized":"2024-01-23T09:25:03.752906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:47:09.171802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"30'25","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.639997+0000","last_change":"2024-01-23T08:54:42.112162+0000","last_active":"2024-01-23T09:25:03.639997+0000","last_peered":"2024-01-23T09:25:03.639997+0000","last_clean":"2024-01-23T09:25:03.639997+0000","last_became_active":"2024-01-23T08:54:42.111635+0000","last_became_peered":"2024-01-23T08:54:42.111635+0000","last_unstale":"2024-01-23T09:25:03.639997+0000","last_undegraded":"2024-01-23T09:25:03.639997+0000","last_fullsized":"2024-01-23T09:25:03.639997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:13:11.423278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"30'28","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.713263+0000","last_change":"2024-01-23T08:54:42.069982+0000","last_active":"2024-01-23T09:25:03.713263+0000","last_peered":"2024-01-23T09:25:03.713263+0000","last_clean":"2024-01-23T09:25:03.713263+0000","last_became_active":"2024-01-23T08:54:42.069262+0000","last_became_peered":"2024-01-23T08:54:42.069262+0000","last_unstale":"2024-01-23T09:25:03.713263+0000","last_undegraded":"2024-01-23T09:25:03.713263+0000","last_fullsized":"2024-01-23T09:25:03.713263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:56:44.803841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"30'23","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.630718+0000","last_change":"2024-01-23T08:54:42.108709+0000","last_active":"2024-01-23T09:25:03.630718+0000","last_peered":"2024-01-23T09:25:03.630718+0000","last_clean":"2024-01-23T09:25:03.630718+0000","last_became_active":"2024-01-23T08:54:42.107985+0000","last_became_peered":"2024-01-23T08:54:42.107985+0000","last_unstale":"2024-01-23T09:25:03.630718+0000","last_undegraded":"2024-01-23T09:25:03.630718+0000","last_fullsized":"2024-01-23T09:25:03.630718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:27:28.770059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"30'17","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.599762+0000","last_change":"2024-01-23T08:54:42.229100+0000","last_active":"2024-01-23T09:25:03.599762+0000","last_peered":"2024-01-23T09:25:03.599762+0000","last_clean":"2024-01-23T09:25:03.599762+0000","last_became_active":"2024-01-23T08:54:42.227918+0000","last_became_peered":"2024-01-23T08:54:42.227918+0000","last_unstale":"2024-01-23T09:25:03.599762+0000","last_undegraded":"2024-01-23T09:25:03.599762+0000","last_fullsized":"2024-01-23T09:25:03.599762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:54:47.705445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"30'20","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.584500+0000","last_change":"2024-01-23T08:54:42.231357+0000","last_active":"2024-01-23T09:25:03.584500+0000","last_peered":"2024-01-23T09:25:03.584500+0000","last_clean":"2024-01-23T09:25:03.584500+0000","last_became_active":"2024-01-23T08:54:42.230615+0000","last_became_peered":"2024-01-23T08:54:42.230615+0000","last_unstale":"2024-01-23T09:25:03.584500+0000","last_undegraded":"2024-01-23T09:25:03.584500+0000","last_fullsized":"2024-01-23T09:25:03.584500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:12:12.757498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"30'35","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.755743+0000","last_change":"2024-01-23T08:54:42.158739+0000","last_active":"2024-01-23T09:25:03.755743+0000","last_peered":"2024-01-23T09:25:03.755743+0000","last_clean":"2024-01-23T09:25:03.755743+0000","last_became_active":"2024-01-23T08:54:42.157106+0000","last_became_peered":"2024-01-23T08:54:42.157106+0000","last_unstale":"2024-01-23T09:25:03.755743+0000","last_undegraded":"2024-01-23T09:25:03.755743+0000","last_fullsized":"2024-01-23T09:25:03.755743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:32:37.961458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"30'20","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.609816+0000","last_change":"2024-01-23T08:54:42.092942+0000","last_active":"2024-01-23T09:25:03.609816+0000","last_peered":"2024-01-23T09:25:03.609816+0000","last_clean":"2024-01-23T09:25:03.609816+0000","last_became_active":"2024-01-23T08:54:42.092149+0000","last_became_peered":"2024-01-23T08:54:42.092149+0000","last_unstale":"2024-01-23T09:25:03.609816+0000","last_undegraded":"2024-01-23T09:25:03.609816+0000","last_fullsized":"2024-01-23T09:25:03.609816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:19.147334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"30'19","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.725472+0000","last_change":"2024-01-23T08:54:42.069948+0000","last_active":"2024-01-23T09:25:03.725472+0000","last_peered":"2024-01-23T09:25:03.725472+0000","last_clean":"2024-01-23T09:25:03.725472+0000","last_became_active":"2024-01-23T08:54:42.069305+0000","last_became_peered":"2024-01-23T08:54:42.069305+0000","last_unstale":"2024-01-23T09:25:03.725472+0000","last_undegraded":"2024-01-23T09:25:03.725472+0000","last_fullsized":"2024-01-23T09:25:03.725472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:21:50.684517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.626304+0000","last_change":"2024-01-23T08:54:42.158120+0000","last_active":"2024-01-23T09:25:03.626304+0000","last_peered":"2024-01-23T09:25:03.626304+0000","last_clean":"2024-01-23T09:25:03.626304+0000","last_became_active":"2024-01-23T08:54:42.157647+0000","last_became_peered":"2024-01-23T08:54:42.157647+0000","last_unstale":"2024-01-23T09:25:03.626304+0000","last_undegraded":"2024-01-23T09:25:03.626304+0000","last_fullsized":"2024-01-23T09:25:03.626304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:28:50.107504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.697797+0000","last_change":"2024-01-23T08:54:42.119253+0000","last_active":"2024-01-23T09:25:03.697797+0000","last_peered":"2024-01-23T09:25:03.697797+0000","last_clean":"2024-01-23T09:25:03.697797+0000","last_became_active":"2024-01-23T08:54:42.118528+0000","last_became_peered":"2024-01-23T08:54:42.118528+0000","last_unstale":"2024-01-23T09:25:03.697797+0000","last_undegraded":"2024-01-23T09:25:03.697797+0000","last_fullsized":"2024-01-23T09:25:03.697797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:47:09.171802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"30'35","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.736189+0000","last_change":"2024-01-23T08:54:42.197561+0000","last_active":"2024-01-23T09:25:03.736189+0000","last_peered":"2024-01-23T09:25:03.736189+0000","last_clean":"2024-01-23T09:25:03.736189+0000","last_became_active":"2024-01-23T08:54:42.196809+0000","last_became_peered":"2024-01-23T08:54:42.196809+0000","last_unstale":"2024-01-23T09:25:03.736189+0000","last_undegraded":"2024-01-23T09:25:03.736189+0000","last_fullsized":"2024-01-23T09:25:03.736189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:16:34.046447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"30'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.871563+0000","last_change":"2024-01-23T08:54:42.112093+0000","last_active":"2024-01-23T09:25:03.871563+0000","last_peered":"2024-01-23T09:25:03.871563+0000","last_clean":"2024-01-23T09:25:03.871563+0000","last_became_active":"2024-01-23T08:54:42.111207+0000","last_became_peered":"2024-01-23T08:54:42.111207+0000","last_unstale":"2024-01-23T09:25:03.871563+0000","last_undegraded":"2024-01-23T09:25:03.871563+0000","last_fullsized":"2024-01-23T09:25:03.871563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:37.410041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"30'22","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.724979+0000","last_change":"2024-01-23T08:54:42.195803+0000","last_active":"2024-01-23T09:25:03.724979+0000","last_peered":"2024-01-23T09:25:03.724979+0000","last_clean":"2024-01-23T09:25:03.724979+0000","last_became_active":"2024-01-23T08:54:42.194562+0000","last_became_peered":"2024-01-23T08:54:42.194562+0000","last_unstale":"2024-01-23T09:25:03.724979+0000","last_undegraded":"2024-01-23T09:25:03.724979+0000","last_fullsized":"2024-01-23T09:25:03.724979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:53:56.379892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"30'33","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.641853+0000","last_change":"2024-01-23T08:54:42.161219+0000","last_active":"2024-01-23T09:25:03.641853+0000","last_peered":"2024-01-23T09:25:03.641853+0000","last_clean":"2024-01-23T09:25:03.641853+0000","last_became_active":"2024-01-23T08:54:42.160570+0000","last_became_peered":"2024-01-23T08:54:42.160570+0000","last_unstale":"2024-01-23T09:25:03.641853+0000","last_undegraded":"2024-01-23T09:25:03.641853+0000","last_fullsized":"2024-01-23T09:25:03.641853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:47:09.171802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.722516+0000","last_change":"2024-01-23T08:54:42.115468+0000","last_active":"2024-01-23T09:25:03.722516+0000","last_peered":"2024-01-23T09:25:03.722516+0000","last_clean":"2024-01-23T09:25:03.722516+0000","last_became_active":"2024-01-23T08:54:42.114759+0000","last_became_peered":"2024-01-23T08:54:42.114759+0000","last_unstale":"2024-01-23T09:25:03.722516+0000","last_undegraded":"2024-01-23T09:25:03.722516+0000","last_fullsized":"2024-01-23T09:25:03.722516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:00:35.095097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.726671+0000","last_change":"2024-01-23T08:54:42.150054+0000","last_active":"2024-01-23T09:25:03.726671+0000","last_peered":"2024-01-23T09:25:03.726671+0000","last_clean":"2024-01-23T09:25:03.726671+0000","last_became_active":"2024-01-23T08:54:42.149278+0000","last_became_peered":"2024-01-23T08:54:42.149278+0000","last_unstale":"2024-01-23T09:25:03.726671+0000","last_undegraded":"2024-01-23T09:25:03.726671+0000","last_fullsized":"2024-01-23T09:25:03.726671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:16:33.710981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.618372+0000","last_change":"2024-01-23T08:54:42.110442+0000","last_active":"2024-01-23T09:25:03.618372+0000","last_peered":"2024-01-23T09:25:03.618372+0000","last_clean":"2024-01-23T09:25:03.618372+0000","last_became_active":"2024-01-23T08:54:42.109743+0000","last_became_peered":"2024-01-23T08:54:42.109743+0000","last_unstale":"2024-01-23T09:25:03.618372+0000","last_undegraded":"2024-01-23T09:25:03.618372+0000","last_fullsized":"2024-01-23T09:25:03.618372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:58:34.376942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"30'25","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.588171+0000","last_change":"2024-01-23T08:54:42.228264+0000","last_active":"2024-01-23T09:25:03.588171+0000","last_peered":"2024-01-23T09:25:03.588171+0000","last_clean":"2024-01-23T09:25:03.588171+0000","last_became_active":"2024-01-23T08:54:42.227537+0000","last_became_peered":"2024-01-23T08:54:42.227537+0000","last_unstale":"2024-01-23T09:25:03.588171+0000","last_undegraded":"2024-01-23T09:25:03.588171+0000","last_fullsized":"2024-01-23T09:25:03.588171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:54:25.960679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"30'33","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.599333+0000","last_change":"2024-01-23T08:54:42.225968+0000","last_active":"2024-01-23T09:25:03.599333+0000","last_peered":"2024-01-23T09:25:03.599333+0000","last_clean":"2024-01-23T09:25:03.599333+0000","last_became_active":"2024-01-23T08:54:42.224541+0000","last_became_peered":"2024-01-23T08:54:42.224541+0000","last_unstale":"2024-01-23T09:25:03.599333+0000","last_undegraded":"2024-01-23T09:25:03.599333+0000","last_fullsized":"2024-01-23T09:25:03.599333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:04:03.310087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"30'18","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.873515+0000","last_change":"2024-01-23T08:54:42.111363+0000","last_active":"2024-01-23T09:25:03.873515+0000","last_peered":"2024-01-23T09:25:03.873515+0000","last_clean":"2024-01-23T09:25:03.873515+0000","last_became_active":"2024-01-23T08:54:42.111043+0000","last_became_peered":"2024-01-23T08:54:42.111043+0000","last_unstale":"2024-01-23T09:25:03.873515+0000","last_undegraded":"2024-01-23T09:25:03.873515+0000","last_fullsized":"2024-01-23T09:25:03.873515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:22.447523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"30'19","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.867266+0000","last_change":"2024-01-23T08:54:42.116234+0000","last_active":"2024-01-23T09:25:03.867266+0000","last_peered":"2024-01-23T09:25:03.867266+0000","last_clean":"2024-01-23T09:25:03.867266+0000","last_became_active":"2024-01-23T08:54:42.115911+0000","last_became_peered":"2024-01-23T08:54:42.115911+0000","last_unstale":"2024-01-23T09:25:03.867266+0000","last_undegraded":"2024-01-23T09:25:03.867266+0000","last_fullsized":"2024-01-23T09:25:03.867266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:06.320845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"30'33","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.871125+0000","last_change":"2024-01-23T08:54:42.158134+0000","last_active":"2024-01-23T09:25:03.871125+0000","last_peered":"2024-01-23T09:25:03.871125+0000","last_clean":"2024-01-23T09:25:03.871125+0000","last_became_active":"2024-01-23T08:54:42.157331+0000","last_became_peered":"2024-01-23T08:54:42.157331+0000","last_unstale":"2024-01-23T09:25:03.871125+0000","last_undegraded":"2024-01-23T09:25:03.871125+0000","last_fullsized":"2024-01-23T09:25:03.871125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:46.594970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"30'28","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.704939+0000","last_change":"2024-01-23T08:54:42.092495+0000","last_active":"2024-01-23T09:25:03.704939+0000","last_peered":"2024-01-23T09:25:03.704939+0000","last_clean":"2024-01-23T09:25:03.704939+0000","last_became_active":"2024-01-23T08:54:42.091726+0000","last_became_peered":"2024-01-23T08:54:42.091726+0000","last_unstale":"2024-01-23T09:25:03.704939+0000","last_undegraded":"2024-01-23T09:25:03.704939+0000","last_fullsized":"2024-01-23T09:25:03.704939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:19:17.992621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"30'19","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.647706+0000","last_change":"2024-01-23T08:54:42.120617+0000","last_active":"2024-01-23T09:25:03.647706+0000","last_peered":"2024-01-23T09:25:03.647706+0000","last_clean":"2024-01-23T09:25:03.647706+0000","last_became_active":"2024-01-23T08:54:42.119847+0000","last_became_peered":"2024-01-23T08:54:42.119847+0000","last_unstale":"2024-01-23T09:25:03.647706+0000","last_undegraded":"2024-01-23T09:25:03.647706+0000","last_fullsized":"2024-01-23T09:25:03.647706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:29:51.323223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"30'18","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.866794+0000","last_change":"2024-01-23T08:54:42.197133+0000","last_active":"2024-01-23T09:25:03.866794+0000","last_peered":"2024-01-23T09:25:03.866794+0000","last_clean":"2024-01-23T09:25:03.866794+0000","last_became_active":"2024-01-23T08:54:42.195743+0000","last_became_peered":"2024-01-23T08:54:42.195743+0000","last_unstale":"2024-01-23T09:25:03.866794+0000","last_undegraded":"2024-01-23T09:25:03.866794+0000","last_fullsized":"2024-01-23T09:25:03.866794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:48:04.040139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"30'24","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.751801+0000","last_change":"2024-01-23T08:54:42.195979+0000","last_active":"2024-01-23T09:25:03.751801+0000","last_peered":"2024-01-23T09:25:03.751801+0000","last_clean":"2024-01-23T09:25:03.751801+0000","last_became_active":"2024-01-23T08:54:42.194846+0000","last_became_peered":"2024-01-23T08:54:42.194846+0000","last_unstale":"2024-01-23T09:25:03.751801+0000","last_undegraded":"2024-01-23T09:25:03.751801+0000","last_fullsized":"2024-01-23T09:25:03.751801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:07:39.007667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"30'23","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.862699+0000","last_change":"2024-01-23T08:54:42.118056+0000","last_active":"2024-01-23T09:25:03.862699+0000","last_peered":"2024-01-23T09:25:03.862699+0000","last_clean":"2024-01-23T09:25:03.862699+0000","last_became_active":"2024-01-23T08:54:42.117735+0000","last_became_peered":"2024-01-23T08:54:42.117735+0000","last_unstale":"2024-01-23T09:25:03.862699+0000","last_undegraded":"2024-01-23T09:25:03.862699+0000","last_fullsized":"2024-01-23T09:25:03.862699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:19.147334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"30'16","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.752663+0000","last_change":"2024-01-23T08:54:42.195159+0000","last_active":"2024-01-23T09:25:03.752663+0000","last_peered":"2024-01-23T09:25:03.752663+0000","last_clean":"2024-01-23T09:25:03.752663+0000","last_became_active":"2024-01-23T08:54:42.194331+0000","last_became_peered":"2024-01-23T08:54:42.194331+0000","last_unstale":"2024-01-23T09:25:03.752663+0000","last_undegraded":"2024-01-23T09:25:03.752663+0000","last_fullsized":"2024-01-23T09:25:03.752663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:19:25.718244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"30'25","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.634628+0000","last_change":"2024-01-23T08:54:42.197096+0000","last_active":"2024-01-23T09:25:03.634628+0000","last_peered":"2024-01-23T09:25:03.634628+0000","last_clean":"2024-01-23T09:25:03.634628+0000","last_became_active":"2024-01-23T08:54:42.196391+0000","last_became_peered":"2024-01-23T08:54:42.196391+0000","last_unstale":"2024-01-23T09:25:03.634628+0000","last_undegraded":"2024-01-23T09:25:03.634628+0000","last_fullsized":"2024-01-23T09:25:03.634628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:22.447523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"30'18","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.601398+0000","last_change":"2024-01-23T08:54:42.231430+0000","last_active":"2024-01-23T09:25:03.601398+0000","last_peered":"2024-01-23T09:25:03.601398+0000","last_clean":"2024-01-23T09:25:03.601398+0000","last_became_active":"2024-01-23T08:54:42.229220+0000","last_became_peered":"2024-01-23T08:54:42.229220+0000","last_unstale":"2024-01-23T09:25:03.601398+0000","last_undegraded":"2024-01-23T09:25:03.601398+0000","last_fullsized":"2024-01-23T09:25:03.601398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:48:04.040139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"30'24","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.870352+0000","last_change":"2024-01-23T08:54:42.118613+0000","last_active":"2024-01-23T09:25:03.870352+0000","last_peered":"2024-01-23T09:25:03.870352+0000","last_clean":"2024-01-23T09:25:03.870352+0000","last_became_active":"2024-01-23T08:54:42.118233+0000","last_became_peered":"2024-01-23T08:54:42.118233+0000","last_unstale":"2024-01-23T09:25:03.870352+0000","last_undegraded":"2024-01-23T09:25:03.870352+0000","last_fullsized":"2024-01-23T09:25:03.870352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:16:33.710981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2304,"num_write_kb":252373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2476,"ondisk_log_size":2476,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1536,"ondisk_log_size":1536,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":23189121,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":519,"num_read_kb":542,"num_write":5371,"num_write_kb":25642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":46628864,"data_stored":46378242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4894,"ondisk_log_size":4894,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509819,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29528,"kb_used_data":2512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342312,"statfs":{"total":96636764160,"available":96606527488,"internally_reserved":0,"allocated":2572288,"data_stored":2340721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.89200000000000002,"15min":0.88200000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.46100000000000002},"max":{"1min":1.4039999999999999,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.93500000000000005,"15min":0.91400000000000003},"min":{"1min":0.61799999999999999,"5min":0.56599999999999995,"15min":0.46300000000000002},"max":{"1min":1.3999999999999999,"5min":1.456,"15min":1.456},"last":1.2789999999999999}]},{"osd":1,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.97599999999999998,"15min":0.95499999999999996},"min":{"1min":0.66100000000000003,"5min":0.52900000000000003,"15min":0.49399999999999999},"max":{"1min":1.419,"5min":1.425,"15min":1.754},"last":1.1659999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.97499999999999998,"15min":0.97299999999999998},"min":{"1min":0.67900000000000005,"5min":0.54400000000000004,"15min":0.51900000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.597},"last":0.98399999999999999}]},{"osd":2,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.96999999999999997,"15min":0.93400000000000005},"min":{"1min":0.66700000000000004,"5min":0.53000000000000003,"15min":0.47099999999999997},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0369999999999999,"15min":1.014},"min":{"1min":0.73599999999999999,"5min":0.59999999999999998,"15min":0.55000000000000004},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.03}]},{"osd":3,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0069999999999999,"15min":0.99099999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.7190000000000001},"last":1.073},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.052,"15min":1.073},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57099999999999995},"max":{"1min":1.587,"5min":1.587,"15min":1.889},"last":1.244}]},{"osd":4,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":0.97099999999999997,"15min":0.97199999999999998},"min":{"1min":0.68200000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.645},"last":1.206},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.99199999999999999,"15min":0.98999999999999999},"min":{"1min":0.60699999999999998,"5min":0.48899999999999999,"15min":0.46800000000000003},"max":{"1min":1.4259999999999999,"5min":1.621,"15min":1.982},"last":0.878}]},{"osd":5,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0760000000000001,"15min":1.0820000000000001},"min":{"1min":0.71099999999999997,"5min":0.63,"15min":0.57299999999999995},"max":{"1min":1.4570000000000001,"5min":1.613,"15min":1.9710000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.115,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.72299999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.8260000000000001},"last":0.78200000000000003}]},{"osd":6,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.147,"15min":1.1399999999999999},"min":{"1min":0.86499999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.613,"5min":1.613,"15min":1.9399999999999999},"last":1.103},{"interface":"front","average":{"1min":1.123,"5min":1.131,"15min":1.1319999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.752,"5min":1.752,"15min":1.883},"last":1.131}]}]},{"osd":5,"up_from":15,"seq":64424509818,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38352,"kb_used_data":7176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333488,"statfs":{"total":96636764160,"available":96597491712,"internally_reserved":0,"allocated":7348224,"data_stored":7125746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.89100000000000001,"15min":0.88300000000000001},"min":{"1min":0.54300000000000004,"5min":0.51500000000000001,"15min":0.501},"max":{"1min":1.296,"5min":1.3919999999999999,"15min":1.5269999999999999},"last":1.153},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.99399999999999999,"15min":0.98099999999999998},"min":{"1min":0.60899999999999999,"5min":0.58899999999999997,"15min":0.53100000000000003},"max":{"1min":1.3109999999999999,"5min":1.552,"15min":1.552},"last":0.97899999999999998}]},{"osd":1,"last update":"Tue Jan 23 09:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.96599999999999997,"15min":0.95599999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.498},"max":{"1min":1.3,"5min":1.4019999999999999,"15min":1.413},"last":0.871},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.96499999999999997,"15min":0.93799999999999994},"min":{"1min":0.625,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2470000000000001,"5min":1.405,"15min":1.542},"last":1.105}]},{"osd":2,"last update":"Tue Jan 23 09:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.94299999999999995,"15min":0.92100000000000004},"min":{"1min":0.63900000000000001,"5min":0.55300000000000005,"15min":0.51100000000000001},"max":{"1min":1.2709999999999999,"5min":1.421,"15min":1.46},"last":1.014},{"interface":"front","average":{"1min":1.012,"5min":1.03,"15min":1.0189999999999999},"min":{"1min":0.64400000000000002,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.385,"5min":1.456,"15min":1.53},"last":1.421}]},{"osd":3,"last update":"Tue Jan 23 09:24:08 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.026,"15min":1.028},"min":{"1min":0.72999999999999998,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.431,"5min":1.4570000000000001,"15min":1.677},"last":1.056},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.0640000000000001,"15min":1.0489999999999999},"min":{"1min":0.76300000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.3109999999999999}]},{"osd":4,"last update":"Tue Jan 23 09:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.97299999999999998,"15min":0.98899999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.48599999999999999},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.8779999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.046,"5min":1.0069999999999999,"15min":1.0109999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.2669999999999999}]},{"osd":6,"last update":"Tue Jan 23 09:24:08 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0309999999999999,"15min":1.044},"min":{"1min":0.71299999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.349,"5min":1.4690000000000001,"15min":1.823},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.1120000000000001,"15min":1.1060000000000001},"min":{"1min":0.76100000000000001,"5min":0.72299999999999998,"15min":0.42599999999999999},"max":{"1min":1.3959999999999999,"5min":1.532,"15min":1.6759999999999999},"last":1.4610000000000001}]},{"osd":7,"last update":"Tue Jan 23 09:24:08 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.1000000000000001,"15min":1.1339999999999999},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.518,"5min":1.518,"15min":1.919},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.163,"15min":1.1659999999999999},"min":{"1min":0.93400000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4670000000000001,"5min":1.5489999999999999,"15min":1.8140000000000001},"last":1.3879999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509817,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39732,"kb_used_data":8556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332108,"statfs":{"total":96636764160,"available":96596078592,"internally_reserved":0,"allocated":8761344,"data_stored":8522021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.92400000000000004,"15min":0.91300000000000003},"min":{"1min":0.56599999999999995,"5min":0.50700000000000001,"15min":0.46600000000000003},"max":{"1min":1.3129999999999999,"5min":1.3799999999999999,"15min":1.583},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.95499999999999996,"15min":0.91800000000000004},"min":{"1min":0.60499999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.282,"5min":1.329,"15min":1.5629999999999999},"last":0.89600000000000002}]},{"osd":1,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.97699999999999998,"15min":0.93000000000000005},"min":{"1min":0.74099999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3640000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.94099999999999995,"15min":0.95299999999999996},"min":{"1min":0.66100000000000003,"5min":0.59999999999999998,"15min":0.5},"max":{"1min":1.232,"5min":1.415,"15min":1.415},"last":0.85699999999999998}]},{"osd":2,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.96099999999999997,"15min":0.93700000000000006},"min":{"1min":0.625,"5min":0.56599999999999995,"15min":0.54000000000000004},"max":{"1min":1.3460000000000001,"5min":1.387,"15min":1.387},"last":0.999},{"interface":"front","average":{"1min":1,"5min":1.0589999999999999,"15min":1.0329999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.498},"max":{"1min":1.296,"5min":1.411,"15min":1.736},"last":1.169}]},{"osd":3,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0009999999999999,"15min":0.98199999999999998},"min":{"1min":0.70199999999999996,"5min":0.58899999999999997,"15min":0.55300000000000005},"max":{"1min":1.3720000000000001,"5min":1.3779999999999999,"15min":1.7509999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.101,"5min":1.0840000000000001,"15min":1.0680000000000001},"min":{"1min":0.78800000000000003,"5min":0.77100000000000002,"15min":0.60799999999999998},"max":{"1min":1.349,"5min":1.3859999999999999,"15min":1.482},"last":0.92600000000000005}]},{"osd":5,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.96599999999999997,"15min":0.98299999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3100000000000001,"5min":1.5549999999999999,"15min":1.643},"last":1.121},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.98699999999999999,"15min":0.98899999999999999},"min":{"1min":0.64300000000000002,"5min":0.57999999999999996,"15min":0.52300000000000002},"max":{"1min":1.417,"5min":1.4330000000000001,"15min":1.986},"last":0.81599999999999995}]},{"osd":6,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.0289999999999999,"15min":1.0309999999999999},"min":{"1min":0.64900000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.4279999999999999,"5min":1.446,"15min":1.825},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.139,"5min":1.1160000000000001,"15min":1.1180000000000001},"min":{"1min":0.86599999999999999,"5min":0.77000000000000002,"15min":0.45700000000000002},"max":{"1min":1.373,"5min":1.5049999999999999,"15min":1.7749999999999999},"last":1.024}]},{"osd":7,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.0549999999999999,"15min":1.0629999999999999},"min":{"1min":0.72999999999999998,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.573,"5min":1.573,"15min":1.673},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.1950000000000001,"15min":1.173},"min":{"1min":0.94399999999999995,"5min":0.71099999999999997,"15min":0.69399999999999995},"max":{"1min":1.4850000000000001,"5min":1.5369999999999999,"15min":1.5629999999999999},"last":1.097}]}]},{"osd":2,"up_from":15,"seq":64424509819,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39696,"kb_used_data":8520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332144,"statfs":{"total":96636764160,"available":96596115456,"internally_reserved":0,"allocated":8724480,"data_stored":8520251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.74299999999999999,"15min":0.72899999999999998},"min":{"1min":0.44600000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.1890000000000001,"5min":1.528,"15min":1.5820000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.877,"15min":0.82499999999999996},"min":{"1min":0.54000000000000004,"5min":0.40200000000000002,"15min":0.248},"max":{"1min":1.534,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":0.69299999999999995}]},{"osd":1,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90800000000000003,"15min":0.88900000000000001},"min":{"1min":0.51900000000000002,"5min":0.42799999999999999,"15min":0.376},"max":{"1min":1.401,"5min":1.974,"15min":1.974},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.995,"5min":0.89800000000000002,"15min":0.88600000000000001},"min":{"1min":0.61399999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.393,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.84899999999999998}]},{"osd":3,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.86299999999999999,"15min":0.85199999999999998},"min":{"1min":0.55800000000000005,"5min":0.36499999999999999,"15min":0.36199999999999999},"max":{"1min":1.7310000000000001,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0549999999999999,"15min":1.0109999999999999},"min":{"1min":0.67100000000000004,"5min":0.38,"15min":0.38},"max":{"1min":1.591,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.98799999999999999}]},{"osd":4,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.1499999999999999,"15min":1.123},"min":{"1min":0.78900000000000003,"5min":0.59699999999999998,"15min":0.55000000000000004},"max":{"1min":1.446,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.048},{"interface":"front","average":{"1min":1.23,"5min":1.1559999999999999,"15min":1.153},"min":{"1min":0.82499999999999996,"5min":0.61599999999999999,"15min":0.60399999999999998},"max":{"1min":1.754,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.93400000000000005}]},{"osd":5,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1020000000000001,"15min":1.091},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53700000000000003},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.9379999999999999},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.26,"5min":1.2430000000000001,"15min":1.2130000000000001},"min":{"1min":0.79300000000000004,"5min":0.68899999999999995,"15min":0.624},"max":{"1min":1.681,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.163}]},{"osd":6,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.202,"15min":1.198},"min":{"1min":0.71499999999999997,"5min":0.60899999999999999,"15min":0.59499999999999997},"max":{"1min":1.796,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.202},{"interface":"front","average":{"1min":1.2,"5min":1.1919999999999999,"15min":1.175},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.577,"5min":1.6519999999999999,"15min":1.843},"last":1.369}]},{"osd":7,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.2849999999999999,"15min":1.262},"min":{"1min":0.79600000000000004,"5min":0.77100000000000002,"15min":0.59499999999999997},"max":{"1min":2,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.26,"15min":1.2370000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.4550000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509818,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":933888,"data_stored":722685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.56200000000000006,"5min":0.36599999999999999,"15min":0.28599999999999998},"max":{"1min":1.371,"5min":1.371,"15min":1.681},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.83699999999999997,"15min":0.80900000000000005},"min":{"1min":0.51500000000000001,"5min":0.42499999999999999,"15min":0.36399999999999999},"max":{"1min":1.246,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.59699999999999998}]},{"osd":2,"last update":"Tue Jan 23 09:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76200000000000001,"15min":0.73299999999999998},"min":{"1min":0.55000000000000004,"5min":0.38400000000000001,"15min":0.375},"max":{"1min":1.1499999999999999,"5min":1.262,"15min":1.5960000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.94399999999999995,"15min":0.92200000000000004},"min":{"1min":0.70199999999999996,"5min":0.48099999999999998,"15min":0.30499999999999999},"max":{"1min":1.425,"5min":1.4470000000000001,"15min":1.6919999999999999},"last":1.0149999999999999}]},{"osd":3,"last update":"Tue Jan 23 09:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.96099999999999997,"15min":0.93400000000000005},"min":{"1min":0.60899999999999999,"5min":0.50900000000000001,"15min":0.40400000000000003},"max":{"1min":1.4119999999999999,"5min":1.569,"15min":1.8069999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.97799999999999998,"15min":0.96799999999999997},"min":{"1min":0.51200000000000001,"5min":0.496,"15min":0.35599999999999998},"max":{"1min":1.4930000000000001,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.80800000000000005}]},{"osd":4,"last update":"Tue Jan 23 09:24:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0820000000000001,"15min":1.0780000000000001},"min":{"1min":0.75600000000000001,"5min":0.63,"15min":0.54300000000000004},"max":{"1min":1.357,"5min":1.601,"15min":1.6799999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.196,"15min":1.177},"min":{"1min":1.0149999999999999,"5min":0.64000000000000001,"15min":0.50600000000000001},"max":{"1min":1.5720000000000001,"5min":1.6910000000000001,"15min":2.2450000000000001},"last":1.2110000000000001}]},{"osd":5,"last update":"Tue Jan 23 09:24:07 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.1950000000000001,"15min":1.175},"min":{"1min":0.73899999999999999,"5min":0.66200000000000003,"15min":0.63},"max":{"1min":1.8260000000000001,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.21,"5min":1.1679999999999999,"15min":1.1559999999999999},"min":{"1min":0.79500000000000004,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.6120000000000001,"5min":1.802,"15min":1.802},"last":1.0600000000000001}]},{"osd":6,"last update":"Tue Jan 23 09:24:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.262,"15min":1.234},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.58699999999999997},"max":{"1min":1.7330000000000001,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.232,"5min":1.2130000000000001,"15min":1.2},"min":{"1min":0.78300000000000003,"5min":0.68600000000000005,"15min":0.66700000000000004},"max":{"1min":1.577,"5min":1.857,"15min":1.857},"last":0.95099999999999996}]},{"osd":7,"last update":"Tue Jan 23 09:24:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.292,"15min":1.2809999999999999},"min":{"1min":1.0309999999999999,"5min":0.77600000000000002,"15min":0.65500000000000003},"max":{"1min":1.6719999999999999,"5min":1.913,"15min":2.1110000000000002},"last":1.127},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.3029999999999999,"15min":1.29},"min":{"1min":0.90800000000000003,"5min":0.872,"15min":0.72099999999999997},"max":{"1min":1.595,"5min":2.238,"15min":2.238},"last":1.0940000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509818,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":4444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":4550656,"data_stored":4328911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 23 09:24:16 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70999999999999996,"15min":0.71299999999999997},"min":{"1min":0.32800000000000001,"5min":0.308,"15min":0.29499999999999998},"max":{"1min":0.97599999999999998,"5min":1.28,"15min":1.8280000000000001},"last":9.5459999999999994},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.85399999999999998,"15min":0.84299999999999997},"min":{"1min":0.56899999999999995,"5min":0.38,"15min":0.26500000000000001},"max":{"1min":1.407,"5min":1.407,"15min":2.21},"last":0.74299999999999999}]},{"osd":2,"last update":"Tue Jan 23 09:24:16 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.81999999999999995,"15min":0.79300000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.312},"max":{"1min":1.1819999999999999,"5min":1.343,"15min":3.8130000000000002},"last":5.5199999999999996},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90900000000000003,"15min":0.89600000000000002},"min":{"1min":0.54000000000000004,"5min":0.46800000000000003,"15min":0.40400000000000003},"max":{"1min":1.2110000000000001,"5min":1.5309999999999999,"15min":2.1440000000000001},"last":0.84099999999999997}]},{"osd":3,"last update":"Tue Jan 23 09:24:16 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.91000000000000003,"15min":0.91300000000000003},"min":{"1min":0.433,"5min":0.432,"15min":0.32200000000000001},"max":{"1min":1.2789999999999999,"5min":1.593,"15min":1.7150000000000001},"last":9.6470000000000002},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.97699999999999998,"15min":0.94399999999999995},"min":{"1min":0.51000000000000001,"5min":0.50800000000000001,"15min":0.42899999999999999},"max":{"1min":1.3819999999999999,"5min":1.583,"15min":1.583},"last":42.942}]},{"osd":4,"last update":"Tue Jan 23 09:24:16 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.115,"15min":1.105},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.47299999999999998},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":2.3050000000000002},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.101,"5min":1.1539999999999999,"15min":1.1459999999999999},"min":{"1min":0.82599999999999996,"5min":0.72399999999999998,"15min":0.60099999999999998},"max":{"1min":1.3899999999999999,"5min":1.899,"15min":1.982},"last":3.6619999999999999}]},{"osd":5,"last update":"Tue Jan 23 09:24:16 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.1439999999999999,"15min":1.1240000000000001},"min":{"1min":0.749,"5min":0.63800000000000001,"15min":0.5},"max":{"1min":1.466,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":5.6210000000000004},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.244,"15min":1.236},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.51700000000000002},"max":{"1min":1.796,"5min":1.8460000000000001,"15min":2.1080000000000001},"last":1.2450000000000001}]},{"osd":6,"last update":"Tue Jan 23 09:24:16 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.242,"15min":1.24},"min":{"1min":0.66700000000000004,"5min":0.60999999999999999,"15min":0.59599999999999997},"max":{"1min":1.6859999999999999,"5min":2.0150000000000001,"15min":2.036},"last":3.5609999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2410000000000001,"15min":1.2250000000000001},"min":{"1min":0.754,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.6830000000000001,"5min":1.821,"15min":2.0070000000000001},"last":3.4359999999999999}]},{"osd":7,"last update":"Tue Jan 23 09:24:16 2024","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.298,"15min":1.3049999999999999},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.54400000000000004},"max":{"1min":1.98,"5min":1.98,"15min":2.2160000000000002},"last":1.397},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.306,"15min":1.304},"min":{"1min":0.84899999999999998,"5min":0.65700000000000003,"15min":0.57699999999999996},"max":{"1min":1.6200000000000001,"5min":1.7869999999999999,"15min":1.9139999999999999},"last":4.3330000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509820,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47980,"kb_used_data":12644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323860,"statfs":{"total":96636764160,"available":96587632640,"internally_reserved":0,"allocated":12947456,"data_stored":12717118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.755,"15min":0.73699999999999999},"min":{"1min":0.54400000000000004,"5min":0.434,"15min":0.28100000000000003},"max":{"1min":1.1850000000000001,"5min":1.492,"15min":1.514},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.78100000000000003,"15min":0.751},"min":{"1min":0.51800000000000002,"5min":0.45800000000000002,"15min":0.34799999999999998},"max":{"1min":1.155,"5min":1.2450000000000001,"15min":1.641},"last":1.0489999999999999}]},{"osd":1,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.83899999999999997,"15min":0.79700000000000004},"min":{"1min":0.53600000000000003,"5min":0.42099999999999999,"15min":0.309},"max":{"1min":1.0820000000000001,"5min":1.782,"15min":1.782},"last":0.63500000000000001},{"interface":"front","average":{"1min":1.026,"5min":0.95999999999999996,"15min":0.90500000000000003},"min":{"1min":0.70199999999999996,"5min":0.437,"15min":0.32900000000000001},"max":{"1min":1.367,"5min":2.698,"15min":2.698},"last":0.84099999999999997}]},{"osd":2,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.95899999999999996,"15min":0.91200000000000003},"min":{"1min":0.67600000000000005,"5min":0.54800000000000004,"15min":0.379},"max":{"1min":1.3879999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.018,"15min":0.96499999999999997},"min":{"1min":0.56100000000000005,"5min":0.49399999999999999,"15min":0.312},"max":{"1min":1.405,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":1.1899999999999999}]},{"osd":4,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.093,"15min":1.0720000000000001},"min":{"1min":0.85399999999999998,"5min":0.624,"15min":0.57099999999999995},"max":{"1min":1.53,"5min":1.53,"15min":1.736},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1439999999999999,"15min":1.1000000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.499},"max":{"1min":1.4419999999999999,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":0.90700000000000003}]},{"osd":5,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1890000000000001,"15min":1.1499999999999999},"min":{"1min":0.873,"5min":0.72199999999999998,"15min":0.51800000000000002},"max":{"1min":1.5800000000000001,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.093},{"interface":"front","average":{"1min":1.256,"5min":1.284,"15min":1.24},"min":{"1min":0.88700000000000001,"5min":0.69399999999999995,"15min":0.47999999999999998},"max":{"1min":1.7549999999999999,"5min":2.794,"15min":2.794},"last":1.3109999999999999}]},{"osd":6,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3160000000000001,"15min":1.2669999999999999},"min":{"1min":0.94499999999999995,"5min":0.77200000000000002,"15min":0.61399999999999999},"max":{"1min":1.877,"5min":2.8730000000000002,"15min":2.8730000000000002},"last":1.012},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.1970000000000001,"15min":1.1859999999999999},"min":{"1min":0.87,"5min":0.68000000000000005,"15min":0.60699999999999998},"max":{"1min":1.577,"5min":1.5880000000000001,"15min":2.3170000000000002},"last":1.343}]},{"osd":7,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.258,"15min":1.224},"min":{"1min":1.1319999999999999,"5min":0.91100000000000003,"15min":0.68000000000000005},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":2.1960000000000002},"last":1.28},{"interface":"front","average":{"1min":1.331,"5min":1.2969999999999999,"15min":1.262},"min":{"1min":1.004,"5min":0.90700000000000003,"15min":0.63400000000000001},"max":{"1min":1.679,"5min":1.9330000000000001,"15min":2.0910000000000002},"last":1.246}]}]},{"osd":6,"up_from":14,"seq":60129542522,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43924,"kb_used_data":4428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327916,"statfs":{"total":96636764160,"available":96591785984,"internally_reserved":0,"allocated":4534272,"data_stored":4328749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.90200000000000002,"15min":0.87},"min":{"1min":0.56999999999999995,"5min":0.48099999999999998,"15min":0.44},"max":{"1min":1.274,"5min":1.3520000000000001,"15min":1.4199999999999999},"last":0.871},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.88900000000000001,"15min":0.89500000000000002},"min":{"1min":0.61599999999999999,"5min":0.501,"15min":0.39600000000000002},"max":{"1min":1.141,"5min":1.575,"15min":1.575},"last":0.89400000000000002}]},{"osd":1,"last update":"Tue Jan 23 09:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.94699999999999995,"15min":0.93500000000000005},"min":{"1min":0.623,"5min":0.55500000000000005,"15min":0.53500000000000003},"max":{"1min":1.2669999999999999,"5min":1.3169999999999999,"15min":1.3400000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0209999999999999,"15min":0.98499999999999999},"min":{"1min":0.67800000000000005,"5min":0.57699999999999996,"15min":0.48399999999999999},"max":{"1min":1.359,"5min":1.5209999999999999,"15min":1.548},"last":0.70199999999999996}]},{"osd":2,"last update":"Tue Jan 23 09:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.93600000000000005,"15min":0.92400000000000004},"min":{"1min":0.55300000000000005,"5min":0.502,"15min":0.502},"max":{"1min":1.302,"5min":1.484,"15min":2.1219999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.93000000000000005,"15min":0.93100000000000005},"min":{"1min":0.68300000000000005,"5min":0.58599999999999997,"15min":0.46700000000000003},"max":{"1min":1.2529999999999999,"5min":1.3180000000000001,"15min":1.429},"last":1.1699999999999999}]},{"osd":3,"last update":"Tue Jan 23 09:24:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.042,"15min":1.044},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.625},"max":{"1min":1.4119999999999999,"5min":1.4390000000000001,"15min":1.4850000000000001},"last":1.097},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.022,"15min":1.0209999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.53900000000000003},"max":{"1min":1.2130000000000001,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.93700000000000006}]},{"osd":4,"last update":"Tue Jan 23 09:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.95799999999999996,"15min":0.95299999999999996},"min":{"1min":0.64800000000000002,"5min":0.57699999999999996,"15min":0.53800000000000003},"max":{"1min":1.21,"5min":1.4419999999999999,"15min":1.518},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0880000000000001,"15min":1.1000000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3540000000000001,"5min":1.4790000000000001,"15min":1.5680000000000001},"last":0.73399999999999999}]},{"osd":5,"last update":"Tue Jan 23 09:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.95399999999999996,"15min":0.95499999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.497},"max":{"1min":1.339,"5min":1.4299999999999999,"15min":1.734},"last":0.59999999999999998},{"interface":"front","average":{"1min":1.081,"5min":1.145,"15min":1.1379999999999999},"min":{"1min":0.78500000000000003,"5min":0.63800000000000001,"15min":0.57599999999999996},"max":{"1min":1.3899999999999999,"5min":1.601,"15min":2.278},"last":0.50600000000000001}]},{"osd":7,"last update":"Tue Jan 23 09:24:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.034,"15min":1.042},"min":{"1min":0.71499999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3919999999999999,"5min":1.659,"15min":1.659},"last":1.018},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0629999999999999,"15min":1.075},"min":{"1min":0.66900000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.2969999999999999,"5min":1.5289999999999999,"15min":1.6599999999999999},"last":0.83999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4231168,"data_stored":4198008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12627968,"data_stored":12586215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8441856,"data_stored":8391118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6434816,"data_stored":6404475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4214784,"data_stored":4197846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2252800,"data_stored":2209818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-23T09:25:11.109 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-23T09:25:11.109 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-23T09:25:11.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.270+0000 7fac497f0640 1 Processor -- start 2024-01-23T09:25:11.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.270+0000 7fac497f0640 1 -- start start 2024-01-23T09:25:11.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.270+0000 7fac497f0640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fac440cb370 0x7fac44071a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:11.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.270+0000 7fac497f0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fac440bffd0 0x7fac44159f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:11.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.270+0000 7fac497f0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac440cb750 0x7fac4415a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:11.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.270+0000 7fac497f0640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac44071f40 con 0x7fac440cb370 2024-01-23T09:25:11.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.270+0000 7fac497f0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac440722a0 con 0x7fac440bffd0 2024-01-23T09:25:11.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.270+0000 7fac497f0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac44072580 con 0x7fac440cb750 2024-01-23T09:25:11.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.274+0000 7fac42ffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fac440cb370 0x7fac44071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:11.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.274+0000 7fac42ffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fac440cb370 0x7fac44071a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51976/0 (socket says 172.21.15.46:51976) 2024-01-23T09:25:11.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.274+0000 7fac42ffd640 1 -- 172.21.15.46:0/3124264119 learned_addr learned my addr 172.21.15.46:0/3124264119 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:11.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.274+0000 7fac427fc640 1 --2- 172.21.15.46:0/3124264119 >> v2:172.21.15.175:3300/0 conn(0x7fac440bffd0 0x7fac44159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:11.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.274+0000 7fac437fe640 1 --2- 172.21.15.46:0/3124264119 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac440cb750 0x7fac4415a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:11.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.274+0000 7fac42ffd640 1 -- 172.21.15.46:0/3124264119 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac440cb750 msgr2=0x7fac4415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:11.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.274+0000 7fac42ffd640 1 --2- 172.21.15.46:0/3124264119 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac440cb750 0x7fac4415a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:11.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.274+0000 7fac42ffd640 1 -- 172.21.15.46:0/3124264119 >> v2:172.21.15.175:3300/0 conn(0x7fac440bffd0 msgr2=0x7fac44159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:11.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.274+0000 7fac42ffd640 1 --2- 172.21.15.46:0/3124264119 >> v2:172.21.15.175:3300/0 conn(0x7fac440bffd0 0x7fac44159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:11.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.274+0000 7fac42ffd640 1 -- 172.21.15.46:0/3124264119 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac44072860 con 0x7fac440cb370 2024-01-23T09:25:11.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.282+0000 7fac42ffd640 1 --2- 172.21.15.46:0/3124264119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac440cb370 0x7fac44071a00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fac34009870 tx=0x7fac3401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab81dc17072c20c3 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:11.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.286+0000 7fac41ffb640 1 -- 172.21.15.46:0/3124264119 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac340a89b0 con 0x7fac440cb370 2024-01-23T09:25:11.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.286+0000 7fac41ffb640 1 -- 172.21.15.46:0/3124264119 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac340a8b10 con 0x7fac440cb370 2024-01-23T09:25:11.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.286+0000 7fac41ffb640 1 -- 172.21.15.46:0/3124264119 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac340a8ea0 con 0x7fac440cb370 2024-01-23T09:25:11.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.286+0000 7fac497f0640 1 -- 172.21.15.46:0/3124264119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac440cb370 msgr2=0x7fac44071a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:11.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.286+0000 7fac497f0640 1 --2- 172.21.15.46:0/3124264119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac440cb370 0x7fac44071a00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fac34009870 tx=0x7fac3401ecf0 comp rx=0 tx=0).stop 2024-01-23T09:25:11.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.286+0000 7fac497f0640 1 -- 172.21.15.46:0/3124264119 shutdown_connections 2024-01-23T09:25:11.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.286+0000 7fac497f0640 1 --2- 172.21.15.46:0/3124264119 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac440cb750 0x7fac4415a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:11.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.290+0000 7fac497f0640 1 --2- 172.21.15.46:0/3124264119 >> v2:172.21.15.175:3300/0 conn(0x7fac440bffd0 0x7fac44159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:11.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.290+0000 7fac497f0640 1 --2- 172.21.15.46:0/3124264119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac440cb370 0x7fac44071a00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:11.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.290+0000 7fac497f0640 1 -- 172.21.15.46:0/3124264119 >> 172.21.15.46:0/3124264119 conn(0x7fac4406d590 msgr2=0x7fac44066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:11.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.290+0000 7fac497f0640 1 -- 172.21.15.46:0/3124264119 shutdown_connections 2024-01-23T09:25:11.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.290+0000 7fac497f0640 1 -- 172.21.15.46:0/3124264119 wait complete. 2024-01-23T09:25:11.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.290+0000 7fac497f0640 1 Processor -- start 2024-01-23T09:25:11.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.290+0000 7fac497f0640 1 -- start start 2024-01-23T09:25:11.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.290+0000 7fac497f0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac440bffd0 0x7fac4414a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:11.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.290+0000 7fac497f0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac440cb370 0x7fac440c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:11.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.290+0000 7fac497f0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac440cb750 0x7fac441e21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:11.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.290+0000 7fac497f0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac441e0b20 con 0x7fac440bffd0 2024-01-23T09:25:11.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.290+0000 7fac497f0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4414aa50 con 0x7fac440cb370 2024-01-23T09:25:11.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.290+0000 7fac497f0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4414c890 con 0x7fac440cb750 2024-01-23T09:25:11.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.294+0000 7fac437fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac440cb750 0x7fac441e21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:11.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.294+0000 7fac427fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac440cb370 0x7fac440c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:11.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.294+0000 7fac437fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac440cb750 0x7fac441e21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:47952/0 (socket says 172.21.15.46:47952) 2024-01-23T09:25:11.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.294+0000 7fac437fe640 1 -- 172.21.15.46:0/412559036 learned_addr learned my addr 172.21.15.46:0/412559036 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:11.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.294+0000 7fac42ffd640 1 --2- 172.21.15.46:0/412559036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac440bffd0 0x7fac4414a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:11.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.298+0000 7fac42ffd640 1 -- 172.21.15.46:0/412559036 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac440cb750 msgr2=0x7fac441e21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:11.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.298+0000 7fac42ffd640 1 --2- 172.21.15.46:0/412559036 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac440cb750 0x7fac441e21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:11.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.298+0000 7fac42ffd640 1 -- 172.21.15.46:0/412559036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac440cb370 msgr2=0x7fac440c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:11.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.298+0000 7fac42ffd640 1 --2- 172.21.15.46:0/412559036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac440cb370 0x7fac440c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:11.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.298+0000 7fac42ffd640 1 -- 172.21.15.46:0/412559036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac340094d0 con 0x7fac440bffd0 2024-01-23T09:25:11.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.302+0000 7fac42ffd640 1 --2- 172.21.15.46:0/412559036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac440bffd0 0x7fac4414a470 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fac340af000 tx=0x7fac3401ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:11.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.306+0000 7fac2b7fe640 1 -- 172.21.15.46:0/412559036 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac340b1e10 con 0x7fac440bffd0 2024-01-23T09:25:11.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.306+0000 7fac2b7fe640 1 -- 172.21.15.46:0/412559036 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac340b9440 con 0x7fac440bffd0 2024-01-23T09:25:11.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.306+0000 7fac2b7fe640 1 -- 172.21.15.46:0/412559036 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac340b97f0 con 0x7fac440bffd0 2024-01-23T09:25:11.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.306+0000 7fac497f0640 1 -- 172.21.15.46:0/412559036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac441e1c30 con 0x7fac440bffd0 2024-01-23T09:25:11.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.306+0000 7fac497f0640 1 -- 172.21.15.46:0/412559036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac4414bf60 con 0x7fac440bffd0 2024-01-23T09:25:11.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.310+0000 7fac497f0640 1 -- 172.21.15.46:0/412559036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac44074340 con 0x7fac440bffd0 2024-01-23T09:25:11.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.330+0000 7fac2b7fe640 1 -- 172.21.15.46:0/412559036 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fac340b7070 con 0x7fac440bffd0 2024-01-23T09:25:11.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.330+0000 7fac2b7fe640 1 --2- 172.21.15.46:0/412559036 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fac30066580 0x7fac30068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:11.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.330+0000 7fac427fc640 1 --2- 172.21.15.46:0/412559036 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fac30066580 0x7fac30068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:11.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.330+0000 7fac427fc640 1 --2- 172.21.15.46:0/412559036 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fac30066580 0x7fac30068a40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fac441ed9a0 tx=0x7fac38008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:11.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.334+0000 7fac2b7fe640 1 -- 172.21.15.46:0/412559036 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fac340c3e20 con 0x7fac440bffd0 2024-01-23T09:25:11.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.630+0000 7fac2b7fe640 1 -- 172.21.15.46:0/412559036 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fac340ef450 con 0x7fac440bffd0 2024-01-23T09:25:11.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.822+0000 7fac497f0640 1 -- 172.21.15.46:0/412559036 --> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fac441599e0 con 0x7fac30066580 2024-01-23T09:25:11.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.834+0000 7fac2b7fe640 1 -- 172.21.15.46:0/412559036 <== mgr.4107 v2:172.21.15.46:6800/2324478006 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368656 (secure 0 0 0) 0x7fac380108a0 con 0x7fac30066580 2024-01-23T09:25:11.840 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T09:25:11.843 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-01-23T09:25:11.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.838+0000 7fac497f0640 1 -- 172.21.15.46:0/412559036 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fac30066580 msgr2=0x7fac30068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:11.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.838+0000 7fac497f0640 1 --2- 172.21.15.46:0/412559036 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fac30066580 0x7fac30068a40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fac441ed9a0 tx=0x7fac38008040 comp rx=0 tx=0).stop 2024-01-23T09:25:11.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.838+0000 7fac497f0640 1 -- 172.21.15.46:0/412559036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac440bffd0 msgr2=0x7fac4414a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:11.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.838+0000 7fac497f0640 1 --2- 172.21.15.46:0/412559036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac440bffd0 0x7fac4414a470 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fac340af000 tx=0x7fac3401ba90 comp rx=0 tx=0).stop 2024-01-23T09:25:11.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.838+0000 7fac497f0640 1 -- 172.21.15.46:0/412559036 shutdown_connections 2024-01-23T09:25:11.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.838+0000 7fac497f0640 1 --2- 172.21.15.46:0/412559036 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac440cb750 0x7fac441e21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:11.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.838+0000 7fac497f0640 1 --2- 172.21.15.46:0/412559036 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fac30066580 0x7fac30068a40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:11.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.838+0000 7fac497f0640 1 --2- 172.21.15.46:0/412559036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac440cb370 0x7fac440c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:11.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.838+0000 7fac497f0640 1 --2- 172.21.15.46:0/412559036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac440bffd0 0x7fac4414a470 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:11.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.838+0000 7fac497f0640 1 -- 172.21.15.46:0/412559036 >> 172.21.15.46:0/412559036 conn(0x7fac4406d590 msgr2=0x7fac4406aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:11.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.838+0000 7fac497f0640 1 -- 172.21.15.46:0/412559036 shutdown_connections 2024-01-23T09:25:11.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:11.838+0000 7fac497f0640 1 -- 172.21.15.46:0/412559036 wait complete. 2024-01-23T09:25:11.860 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":963,"stamp":"2024-01-23T09:25:11.376655+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23779489,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":635,"num_read_kb":642,"num_write":7834,"num_write_kb":280431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9023,"ondisk_log_size":9023,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":302760,"kb_used_data":49192,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754671960,"statfs":{"total":773094113280,"available":772784087040,"internally_reserved":0,"allocated":50372608,"data_stored":48606202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1372,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004663"},"pg_stats":[{"pgid":"2.1f","version":"30'621","reported_seq":656,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:53.809154+0000","last_change":"2024-01-23T08:54:40.661700+0000","last_active":"2024-01-23T09:23:53.809154+0000","last_peered":"2024-01-23T09:23:53.809154+0000","last_clean":"2024-01-23T09:23:53.809154+0000","last_became_active":"2024-01-23T08:54:40.660901+0000","last_became_peered":"2024-01-23T08:54:40.660901+0000","last_unstale":"2024-01-23T09:23:53.809154+0000","last_undegraded":"2024-01-23T09:23:53.809154+0000","last_fullsized":"2024-01-23T09:23:53.809154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:59:22.804479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":621,"num_write_kb":4439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"30'17","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.608355+0000","last_change":"2024-01-23T08:54:42.159130+0000","last_active":"2024-01-23T09:25:03.608355+0000","last_peered":"2024-01-23T09:25:03.608355+0000","last_clean":"2024-01-23T09:25:03.608355+0000","last_became_active":"2024-01-23T08:54:42.158776+0000","last_became_peered":"2024-01-23T08:54:42.158776+0000","last_unstale":"2024-01-23T09:25:03.608355+0000","last_undegraded":"2024-01-23T09:25:03.608355+0000","last_fullsized":"2024-01-23T09:25:03.608355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:06.320845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"30'65","reported_seq":92,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:53.759886+0000","last_change":"2024-01-23T08:54:49.752558+0000","last_active":"2024-01-23T09:23:53.759886+0000","last_peered":"2024-01-23T09:23:53.759886+0000","last_clean":"2024-01-23T09:23:53.759886+0000","last_became_active":"2024-01-23T08:54:49.752077+0000","last_became_peered":"2024-01-23T08:54:49.752077+0000","last_unstale":"2024-01-23T09:23:53.759886+0000","last_undegraded":"2024-01-23T09:23:53.759886+0000","last_fullsized":"2024-01-23T09:23:53.759886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:20:50.653881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":3048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"30'229","reported_seq":265,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.245082+0000","last_change":"2024-01-23T08:54:40.700164+0000","last_active":"2024-01-23T09:25:03.245082+0000","last_peered":"2024-01-23T09:25:03.245082+0000","last_clean":"2024-01-23T09:25:03.245082+0000","last_became_active":"2024-01-23T08:54:40.699449+0000","last_became_peered":"2024-01-23T08:54:40.699449+0000","last_unstale":"2024-01-23T09:25:03.245082+0000","last_undegraded":"2024-01-23T09:25:03.245082+0000","last_fullsized":"2024-01-23T09:25:03.245082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:16:32.814250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2084932,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":2149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"30'24","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.647865+0000","last_change":"2024-01-23T08:54:42.092833+0000","last_active":"2024-01-23T09:25:03.647865+0000","last_peered":"2024-01-23T09:25:03.647865+0000","last_clean":"2024-01-23T09:25:03.647865+0000","last_became_active":"2024-01-23T08:54:42.091950+0000","last_became_peered":"2024-01-23T08:54:42.091950+0000","last_unstale":"2024-01-23T09:25:03.647865+0000","last_undegraded":"2024-01-23T09:25:03.647865+0000","last_fullsized":"2024-01-23T09:25:03.647865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:46.594970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"30'80","reported_seq":107,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:48.744170+0000","last_change":"2024-01-23T08:54:49.747131+0000","last_active":"2024-01-23T09:23:48.744170+0000","last_peered":"2024-01-23T09:23:48.744170+0000","last_clean":"2024-01-23T09:23:48.744170+0000","last_became_active":"2024-01-23T08:54:49.746481+0000","last_became_peered":"2024-01-23T08:54:49.746481+0000","last_unstale":"2024-01-23T09:23:48.744170+0000","last_undegraded":"2024-01-23T09:23:48.744170+0000","last_fullsized":"2024-01-23T09:23:48.744170+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:45:19.670524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":5137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"30'18","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:43.591688+0000","last_change":"2024-01-23T08:54:40.687614+0000","last_active":"2024-01-23T09:24:43.591688+0000","last_peered":"2024-01-23T09:24:43.591688+0000","last_clean":"2024-01-23T09:24:43.591688+0000","last_became_active":"2024-01-23T08:54:40.687234+0000","last_became_peered":"2024-01-23T08:54:40.687234+0000","last_unstale":"2024-01-23T09:24:43.591688+0000","last_undegraded":"2024-01-23T09:24:43.591688+0000","last_fullsized":"2024-01-23T09:24:43.591688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:54:17.627706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"30'21","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.689092+0000","last_change":"2024-01-23T08:55:47.540221+0000","last_active":"2024-01-23T09:25:03.689092+0000","last_peered":"2024-01-23T09:25:03.689092+0000","last_clean":"2024-01-23T09:25:03.689092+0000","last_became_active":"2024-01-23T08:55:47.539657+0000","last_became_peered":"2024-01-23T08:55:47.539657+0000","last_unstale":"2024-01-23T09:25:03.689092+0000","last_undegraded":"2024-01-23T09:25:03.689092+0000","last_fullsized":"2024-01-23T09:25:03.689092+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:19.147334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"30'86","reported_seq":113,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:56.638456+0000","last_change":"2024-01-23T08:54:49.747332+0000","last_active":"2024-01-23T09:23:56.638456+0000","last_peered":"2024-01-23T09:23:56.638456+0000","last_clean":"2024-01-23T09:23:56.638456+0000","last_became_active":"2024-01-23T08:54:49.746474+0000","last_became_peered":"2024-01-23T08:54:49.746474+0000","last_unstale":"2024-01-23T09:23:56.638456+0000","last_undegraded":"2024-01-23T09:23:56.638456+0000","last_fullsized":"2024-01-23T09:23:56.638456+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:28:57.975606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":12223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"30'8","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:48.167428+0000","last_change":"2024-01-23T08:54:40.687290+0000","last_active":"2024-01-23T09:24:48.167428+0000","last_peered":"2024-01-23T09:24:48.167428+0000","last_clean":"2024-01-23T09:24:48.167428+0000","last_became_active":"2024-01-23T08:54:40.686903+0000","last_became_peered":"2024-01-23T08:54:40.686903+0000","last_unstale":"2024-01-23T09:24:48.167428+0000","last_undegraded":"2024-01-23T09:24:48.167428+0000","last_fullsized":"2024-01-23T09:24:48.167428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:57:23.064188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"30'36","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.725842+0000","last_change":"2024-01-23T08:54:42.109485+0000","last_active":"2024-01-23T09:25:03.725842+0000","last_peered":"2024-01-23T09:25:03.725842+0000","last_clean":"2024-01-23T09:25:03.725842+0000","last_became_active":"2024-01-23T08:54:42.108182+0000","last_became_peered":"2024-01-23T08:54:42.108182+0000","last_unstale":"2024-01-23T09:25:03.725842+0000","last_undegraded":"2024-01-23T09:25:03.725842+0000","last_fullsized":"2024-01-23T09:25:03.725842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:51:12.417589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"30'61","reported_seq":88,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:55.602368+0000","last_change":"2024-01-23T08:54:49.747949+0000","last_active":"2024-01-23T09:23:55.602368+0000","last_peered":"2024-01-23T09:23:55.602368+0000","last_clean":"2024-01-23T09:23:55.602368+0000","last_became_active":"2024-01-23T08:54:49.746880+0000","last_became_peered":"2024-01-23T08:54:49.746880+0000","last_unstale":"2024-01-23T09:23:55.602368+0000","last_undegraded":"2024-01-23T09:23:55.602368+0000","last_fullsized":"2024-01-23T09:23:55.602368+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:54:26.728005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":7433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"30'19","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.725334+0000","last_change":"2024-01-23T08:54:42.088786+0000","last_active":"2024-01-23T09:25:03.725334+0000","last_peered":"2024-01-23T09:25:03.725334+0000","last_clean":"2024-01-23T09:25:03.725334+0000","last_became_active":"2024-01-23T08:54:42.088068+0000","last_became_peered":"2024-01-23T08:54:42.088068+0000","last_unstale":"2024-01-23T09:25:03.725334+0000","last_undegraded":"2024-01-23T09:25:03.725334+0000","last_fullsized":"2024-01-23T09:25:03.725334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:38:41.382732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"30'671","reported_seq":705,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:41.735844+0000","last_change":"2024-01-23T08:54:40.612044+0000","last_active":"2024-01-23T09:24:41.735844+0000","last_peered":"2024-01-23T09:24:41.735844+0000","last_clean":"2024-01-23T09:24:41.735844+0000","last_became_active":"2024-01-23T08:54:40.611589+0000","last_became_peered":"2024-01-23T08:54:40.611589+0000","last_unstale":"2024-01-23T09:24:41.735844+0000","last_undegraded":"2024-01-23T09:24:41.735844+0000","last_fullsized":"2024-01-23T09:24:41.735844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:36.177844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":666,"num_write_kb":4421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'70","reported_seq":98,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:57.942928+0000","last_change":"2024-01-23T08:54:49.716713+0000","last_active":"2024-01-23T09:23:57.942928+0000","last_peered":"2024-01-23T09:23:57.942928+0000","last_clean":"2024-01-23T09:23:57.942928+0000","last_became_active":"2024-01-23T08:54:49.715843+0000","last_became_peered":"2024-01-23T08:54:49.715843+0000","last_unstale":"2024-01-23T09:23:57.942928+0000","last_undegraded":"2024-01-23T09:23:57.942928+0000","last_fullsized":"2024-01-23T09:23:57.942928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:46:24.157230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":10371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"30'21","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.634669+0000","last_change":"2024-01-23T08:54:42.230199+0000","last_active":"2024-01-23T09:25:03.634669+0000","last_peered":"2024-01-23T09:25:03.634669+0000","last_clean":"2024-01-23T09:25:03.634669+0000","last_became_active":"2024-01-23T08:54:42.229547+0000","last_became_peered":"2024-01-23T08:54:42.229547+0000","last_unstale":"2024-01-23T09:25:03.634669+0000","last_undegraded":"2024-01-23T09:25:03.634669+0000","last_fullsized":"2024-01-23T09:25:03.634669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:07:07.781698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"30'4","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:22:56.793323+0000","last_change":"2024-01-23T08:54:40.688971+0000","last_active":"2024-01-23T09:22:56.793323+0000","last_peered":"2024-01-23T09:22:56.793323+0000","last_clean":"2024-01-23T09:22:56.793323+0000","last_became_active":"2024-01-23T08:54:40.688230+0000","last_became_peered":"2024-01-23T08:54:40.688230+0000","last_unstale":"2024-01-23T09:22:56.793323+0000","last_undegraded":"2024-01-23T09:22:56.793323+0000","last_fullsized":"2024-01-23T09:22:56.793323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:40:12.245110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"30'94","reported_seq":122,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:58.826706+0000","last_change":"2024-01-23T08:54:49.748471+0000","last_active":"2024-01-23T09:23:58.826706+0000","last_peered":"2024-01-23T09:23:58.826706+0000","last_clean":"2024-01-23T09:23:58.826706+0000","last_became_active":"2024-01-23T08:54:49.747958+0000","last_became_peered":"2024-01-23T08:54:49.747958+0000","last_unstale":"2024-01-23T09:23:58.826706+0000","last_undegraded":"2024-01-23T09:23:58.826706+0000","last_fullsized":"2024-01-23T09:23:58.826706+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:46:36.583078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":8657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"30'23","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.718611+0000","last_change":"2024-01-23T08:54:42.194148+0000","last_active":"2024-01-23T09:25:03.718611+0000","last_peered":"2024-01-23T09:25:03.718611+0000","last_clean":"2024-01-23T09:25:03.718611+0000","last_became_active":"2024-01-23T08:54:42.193403+0000","last_became_peered":"2024-01-23T08:54:42.193403+0000","last_unstale":"2024-01-23T09:25:03.718611+0000","last_undegraded":"2024-01-23T09:25:03.718611+0000","last_fullsized":"2024-01-23T09:25:03.718611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:38:42.543776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"30'11","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:48.195751+0000","last_change":"2024-01-23T08:54:40.688897+0000","last_active":"2024-01-23T09:24:48.195751+0000","last_peered":"2024-01-23T09:24:48.195751+0000","last_clean":"2024-01-23T09:24:48.195751+0000","last_became_active":"2024-01-23T08:54:40.688122+0000","last_became_peered":"2024-01-23T08:54:40.688122+0000","last_unstale":"2024-01-23T09:24:48.195751+0000","last_undegraded":"2024-01-23T09:24:48.195751+0000","last_fullsized":"2024-01-23T09:24:48.195751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:19:16.760424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'73","reported_seq":101,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:57.989453+0000","last_change":"2024-01-23T08:54:49.738331+0000","last_active":"2024-01-23T09:23:57.989453+0000","last_peered":"2024-01-23T09:23:57.989453+0000","last_clean":"2024-01-23T09:23:57.989453+0000","last_became_active":"2024-01-23T08:54:49.737442+0000","last_became_peered":"2024-01-23T08:54:49.737442+0000","last_unstale":"2024-01-23T09:23:57.989453+0000","last_undegraded":"2024-01-23T09:23:57.989453+0000","last_fullsized":"2024-01-23T09:23:57.989453+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:59:20.106849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":10395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"30'19","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.549005+0000","last_change":"2024-01-23T08:54:42.192681+0000","last_active":"2024-01-23T09:25:03.549005+0000","last_peered":"2024-01-23T09:25:03.549005+0000","last_clean":"2024-01-23T09:25:03.549005+0000","last_became_active":"2024-01-23T08:54:42.192225+0000","last_became_peered":"2024-01-23T08:54:42.192225+0000","last_unstale":"2024-01-23T09:25:03.549005+0000","last_undegraded":"2024-01-23T09:25:03.549005+0000","last_fullsized":"2024-01-23T09:25:03.549005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:20:26.263299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"30'7","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:41.715962+0000","last_change":"2024-01-23T08:54:40.686987+0000","last_active":"2024-01-23T09:24:41.715962+0000","last_peered":"2024-01-23T09:24:41.715962+0000","last_clean":"2024-01-23T09:24:41.715962+0000","last_became_active":"2024-01-23T08:54:40.686654+0000","last_became_peered":"2024-01-23T08:54:40.686654+0000","last_unstale":"2024-01-23T09:24:41.715962+0000","last_undegraded":"2024-01-23T09:24:41.715962+0000","last_fullsized":"2024-01-23T09:24:41.715962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:43:26.442461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"30'83","reported_seq":111,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:56.641319+0000","last_change":"2024-01-23T08:54:49.736471+0000","last_active":"2024-01-23T09:23:56.641319+0000","last_peered":"2024-01-23T09:23:56.641319+0000","last_clean":"2024-01-23T09:23:56.641319+0000","last_became_active":"2024-01-23T08:54:49.735971+0000","last_became_peered":"2024-01-23T08:54:49.735971+0000","last_unstale":"2024-01-23T09:23:56.641319+0000","last_undegraded":"2024-01-23T09:23:56.641319+0000","last_fullsized":"2024-01-23T09:23:56.641319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:18:10.354308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":6293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"30'30","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.734411+0000","last_change":"2024-01-23T08:54:42.195854+0000","last_active":"2024-01-23T09:25:03.734411+0000","last_peered":"2024-01-23T09:25:03.734411+0000","last_clean":"2024-01-23T09:25:03.734411+0000","last_became_active":"2024-01-23T08:54:42.195052+0000","last_became_peered":"2024-01-23T08:54:42.195052+0000","last_unstale":"2024-01-23T09:25:03.734411+0000","last_undegraded":"2024-01-23T09:25:03.734411+0000","last_fullsized":"2024-01-23T09:25:03.734411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:54:18.859903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"30'9","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:43.336973+0000","last_change":"2024-01-23T08:54:40.694194+0000","last_active":"2024-01-23T09:24:43.336973+0000","last_peered":"2024-01-23T09:24:43.336973+0000","last_clean":"2024-01-23T09:24:43.336973+0000","last_became_active":"2024-01-23T08:54:40.693610+0000","last_became_peered":"2024-01-23T08:54:40.693610+0000","last_unstale":"2024-01-23T09:24:43.336973+0000","last_undegraded":"2024-01-23T09:24:43.336973+0000","last_fullsized":"2024-01-23T09:24:43.336973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:47:30.746915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"30'40","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:51.975770+0000","last_change":"2024-01-23T08:54:49.747205+0000","last_active":"2024-01-23T09:23:51.975770+0000","last_peered":"2024-01-23T09:23:51.975770+0000","last_clean":"2024-01-23T09:23:51.975770+0000","last_became_active":"2024-01-23T08:54:49.746792+0000","last_became_peered":"2024-01-23T08:54:49.746792+0000","last_unstale":"2024-01-23T09:23:51.975770+0000","last_undegraded":"2024-01-23T09:23:51.975770+0000","last_fullsized":"2024-01-23T09:23:51.975770+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:58:42.245045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":6755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.751593+0000","last_change":"2024-01-23T08:54:42.233783+0000","last_active":"2024-01-23T09:25:03.751593+0000","last_peered":"2024-01-23T09:25:03.751593+0000","last_clean":"2024-01-23T09:25:03.751593+0000","last_became_active":"2024-01-23T08:54:42.233018+0000","last_became_peered":"2024-01-23T08:54:42.233018+0000","last_unstale":"2024-01-23T09:25:03.751593+0000","last_undegraded":"2024-01-23T09:25:03.751593+0000","last_fullsized":"2024-01-23T09:25:03.751593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:04:58.998914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"30'336","reported_seq":371,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:02.817611+0000","last_change":"2024-01-23T08:54:40.690385+0000","last_active":"2024-01-23T09:25:02.817611+0000","last_peered":"2024-01-23T09:25:02.817611+0000","last_clean":"2024-01-23T09:25:02.817611+0000","last_became_active":"2024-01-23T08:54:40.689528+0000","last_became_peered":"2024-01-23T08:54:40.689528+0000","last_unstale":"2024-01-23T09:25:02.817611+0000","last_undegraded":"2024-01-23T09:25:02.817611+0000","last_fullsized":"2024-01-23T09:25:02.817611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:59:11.006550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":906,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"30'90","reported_seq":120,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:56.578837+0000","last_change":"2024-01-23T08:54:49.731870+0000","last_active":"2024-01-23T09:23:56.578837+0000","last_peered":"2024-01-23T09:23:56.578837+0000","last_clean":"2024-01-23T09:23:56.578837+0000","last_became_active":"2024-01-23T08:54:49.731414+0000","last_became_peered":"2024-01-23T08:54:49.731414+0000","last_unstale":"2024-01-23T09:23:56.578837+0000","last_undegraded":"2024-01-23T09:23:56.578837+0000","last_fullsized":"2024-01-23T09:23:56.578837+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:30.315625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":11197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.581262+0000","last_change":"2024-01-23T08:54:42.227885+0000","last_active":"2024-01-23T09:25:03.581262+0000","last_peered":"2024-01-23T09:25:03.581262+0000","last_clean":"2024-01-23T09:25:03.581262+0000","last_became_active":"2024-01-23T08:54:42.227188+0000","last_became_peered":"2024-01-23T08:54:42.227188+0000","last_unstale":"2024-01-23T09:25:03.581262+0000","last_undegraded":"2024-01-23T09:25:03.581262+0000","last_fullsized":"2024-01-23T09:25:03.581262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:02:13.790208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"30'7","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:43.848650+0000","last_change":"2024-01-23T08:54:40.658365+0000","last_active":"2024-01-23T09:24:43.848650+0000","last_peered":"2024-01-23T09:24:43.848650+0000","last_clean":"2024-01-23T09:24:43.848650+0000","last_became_active":"2024-01-23T08:54:40.657616+0000","last_became_peered":"2024-01-23T08:54:40.657616+0000","last_unstale":"2024-01-23T09:24:43.848650+0000","last_undegraded":"2024-01-23T09:24:43.848650+0000","last_fullsized":"2024-01-23T09:24:43.848650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:23:50.053046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"30'59","reported_seq":88,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:58.800322+0000","last_change":"2024-01-23T08:54:49.739474+0000","last_active":"2024-01-23T09:23:58.800322+0000","last_peered":"2024-01-23T09:23:58.800322+0000","last_clean":"2024-01-23T09:23:58.800322+0000","last_became_active":"2024-01-23T08:54:49.738579+0000","last_became_peered":"2024-01-23T08:54:49.738579+0000","last_unstale":"2024-01-23T09:23:58.800322+0000","last_undegraded":"2024-01-23T09:23:58.800322+0000","last_fullsized":"2024-01-23T09:23:58.800322+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:23:32.238072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":6541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"30'19","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.748715+0000","last_change":"2024-01-23T08:54:42.228302+0000","last_active":"2024-01-23T09:25:03.748715+0000","last_peered":"2024-01-23T09:25:03.748715+0000","last_clean":"2024-01-23T09:25:03.748715+0000","last_became_active":"2024-01-23T08:54:42.227558+0000","last_became_peered":"2024-01-23T08:54:42.227558+0000","last_unstale":"2024-01-23T09:25:03.748715+0000","last_undegraded":"2024-01-23T09:25:03.748715+0000","last_fullsized":"2024-01-23T09:25:03.748715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:19:17.992621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:24.630053+0000","last_change":"2024-01-23T08:54:40.697453+0000","last_active":"2024-01-23T09:24:24.630053+0000","last_peered":"2024-01-23T09:24:24.630053+0000","last_clean":"2024-01-23T09:24:24.630053+0000","last_became_active":"2024-01-23T08:54:40.696688+0000","last_became_peered":"2024-01-23T08:54:40.696688+0000","last_unstale":"2024-01-23T09:24:24.630053+0000","last_undegraded":"2024-01-23T09:24:24.630053+0000","last_fullsized":"2024-01-23T09:24:24.630053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:59:22.804479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'81","reported_seq":110,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:57.989602+0000","last_change":"2024-01-23T08:54:49.726678+0000","last_active":"2024-01-23T09:23:57.989602+0000","last_peered":"2024-01-23T09:23:57.989602+0000","last_clean":"2024-01-23T09:23:57.989602+0000","last_became_active":"2024-01-23T08:54:49.725830+0000","last_became_peered":"2024-01-23T08:54:49.725830+0000","last_unstale":"2024-01-23T09:23:57.989602+0000","last_undegraded":"2024-01-23T09:23:57.989602+0000","last_fullsized":"2024-01-23T09:23:57.989602+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:12:34.009779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":6498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.867420+0000","last_change":"2024-01-23T08:54:42.149751+0000","last_active":"2024-01-23T09:25:03.867420+0000","last_peered":"2024-01-23T09:25:03.867420+0000","last_clean":"2024-01-23T09:25:03.867420+0000","last_became_active":"2024-01-23T08:54:42.149019+0000","last_became_peered":"2024-01-23T08:54:42.149019+0000","last_unstale":"2024-01-23T09:25:03.867420+0000","last_undegraded":"2024-01-23T09:25:03.867420+0000","last_fullsized":"2024-01-23T09:25:03.867420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:38:36.083606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"30'8","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:26.661016+0000","last_change":"2024-01-23T08:54:40.680243+0000","last_active":"2024-01-23T09:24:26.661016+0000","last_peered":"2024-01-23T09:24:26.661016+0000","last_clean":"2024-01-23T09:24:26.661016+0000","last_became_active":"2024-01-23T08:54:40.679839+0000","last_became_peered":"2024-01-23T08:54:40.679839+0000","last_unstale":"2024-01-23T09:24:26.661016+0000","last_undegraded":"2024-01-23T09:24:26.661016+0000","last_fullsized":"2024-01-23T09:24:26.661016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:38:34.851409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"30'52","reported_seq":90,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:54.728488+0000","last_change":"2024-01-23T08:55:47.750803+0000","last_active":"2024-01-23T09:23:54.728488+0000","last_peered":"2024-01-23T09:23:54.728488+0000","last_clean":"2024-01-23T09:23:54.728488+0000","last_became_active":"2024-01-23T08:55:47.749227+0000","last_became_peered":"2024-01-23T08:55:47.749227+0000","last_unstale":"2024-01-23T09:23:54.728488+0000","last_undegraded":"2024-01-23T09:23:54.728488+0000","last_fullsized":"2024-01-23T09:23:54.728488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:52:35.422787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":3470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,5],"acting":[6,7,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"30'22","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.609765+0000","last_change":"2024-01-23T08:54:42.108793+0000","last_active":"2024-01-23T09:25:03.609765+0000","last_peered":"2024-01-23T09:25:03.609765+0000","last_clean":"2024-01-23T09:25:03.609765+0000","last_became_active":"2024-01-23T08:54:42.108346+0000","last_became_peered":"2024-01-23T08:54:42.108346+0000","last_unstale":"2024-01-23T09:25:03.609765+0000","last_undegraded":"2024-01-23T09:25:03.609765+0000","last_fullsized":"2024-01-23T09:25:03.609765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:18:02.486206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"30'534","reported_seq":1088,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:00.345864+0000","last_change":"2024-01-23T08:54:40.708494+0000","last_active":"2024-01-23T09:25:00.345864+0000","last_peered":"2024-01-23T09:25:00.345864+0000","last_clean":"2024-01-23T09:25:00.345864+0000","last_became_active":"2024-01-23T08:54:40.707841+0000","last_became_peered":"2024-01-23T08:54:40.707841+0000","last_unstale":"2024-01-23T09:25:00.345864+0000","last_undegraded":"2024-01-23T09:25:00.345864+0000","last_fullsized":"2024-01-23T09:25:00.345864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":534,"log_dups_size":0,"ondisk_log_size":534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:53:17.764440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123944,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":519,"num_read_kb":542,"num_write":528,"num_write_kb":547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"30'72","reported_seq":100,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:53.728690+0000","last_change":"2024-01-23T08:54:49.738198+0000","last_active":"2024-01-23T09:23:53.728690+0000","last_peered":"2024-01-23T09:23:53.728690+0000","last_clean":"2024-01-23T09:23:53.728690+0000","last_became_active":"2024-01-23T08:54:49.737677+0000","last_became_peered":"2024-01-23T08:54:49.737677+0000","last_unstale":"2024-01-23T09:23:53.728690+0000","last_undegraded":"2024-01-23T09:23:53.728690+0000","last_fullsized":"2024-01-23T09:23:53.728690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:57:26.436916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"30'12","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.591042+0000","last_change":"2024-01-23T08:54:42.228222+0000","last_active":"2024-01-23T09:25:03.591042+0000","last_peered":"2024-01-23T09:25:03.591042+0000","last_clean":"2024-01-23T09:25:03.591042+0000","last_became_active":"2024-01-23T08:54:42.227335+0000","last_became_peered":"2024-01-23T08:54:42.227335+0000","last_unstale":"2024-01-23T09:25:03.591042+0000","last_undegraded":"2024-01-23T09:25:03.591042+0000","last_fullsized":"2024-01-23T09:25:03.591042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:29:51.842390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"30'11","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:52.504714+0000","last_change":"2024-01-23T08:54:40.679852+0000","last_active":"2024-01-23T09:24:52.504714+0000","last_peered":"2024-01-23T09:24:52.504714+0000","last_clean":"2024-01-23T09:24:52.504714+0000","last_became_active":"2024-01-23T08:54:40.679467+0000","last_became_peered":"2024-01-23T08:54:40.679467+0000","last_unstale":"2024-01-23T09:24:52.504714+0000","last_undegraded":"2024-01-23T09:24:52.504714+0000","last_fullsized":"2024-01-23T09:24:52.504714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:17.915137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"30'96","reported_seq":125,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:57.955841+0000","last_change":"2024-01-23T08:54:49.730538+0000","last_active":"2024-01-23T09:23:57.955841+0000","last_peered":"2024-01-23T09:23:57.955841+0000","last_clean":"2024-01-23T09:23:57.955841+0000","last_became_active":"2024-01-23T08:54:49.729861+0000","last_became_peered":"2024-01-23T08:54:49.729861+0000","last_unstale":"2024-01-23T09:23:57.955841+0000","last_undegraded":"2024-01-23T09:23:57.955841+0000","last_fullsized":"2024-01-23T09:23:57.955841+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:46:36.583078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":9432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.718567+0000","last_change":"2024-01-23T08:54:42.196505+0000","last_active":"2024-01-23T09:25:03.718567+0000","last_peered":"2024-01-23T09:25:03.718567+0000","last_clean":"2024-01-23T09:25:03.718567+0000","last_became_active":"2024-01-23T08:54:42.195555+0000","last_became_peered":"2024-01-23T08:54:42.195555+0000","last_unstale":"2024-01-23T09:25:03.718567+0000","last_undegraded":"2024-01-23T09:25:03.718567+0000","last_fullsized":"2024-01-23T09:25:03.718567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:57:24.296384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"30'8","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:20.572206+0000","last_change":"2024-01-23T08:54:40.612594+0000","last_active":"2024-01-23T09:24:20.572206+0000","last_peered":"2024-01-23T09:24:20.572206+0000","last_clean":"2024-01-23T09:24:20.572206+0000","last_became_active":"2024-01-23T08:54:40.611932+0000","last_became_peered":"2024-01-23T08:54:40.611932+0000","last_unstale":"2024-01-23T09:24:20.572206+0000","last_undegraded":"2024-01-23T09:24:20.572206+0000","last_fullsized":"2024-01-23T09:24:20.572206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:05.088648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:22:08.761197+0000","last_change":"2024-01-23T08:54:01.491195+0000","last_active":"2024-01-23T09:22:08.761197+0000","last_peered":"2024-01-23T09:22:08.761197+0000","last_clean":"2024-01-23T09:22:08.761197+0000","last_became_active":"2024-01-23T08:54:01.490869+0000","last_became_peered":"2024-01-23T08:54:01.490869+0000","last_unstale":"2024-01-23T09:22:08.761197+0000","last_undegraded":"2024-01-23T09:22:08.761197+0000","last_fullsized":"2024-01-23T09:22:08.761197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:53:59.492955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:53:59.492955+0000","last_clean_scrub_stamp":"2024-01-23T08:53:59.492955+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:18:58.446726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"30'73","reported_seq":102,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:58.745460+0000","last_change":"2024-01-23T08:54:49.716297+0000","last_active":"2024-01-23T09:23:58.745460+0000","last_peered":"2024-01-23T09:23:58.745460+0000","last_clean":"2024-01-23T09:23:58.745460+0000","last_became_active":"2024-01-23T08:54:49.715231+0000","last_became_peered":"2024-01-23T08:54:49.715231+0000","last_unstale":"2024-01-23T09:23:58.745460+0000","last_undegraded":"2024-01-23T09:23:58.745460+0000","last_fullsized":"2024-01-23T09:23:58.745460+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:17:59.837409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.725996+0000","last_change":"2024-01-23T08:54:42.089174+0000","last_active":"2024-01-23T09:25:03.725996+0000","last_peered":"2024-01-23T09:25:03.725996+0000","last_clean":"2024-01-23T09:25:03.725996+0000","last_became_active":"2024-01-23T08:54:42.088303+0000","last_became_peered":"2024-01-23T08:54:42.088303+0000","last_unstale":"2024-01-23T09:25:03.725996+0000","last_undegraded":"2024-01-23T09:25:03.725996+0000","last_fullsized":"2024-01-23T09:25:03.725996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:06:49.326117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"30'9","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:53.537619+0000","last_change":"2024-01-23T08:54:40.690720+0000","last_active":"2024-01-23T09:24:53.537619+0000","last_peered":"2024-01-23T09:24:53.537619+0000","last_clean":"2024-01-23T09:24:53.537619+0000","last_became_active":"2024-01-23T08:54:40.689895+0000","last_became_peered":"2024-01-23T08:54:40.689895+0000","last_unstale":"2024-01-23T09:24:53.537619+0000","last_undegraded":"2024-01-23T09:24:53.537619+0000","last_fullsized":"2024-01-23T09:24:53.537619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:33:12.542607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1751,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"30'84","reported_seq":112,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:52.014886+0000","last_change":"2024-01-23T08:54:49.736539+0000","last_active":"2024-01-23T09:23:52.014886+0000","last_peered":"2024-01-23T09:23:52.014886+0000","last_clean":"2024-01-23T09:23:52.014886+0000","last_became_active":"2024-01-23T08:54:49.735777+0000","last_became_peered":"2024-01-23T08:54:49.735777+0000","last_unstale":"2024-01-23T09:23:52.014886+0000","last_undegraded":"2024-01-23T09:23:52.014886+0000","last_fullsized":"2024-01-23T09:23:52.014886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:05:06.867017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":8939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'22","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.866868+0000","last_change":"2024-01-23T08:54:42.107066+0000","last_active":"2024-01-23T09:25:03.866868+0000","last_peered":"2024-01-23T09:25:03.866868+0000","last_clean":"2024-01-23T09:25:03.866868+0000","last_became_active":"2024-01-23T08:54:42.106757+0000","last_became_peered":"2024-01-23T08:54:42.106757+0000","last_unstale":"2024-01-23T09:25:03.866868+0000","last_undegraded":"2024-01-23T09:25:03.866868+0000","last_fullsized":"2024-01-23T09:25:03.866868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:47:31.979111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"30'7","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:46.123009+0000","last_change":"2024-01-23T08:54:40.687942+0000","last_active":"2024-01-23T09:24:46.123009+0000","last_peered":"2024-01-23T09:24:46.123009+0000","last_clean":"2024-01-23T09:24:46.123009+0000","last_became_active":"2024-01-23T08:54:40.686860+0000","last_became_peered":"2024-01-23T08:54:40.686860+0000","last_unstale":"2024-01-23T09:24:46.123009+0000","last_undegraded":"2024-01-23T09:24:46.123009+0000","last_fullsized":"2024-01-23T09:24:46.123009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:04:57.766717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'92","reported_seq":120,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:55.592422+0000","last_change":"2024-01-23T08:54:49.727416+0000","last_active":"2024-01-23T09:23:55.592422+0000","last_peered":"2024-01-23T09:23:55.592422+0000","last_clean":"2024-01-23T09:23:55.592422+0000","last_became_active":"2024-01-23T08:54:49.721494+0000","last_became_peered":"2024-01-23T08:54:49.721494+0000","last_unstale":"2024-01-23T09:23:55.592422+0000","last_undegraded":"2024-01-23T09:23:55.592422+0000","last_fullsized":"2024-01-23T09:23:55.592422+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:52:20.767279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":9285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"30'25","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.873759+0000","last_change":"2024-01-23T08:54:42.117785+0000","last_active":"2024-01-23T09:25:03.873759+0000","last_peered":"2024-01-23T09:25:03.873759+0000","last_clean":"2024-01-23T09:25:03.873759+0000","last_became_active":"2024-01-23T08:54:42.117317+0000","last_became_peered":"2024-01-23T08:54:42.117317+0000","last_unstale":"2024-01-23T09:25:03.873759+0000","last_undegraded":"2024-01-23T09:25:03.873759+0000","last_fullsized":"2024-01-23T09:25:03.873759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:48:28.943781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"30'7","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:19.375993+0000","last_change":"2024-01-23T08:54:40.682656+0000","last_active":"2024-01-23T09:24:19.375993+0000","last_peered":"2024-01-23T09:24:19.375993+0000","last_clean":"2024-01-23T09:24:19.375993+0000","last_became_active":"2024-01-23T08:54:40.681954+0000","last_became_peered":"2024-01-23T08:54:40.681954+0000","last_unstale":"2024-01-23T09:24:19.375993+0000","last_undegraded":"2024-01-23T09:24:19.375993+0000","last_fullsized":"2024-01-23T09:24:19.375993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:20:41.553582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"30'57","reported_seq":86,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:58.796561+0000","last_change":"2024-01-23T08:54:49.716316+0000","last_active":"2024-01-23T09:23:58.796561+0000","last_peered":"2024-01-23T09:23:58.796561+0000","last_clean":"2024-01-23T09:23:58.796561+0000","last_became_active":"2024-01-23T08:54:49.715917+0000","last_became_peered":"2024-01-23T08:54:49.715917+0000","last_unstale":"2024-01-23T09:23:58.796561+0000","last_undegraded":"2024-01-23T09:23:58.796561+0000","last_fullsized":"2024-01-23T09:23:58.796561+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:56:01.803823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":5210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"30'17","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.754214+0000","last_change":"2024-01-23T08:54:42.158814+0000","last_active":"2024-01-23T09:25:03.754214+0000","last_peered":"2024-01-23T09:25:03.754214+0000","last_clean":"2024-01-23T09:25:03.754214+0000","last_became_active":"2024-01-23T08:54:42.155411+0000","last_became_peered":"2024-01-23T08:54:42.155411+0000","last_unstale":"2024-01-23T09:25:03.754214+0000","last_undegraded":"2024-01-23T09:25:03.754214+0000","last_fullsized":"2024-01-23T09:25:03.754214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:28:02.074838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"30'5","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:30.102947+0000","last_change":"2024-01-23T08:54:40.696522+0000","last_active":"2024-01-23T09:24:30.102947+0000","last_peered":"2024-01-23T09:24:30.102947+0000","last_clean":"2024-01-23T09:24:30.102947+0000","last_became_active":"2024-01-23T08:54:40.696128+0000","last_became_peered":"2024-01-23T08:54:40.696128+0000","last_unstale":"2024-01-23T09:24:30.102947+0000","last_undegraded":"2024-01-23T09:24:30.102947+0000","last_fullsized":"2024-01-23T09:24:30.102947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:18:01.254009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"30'112","reported_seq":141,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:58.805307+0000","last_change":"2024-01-23T08:54:49.724660+0000","last_active":"2024-01-23T09:23:58.805307+0000","last_peered":"2024-01-23T09:23:58.805307+0000","last_clean":"2024-01-23T09:23:58.805307+0000","last_became_active":"2024-01-23T08:54:49.723038+0000","last_became_peered":"2024-01-23T08:54:49.723038+0000","last_unstale":"2024-01-23T09:23:58.805307+0000","last_undegraded":"2024-01-23T09:23:58.805307+0000","last_fullsized":"2024-01-23T09:23:58.805307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:20:50.653881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":12618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"30'22","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.725027+0000","last_change":"2024-01-23T08:54:42.149978+0000","last_active":"2024-01-23T09:25:03.725027+0000","last_peered":"2024-01-23T09:25:03.725027+0000","last_clean":"2024-01-23T09:25:03.725027+0000","last_became_active":"2024-01-23T08:54:42.149180+0000","last_became_peered":"2024-01-23T08:54:42.149180+0000","last_unstale":"2024-01-23T09:25:03.725027+0000","last_undegraded":"2024-01-23T09:25:03.725027+0000","last_fullsized":"2024-01-23T09:25:03.725027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:52:12.899176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"30'22","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:00.353895+0000","last_change":"2024-01-23T08:54:40.699997+0000","last_active":"2024-01-23T09:25:00.353895+0000","last_peered":"2024-01-23T09:25:00.353895+0000","last_clean":"2024-01-23T09:25:00.353895+0000","last_became_active":"2024-01-23T08:54:40.699246+0000","last_became_peered":"2024-01-23T08:54:40.699246+0000","last_unstale":"2024-01-23T09:25:00.353895+0000","last_undegraded":"2024-01-23T09:25:00.353895+0000","last_fullsized":"2024-01-23T09:25:00.353895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:19:24.486048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"30'97","reported_seq":124,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:54.636016+0000","last_change":"2024-01-23T08:54:49.729218+0000","last_active":"2024-01-23T09:23:54.636016+0000","last_peered":"2024-01-23T09:23:54.636016+0000","last_clean":"2024-01-23T09:23:54.636016+0000","last_became_active":"2024-01-23T08:54:49.728448+0000","last_became_peered":"2024-01-23T08:54:49.728448+0000","last_unstale":"2024-01-23T09:23:54.636016+0000","last_undegraded":"2024-01-23T09:23:54.636016+0000","last_fullsized":"2024-01-23T09:23:54.636016+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:56:52.671943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":7067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"30'23","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.687551+0000","last_change":"2024-01-23T08:54:42.087980+0000","last_active":"2024-01-23T09:25:03.687551+0000","last_peered":"2024-01-23T09:25:03.687551+0000","last_clean":"2024-01-23T09:25:03.687551+0000","last_became_active":"2024-01-23T08:54:42.087328+0000","last_became_peered":"2024-01-23T08:54:42.087328+0000","last_unstale":"2024-01-23T09:25:03.687551+0000","last_undegraded":"2024-01-23T09:25:03.687551+0000","last_fullsized":"2024-01-23T09:25:03.687551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:07:07.781698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"30'11","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.251016+0000","last_change":"2024-01-23T08:54:40.693906+0000","last_active":"2024-01-23T09:25:03.251016+0000","last_peered":"2024-01-23T09:25:03.251016+0000","last_clean":"2024-01-23T09:25:03.251016+0000","last_became_active":"2024-01-23T08:54:40.693530+0000","last_became_peered":"2024-01-23T08:54:40.693530+0000","last_unstale":"2024-01-23T09:25:03.251016+0000","last_undegraded":"2024-01-23T09:25:03.251016+0000","last_fullsized":"2024-01-23T09:25:03.251016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:59:11.006550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"30'73","reported_seq":109,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:54.780082+0000","last_change":"2024-01-23T08:55:47.750297+0000","last_active":"2024-01-23T09:23:54.780082+0000","last_peered":"2024-01-23T09:23:54.780082+0000","last_clean":"2024-01-23T09:23:54.780082+0000","last_became_active":"2024-01-23T08:55:47.749074+0000","last_became_peered":"2024-01-23T08:55:47.749074+0000","last_unstale":"2024-01-23T09:23:54.780082+0000","last_undegraded":"2024-01-23T09:23:54.780082+0000","last_fullsized":"2024-01-23T09:23:54.780082+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:29:47.219931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":8234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,6,4],"acting":[5,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'36","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.725572+0000","last_change":"2024-01-23T08:54:42.108919+0000","last_active":"2024-01-23T09:25:03.725572+0000","last_peered":"2024-01-23T09:25:03.725572+0000","last_clean":"2024-01-23T09:25:03.725572+0000","last_became_active":"2024-01-23T08:54:42.108253+0000","last_became_peered":"2024-01-23T08:54:42.108253+0000","last_unstale":"2024-01-23T09:25:03.725572+0000","last_undegraded":"2024-01-23T09:25:03.725572+0000","last_fullsized":"2024-01-23T09:25:03.725572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:46:28.714976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"30'11","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:54.291823+0000","last_change":"2024-01-23T08:54:40.696080+0000","last_active":"2024-01-23T09:24:54.291823+0000","last_peered":"2024-01-23T09:24:54.291823+0000","last_clean":"2024-01-23T09:24:54.291823+0000","last_became_active":"2024-01-23T08:54:40.695699+0000","last_became_peered":"2024-01-23T08:54:40.695699+0000","last_unstale":"2024-01-23T09:24:54.291823+0000","last_undegraded":"2024-01-23T09:24:54.291823+0000","last_fullsized":"2024-01-23T09:24:54.291823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:21.215326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"30'63","reported_seq":90,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:51.986229+0000","last_change":"2024-01-23T08:54:49.740480+0000","last_active":"2024-01-23T09:23:51.986229+0000","last_peered":"2024-01-23T09:23:51.986229+0000","last_clean":"2024-01-23T09:23:51.986229+0000","last_became_active":"2024-01-23T08:54:49.739524+0000","last_became_peered":"2024-01-23T08:54:49.739524+0000","last_unstale":"2024-01-23T09:23:51.986229+0000","last_undegraded":"2024-01-23T09:23:51.986229+0000","last_fullsized":"2024-01-23T09:23:51.986229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:45:25.447987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":7121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.588272+0000","last_change":"2024-01-23T08:54:42.230659+0000","last_active":"2024-01-23T09:25:03.588272+0000","last_peered":"2024-01-23T09:25:03.588272+0000","last_clean":"2024-01-23T09:25:03.588272+0000","last_became_active":"2024-01-23T08:54:42.229952+0000","last_became_peered":"2024-01-23T08:54:42.229952+0000","last_unstale":"2024-01-23T09:25:03.588272+0000","last_undegraded":"2024-01-23T09:25:03.588272+0000","last_fullsized":"2024-01-23T09:25:03.588272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:41:53.265527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"30'14","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:30.107136+0000","last_change":"2024-01-23T08:54:40.698779+0000","last_active":"2024-01-23T09:24:30.107136+0000","last_peered":"2024-01-23T09:24:30.107136+0000","last_clean":"2024-01-23T09:24:30.107136+0000","last_became_active":"2024-01-23T08:54:40.698059+0000","last_became_peered":"2024-01-23T08:54:40.698059+0000","last_unstale":"2024-01-23T09:24:30.107136+0000","last_undegraded":"2024-01-23T09:24:30.107136+0000","last_fullsized":"2024-01-23T09:24:30.107136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:24:40.655839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"30'67","reported_seq":94,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:53.764913+0000","last_change":"2024-01-23T08:54:49.708388+0000","last_active":"2024-01-23T09:23:53.764913+0000","last_peered":"2024-01-23T09:23:53.764913+0000","last_clean":"2024-01-23T09:23:53.764913+0000","last_became_active":"2024-01-23T08:54:49.707837+0000","last_became_peered":"2024-01-23T08:54:49.707837+0000","last_unstale":"2024-01-23T09:23:53.764913+0000","last_undegraded":"2024-01-23T09:23:53.764913+0000","last_fullsized":"2024-01-23T09:23:53.764913+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:49:25.509880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":5283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'21","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.867783+0000","last_change":"2024-01-23T08:54:42.229836+0000","last_active":"2024-01-23T09:25:03.867783+0000","last_peered":"2024-01-23T09:25:03.867783+0000","last_clean":"2024-01-23T09:25:03.867783+0000","last_became_active":"2024-01-23T08:54:42.229252+0000","last_became_peered":"2024-01-23T08:54:42.229252+0000","last_unstale":"2024-01-23T09:25:03.867783+0000","last_undegraded":"2024-01-23T09:25:03.867783+0000","last_fullsized":"2024-01-23T09:25:03.867783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:23:51.285243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"30'833","reported_seq":866,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:47.846700+0000","last_change":"2024-01-23T08:54:40.658490+0000","last_active":"2024-01-23T09:24:47.846700+0000","last_peered":"2024-01-23T09:24:47.846700+0000","last_clean":"2024-01-23T09:24:47.846700+0000","last_became_active":"2024-01-23T08:54:40.657711+0000","last_became_peered":"2024-01-23T08:54:40.657711+0000","last_unstale":"2024-01-23T09:24:47.846700+0000","last_undegraded":"2024-01-23T09:24:47.846700+0000","last_fullsized":"2024-01-23T09:24:47.846700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:37:29.479181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":833,"num_write_kb":4568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"30'86","reported_seq":114,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:58.839813+0000","last_change":"2024-01-23T08:54:49.737210+0000","last_active":"2024-01-23T09:23:58.839813+0000","last_peered":"2024-01-23T09:23:58.839813+0000","last_clean":"2024-01-23T09:23:58.839813+0000","last_became_active":"2024-01-23T08:54:49.735023+0000","last_became_peered":"2024-01-23T08:54:49.735023+0000","last_unstale":"2024-01-23T09:23:58.839813+0000","last_undegraded":"2024-01-23T09:23:58.839813+0000","last_fullsized":"2024-01-23T09:23:58.839813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:27.015436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":9278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"30'25","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.726970+0000","last_change":"2024-01-23T08:54:42.154453+0000","last_active":"2024-01-23T09:25:03.726970+0000","last_peered":"2024-01-23T09:25:03.726970+0000","last_clean":"2024-01-23T09:25:03.726970+0000","last_became_active":"2024-01-23T08:54:42.153735+0000","last_became_peered":"2024-01-23T08:54:42.153735+0000","last_unstale":"2024-01-23T09:25:03.726970+0000","last_undegraded":"2024-01-23T09:25:03.726970+0000","last_fullsized":"2024-01-23T09:25:03.726970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:54:39.173058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"30'361","reported_seq":394,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:54.303102+0000","last_change":"2024-01-23T08:54:40.702888+0000","last_active":"2024-01-23T09:24:54.303102+0000","last_peered":"2024-01-23T09:24:54.303102+0000","last_clean":"2024-01-23T09:24:54.303102+0000","last_became_active":"2024-01-23T08:54:40.701827+0000","last_became_peered":"2024-01-23T08:54:40.701827+0000","last_unstale":"2024-01-23T09:24:54.303102+0000","last_undegraded":"2024-01-23T09:24:54.303102+0000","last_fullsized":"2024-01-23T09:24:54.303102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:18:17.748052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"30'124","reported_seq":152,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:58.901371+0000","last_change":"2024-01-23T08:54:49.736262+0000","last_active":"2024-01-23T09:23:58.901371+0000","last_peered":"2024-01-23T09:23:58.901371+0000","last_clean":"2024-01-23T09:23:58.901371+0000","last_became_active":"2024-01-23T08:54:49.735765+0000","last_became_peered":"2024-01-23T08:54:49.735765+0000","last_unstale":"2024-01-23T09:23:58.901371+0000","last_undegraded":"2024-01-23T09:23:58.901371+0000","last_fullsized":"2024-01-23T09:23:58.901371+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:29:59.191326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":11379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"30'28","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.616372+0000","last_change":"2024-01-23T08:54:42.071292+0000","last_active":"2024-01-23T09:25:03.616372+0000","last_peered":"2024-01-23T09:25:03.616372+0000","last_clean":"2024-01-23T09:25:03.616372+0000","last_became_active":"2024-01-23T08:54:42.070703+0000","last_became_peered":"2024-01-23T08:54:42.070703+0000","last_unstale":"2024-01-23T09:25:03.616372+0000","last_undegraded":"2024-01-23T09:25:03.616372+0000","last_fullsized":"2024-01-23T09:25:03.616372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:37.410041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"30'6","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:04.273279+0000","last_change":"2024-01-23T08:54:40.687946+0000","last_active":"2024-01-23T09:24:04.273279+0000","last_peered":"2024-01-23T09:24:04.273279+0000","last_clean":"2024-01-23T09:24:04.273279+0000","last_became_active":"2024-01-23T08:54:40.687656+0000","last_became_peered":"2024-01-23T08:54:40.687656+0000","last_unstale":"2024-01-23T09:24:04.273279+0000","last_undegraded":"2024-01-23T09:24:04.273279+0000","last_fullsized":"2024-01-23T09:24:04.273279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:29:50.091026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'70","reported_seq":98,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:41.205524+0000","last_change":"2024-01-23T08:54:49.729434+0000","last_active":"2024-01-23T09:23:41.205524+0000","last_peered":"2024-01-23T09:23:41.205524+0000","last_clean":"2024-01-23T09:23:41.205524+0000","last_became_active":"2024-01-23T08:54:49.728191+0000","last_became_peered":"2024-01-23T08:54:49.728191+0000","last_unstale":"2024-01-23T09:23:41.205524+0000","last_undegraded":"2024-01-23T09:23:41.205524+0000","last_fullsized":"2024-01-23T09:23:41.205524+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:30:27.390400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":6489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"30'28","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.757845+0000","last_change":"2024-01-23T08:54:42.155857+0000","last_active":"2024-01-23T09:25:03.757845+0000","last_peered":"2024-01-23T09:25:03.757845+0000","last_clean":"2024-01-23T09:25:03.757845+0000","last_became_active":"2024-01-23T08:54:42.153539+0000","last_became_peered":"2024-01-23T08:54:42.153539+0000","last_unstale":"2024-01-23T09:25:03.757845+0000","last_undegraded":"2024-01-23T09:25:03.757845+0000","last_fullsized":"2024-01-23T09:25:03.757845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:27:34.618270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"30'12","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.241284+0000","last_change":"2024-01-23T08:54:40.683174+0000","last_active":"2024-01-23T09:25:03.241284+0000","last_peered":"2024-01-23T09:25:03.241284+0000","last_clean":"2024-01-23T09:25:03.241284+0000","last_became_active":"2024-01-23T08:54:40.682765+0000","last_became_peered":"2024-01-23T08:54:40.682765+0000","last_unstale":"2024-01-23T09:25:03.241284+0000","last_undegraded":"2024-01-23T09:25:03.241284+0000","last_fullsized":"2024-01-23T09:25:03.241284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:13:10.191082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"30'72","reported_seq":100,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:57.975282+0000","last_change":"2024-01-23T08:54:49.728962+0000","last_active":"2024-01-23T09:23:57.975282+0000","last_peered":"2024-01-23T09:23:57.975282+0000","last_clean":"2024-01-23T09:23:57.975282+0000","last_became_active":"2024-01-23T08:54:49.724121+0000","last_became_peered":"2024-01-23T08:54:49.724121+0000","last_unstale":"2024-01-23T09:23:57.975282+0000","last_undegraded":"2024-01-23T09:23:57.975282+0000","last_fullsized":"2024-01-23T09:23:57.975282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:14.188947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":8509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"30'65","reported_seq":95,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:54.910192+0000","last_change":"2024-01-23T08:54:49.735678+0000","last_active":"2024-01-23T09:23:54.910192+0000","last_peered":"2024-01-23T09:23:54.910192+0000","last_clean":"2024-01-23T09:23:54.910192+0000","last_became_active":"2024-01-23T08:54:49.732632+0000","last_became_peered":"2024-01-23T08:54:49.732632+0000","last_unstale":"2024-01-23T09:23:54.910192+0000","last_undegraded":"2024-01-23T09:23:54.910192+0000","last_fullsized":"2024-01-23T09:23:54.910192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:54.463072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":5816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"30'26","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.753551+0000","last_change":"2024-01-23T08:54:42.196434+0000","last_active":"2024-01-23T09:25:03.753551+0000","last_peered":"2024-01-23T09:25:03.753551+0000","last_clean":"2024-01-23T09:25:03.753551+0000","last_became_active":"2024-01-23T08:54:42.195570+0000","last_became_peered":"2024-01-23T08:54:42.195570+0000","last_unstale":"2024-01-23T09:25:03.753551+0000","last_undegraded":"2024-01-23T09:25:03.753551+0000","last_fullsized":"2024-01-23T09:25:03.753551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:04:44.856358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"30'6","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:31.167629+0000","last_change":"2024-01-23T08:54:40.678920+0000","last_active":"2024-01-23T09:24:31.167629+0000","last_peered":"2024-01-23T09:24:31.167629+0000","last_clean":"2024-01-23T09:24:31.167629+0000","last_became_active":"2024-01-23T08:54:40.678527+0000","last_became_peered":"2024-01-23T08:54:40.678527+0000","last_unstale":"2024-01-23T09:24:31.167629+0000","last_undegraded":"2024-01-23T09:24:31.167629+0000","last_fullsized":"2024-01-23T09:24:31.167629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:48:02.807942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'89","reported_seq":118,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:55.557591+0000","last_change":"2024-01-23T08:54:49.719401+0000","last_active":"2024-01-23T09:23:55.557591+0000","last_peered":"2024-01-23T09:23:55.557591+0000","last_clean":"2024-01-23T09:23:55.557591+0000","last_became_active":"2024-01-23T08:54:49.717116+0000","last_became_peered":"2024-01-23T08:54:49.717116+0000","last_unstale":"2024-01-23T09:23:55.557591+0000","last_undegraded":"2024-01-23T09:23:55.557591+0000","last_fullsized":"2024-01-23T09:23:55.557591+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:58:50.143993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":12319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"30'30","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.632552+0000","last_change":"2024-01-23T08:54:42.235843+0000","last_active":"2024-01-23T09:25:03.632552+0000","last_peered":"2024-01-23T09:25:03.632552+0000","last_clean":"2024-01-23T09:25:03.632552+0000","last_became_active":"2024-01-23T08:54:42.235116+0000","last_became_peered":"2024-01-23T08:54:42.235116+0000","last_unstale":"2024-01-23T09:25:03.632552+0000","last_undegraded":"2024-01-23T09:25:03.632552+0000","last_fullsized":"2024-01-23T09:25:03.632552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:43:27.674658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"30'7","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:31.174876+0000","last_change":"2024-01-23T08:54:40.690150+0000","last_active":"2024-01-23T09:24:31.174876+0000","last_peered":"2024-01-23T09:24:31.174876+0000","last_clean":"2024-01-23T09:24:31.174876+0000","last_became_active":"2024-01-23T08:54:40.689433+0000","last_became_peered":"2024-01-23T08:54:40.689433+0000","last_unstale":"2024-01-23T09:24:31.174876+0000","last_undegraded":"2024-01-23T09:24:31.174876+0000","last_fullsized":"2024-01-23T09:24:31.174876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:35:11.315349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"30'511","reported_seq":544,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:37.442027+0000","last_change":"2024-01-23T08:54:40.686731+0000","last_active":"2024-01-23T09:24:37.442027+0000","last_peered":"2024-01-23T09:24:37.442027+0000","last_clean":"2024-01-23T09:24:37.442027+0000","last_became_active":"2024-01-23T08:54:40.686371+0000","last_became_peered":"2024-01-23T08:54:40.686371+0000","last_unstale":"2024-01-23T09:24:37.442027+0000","last_undegraded":"2024-01-23T09:24:37.442027+0000","last_fullsized":"2024-01-23T09:24:37.442027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:45.362773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":507,"num_write_kb":4372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"30'22","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.736889+0000","last_change":"2024-01-23T08:54:42.200428+0000","last_active":"2024-01-23T09:25:03.736889+0000","last_peered":"2024-01-23T09:25:03.736889+0000","last_clean":"2024-01-23T09:25:03.736889+0000","last_became_active":"2024-01-23T08:54:42.198648+0000","last_became_peered":"2024-01-23T08:54:42.198648+0000","last_unstale":"2024-01-23T09:25:03.736889+0000","last_undegraded":"2024-01-23T09:25:03.736889+0000","last_fullsized":"2024-01-23T09:25:03.736889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:45:11.802421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"30'54","reported_seq":81,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:54.793810+0000","last_change":"2024-01-23T08:54:49.742269+0000","last_active":"2024-01-23T09:23:54.793810+0000","last_peered":"2024-01-23T09:23:54.793810+0000","last_clean":"2024-01-23T09:23:54.793810+0000","last_became_active":"2024-01-23T08:54:49.741692+0000","last_became_peered":"2024-01-23T08:54:49.741692+0000","last_unstale":"2024-01-23T09:23:54.793810+0000","last_undegraded":"2024-01-23T09:23:54.793810+0000","last_fullsized":"2024-01-23T09:23:54.793810+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:45.278144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":4034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"30'585","reported_seq":618,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:47.051020+0000","last_change":"2024-01-23T08:54:40.687352+0000","last_active":"2024-01-23T09:24:47.051020+0000","last_peered":"2024-01-23T09:24:47.051020+0000","last_clean":"2024-01-23T09:24:47.051020+0000","last_became_active":"2024-01-23T08:54:40.686125+0000","last_became_peered":"2024-01-23T08:54:40.686125+0000","last_unstale":"2024-01-23T09:24:47.051020+0000","last_undegraded":"2024-01-23T09:24:47.051020+0000","last_fullsized":"2024-01-23T09:24:47.051020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:38:41.311580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195507,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":4397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"30'19","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.698551+0000","last_change":"2024-01-23T08:54:42.090249+0000","last_active":"2024-01-23T09:25:03.698551+0000","last_peered":"2024-01-23T09:25:03.698551+0000","last_clean":"2024-01-23T09:25:03.698551+0000","last_became_active":"2024-01-23T08:54:42.089826+0000","last_became_peered":"2024-01-23T08:54:42.089826+0000","last_unstale":"2024-01-23T09:25:03.698551+0000","last_undegraded":"2024-01-23T09:25:03.698551+0000","last_fullsized":"2024-01-23T09:25:03.698551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:07:39.007667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"30'96","reported_seq":119,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:49.097776+0000","last_change":"2024-01-23T08:55:47.749137+0000","last_active":"2024-01-23T09:23:49.097776+0000","last_peered":"2024-01-23T09:23:49.097776+0000","last_clean":"2024-01-23T09:23:49.097776+0000","last_became_active":"2024-01-23T08:55:47.747327+0000","last_became_peered":"2024-01-23T08:55:47.747327+0000","last_unstale":"2024-01-23T09:23:49.097776+0000","last_undegraded":"2024-01-23T09:23:49.097776+0000","last_fullsized":"2024-01-23T09:23:49.097776+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:51:20.285692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":8062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"30'35","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.752906+0000","last_change":"2024-01-23T08:54:42.228128+0000","last_active":"2024-01-23T09:25:03.752906+0000","last_peered":"2024-01-23T09:25:03.752906+0000","last_clean":"2024-01-23T09:25:03.752906+0000","last_became_active":"2024-01-23T08:54:42.227421+0000","last_became_peered":"2024-01-23T08:54:42.227421+0000","last_unstale":"2024-01-23T09:25:03.752906+0000","last_undegraded":"2024-01-23T09:25:03.752906+0000","last_fullsized":"2024-01-23T09:25:03.752906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:47:09.171802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"30'25","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.639997+0000","last_change":"2024-01-23T08:54:42.112162+0000","last_active":"2024-01-23T09:25:03.639997+0000","last_peered":"2024-01-23T09:25:03.639997+0000","last_clean":"2024-01-23T09:25:03.639997+0000","last_became_active":"2024-01-23T08:54:42.111635+0000","last_became_peered":"2024-01-23T08:54:42.111635+0000","last_unstale":"2024-01-23T09:25:03.639997+0000","last_undegraded":"2024-01-23T09:25:03.639997+0000","last_fullsized":"2024-01-23T09:25:03.639997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:13:11.423278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"30'28","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.713263+0000","last_change":"2024-01-23T08:54:42.069982+0000","last_active":"2024-01-23T09:25:03.713263+0000","last_peered":"2024-01-23T09:25:03.713263+0000","last_clean":"2024-01-23T09:25:03.713263+0000","last_became_active":"2024-01-23T08:54:42.069262+0000","last_became_peered":"2024-01-23T08:54:42.069262+0000","last_unstale":"2024-01-23T09:25:03.713263+0000","last_undegraded":"2024-01-23T09:25:03.713263+0000","last_fullsized":"2024-01-23T09:25:03.713263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:56:44.803841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"30'23","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.630718+0000","last_change":"2024-01-23T08:54:42.108709+0000","last_active":"2024-01-23T09:25:03.630718+0000","last_peered":"2024-01-23T09:25:03.630718+0000","last_clean":"2024-01-23T09:25:03.630718+0000","last_became_active":"2024-01-23T08:54:42.107985+0000","last_became_peered":"2024-01-23T08:54:42.107985+0000","last_unstale":"2024-01-23T09:25:03.630718+0000","last_undegraded":"2024-01-23T09:25:03.630718+0000","last_fullsized":"2024-01-23T09:25:03.630718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:27:28.770059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"30'17","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.599762+0000","last_change":"2024-01-23T08:54:42.229100+0000","last_active":"2024-01-23T09:25:03.599762+0000","last_peered":"2024-01-23T09:25:03.599762+0000","last_clean":"2024-01-23T09:25:03.599762+0000","last_became_active":"2024-01-23T08:54:42.227918+0000","last_became_peered":"2024-01-23T08:54:42.227918+0000","last_unstale":"2024-01-23T09:25:03.599762+0000","last_undegraded":"2024-01-23T09:25:03.599762+0000","last_fullsized":"2024-01-23T09:25:03.599762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:54:47.705445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"30'20","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.584500+0000","last_change":"2024-01-23T08:54:42.231357+0000","last_active":"2024-01-23T09:25:03.584500+0000","last_peered":"2024-01-23T09:25:03.584500+0000","last_clean":"2024-01-23T09:25:03.584500+0000","last_became_active":"2024-01-23T08:54:42.230615+0000","last_became_peered":"2024-01-23T08:54:42.230615+0000","last_unstale":"2024-01-23T09:25:03.584500+0000","last_undegraded":"2024-01-23T09:25:03.584500+0000","last_fullsized":"2024-01-23T09:25:03.584500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:12:12.757498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"30'35","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.755743+0000","last_change":"2024-01-23T08:54:42.158739+0000","last_active":"2024-01-23T09:25:03.755743+0000","last_peered":"2024-01-23T09:25:03.755743+0000","last_clean":"2024-01-23T09:25:03.755743+0000","last_became_active":"2024-01-23T08:54:42.157106+0000","last_became_peered":"2024-01-23T08:54:42.157106+0000","last_unstale":"2024-01-23T09:25:03.755743+0000","last_undegraded":"2024-01-23T09:25:03.755743+0000","last_fullsized":"2024-01-23T09:25:03.755743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:32:37.961458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"30'20","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.609816+0000","last_change":"2024-01-23T08:54:42.092942+0000","last_active":"2024-01-23T09:25:03.609816+0000","last_peered":"2024-01-23T09:25:03.609816+0000","last_clean":"2024-01-23T09:25:03.609816+0000","last_became_active":"2024-01-23T08:54:42.092149+0000","last_became_peered":"2024-01-23T08:54:42.092149+0000","last_unstale":"2024-01-23T09:25:03.609816+0000","last_undegraded":"2024-01-23T09:25:03.609816+0000","last_fullsized":"2024-01-23T09:25:03.609816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:19.147334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"30'19","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.725472+0000","last_change":"2024-01-23T08:54:42.069948+0000","last_active":"2024-01-23T09:25:03.725472+0000","last_peered":"2024-01-23T09:25:03.725472+0000","last_clean":"2024-01-23T09:25:03.725472+0000","last_became_active":"2024-01-23T08:54:42.069305+0000","last_became_peered":"2024-01-23T08:54:42.069305+0000","last_unstale":"2024-01-23T09:25:03.725472+0000","last_undegraded":"2024-01-23T09:25:03.725472+0000","last_fullsized":"2024-01-23T09:25:03.725472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:21:50.684517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.626304+0000","last_change":"2024-01-23T08:54:42.158120+0000","last_active":"2024-01-23T09:25:03.626304+0000","last_peered":"2024-01-23T09:25:03.626304+0000","last_clean":"2024-01-23T09:25:03.626304+0000","last_became_active":"2024-01-23T08:54:42.157647+0000","last_became_peered":"2024-01-23T08:54:42.157647+0000","last_unstale":"2024-01-23T09:25:03.626304+0000","last_undegraded":"2024-01-23T09:25:03.626304+0000","last_fullsized":"2024-01-23T09:25:03.626304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:28:50.107504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.697797+0000","last_change":"2024-01-23T08:54:42.119253+0000","last_active":"2024-01-23T09:25:03.697797+0000","last_peered":"2024-01-23T09:25:03.697797+0000","last_clean":"2024-01-23T09:25:03.697797+0000","last_became_active":"2024-01-23T08:54:42.118528+0000","last_became_peered":"2024-01-23T08:54:42.118528+0000","last_unstale":"2024-01-23T09:25:03.697797+0000","last_undegraded":"2024-01-23T09:25:03.697797+0000","last_fullsized":"2024-01-23T09:25:03.697797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:47:09.171802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"30'35","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.736189+0000","last_change":"2024-01-23T08:54:42.197561+0000","last_active":"2024-01-23T09:25:03.736189+0000","last_peered":"2024-01-23T09:25:03.736189+0000","last_clean":"2024-01-23T09:25:03.736189+0000","last_became_active":"2024-01-23T08:54:42.196809+0000","last_became_peered":"2024-01-23T08:54:42.196809+0000","last_unstale":"2024-01-23T09:25:03.736189+0000","last_undegraded":"2024-01-23T09:25:03.736189+0000","last_fullsized":"2024-01-23T09:25:03.736189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:16:34.046447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"30'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.871563+0000","last_change":"2024-01-23T08:54:42.112093+0000","last_active":"2024-01-23T09:25:03.871563+0000","last_peered":"2024-01-23T09:25:03.871563+0000","last_clean":"2024-01-23T09:25:03.871563+0000","last_became_active":"2024-01-23T08:54:42.111207+0000","last_became_peered":"2024-01-23T08:54:42.111207+0000","last_unstale":"2024-01-23T09:25:03.871563+0000","last_undegraded":"2024-01-23T09:25:03.871563+0000","last_fullsized":"2024-01-23T09:25:03.871563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:37.410041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"30'22","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.724979+0000","last_change":"2024-01-23T08:54:42.195803+0000","last_active":"2024-01-23T09:25:03.724979+0000","last_peered":"2024-01-23T09:25:03.724979+0000","last_clean":"2024-01-23T09:25:03.724979+0000","last_became_active":"2024-01-23T08:54:42.194562+0000","last_became_peered":"2024-01-23T08:54:42.194562+0000","last_unstale":"2024-01-23T09:25:03.724979+0000","last_undegraded":"2024-01-23T09:25:03.724979+0000","last_fullsized":"2024-01-23T09:25:03.724979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:53:56.379892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"30'33","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.641853+0000","last_change":"2024-01-23T08:54:42.161219+0000","last_active":"2024-01-23T09:25:03.641853+0000","last_peered":"2024-01-23T09:25:03.641853+0000","last_clean":"2024-01-23T09:25:03.641853+0000","last_became_active":"2024-01-23T08:54:42.160570+0000","last_became_peered":"2024-01-23T08:54:42.160570+0000","last_unstale":"2024-01-23T09:25:03.641853+0000","last_undegraded":"2024-01-23T09:25:03.641853+0000","last_fullsized":"2024-01-23T09:25:03.641853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:47:09.171802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.722516+0000","last_change":"2024-01-23T08:54:42.115468+0000","last_active":"2024-01-23T09:25:03.722516+0000","last_peered":"2024-01-23T09:25:03.722516+0000","last_clean":"2024-01-23T09:25:03.722516+0000","last_became_active":"2024-01-23T08:54:42.114759+0000","last_became_peered":"2024-01-23T08:54:42.114759+0000","last_unstale":"2024-01-23T09:25:03.722516+0000","last_undegraded":"2024-01-23T09:25:03.722516+0000","last_fullsized":"2024-01-23T09:25:03.722516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:00:35.095097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.726671+0000","last_change":"2024-01-23T08:54:42.150054+0000","last_active":"2024-01-23T09:25:03.726671+0000","last_peered":"2024-01-23T09:25:03.726671+0000","last_clean":"2024-01-23T09:25:03.726671+0000","last_became_active":"2024-01-23T08:54:42.149278+0000","last_became_peered":"2024-01-23T08:54:42.149278+0000","last_unstale":"2024-01-23T09:25:03.726671+0000","last_undegraded":"2024-01-23T09:25:03.726671+0000","last_fullsized":"2024-01-23T09:25:03.726671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:16:33.710981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.618372+0000","last_change":"2024-01-23T08:54:42.110442+0000","last_active":"2024-01-23T09:25:03.618372+0000","last_peered":"2024-01-23T09:25:03.618372+0000","last_clean":"2024-01-23T09:25:03.618372+0000","last_became_active":"2024-01-23T08:54:42.109743+0000","last_became_peered":"2024-01-23T08:54:42.109743+0000","last_unstale":"2024-01-23T09:25:03.618372+0000","last_undegraded":"2024-01-23T09:25:03.618372+0000","last_fullsized":"2024-01-23T09:25:03.618372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:58:34.376942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"30'25","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.588171+0000","last_change":"2024-01-23T08:54:42.228264+0000","last_active":"2024-01-23T09:25:03.588171+0000","last_peered":"2024-01-23T09:25:03.588171+0000","last_clean":"2024-01-23T09:25:03.588171+0000","last_became_active":"2024-01-23T08:54:42.227537+0000","last_became_peered":"2024-01-23T08:54:42.227537+0000","last_unstale":"2024-01-23T09:25:03.588171+0000","last_undegraded":"2024-01-23T09:25:03.588171+0000","last_fullsized":"2024-01-23T09:25:03.588171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:54:25.960679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"30'33","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.599333+0000","last_change":"2024-01-23T08:54:42.225968+0000","last_active":"2024-01-23T09:25:03.599333+0000","last_peered":"2024-01-23T09:25:03.599333+0000","last_clean":"2024-01-23T09:25:03.599333+0000","last_became_active":"2024-01-23T08:54:42.224541+0000","last_became_peered":"2024-01-23T08:54:42.224541+0000","last_unstale":"2024-01-23T09:25:03.599333+0000","last_undegraded":"2024-01-23T09:25:03.599333+0000","last_fullsized":"2024-01-23T09:25:03.599333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:04:03.310087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"30'18","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.873515+0000","last_change":"2024-01-23T08:54:42.111363+0000","last_active":"2024-01-23T09:25:03.873515+0000","last_peered":"2024-01-23T09:25:03.873515+0000","last_clean":"2024-01-23T09:25:03.873515+0000","last_became_active":"2024-01-23T08:54:42.111043+0000","last_became_peered":"2024-01-23T08:54:42.111043+0000","last_unstale":"2024-01-23T09:25:03.873515+0000","last_undegraded":"2024-01-23T09:25:03.873515+0000","last_fullsized":"2024-01-23T09:25:03.873515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:22.447523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"30'19","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.867266+0000","last_change":"2024-01-23T08:54:42.116234+0000","last_active":"2024-01-23T09:25:03.867266+0000","last_peered":"2024-01-23T09:25:03.867266+0000","last_clean":"2024-01-23T09:25:03.867266+0000","last_became_active":"2024-01-23T08:54:42.115911+0000","last_became_peered":"2024-01-23T08:54:42.115911+0000","last_unstale":"2024-01-23T09:25:03.867266+0000","last_undegraded":"2024-01-23T09:25:03.867266+0000","last_fullsized":"2024-01-23T09:25:03.867266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:06.320845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"30'33","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.871125+0000","last_change":"2024-01-23T08:54:42.158134+0000","last_active":"2024-01-23T09:25:03.871125+0000","last_peered":"2024-01-23T09:25:03.871125+0000","last_clean":"2024-01-23T09:25:03.871125+0000","last_became_active":"2024-01-23T08:54:42.157331+0000","last_became_peered":"2024-01-23T08:54:42.157331+0000","last_unstale":"2024-01-23T09:25:03.871125+0000","last_undegraded":"2024-01-23T09:25:03.871125+0000","last_fullsized":"2024-01-23T09:25:03.871125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:46.594970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"30'28","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.704939+0000","last_change":"2024-01-23T08:54:42.092495+0000","last_active":"2024-01-23T09:25:03.704939+0000","last_peered":"2024-01-23T09:25:03.704939+0000","last_clean":"2024-01-23T09:25:03.704939+0000","last_became_active":"2024-01-23T08:54:42.091726+0000","last_became_peered":"2024-01-23T08:54:42.091726+0000","last_unstale":"2024-01-23T09:25:03.704939+0000","last_undegraded":"2024-01-23T09:25:03.704939+0000","last_fullsized":"2024-01-23T09:25:03.704939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:19:17.992621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"30'19","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.647706+0000","last_change":"2024-01-23T08:54:42.120617+0000","last_active":"2024-01-23T09:25:03.647706+0000","last_peered":"2024-01-23T09:25:03.647706+0000","last_clean":"2024-01-23T09:25:03.647706+0000","last_became_active":"2024-01-23T08:54:42.119847+0000","last_became_peered":"2024-01-23T08:54:42.119847+0000","last_unstale":"2024-01-23T09:25:03.647706+0000","last_undegraded":"2024-01-23T09:25:03.647706+0000","last_fullsized":"2024-01-23T09:25:03.647706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:29:51.323223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"30'18","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.866794+0000","last_change":"2024-01-23T08:54:42.197133+0000","last_active":"2024-01-23T09:25:03.866794+0000","last_peered":"2024-01-23T09:25:03.866794+0000","last_clean":"2024-01-23T09:25:03.866794+0000","last_became_active":"2024-01-23T08:54:42.195743+0000","last_became_peered":"2024-01-23T08:54:42.195743+0000","last_unstale":"2024-01-23T09:25:03.866794+0000","last_undegraded":"2024-01-23T09:25:03.866794+0000","last_fullsized":"2024-01-23T09:25:03.866794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:48:04.040139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"30'24","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.751801+0000","last_change":"2024-01-23T08:54:42.195979+0000","last_active":"2024-01-23T09:25:03.751801+0000","last_peered":"2024-01-23T09:25:03.751801+0000","last_clean":"2024-01-23T09:25:03.751801+0000","last_became_active":"2024-01-23T08:54:42.194846+0000","last_became_peered":"2024-01-23T08:54:42.194846+0000","last_unstale":"2024-01-23T09:25:03.751801+0000","last_undegraded":"2024-01-23T09:25:03.751801+0000","last_fullsized":"2024-01-23T09:25:03.751801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:07:39.007667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"30'23","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.862699+0000","last_change":"2024-01-23T08:54:42.118056+0000","last_active":"2024-01-23T09:25:03.862699+0000","last_peered":"2024-01-23T09:25:03.862699+0000","last_clean":"2024-01-23T09:25:03.862699+0000","last_became_active":"2024-01-23T08:54:42.117735+0000","last_became_peered":"2024-01-23T08:54:42.117735+0000","last_unstale":"2024-01-23T09:25:03.862699+0000","last_undegraded":"2024-01-23T09:25:03.862699+0000","last_fullsized":"2024-01-23T09:25:03.862699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:19.147334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"30'16","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.752663+0000","last_change":"2024-01-23T08:54:42.195159+0000","last_active":"2024-01-23T09:25:03.752663+0000","last_peered":"2024-01-23T09:25:03.752663+0000","last_clean":"2024-01-23T09:25:03.752663+0000","last_became_active":"2024-01-23T08:54:42.194331+0000","last_became_peered":"2024-01-23T08:54:42.194331+0000","last_unstale":"2024-01-23T09:25:03.752663+0000","last_undegraded":"2024-01-23T09:25:03.752663+0000","last_fullsized":"2024-01-23T09:25:03.752663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:19:25.718244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"30'25","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.634628+0000","last_change":"2024-01-23T08:54:42.197096+0000","last_active":"2024-01-23T09:25:03.634628+0000","last_peered":"2024-01-23T09:25:03.634628+0000","last_clean":"2024-01-23T09:25:03.634628+0000","last_became_active":"2024-01-23T08:54:42.196391+0000","last_became_peered":"2024-01-23T08:54:42.196391+0000","last_unstale":"2024-01-23T09:25:03.634628+0000","last_undegraded":"2024-01-23T09:25:03.634628+0000","last_fullsized":"2024-01-23T09:25:03.634628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:22.447523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"30'18","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.601398+0000","last_change":"2024-01-23T08:54:42.231430+0000","last_active":"2024-01-23T09:25:03.601398+0000","last_peered":"2024-01-23T09:25:03.601398+0000","last_clean":"2024-01-23T09:25:03.601398+0000","last_became_active":"2024-01-23T08:54:42.229220+0000","last_became_peered":"2024-01-23T08:54:42.229220+0000","last_unstale":"2024-01-23T09:25:03.601398+0000","last_undegraded":"2024-01-23T09:25:03.601398+0000","last_fullsized":"2024-01-23T09:25:03.601398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:48:04.040139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"30'24","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.870352+0000","last_change":"2024-01-23T08:54:42.118613+0000","last_active":"2024-01-23T09:25:03.870352+0000","last_peered":"2024-01-23T09:25:03.870352+0000","last_clean":"2024-01-23T09:25:03.870352+0000","last_became_active":"2024-01-23T08:54:42.118233+0000","last_became_peered":"2024-01-23T08:54:42.118233+0000","last_unstale":"2024-01-23T09:25:03.870352+0000","last_undegraded":"2024-01-23T09:25:03.870352+0000","last_fullsized":"2024-01-23T09:25:03.870352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:16:33.710981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2304,"num_write_kb":252373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2476,"ondisk_log_size":2476,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1536,"ondisk_log_size":1536,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":23189121,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":519,"num_read_kb":542,"num_write":5371,"num_write_kb":25642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":46628864,"data_stored":46378242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4894,"ondisk_log_size":4894,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509819,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29528,"kb_used_data":2512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342312,"statfs":{"total":96636764160,"available":96606527488,"internally_reserved":0,"allocated":2572288,"data_stored":2340721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.89200000000000002,"15min":0.88200000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.46100000000000002},"max":{"1min":1.4039999999999999,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.93500000000000005,"15min":0.91400000000000003},"min":{"1min":0.61799999999999999,"5min":0.56599999999999995,"15min":0.46300000000000002},"max":{"1min":1.3999999999999999,"5min":1.456,"15min":1.456},"last":1.2789999999999999}]},{"osd":1,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.97599999999999998,"15min":0.95499999999999996},"min":{"1min":0.66100000000000003,"5min":0.52900000000000003,"15min":0.49399999999999999},"max":{"1min":1.419,"5min":1.425,"15min":1.754},"last":1.1659999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.97499999999999998,"15min":0.97299999999999998},"min":{"1min":0.67900000000000005,"5min":0.54400000000000004,"15min":0.51900000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.597},"last":0.98399999999999999}]},{"osd":2,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.96999999999999997,"15min":0.93400000000000005},"min":{"1min":0.66700000000000004,"5min":0.53000000000000003,"15min":0.47099999999999997},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0369999999999999,"15min":1.014},"min":{"1min":0.73599999999999999,"5min":0.59999999999999998,"15min":0.55000000000000004},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.03}]},{"osd":3,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0069999999999999,"15min":0.99099999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.7190000000000001},"last":1.073},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.052,"15min":1.073},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57099999999999995},"max":{"1min":1.587,"5min":1.587,"15min":1.889},"last":1.244}]},{"osd":4,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":0.97099999999999997,"15min":0.97199999999999998},"min":{"1min":0.68200000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.645},"last":1.206},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.99199999999999999,"15min":0.98999999999999999},"min":{"1min":0.60699999999999998,"5min":0.48899999999999999,"15min":0.46800000000000003},"max":{"1min":1.4259999999999999,"5min":1.621,"15min":1.982},"last":0.878}]},{"osd":5,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0760000000000001,"15min":1.0820000000000001},"min":{"1min":0.71099999999999997,"5min":0.63,"15min":0.57299999999999995},"max":{"1min":1.4570000000000001,"5min":1.613,"15min":1.9710000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.115,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.72299999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.8260000000000001},"last":0.78200000000000003}]},{"osd":6,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.147,"15min":1.1399999999999999},"min":{"1min":0.86499999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.613,"5min":1.613,"15min":1.9399999999999999},"last":1.103},{"interface":"front","average":{"1min":1.123,"5min":1.131,"15min":1.1319999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.752,"5min":1.752,"15min":1.883},"last":1.131}]}]},{"osd":5,"up_from":15,"seq":64424509818,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38352,"kb_used_data":7176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333488,"statfs":{"total":96636764160,"available":96597491712,"internally_reserved":0,"allocated":7348224,"data_stored":7125746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.89100000000000001,"15min":0.88300000000000001},"min":{"1min":0.54300000000000004,"5min":0.51500000000000001,"15min":0.501},"max":{"1min":1.296,"5min":1.3919999999999999,"15min":1.5269999999999999},"last":1.153},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.99399999999999999,"15min":0.98099999999999998},"min":{"1min":0.60899999999999999,"5min":0.58899999999999997,"15min":0.53100000000000003},"max":{"1min":1.3109999999999999,"5min":1.552,"15min":1.552},"last":0.97899999999999998}]},{"osd":1,"last update":"Tue Jan 23 09:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.96599999999999997,"15min":0.95599999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.498},"max":{"1min":1.3,"5min":1.4019999999999999,"15min":1.413},"last":0.871},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.96499999999999997,"15min":0.93799999999999994},"min":{"1min":0.625,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2470000000000001,"5min":1.405,"15min":1.542},"last":1.105}]},{"osd":2,"last update":"Tue Jan 23 09:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.94299999999999995,"15min":0.92100000000000004},"min":{"1min":0.63900000000000001,"5min":0.55300000000000005,"15min":0.51100000000000001},"max":{"1min":1.2709999999999999,"5min":1.421,"15min":1.46},"last":1.014},{"interface":"front","average":{"1min":1.012,"5min":1.03,"15min":1.0189999999999999},"min":{"1min":0.64400000000000002,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.385,"5min":1.456,"15min":1.53},"last":1.421}]},{"osd":3,"last update":"Tue Jan 23 09:24:08 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.026,"15min":1.028},"min":{"1min":0.72999999999999998,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.431,"5min":1.4570000000000001,"15min":1.677},"last":1.056},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.0640000000000001,"15min":1.0489999999999999},"min":{"1min":0.76300000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.3109999999999999}]},{"osd":4,"last update":"Tue Jan 23 09:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.97299999999999998,"15min":0.98899999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.48599999999999999},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.8779999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.046,"5min":1.0069999999999999,"15min":1.0109999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.2669999999999999}]},{"osd":6,"last update":"Tue Jan 23 09:24:08 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.0309999999999999,"15min":1.044},"min":{"1min":0.71299999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.349,"5min":1.4690000000000001,"15min":1.823},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.1120000000000001,"15min":1.1060000000000001},"min":{"1min":0.76100000000000001,"5min":0.72299999999999998,"15min":0.42599999999999999},"max":{"1min":1.3959999999999999,"5min":1.532,"15min":1.6759999999999999},"last":1.4610000000000001}]},{"osd":7,"last update":"Tue Jan 23 09:24:08 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.1000000000000001,"15min":1.1339999999999999},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.518,"5min":1.518,"15min":1.919},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.163,"15min":1.1659999999999999},"min":{"1min":0.93400000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4670000000000001,"5min":1.5489999999999999,"15min":1.8140000000000001},"last":1.3879999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509817,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39732,"kb_used_data":8556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332108,"statfs":{"total":96636764160,"available":96596078592,"internally_reserved":0,"allocated":8761344,"data_stored":8522021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.92400000000000004,"15min":0.91300000000000003},"min":{"1min":0.56599999999999995,"5min":0.50700000000000001,"15min":0.46600000000000003},"max":{"1min":1.3129999999999999,"5min":1.3799999999999999,"15min":1.583},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.95499999999999996,"15min":0.91800000000000004},"min":{"1min":0.60499999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.282,"5min":1.329,"15min":1.5629999999999999},"last":0.89600000000000002}]},{"osd":1,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.97699999999999998,"15min":0.93000000000000005},"min":{"1min":0.74099999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3640000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.94099999999999995,"15min":0.95299999999999996},"min":{"1min":0.66100000000000003,"5min":0.59999999999999998,"15min":0.5},"max":{"1min":1.232,"5min":1.415,"15min":1.415},"last":0.85699999999999998}]},{"osd":2,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.96099999999999997,"15min":0.93700000000000006},"min":{"1min":0.625,"5min":0.56599999999999995,"15min":0.54000000000000004},"max":{"1min":1.3460000000000001,"5min":1.387,"15min":1.387},"last":0.999},{"interface":"front","average":{"1min":1,"5min":1.0589999999999999,"15min":1.0329999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.498},"max":{"1min":1.296,"5min":1.411,"15min":1.736},"last":1.169}]},{"osd":3,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0009999999999999,"15min":0.98199999999999998},"min":{"1min":0.70199999999999996,"5min":0.58899999999999997,"15min":0.55300000000000005},"max":{"1min":1.3720000000000001,"5min":1.3779999999999999,"15min":1.7509999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.101,"5min":1.0840000000000001,"15min":1.0680000000000001},"min":{"1min":0.78800000000000003,"5min":0.77100000000000002,"15min":0.60799999999999998},"max":{"1min":1.349,"5min":1.3859999999999999,"15min":1.482},"last":0.92600000000000005}]},{"osd":5,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.96599999999999997,"15min":0.98299999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3100000000000001,"5min":1.5549999999999999,"15min":1.643},"last":1.121},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.98699999999999999,"15min":0.98899999999999999},"min":{"1min":0.64300000000000002,"5min":0.57999999999999996,"15min":0.52300000000000002},"max":{"1min":1.417,"5min":1.4330000000000001,"15min":1.986},"last":0.81599999999999995}]},{"osd":6,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.0289999999999999,"15min":1.0309999999999999},"min":{"1min":0.64900000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.4279999999999999,"5min":1.446,"15min":1.825},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.139,"5min":1.1160000000000001,"15min":1.1180000000000001},"min":{"1min":0.86599999999999999,"5min":0.77000000000000002,"15min":0.45700000000000002},"max":{"1min":1.373,"5min":1.5049999999999999,"15min":1.7749999999999999},"last":1.024}]},{"osd":7,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.0549999999999999,"15min":1.0629999999999999},"min":{"1min":0.72999999999999998,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.573,"5min":1.573,"15min":1.673},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.1950000000000001,"15min":1.173},"min":{"1min":0.94399999999999995,"5min":0.71099999999999997,"15min":0.69399999999999995},"max":{"1min":1.4850000000000001,"5min":1.5369999999999999,"15min":1.5629999999999999},"last":1.097}]}]},{"osd":2,"up_from":15,"seq":64424509819,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39696,"kb_used_data":8520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332144,"statfs":{"total":96636764160,"available":96596115456,"internally_reserved":0,"allocated":8724480,"data_stored":8520251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.74299999999999999,"15min":0.72899999999999998},"min":{"1min":0.44600000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.1890000000000001,"5min":1.528,"15min":1.5820000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.877,"15min":0.82499999999999996},"min":{"1min":0.54000000000000004,"5min":0.40200000000000002,"15min":0.248},"max":{"1min":1.534,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":0.69299999999999995}]},{"osd":1,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90800000000000003,"15min":0.88900000000000001},"min":{"1min":0.51900000000000002,"5min":0.42799999999999999,"15min":0.376},"max":{"1min":1.401,"5min":1.974,"15min":1.974},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.995,"5min":0.89800000000000002,"15min":0.88600000000000001},"min":{"1min":0.61399999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.393,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.84899999999999998}]},{"osd":3,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.86299999999999999,"15min":0.85199999999999998},"min":{"1min":0.55800000000000005,"5min":0.36499999999999999,"15min":0.36199999999999999},"max":{"1min":1.7310000000000001,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0549999999999999,"15min":1.0109999999999999},"min":{"1min":0.67100000000000004,"5min":0.38,"15min":0.38},"max":{"1min":1.591,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.98799999999999999}]},{"osd":4,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.1499999999999999,"15min":1.123},"min":{"1min":0.78900000000000003,"5min":0.59699999999999998,"15min":0.55000000000000004},"max":{"1min":1.446,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.048},{"interface":"front","average":{"1min":1.23,"5min":1.1559999999999999,"15min":1.153},"min":{"1min":0.82499999999999996,"5min":0.61599999999999999,"15min":0.60399999999999998},"max":{"1min":1.754,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.93400000000000005}]},{"osd":5,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1020000000000001,"15min":1.091},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53700000000000003},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.9379999999999999},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.26,"5min":1.2430000000000001,"15min":1.2130000000000001},"min":{"1min":0.79300000000000004,"5min":0.68899999999999995,"15min":0.624},"max":{"1min":1.681,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.163}]},{"osd":6,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.202,"15min":1.198},"min":{"1min":0.71499999999999997,"5min":0.60899999999999999,"15min":0.59499999999999997},"max":{"1min":1.796,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.202},{"interface":"front","average":{"1min":1.2,"5min":1.1919999999999999,"15min":1.175},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.577,"5min":1.6519999999999999,"15min":1.843},"last":1.369}]},{"osd":7,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.2849999999999999,"15min":1.262},"min":{"1min":0.79600000000000004,"5min":0.77100000000000002,"15min":0.59499999999999997},"max":{"1min":2,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.26,"15min":1.2370000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.4550000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509818,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":933888,"data_stored":722685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.56200000000000006,"5min":0.36599999999999999,"15min":0.28599999999999998},"max":{"1min":1.371,"5min":1.371,"15min":1.681},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.83699999999999997,"15min":0.80900000000000005},"min":{"1min":0.51500000000000001,"5min":0.42499999999999999,"15min":0.36399999999999999},"max":{"1min":1.246,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.59699999999999998}]},{"osd":2,"last update":"Tue Jan 23 09:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76200000000000001,"15min":0.73299999999999998},"min":{"1min":0.55000000000000004,"5min":0.38400000000000001,"15min":0.375},"max":{"1min":1.1499999999999999,"5min":1.262,"15min":1.5960000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.94399999999999995,"15min":0.92200000000000004},"min":{"1min":0.70199999999999996,"5min":0.48099999999999998,"15min":0.30499999999999999},"max":{"1min":1.425,"5min":1.4470000000000001,"15min":1.6919999999999999},"last":1.0149999999999999}]},{"osd":3,"last update":"Tue Jan 23 09:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.96099999999999997,"15min":0.93400000000000005},"min":{"1min":0.60899999999999999,"5min":0.50900000000000001,"15min":0.40400000000000003},"max":{"1min":1.4119999999999999,"5min":1.569,"15min":1.8069999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.97799999999999998,"15min":0.96799999999999997},"min":{"1min":0.51200000000000001,"5min":0.496,"15min":0.35599999999999998},"max":{"1min":1.4930000000000001,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.80800000000000005}]},{"osd":4,"last update":"Tue Jan 23 09:24:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0820000000000001,"15min":1.0780000000000001},"min":{"1min":0.75600000000000001,"5min":0.63,"15min":0.54300000000000004},"max":{"1min":1.357,"5min":1.601,"15min":1.6799999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.196,"15min":1.177},"min":{"1min":1.0149999999999999,"5min":0.64000000000000001,"15min":0.50600000000000001},"max":{"1min":1.5720000000000001,"5min":1.6910000000000001,"15min":2.2450000000000001},"last":1.2110000000000001}]},{"osd":5,"last update":"Tue Jan 23 09:24:07 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.1950000000000001,"15min":1.175},"min":{"1min":0.73899999999999999,"5min":0.66200000000000003,"15min":0.63},"max":{"1min":1.8260000000000001,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.21,"5min":1.1679999999999999,"15min":1.1559999999999999},"min":{"1min":0.79500000000000004,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.6120000000000001,"5min":1.802,"15min":1.802},"last":1.0600000000000001}]},{"osd":6,"last update":"Tue Jan 23 09:24:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.262,"15min":1.234},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.58699999999999997},"max":{"1min":1.7330000000000001,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.232,"5min":1.2130000000000001,"15min":1.2},"min":{"1min":0.78300000000000003,"5min":0.68600000000000005,"15min":0.66700000000000004},"max":{"1min":1.577,"5min":1.857,"15min":1.857},"last":0.95099999999999996}]},{"osd":7,"last update":"Tue Jan 23 09:24:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.292,"15min":1.2809999999999999},"min":{"1min":1.0309999999999999,"5min":0.77600000000000002,"15min":0.65500000000000003},"max":{"1min":1.6719999999999999,"5min":1.913,"15min":2.1110000000000002},"last":1.127},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.3029999999999999,"15min":1.29},"min":{"1min":0.90800000000000003,"5min":0.872,"15min":0.72099999999999997},"max":{"1min":1.595,"5min":2.238,"15min":2.238},"last":1.0940000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509818,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":4444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":4550656,"data_stored":4328911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 23 09:24:16 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70999999999999996,"15min":0.71299999999999997},"min":{"1min":0.32800000000000001,"5min":0.308,"15min":0.29499999999999998},"max":{"1min":0.97599999999999998,"5min":1.28,"15min":1.8280000000000001},"last":9.5459999999999994},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.85399999999999998,"15min":0.84299999999999997},"min":{"1min":0.56899999999999995,"5min":0.38,"15min":0.26500000000000001},"max":{"1min":1.407,"5min":1.407,"15min":2.21},"last":0.74299999999999999}]},{"osd":2,"last update":"Tue Jan 23 09:24:16 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.81999999999999995,"15min":0.79300000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.312},"max":{"1min":1.1819999999999999,"5min":1.343,"15min":3.8130000000000002},"last":5.5199999999999996},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90900000000000003,"15min":0.89600000000000002},"min":{"1min":0.54000000000000004,"5min":0.46800000000000003,"15min":0.40400000000000003},"max":{"1min":1.2110000000000001,"5min":1.5309999999999999,"15min":2.1440000000000001},"last":0.84099999999999997}]},{"osd":3,"last update":"Tue Jan 23 09:24:16 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.91000000000000003,"15min":0.91300000000000003},"min":{"1min":0.433,"5min":0.432,"15min":0.32200000000000001},"max":{"1min":1.2789999999999999,"5min":1.593,"15min":1.7150000000000001},"last":9.6470000000000002},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.97699999999999998,"15min":0.94399999999999995},"min":{"1min":0.51000000000000001,"5min":0.50800000000000001,"15min":0.42899999999999999},"max":{"1min":1.3819999999999999,"5min":1.583,"15min":1.583},"last":42.942}]},{"osd":4,"last update":"Tue Jan 23 09:24:16 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.115,"15min":1.105},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.47299999999999998},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":2.3050000000000002},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.101,"5min":1.1539999999999999,"15min":1.1459999999999999},"min":{"1min":0.82599999999999996,"5min":0.72399999999999998,"15min":0.60099999999999998},"max":{"1min":1.3899999999999999,"5min":1.899,"15min":1.982},"last":3.6619999999999999}]},{"osd":5,"last update":"Tue Jan 23 09:24:16 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.1439999999999999,"15min":1.1240000000000001},"min":{"1min":0.749,"5min":0.63800000000000001,"15min":0.5},"max":{"1min":1.466,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":5.6210000000000004},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.244,"15min":1.236},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.51700000000000002},"max":{"1min":1.796,"5min":1.8460000000000001,"15min":2.1080000000000001},"last":1.2450000000000001}]},{"osd":6,"last update":"Tue Jan 23 09:24:16 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.242,"15min":1.24},"min":{"1min":0.66700000000000004,"5min":0.60999999999999999,"15min":0.59599999999999997},"max":{"1min":1.6859999999999999,"5min":2.0150000000000001,"15min":2.036},"last":3.5609999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2410000000000001,"15min":1.2250000000000001},"min":{"1min":0.754,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.6830000000000001,"5min":1.821,"15min":2.0070000000000001},"last":3.4359999999999999}]},{"osd":7,"last update":"Tue Jan 23 09:24:16 2024","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.298,"15min":1.3049999999999999},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.54400000000000004},"max":{"1min":1.98,"5min":1.98,"15min":2.2160000000000002},"last":1.397},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.306,"15min":1.304},"min":{"1min":0.84899999999999998,"5min":0.65700000000000003,"15min":0.57699999999999996},"max":{"1min":1.6200000000000001,"5min":1.7869999999999999,"15min":1.9139999999999999},"last":4.3330000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509820,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47980,"kb_used_data":12644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323860,"statfs":{"total":96636764160,"available":96587632640,"internally_reserved":0,"allocated":12947456,"data_stored":12717118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.755,"15min":0.73699999999999999},"min":{"1min":0.54400000000000004,"5min":0.434,"15min":0.28100000000000003},"max":{"1min":1.1850000000000001,"5min":1.492,"15min":1.514},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.78100000000000003,"15min":0.751},"min":{"1min":0.51800000000000002,"5min":0.45800000000000002,"15min":0.34799999999999998},"max":{"1min":1.155,"5min":1.2450000000000001,"15min":1.641},"last":1.0489999999999999}]},{"osd":1,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.83899999999999997,"15min":0.79700000000000004},"min":{"1min":0.53600000000000003,"5min":0.42099999999999999,"15min":0.309},"max":{"1min":1.0820000000000001,"5min":1.782,"15min":1.782},"last":0.63500000000000001},{"interface":"front","average":{"1min":1.026,"5min":0.95999999999999996,"15min":0.90500000000000003},"min":{"1min":0.70199999999999996,"5min":0.437,"15min":0.32900000000000001},"max":{"1min":1.367,"5min":2.698,"15min":2.698},"last":0.84099999999999997}]},{"osd":2,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.95899999999999996,"15min":0.91200000000000003},"min":{"1min":0.67600000000000005,"5min":0.54800000000000004,"15min":0.379},"max":{"1min":1.3879999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.018,"15min":0.96499999999999997},"min":{"1min":0.56100000000000005,"5min":0.49399999999999999,"15min":0.312},"max":{"1min":1.405,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":1.1899999999999999}]},{"osd":4,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.093,"15min":1.0720000000000001},"min":{"1min":0.85399999999999998,"5min":0.624,"15min":0.57099999999999995},"max":{"1min":1.53,"5min":1.53,"15min":1.736},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1439999999999999,"15min":1.1000000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.499},"max":{"1min":1.4419999999999999,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":0.90700000000000003}]},{"osd":5,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1890000000000001,"15min":1.1499999999999999},"min":{"1min":0.873,"5min":0.72199999999999998,"15min":0.51800000000000002},"max":{"1min":1.5800000000000001,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.093},{"interface":"front","average":{"1min":1.256,"5min":1.284,"15min":1.24},"min":{"1min":0.88700000000000001,"5min":0.69399999999999995,"15min":0.47999999999999998},"max":{"1min":1.7549999999999999,"5min":2.794,"15min":2.794},"last":1.3109999999999999}]},{"osd":6,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3160000000000001,"15min":1.2669999999999999},"min":{"1min":0.94499999999999995,"5min":0.77200000000000002,"15min":0.61399999999999999},"max":{"1min":1.877,"5min":2.8730000000000002,"15min":2.8730000000000002},"last":1.012},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.1970000000000001,"15min":1.1859999999999999},"min":{"1min":0.87,"5min":0.68000000000000005,"15min":0.60699999999999998},"max":{"1min":1.577,"5min":1.5880000000000001,"15min":2.3170000000000002},"last":1.343}]},{"osd":7,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.258,"15min":1.224},"min":{"1min":1.1319999999999999,"5min":0.91100000000000003,"15min":0.68000000000000005},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":2.1960000000000002},"last":1.28},{"interface":"front","average":{"1min":1.331,"5min":1.2969999999999999,"15min":1.262},"min":{"1min":1.004,"5min":0.90700000000000003,"15min":0.63400000000000001},"max":{"1min":1.679,"5min":1.9330000000000001,"15min":2.0910000000000002},"last":1.246}]}]},{"osd":6,"up_from":14,"seq":60129542522,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43924,"kb_used_data":4428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327916,"statfs":{"total":96636764160,"available":96591785984,"internally_reserved":0,"allocated":4534272,"data_stored":4328749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.90200000000000002,"15min":0.87},"min":{"1min":0.56999999999999995,"5min":0.48099999999999998,"15min":0.44},"max":{"1min":1.274,"5min":1.3520000000000001,"15min":1.4199999999999999},"last":0.871},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.88900000000000001,"15min":0.89500000000000002},"min":{"1min":0.61599999999999999,"5min":0.501,"15min":0.39600000000000002},"max":{"1min":1.141,"5min":1.575,"15min":1.575},"last":0.89400000000000002}]},{"osd":1,"last update":"Tue Jan 23 09:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.94699999999999995,"15min":0.93500000000000005},"min":{"1min":0.623,"5min":0.55500000000000005,"15min":0.53500000000000003},"max":{"1min":1.2669999999999999,"5min":1.3169999999999999,"15min":1.3400000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0209999999999999,"15min":0.98499999999999999},"min":{"1min":0.67800000000000005,"5min":0.57699999999999996,"15min":0.48399999999999999},"max":{"1min":1.359,"5min":1.5209999999999999,"15min":1.548},"last":0.70199999999999996}]},{"osd":2,"last update":"Tue Jan 23 09:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.93600000000000005,"15min":0.92400000000000004},"min":{"1min":0.55300000000000005,"5min":0.502,"15min":0.502},"max":{"1min":1.302,"5min":1.484,"15min":2.1219999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.93000000000000005,"15min":0.93100000000000005},"min":{"1min":0.68300000000000005,"5min":0.58599999999999997,"15min":0.46700000000000003},"max":{"1min":1.2529999999999999,"5min":1.3180000000000001,"15min":1.429},"last":1.1699999999999999}]},{"osd":3,"last update":"Tue Jan 23 09:24:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.042,"15min":1.044},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.625},"max":{"1min":1.4119999999999999,"5min":1.4390000000000001,"15min":1.4850000000000001},"last":1.097},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.022,"15min":1.0209999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.53900000000000003},"max":{"1min":1.2130000000000001,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.93700000000000006}]},{"osd":4,"last update":"Tue Jan 23 09:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.95799999999999996,"15min":0.95299999999999996},"min":{"1min":0.64800000000000002,"5min":0.57699999999999996,"15min":0.53800000000000003},"max":{"1min":1.21,"5min":1.4419999999999999,"15min":1.518},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0880000000000001,"15min":1.1000000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3540000000000001,"5min":1.4790000000000001,"15min":1.5680000000000001},"last":0.73399999999999999}]},{"osd":5,"last update":"Tue Jan 23 09:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.95399999999999996,"15min":0.95499999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.497},"max":{"1min":1.339,"5min":1.4299999999999999,"15min":1.734},"last":0.59999999999999998},{"interface":"front","average":{"1min":1.081,"5min":1.145,"15min":1.1379999999999999},"min":{"1min":0.78500000000000003,"5min":0.63800000000000001,"15min":0.57599999999999996},"max":{"1min":1.3899999999999999,"5min":1.601,"15min":2.278},"last":0.50600000000000001}]},{"osd":7,"last update":"Tue Jan 23 09:24:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.034,"15min":1.042},"min":{"1min":0.71499999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3919999999999999,"5min":1.659,"15min":1.659},"last":1.018},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0629999999999999,"15min":1.075},"min":{"1min":0.66900000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.2969999999999999,"5min":1.5289999999999999,"15min":1.6599999999999999},"last":0.83999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4231168,"data_stored":4198008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12627968,"data_stored":12586215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8441856,"data_stored":8391118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6434816,"data_stored":6404475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4214784,"data_stored":4197846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2252800,"data_stored":2209818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-23T09:25:11.866 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-23T09:25:12.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.022+0000 7faaefe94640 1 Processor -- start 2024-01-23T09:25:12.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.022+0000 7faaefe94640 1 -- start start 2024-01-23T09:25:12.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.022+0000 7faaefe94640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faae8153960 0x7faae80c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:12.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.022+0000 7faaefe94640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7faae815d610 0x7faae80c4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:12.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.022+0000 7faaefe94640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faae8159740 con 0x7faae80c3de0 2024-01-23T09:25:12.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.022+0000 7faaefe94640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae8153d40 con 0x7faae8153960 2024-01-23T09:25:12.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.022+0000 7faaefe94640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae81599e0 con 0x7faae815d610 2024-01-23T09:25:12.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.022+0000 7faaedc30640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faae8153960 0x7faae80c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:12.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.022+0000 7faaedc30640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faae8153960 0x7faae80c9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52000/0 (socket says 172.21.15.46:52000) 2024-01-23T09:25:12.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.022+0000 7faaedc30640 1 -- 172.21.15.46:0/3034913661 learned_addr learned my addr 172.21.15.46:0/3034913661 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:12.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.026+0000 7faaee431640 1 --2- 172.21.15.46:0/3034913661 >> v2:172.21.15.175:3300/0 conn(0x7faae815d610 0x7faae80c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:12.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.026+0000 7faaedc30640 1 -- 172.21.15.46:0/3034913661 >> v2:172.21.15.175:3300/0 conn(0x7faae815d610 msgr2=0x7faae80c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:12.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.026+0000 7faaedc30640 1 --2- 172.21.15.46:0/3034913661 >> v2:172.21.15.175:3300/0 conn(0x7faae815d610 0x7faae80c4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:12.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.026+0000 7faaedc30640 1 -- 172.21.15.46:0/3034913661 >> v1:172.21.15.175:6789/0 conn(0x7faae80c3de0 legacy=0x7faae815cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:12.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.026+0000 7faaedc30640 1 -- 172.21.15.46:0/3034913661 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae8159cc0 con 0x7faae8153960 2024-01-23T09:25:12.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.030+0000 7faaedc30640 1 --2- 172.21.15.46:0/3034913661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae8153960 0x7faae80c9da0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7faae808c2c0 tx=0x7faae401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55970c658902e43b server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:12.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.034+0000 7faaecc2e640 1 -- 172.21.15.46:0/3034913661 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae40a89f0 con 0x7faae8153960 2024-01-23T09:25:12.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.034+0000 7faaecc2e640 1 -- 172.21.15.46:0/3034913661 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae40a8b50 con 0x7faae8153960 2024-01-23T09:25:12.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.038+0000 7faaecc2e640 1 -- 172.21.15.46:0/3034913661 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae40b0440 con 0x7faae8153960 2024-01-23T09:25:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.038+0000 7faaefe94640 1 -- 172.21.15.46:0/3034913661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae8153960 msgr2=0x7faae80c9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.038+0000 7faaefe94640 1 --2- 172.21.15.46:0/3034913661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae8153960 0x7faae80c9da0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7faae808c2c0 tx=0x7faae401ecf0 comp rx=0 tx=0).stop 2024-01-23T09:25:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.038+0000 7faaefe94640 1 -- 172.21.15.46:0/3034913661 shutdown_connections 2024-01-23T09:25:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.038+0000 7faaefe94640 1 --2- 172.21.15.46:0/3034913661 >> v2:172.21.15.175:3300/0 conn(0x7faae815d610 0x7faae80c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.038+0000 7faaefe94640 1 --2- 172.21.15.46:0/3034913661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae8153960 0x7faae80c9da0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.038+0000 7faaefe94640 1 -- 172.21.15.46:0/3034913661 >> 172.21.15.46:0/3034913661 conn(0x7faae808afa0 msgr2=0x7faae808b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.038+0000 7faaefe94640 1 -- 172.21.15.46:0/3034913661 shutdown_connections 2024-01-23T09:25:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.038+0000 7faaefe94640 1 -- 172.21.15.46:0/3034913661 wait complete. 2024-01-23T09:25:12.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.038+0000 7faaefe94640 1 Processor -- start 2024-01-23T09:25:12.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.038+0000 7faaefe94640 1 -- start start 2024-01-23T09:25:12.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.038+0000 7faaefe94640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faae80c3de0 0x7faae8149ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:12.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.038+0000 7faaefe94640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae8153960 0x7faae81ef610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:12.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.038+0000 7faaefe94640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faae815d610 0x7faae80b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:12.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.038+0000 7faaefe94640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae81ef180 con 0x7faae8153960 2024-01-23T09:25:12.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.038+0000 7faaefe94640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae814a1e0 con 0x7faae80c3de0 2024-01-23T09:25:12.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.038+0000 7faaefe94640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae81f3030 con 0x7faae815d610 2024-01-23T09:25:12.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.038+0000 7faaed42f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae8153960 0x7faae81ef610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:12.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.038+0000 7faaed42f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae8153960 0x7faae81ef610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52002/0 (socket says 172.21.15.46:52002) 2024-01-23T09:25:12.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.038+0000 7faaed42f640 1 -- 172.21.15.46:0/783349633 learned_addr learned my addr 172.21.15.46:0/783349633 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:12.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.042+0000 7faaee431640 1 --2- 172.21.15.46:0/783349633 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faae815d610 0x7faae80b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:12.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.042+0000 7faaedc30640 1 --2- 172.21.15.46:0/783349633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faae80c3de0 0x7faae8149ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:12.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.042+0000 7faaed42f640 1 -- 172.21.15.46:0/783349633 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faae815d610 msgr2=0x7faae80b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:12.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.042+0000 7faaed42f640 1 --2- 172.21.15.46:0/783349633 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faae815d610 0x7faae80b41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:12.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.042+0000 7faaed42f640 1 -- 172.21.15.46:0/783349633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faae80c3de0 msgr2=0x7faae8149ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:12.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.042+0000 7faaed42f640 1 --2- 172.21.15.46:0/783349633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faae80c3de0 0x7faae8149ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:12.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.042+0000 7faaed42f640 1 -- 172.21.15.46:0/783349633 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae40094d0 con 0x7faae8153960 2024-01-23T09:25:12.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.046+0000 7faaed42f640 1 --2- 172.21.15.46:0/783349633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae8153960 0x7faae81ef610 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7faad800c420 tx=0x7faad800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:12.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.050+0000 7faade7fc640 1 -- 172.21.15.46:0/783349633 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad80052d0 con 0x7faae8153960 2024-01-23T09:25:12.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.050+0000 7faade7fc640 1 -- 172.21.15.46:0/783349633 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad8005430 con 0x7faae8153960 2024-01-23T09:25:12.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.050+0000 7faaefe94640 1 -- 172.21.15.46:0/783349633 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae815c480 con 0x7faae8153960 2024-01-23T09:25:12.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.050+0000 7faade7fc640 1 -- 172.21.15.46:0/783349633 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad8007260 con 0x7faae8153960 2024-01-23T09:25:12.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.050+0000 7faaefe94640 1 -- 172.21.15.46:0/783349633 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae81eee10 con 0x7faae8153960 2024-01-23T09:25:12.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.054+0000 7faaefe94640 1 -- 172.21.15.46:0/783349633 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae81eefd0 con 0x7faae8153960 2024-01-23T09:25:12.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.074+0000 7faade7fc640 1 -- 172.21.15.46:0/783349633 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7faad80073c0 con 0x7faae8153960 2024-01-23T09:25:12.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.074+0000 7faade7fc640 1 --2- 172.21.15.46:0/783349633 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7faacc066580 0x7faacc068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:12.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.074+0000 7faaedc30640 1 --2- 172.21.15.46:0/783349633 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7faacc066580 0x7faacc068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:12.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.074+0000 7faaedc30640 1 --2- 172.21.15.46:0/783349633 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7faacc066580 0x7faacc068a40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7faae40b2000 tx=0x7faae40aa070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:12.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.078+0000 7faade7fc640 1 -- 172.21.15.46:0/783349633 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7faad8054a00 con 0x7faae8153960 2024-01-23T09:25:12.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.362+0000 7faade7fc640 1 -- 172.21.15.46:0/783349633 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7faad8050d40 con 0x7faae8153960 2024-01-23T09:25:12.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.534+0000 7faaefe94640 1 -- 172.21.15.46:0/783349633 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faae8074340 con 0x7faae8153960 2024-01-23T09:25:12.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.606+0000 7faade7fc640 1 -- 172.21.15.46:0/783349633 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18552 (secure 0 0 0) 0x7faad8020020 con 0x7faae8153960 2024-01-23T09:25:12.611 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T09:25:12.611 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":30,"fsid":"fdbdd393-f422-45ae-a488-2bbb0163e580","created":"2024-01-23T08:53:36.942515+0000","modified":"2024-01-23T08:55:46.483867+0000","last_up_change":"2024-01-23T08:53:57.198113+0000","last_in_change":"2024-01-23T08:53:47.852614+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-23T08:53:59.340853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-23T08:54:38.278770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-23T08:54:40.216521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-23T08:54:47.311079+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f32c3d7d-e32a-42d8-b55f-db874d915a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6818","nonce":2681790976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6821","nonce":2681790976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6825","nonce":2681790976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6823","nonce":2681790976}]},"public_addr":"172.21.15.46:6818/2681790976","cluster_addr":"172.21.15.46:6821/2681790976","heartbeat_back_addr":"172.21.15.46:6825/2681790976","heartbeat_front_addr":"172.21.15.46:6823/2681790976","state":["exists","up"]},{"osd":1,"uuid":"6f3b6bd2-bbea-4d08-84d5-4407363b5eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6803","nonce":3679152623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6805","nonce":3679152623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6809","nonce":3679152623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6807","nonce":3679152623}]},"public_addr":"172.21.15.46:6803/3679152623","cluster_addr":"172.21.15.46:6805/3679152623","heartbeat_back_addr":"172.21.15.46:6809/3679152623","heartbeat_front_addr":"172.21.15.46:6807/3679152623","state":["exists","up"]},{"osd":2,"uuid":"8f110727-31e7-4f69-926b-c87481d4d28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6811","nonce":3869652274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6813","nonce":3869652274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6820","nonce":3869652274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6815","nonce":3869652274}]},"public_addr":"172.21.15.46:6811/3869652274","cluster_addr":"172.21.15.46:6813/3869652274","heartbeat_back_addr":"172.21.15.46:6820/3869652274","heartbeat_front_addr":"172.21.15.46:6815/3869652274","state":["exists","up"]},{"osd":3,"uuid":"3aa7527d-0463-4373-b9c7-e6b507a7987f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6827","nonce":4168860822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6829","nonce":4168860822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6833","nonce":4168860822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6831","nonce":4168860822}]},"public_addr":"172.21.15.46:6827/4168860822","cluster_addr":"172.21.15.46:6829/4168860822","heartbeat_back_addr":"172.21.15.46:6833/4168860822","heartbeat_front_addr":"172.21.15.46:6831/4168860822","state":["exists","up"]},{"osd":4,"uuid":"eb47a1e5-9f26-465f-b188-87c6eed63c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6805","nonce":3115257412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6808","nonce":3115257412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6815","nonce":3115257412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6812","nonce":3115257412}]},"public_addr":"172.21.15.175:6805/3115257412","cluster_addr":"172.21.15.175:6808/3115257412","heartbeat_back_addr":"172.21.15.175:6815/3115257412","heartbeat_front_addr":"172.21.15.175:6812/3115257412","state":["exists","up"]},{"osd":5,"uuid":"34048409-998c-44f3-a29d-dcad7a6c917b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6818","nonce":3146473948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6822","nonce":3146473948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6831","nonce":3146473948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6826","nonce":3146473948}]},"public_addr":"172.21.15.175:6818/3146473948","cluster_addr":"172.21.15.175:6822/3146473948","heartbeat_back_addr":"172.21.15.175:6831/3146473948","heartbeat_front_addr":"172.21.15.175:6826/3146473948","state":["exists","up"]},{"osd":6,"uuid":"f5d45d3f-9af3-44a1-a730-c260ed1654b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6801","nonce":4161180058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6804","nonce":4161180058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6814","nonce":4161180058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6809","nonce":4161180058}]},"public_addr":"172.21.15.175:6801/4161180058","cluster_addr":"172.21.15.175:6804/4161180058","heartbeat_back_addr":"172.21.15.175:6814/4161180058","heartbeat_front_addr":"172.21.15.175:6809/4161180058","state":["exists","up"]},{"osd":7,"uuid":"16d12e53-2ad3-4b5c-a789-22b45056fd9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6819","nonce":2670236415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6823","nonce":2670236415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6830","nonce":2670236415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6827","nonce":2670236415}]},"public_addr":"172.21.15.175:6819/2670236415","cluster_addr":"172.21.15.175:6823/2670236415","heartbeat_back_addr":"172.21.15.175:6830/2670236415","heartbeat_front_addr":"172.21.15.175:6827/2670236415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.847037+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.765547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.716122+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.874628+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.786580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.924885+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.285635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.898130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":0,"to":7}]},{"pgid":"4.4","mappings":[{"from":3,"to":5}]},{"pgid":"4.17","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T09:25:12.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.610+0000 7faaefe94640 1 -- 172.21.15.46:0/783349633 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7faacc066580 msgr2=0x7faacc068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:12.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.610+0000 7faaefe94640 1 --2- 172.21.15.46:0/783349633 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7faacc066580 0x7faacc068a40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7faae40b2000 tx=0x7faae40aa070 comp rx=0 tx=0).stop 2024-01-23T09:25:12.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.610+0000 7faaefe94640 1 -- 172.21.15.46:0/783349633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae8153960 msgr2=0x7faae81ef610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:12.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.610+0000 7faaefe94640 1 --2- 172.21.15.46:0/783349633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae8153960 0x7faae81ef610 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7faad800c420 tx=0x7faad800c8e0 comp rx=0 tx=0).stop 2024-01-23T09:25:12.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.610+0000 7faaefe94640 1 -- 172.21.15.46:0/783349633 shutdown_connections 2024-01-23T09:25:12.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.610+0000 7faaefe94640 1 --2- 172.21.15.46:0/783349633 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faae815d610 0x7faae80b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:12.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.610+0000 7faaefe94640 1 --2- 172.21.15.46:0/783349633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae8153960 0x7faae81ef610 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:12.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.610+0000 7faaefe94640 1 --2- 172.21.15.46:0/783349633 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7faacc066580 0x7faacc068a40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:12.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.610+0000 7faaefe94640 1 --2- 172.21.15.46:0/783349633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faae80c3de0 0x7faae8149ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:12.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.610+0000 7faaefe94640 1 -- 172.21.15.46:0/783349633 >> 172.21.15.46:0/783349633 conn(0x7faae808afa0 msgr2=0x7faae8150c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:12.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.610+0000 7faaefe94640 1 -- 172.21.15.46:0/783349633 shutdown_connections 2024-01-23T09:25:12.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:12.610+0000 7faaefe94640 1 -- 172.21.15.46:0/783349633 wait complete. 2024-01-23T09:25:13.635 INFO:tasks.ceph:Scrubbing osd.0 2024-01-23T09:25:13.635 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-01-23T09:25:13.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.774+0000 7f2bbc60c640 1 Processor -- start 2024-01-23T09:25:13.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.774+0000 7f2bbc60c640 1 -- start start 2024-01-23T09:25:13.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.778+0000 7f2bbc60c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2bb415cde0 0x7f2bb40b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:13.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.778+0000 7f2bbc60c640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb40ca750 con 0x7f2bb4071d90 2024-01-23T09:25:13.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.778+0000 7f2bbc60c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb4072240 con 0x7f2bb4153ba0 2024-01-23T09:25:13.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.778+0000 7f2bbc60c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb40b3b10 con 0x7f2bb415cde0 2024-01-23T09:25:13.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.778+0000 7f2bb9ba7640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2bb4071d90 0x7f2bb40b1c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41494/0 (socket says 172.21.15.46:41494) 2024-01-23T09:25:13.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.778+0000 7f2bb9ba7640 1 -- 172.21.15.46:0/98027953 learned_addr learned my addr 172.21.15.46:0/98027953 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T09:25:13.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.778+0000 7f2bbaba9640 1 --2- 172.21.15.46:0/98027953 >> v2:172.21.15.175:3300/0 conn(0x7f2bb415cde0 0x7f2bb40b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:13.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.782+0000 7f2bb93a6640 1 -- 172.21.15.46:0/98027953 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829073060 0 0) 0x7f2bb40ca750 con 0x7f2bb4071d90 2024-01-23T09:25:13.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.782+0000 7f2bb93a6640 1 -- 172.21.15.46:0/98027953 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ba0003530 con 0x7f2bb4071d90 2024-01-23T09:25:13.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.782+0000 7f2bb93a6640 1 -- 172.21.15.46:0/98027953 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3127953846 0 0) 0x7f2ba0003530 con 0x7f2bb4071d90 2024-01-23T09:25:13.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.786+0000 7f2bb93a6640 1 -- 172.21.15.46:0/98027953 >> v2:172.21.15.175:3300/0 conn(0x7f2bb415cde0 msgr2=0x7f2bb40b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:13.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.786+0000 7f2bb93a6640 1 --2- 172.21.15.46:0/98027953 >> v2:172.21.15.175:3300/0 conn(0x7f2bb415cde0 0x7f2bb40b35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:13.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.786+0000 7f2bb93a6640 1 -- 172.21.15.46:0/98027953 >> v1:172.21.15.175:6789/0 conn(0x7f2bb4153ba0 legacy=0x7f2bb40ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:13.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.786+0000 7f2bb93a6640 1 -- 172.21.15.46:0/98027953 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb4072520 con 0x7f2bb4071d90 2024-01-23T09:25:13.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.786+0000 7f2bb93a6640 1 -- 172.21.15.46:0/98027953 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466917103 0 0) 0x7f2ba4001680 con 0x7f2bb4071d90 2024-01-23T09:25:13.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.786+0000 7f2bb93a6640 1 -- 172.21.15.46:0/98027953 >> v1:172.21.15.46:6789/0 conn(0x7f2bb4071d90 legacy=0x7f2bb40b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:13.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.786+0000 7f2bb93a6640 1 --2- 172.21.15.46:0/98027953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ba00039d0 0x7f2ba0003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:13.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.786+0000 7f2bb93a6640 1 --2- 172.21.15.46:0/98027953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ba00047d0 0x7f2ba0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:13.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.786+0000 7f2bb93a6640 1 --2- 172.21.15.46:0/98027953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ba00051e0 0x7f2ba000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:13.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.786+0000 7f2bb93a6640 1 -- 172.21.15.46:0/98027953 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb40b3b10 con 0x7f2ba00039d0 2024-01-23T09:25:13.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.786+0000 7f2bb93a6640 1 -- 172.21.15.46:0/98027953 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba000c120 con 0x7f2ba00047d0 2024-01-23T09:25:13.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.786+0000 7f2bb93a6640 1 -- 172.21.15.46:0/98027953 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba000c2e0 con 0x7f2ba00051e0 2024-01-23T09:25:13.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.786+0000 7f2bbaba9640 1 --2- 172.21.15.46:0/98027953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ba00051e0 0x7f2ba000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:13.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.786+0000 7f2bba3a8640 1 --2- 172.21.15.46:0/98027953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ba00039d0 0x7f2ba0003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:13.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.790+0000 7f2bba3a8640 1 -- 172.21.15.46:0/98027953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ba00051e0 msgr2=0x7f2ba000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:13.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.790+0000 7f2bba3a8640 1 --2- 172.21.15.46:0/98027953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ba00051e0 0x7f2ba000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:13.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.790+0000 7f2bba3a8640 1 -- 172.21.15.46:0/98027953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ba00047d0 msgr2=0x7f2ba0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:13.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.790+0000 7f2bba3a8640 1 --2- 172.21.15.46:0/98027953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ba00047d0 0x7f2ba0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:13.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.790+0000 7f2bba3a8640 1 -- 172.21.15.46:0/98027953 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba0003530 con 0x7f2ba00039d0 2024-01-23T09:25:13.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.790+0000 7f2bbaba9640 1 -- 172.21.15.46:0/98027953 reap_dead start 2024-01-23T09:25:13.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.794+0000 7f2bba3a8640 1 --2- 172.21.15.46:0/98027953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ba00039d0 0x7f2ba0003df0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0001780 tx=0x7f2bb001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e954621da09d3680 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:13.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.798+0000 7f2bb93a6640 1 -- 172.21.15.46:0/98027953 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb00052d0 con 0x7f2ba00039d0 2024-01-23T09:25:13.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.798+0000 7f2bb93a6640 1 -- 172.21.15.46:0/98027953 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb00a7050 con 0x7f2ba00039d0 2024-01-23T09:25:13.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.798+0000 7f2bb93a6640 1 -- 172.21.15.46:0/98027953 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0003600 con 0x7f2ba00039d0 2024-01-23T09:25:13.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.798+0000 7f2bbc60c640 1 -- 172.21.15.46:0/98027953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ba00039d0 msgr2=0x7f2ba0003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:13.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.798+0000 7f2bbc60c640 1 --2- 172.21.15.46:0/98027953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ba00039d0 0x7f2ba0003df0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0001780 tx=0x7f2bb001c3e0 comp rx=0 tx=0).stop 2024-01-23T09:25:13.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.798+0000 7f2bbc60c640 1 -- 172.21.15.46:0/98027953 shutdown_connections 2024-01-23T09:25:13.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.798+0000 7f2bbc60c640 1 --2- 172.21.15.46:0/98027953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ba00039d0 0x7f2ba0003df0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:13.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.798+0000 7f2bbc60c640 1 -- 172.21.15.46:0/98027953 >> 172.21.15.46:0/98027953 conn(0x7f2bb408afa0 msgr2=0x7f2bb408b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:13.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.798+0000 7f2bbc60c640 1 -- 172.21.15.46:0/98027953 shutdown_connections 2024-01-23T09:25:13.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.798+0000 7f2bbc60c640 1 -- 172.21.15.46:0/98027953 wait complete. 2024-01-23T09:25:13.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.802+0000 7f2bbc60c640 1 Processor -- start 2024-01-23T09:25:13.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.802+0000 7f2bbc60c640 1 -- start start 2024-01-23T09:25:13.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.802+0000 7f2bbc60c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ba00039d0 0x7f2bb4151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:13.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.802+0000 7f2bbc60c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bb4156930 0x7f2bb414b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:13.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.802+0000 7f2bbc60c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bb414b7b0 0x7f2bb41f27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:13.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.802+0000 7f2bbc60c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb414bc30 con 0x7f2bb414b7b0 2024-01-23T09:25:13.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.802+0000 7f2bbc60c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb40c8f90 con 0x7f2ba00039d0 2024-01-23T09:25:13.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.802+0000 7f2bbc60c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb4153470 con 0x7f2bb4156930 2024-01-23T09:25:13.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.802+0000 7f2bbaba9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bb414b7b0 0x7f2bb41f27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:13.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.802+0000 7f2bbaba9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bb414b7b0 0x7f2bb41f27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47698/0 (socket says 172.21.15.46:47698) 2024-01-23T09:25:13.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.802+0000 7f2bbaba9640 1 -- 172.21.15.46:0/2966335479 learned_addr learned my addr 172.21.15.46:0/2966335479 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:13.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.802+0000 7f2bb9ba7640 1 --2- 172.21.15.46:0/2966335479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bb4156930 0x7f2bb414b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:13.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.806+0000 7f2bba3a8640 1 --2- 172.21.15.46:0/2966335479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ba00039d0 0x7f2bb4151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:13.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.806+0000 7f2bbaba9640 1 -- 172.21.15.46:0/2966335479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bb4156930 msgr2=0x7f2bb414b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:13.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.806+0000 7f2bbaba9640 1 --2- 172.21.15.46:0/2966335479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bb4156930 0x7f2bb414b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:13.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.806+0000 7f2bbaba9640 1 -- 172.21.15.46:0/2966335479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ba00039d0 msgr2=0x7f2bb4151110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:13.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.806+0000 7f2bbaba9640 1 --2- 172.21.15.46:0/2966335479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ba00039d0 0x7f2bb4151110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:13.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.806+0000 7f2bbaba9640 1 -- 172.21.15.46:0/2966335479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb40c74d0 con 0x7f2bb414b7b0 2024-01-23T09:25:13.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.810+0000 7f2bbaba9640 1 --2- 172.21.15.46:0/2966335479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bb414b7b0 0x7f2bb41f27a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40c5fd0 tx=0x7f2bac007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:13.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.810+0000 7f2baaffd640 1 -- 172.21.15.46:0/2966335479 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac0046a0 con 0x7f2bb414b7b0 2024-01-23T09:25:13.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.810+0000 7f2baaffd640 1 -- 172.21.15.46:0/2966335479 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bac004800 con 0x7f2bb414b7b0 2024-01-23T09:25:13.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.810+0000 7f2baaffd640 1 -- 172.21.15.46:0/2966335479 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac015660 con 0x7f2bb414b7b0 2024-01-23T09:25:13.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.810+0000 7f2bbc60c640 1 -- 172.21.15.46:0/2966335479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb4152eb0 con 0x7f2bb414b7b0 2024-01-23T09:25:13.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.814+0000 7f2bbc60c640 1 -- 172.21.15.46:0/2966335479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb40c77b0 con 0x7f2bb414b7b0 2024-01-23T09:25:13.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.814+0000 7f2bbc60c640 1 -- 172.21.15.46:0/2966335479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2bb40b30b0 con 0x7f2bb414b7b0 2024-01-23T09:25:13.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.834+0000 7f2baaffd640 1 -- 172.21.15.46:0/2966335479 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f2bac0157c0 con 0x7f2bb414b7b0 2024-01-23T09:25:13.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.834+0000 7f2baaffd640 1 --2- 172.21.15.46:0/2966335479 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f2b98066500 0x7f2b980689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:13.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.834+0000 7f2bba3a8640 1 --2- 172.21.15.46:0/2966335479 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f2b98066500 0x7f2b980689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:13.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.838+0000 7f2bba3a8640 1 --2- 172.21.15.46:0/2966335479 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f2b98066500 0x7f2b980689c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0001750 tx=0x7f2bb00011a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:13.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.838+0000 7f2baaffd640 1 -- 172.21.15.46:0/2966335479 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f2bac056550 con 0x7f2bb414b7b0 2024-01-23T09:25:13.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.838+0000 7f2baaffd640 1 --2- 172.21.15.46:0/2966335479 >> [v2:172.21.15.46:6816/2681790976,v1:172.21.15.46:6818/2681790976] conn(0x7f2b9806fb60 0x7f2b98072000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:13.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.838+0000 7f2baaffd640 1 -- 172.21.15.46:0/2966335479 --> [v2:172.21.15.46:6816/2681790976,v1:172.21.15.46:6818/2681790976] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b980726d0 con 0x7f2b9806fb60 2024-01-23T09:25:13.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.838+0000 7f2baaffd640 1 -- 172.21.15.46:0/2966335479 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2bac052190 con 0x7f2bb414b7b0 2024-01-23T09:25:13.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.838+0000 7f2bb9ba7640 1 --2- 172.21.15.46:0/2966335479 >> [v2:172.21.15.46:6816/2681790976,v1:172.21.15.46:6818/2681790976] conn(0x7f2b9806fb60 0x7f2b98072000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:13.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.838+0000 7f2bb9ba7640 1 --2- 172.21.15.46:0/2966335479 >> [v2:172.21.15.46:6816/2681790976,v1:172.21.15.46:6818/2681790976] conn(0x7f2b9806fb60 0x7f2b98072000 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:13.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.842+0000 7f2baaffd640 1 -- 172.21.15.46:0/2966335479 <== osd.0 v2:172.21.15.46:6816/2681790976 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2b980726d0 con 0x7f2b9806fb60 2024-01-23T09:25:13.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.854+0000 7f2bbc60c640 1 -- 172.21.15.46:0/2966335479 --> [v2:172.21.15.46:6816/2681790976,v1:172.21.15.46:6818/2681790976] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2bb40b2dd0 con 0x7f2b9806fb60 2024-01-23T09:25:13.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.854+0000 7f2baaffd640 1 -- 172.21.15.46:0/2966335479 <== osd.0 v2:172.21.15.46:6816/2681790976 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2ba40078f0 con 0x7f2b9806fb60 2024-01-23T09:25:13.858 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-23T09:25:13.858 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-23T09:25:13.858 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-23T09:25:13.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.854+0000 7f2bbc60c640 1 -- 172.21.15.46:0/2966335479 >> [v2:172.21.15.46:6816/2681790976,v1:172.21.15.46:6818/2681790976] conn(0x7f2b9806fb60 msgr2=0x7f2b98072000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:13.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.854+0000 7f2bbc60c640 1 --2- 172.21.15.46:0/2966335479 >> [v2:172.21.15.46:6816/2681790976,v1:172.21.15.46:6818/2681790976] conn(0x7f2b9806fb60 0x7f2b98072000 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:13.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.854+0000 7f2bbc60c640 1 -- 172.21.15.46:0/2966335479 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f2b98066500 msgr2=0x7f2b980689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:13.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.854+0000 7f2bbc60c640 1 --2- 172.21.15.46:0/2966335479 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f2b98066500 0x7f2b980689c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0001750 tx=0x7f2bb00011a0 comp rx=0 tx=0).stop 2024-01-23T09:25:13.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.854+0000 7f2bbc60c640 1 -- 172.21.15.46:0/2966335479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bb414b7b0 msgr2=0x7f2bb41f27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:13.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.854+0000 7f2bbc60c640 1 --2- 172.21.15.46:0/2966335479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2bb414b7b0 0x7f2bb41f27a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40c5fd0 tx=0x7f2bac007700 comp rx=0 tx=0).stop 2024-01-23T09:25:13.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.854+0000 7f2bbaba9640 1 -- 172.21.15.46:0/2966335479 reap_dead start 2024-01-23T09:25:13.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.854+0000 7f2bbc60c640 1 -- 172.21.15.46:0/2966335479 shutdown_connections 2024-01-23T09:25:13.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.854+0000 7f2bbc60c640 1 -- 172.21.15.46:0/2966335479 >> 172.21.15.46:0/2966335479 conn(0x7f2bb408afa0 msgr2=0x7f2bb4157e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:13.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.854+0000 7f2bbc60c640 1 -- 172.21.15.46:0/2966335479 shutdown_connections 2024-01-23T09:25:13.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.854+0000 7f2bbc60c640 1 -- 172.21.15.46:0/2966335479 wait complete. 2024-01-23T09:25:13.877 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-01-23T09:25:14.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.998+0000 7f358b11c640 1 Processor -- start 2024-01-23T09:25:14.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:13.998+0000 7f358b11c640 1 -- start start 2024-01-23T09:25:14.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.002+0000 7f358b11c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3584159bd0 0x7f35840c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:14.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.002+0000 7f358b11c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35840c46c0 0x7f35840c4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:14.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.002+0000 7f358b11c640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35840c28e0 con 0x7f358414fc80 2024-01-23T09:25:14.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.002+0000 7f358b11c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3584159ff0 con 0x7f3584159bd0 2024-01-23T09:25:14.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.002+0000 7f358b11c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3584159740 con 0x7f35840c46c0 2024-01-23T09:25:14.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.002+0000 7f35896b9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35840c46c0 0x7f35840c4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:14.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.002+0000 7f3583fff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3584159bd0 0x7f35840c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:14.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.002+0000 7f35896b9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35840c46c0 0x7f35840c4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:57556/0 (socket says 172.21.15.46:57556) 2024-01-23T09:25:14.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.002+0000 7f35896b9640 1 -- 172.21.15.46:0/1652628811 learned_addr learned my addr 172.21.15.46:0/1652628811 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:14.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.010+0000 7f35896b9640 1 -- 172.21.15.46:0/1652628811 >> v2:172.21.15.175:3300/0 conn(0x7f3584159bd0 msgr2=0x7f35840c5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:14.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.010+0000 7f35896b9640 1 --2- 172.21.15.46:0/1652628811 >> v2:172.21.15.175:3300/0 conn(0x7f3584159bd0 0x7f35840c5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:14.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.010+0000 7f35896b9640 1 -- 172.21.15.46:0/1652628811 >> v1:172.21.15.46:6789/0 conn(0x7f358414fc80 legacy=0x7f35840c7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:14.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.010+0000 7f35896b9640 1 -- 172.21.15.46:0/1652628811 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35840c7c20 con 0x7f35840c46c0 2024-01-23T09:25:14.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.014+0000 7f35896b9640 1 --2- 172.21.15.46:0/1652628811 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35840c46c0 0x7f35840c4b50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f357400aa10 tx=0x7f357401d8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a49b36a101d4e393 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:14.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.022+0000 7f35837fe640 1 -- 172.21.15.46:0/1652628811 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35740a67b0 con 0x7f35840c46c0 2024-01-23T09:25:14.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.026+0000 7f35837fe640 1 -- 172.21.15.46:0/1652628811 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35740a6910 con 0x7f35840c46c0 2024-01-23T09:25:14.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.026+0000 7f35837fe640 1 -- 172.21.15.46:0/1652628811 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35740a6ca0 con 0x7f35840c46c0 2024-01-23T09:25:14.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.026+0000 7f358b11c640 1 -- 172.21.15.46:0/1652628811 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35840c46c0 msgr2=0x7f35840c4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:14.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.026+0000 7f358b11c640 1 --2- 172.21.15.46:0/1652628811 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35840c46c0 0x7f35840c4b50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f357400aa10 tx=0x7f357401d8d0 comp rx=0 tx=0).stop 2024-01-23T09:25:14.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.026+0000 7f358b11c640 1 -- 172.21.15.46:0/1652628811 shutdown_connections 2024-01-23T09:25:14.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.026+0000 7f358b11c640 1 --2- 172.21.15.46:0/1652628811 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35840c46c0 0x7f35840c4b50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:14.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.026+0000 7f358b11c640 1 --2- 172.21.15.46:0/1652628811 >> v2:172.21.15.175:3300/0 conn(0x7f3584159bd0 0x7f35840c5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:14.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.026+0000 7f358b11c640 1 -- 172.21.15.46:0/1652628811 >> 172.21.15.46:0/1652628811 conn(0x7f35840cb3e0 msgr2=0x7f35840cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:14.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.026+0000 7f358b11c640 1 -- 172.21.15.46:0/1652628811 shutdown_connections 2024-01-23T09:25:14.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.026+0000 7f358b11c640 1 -- 172.21.15.46:0/1652628811 wait complete. 2024-01-23T09:25:14.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.026+0000 7f358b11c640 1 Processor -- start 2024-01-23T09:25:14.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.026+0000 7f358b11c640 1 -- start start 2024-01-23T09:25:14.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.026+0000 7f358b11c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35840c46c0 0x7f35841f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:14.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.026+0000 7f358b11c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f358414fc80 0x7f358415e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:14.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.026+0000 7f358b11c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3584159bd0 0x7f35841559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:14.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.026+0000 7f358b11c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35840cb190 con 0x7f358414fc80 2024-01-23T09:25:14.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.026+0000 7f358b11c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3584154630 con 0x7f35840c46c0 2024-01-23T09:25:14.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.026+0000 7f358b11c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3584154910 con 0x7f3584159bd0 2024-01-23T09:25:14.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.030+0000 7f35896b9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3584159bd0 0x7f35841559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:14.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.030+0000 7f3588eb8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35840c46c0 0x7f35841f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:14.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.030+0000 7f3588eb8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35840c46c0 0x7f35841f22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:39580/0 (socket says 172.21.15.46:39580) 2024-01-23T09:25:14.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.030+0000 7f3588eb8640 1 -- 172.21.15.46:0/4016588655 learned_addr learned my addr 172.21.15.46:0/4016588655 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:14.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.038+0000 7f35896b9640 1 -- 172.21.15.46:0/4016588655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35840c46c0 msgr2=0x7f35841f22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:14.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.038+0000 7f35896b9640 1 --2- 172.21.15.46:0/4016588655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35840c46c0 0x7f35841f22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:14.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.038+0000 7f35896b9640 1 -- 172.21.15.46:0/4016588655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f358414fc80 msgr2=0x7f358415e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:14.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.038+0000 7f35896b9640 1 --2- 172.21.15.46:0/4016588655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f358414fc80 0x7f358415e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:14.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.038+0000 7f35896b9640 1 -- 172.21.15.46:0/4016588655 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357400a670 con 0x7f3584159bd0 2024-01-23T09:25:14.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.046+0000 7f35896b9640 1 --2- 172.21.15.46:0/4016588655 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3584159bd0 0x7f35841559b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f35740ad000 tx=0x7f357401a670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:14.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.054+0000 7f35817fa640 1 -- 172.21.15.46:0/4016588655 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35740bd070 con 0x7f3584159bd0 2024-01-23T09:25:14.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.054+0000 7f35817fa640 1 -- 172.21.15.46:0/4016588655 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35740ae650 con 0x7f3584159bd0 2024-01-23T09:25:14.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.054+0000 7f35817fa640 1 -- 172.21.15.46:0/4016588655 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35740ae9e0 con 0x7f3584159bd0 2024-01-23T09:25:14.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.054+0000 7f358b11c640 1 -- 172.21.15.46:0/4016588655 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3584154bf0 con 0x7f3584159bd0 2024-01-23T09:25:14.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.058+0000 7f358b11c640 1 -- 172.21.15.46:0/4016588655 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35841551b0 con 0x7f3584159bd0 2024-01-23T09:25:14.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.058+0000 7f358b11c640 1 -- 172.21.15.46:0/4016588655 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3584074340 con 0x7f3584159bd0 2024-01-23T09:25:14.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.114+0000 7f35817fa640 1 -- 172.21.15.46:0/4016588655 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f35740aeb40 con 0x7f3584159bd0 2024-01-23T09:25:14.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.114+0000 7f35817fa640 1 --2- 172.21.15.46:0/4016588655 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3570066550 0x7f3570068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:14.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.114+0000 7f3588eb8640 1 --2- 172.21.15.46:0/4016588655 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3570066550 0x7f3570068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:14.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.114+0000 7f3588eb8640 1 --2- 172.21.15.46:0/4016588655 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3570066550 0x7f3570068a10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f357c001fd0 tx=0x7f357c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:14.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.122+0000 7f35817fa640 1 -- 172.21.15.46:0/4016588655 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f35740f0210 con 0x7f3584159bd0 2024-01-23T09:25:14.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.474+0000 7f35817fa640 1 -- 172.21.15.46:0/4016588655 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f35740ebe50 con 0x7f3584159bd0 2024-01-23T09:25:14.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.654+0000 7f358b11c640 1 -- 172.21.15.46:0/4016588655 --> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f35840c53e0 con 0x7f3570066550 2024-01-23T09:25:14.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.654+0000 7f35817fa640 1 -- 172.21.15.46:0/4016588655 <== mgr.4107 v2:172.21.15.46:6800/2324478006 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f35840c53e0 con 0x7f3570066550 2024-01-23T09:25:14.657 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 0 to deep-scrub 2024-01-23T09:25:14.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.658+0000 7f358b11c640 1 -- 172.21.15.46:0/4016588655 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3570066550 msgr2=0x7f3570068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:14.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.658+0000 7f358b11c640 1 --2- 172.21.15.46:0/4016588655 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3570066550 0x7f3570068a10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f357c001fd0 tx=0x7f357c009040 comp rx=0 tx=0).stop 2024-01-23T09:25:14.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.658+0000 7f358b11c640 1 -- 172.21.15.46:0/4016588655 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3584159bd0 msgr2=0x7f35841559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:14.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.658+0000 7f358b11c640 1 --2- 172.21.15.46:0/4016588655 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3584159bd0 0x7f35841559b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f35740ad000 tx=0x7f357401a670 comp rx=0 tx=0).stop 2024-01-23T09:25:14.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.658+0000 7f358b11c640 1 -- 172.21.15.46:0/4016588655 shutdown_connections 2024-01-23T09:25:14.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.658+0000 7f358b11c640 1 --2- 172.21.15.46:0/4016588655 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3584159bd0 0x7f35841559b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:14.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.658+0000 7f358b11c640 1 --2- 172.21.15.46:0/4016588655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f358414fc80 0x7f358415e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:14.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.658+0000 7f358b11c640 1 --2- 172.21.15.46:0/4016588655 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f3570066550 0x7f3570068a10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:14.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.658+0000 7f358b11c640 1 --2- 172.21.15.46:0/4016588655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35840c46c0 0x7f35841f22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:14.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.658+0000 7f358b11c640 1 -- 172.21.15.46:0/4016588655 >> 172.21.15.46:0/4016588655 conn(0x7f35840cb3e0 msgr2=0x7f35840c4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:14.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.658+0000 7f358b11c640 1 -- 172.21.15.46:0/4016588655 shutdown_connections 2024-01-23T09:25:14.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.658+0000 7f358b11c640 1 -- 172.21.15.46:0/4016588655 wait complete. 2024-01-23T09:25:14.679 INFO:tasks.ceph:Scrubbing osd.1 2024-01-23T09:25:14.680 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-01-23T09:25:14.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.806+0000 7f772197f640 1 Processor -- start 2024-01-23T09:25:14.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.806+0000 7f772197f640 1 -- start start 2024-01-23T09:25:14.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.810+0000 7f772197f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f771c151240 0x7f771c0c8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:14.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.810+0000 7f772197f640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f771c151620 0x7f771c0c5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:14.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.810+0000 7f772197f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f771c071400 0x7f771c071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:14.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.810+0000 7f772197f640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f771c0c55c0 con 0x7f771c151620 2024-01-23T09:25:14.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.810+0000 7f772197f640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f771c0c7cd0 con 0x7f771c071400 2024-01-23T09:25:14.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.810+0000 7f772197f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f771c0caff0 con 0x7f771c151240 2024-01-23T09:25:14.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.810+0000 7f771b7fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f771c071400 0x7f771c071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:14.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.810+0000 7f771affd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f771c151240 0x7f771c0c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:14.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.810+0000 7f771affd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f771c151240 0x7f771c0c8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:57574/0 (socket says 172.21.15.46:57574) 2024-01-23T09:25:14.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.810+0000 7f771affd640 1 -- 172.21.15.46:0/3082618780 learned_addr learned my addr 172.21.15.46:0/3082618780 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:14.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.818+0000 7f771b7fe640 1 -- 172.21.15.46:0/3082618780 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f771c151240 msgr2=0x7f771c0c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:14.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.818+0000 7f771b7fe640 1 --2- 172.21.15.46:0/3082618780 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f771c151240 0x7f771c0c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:14.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.818+0000 7f771b7fe640 1 -- 172.21.15.46:0/3082618780 >> v2:172.21.15.46:3300/0 conn(0x7f771c151620 msgr2=0x7f771c0c5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:14.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.818+0000 7f771b7fe640 1 --2- 172.21.15.46:0/3082618780 >> v2:172.21.15.46:3300/0 conn(0x7f771c151620 0x7f771c0c5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:14.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.818+0000 7f771b7fe640 1 -- 172.21.15.46:0/3082618780 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771c158170 con 0x7f771c071400 2024-01-23T09:25:14.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.822+0000 7f771b7fe640 1 --2- 172.21.15.46:0/3082618780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f771c071400 0x7f771c071870 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f771c06cb20 tx=0x7f771401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71fbf4aae109f798 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:14.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.830+0000 7f7719ffb640 1 -- 172.21.15.46:0/3082618780 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77140a5960 con 0x7f771c071400 2024-01-23T09:25:14.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.830+0000 7f7719ffb640 1 -- 172.21.15.46:0/3082618780 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77140a5ac0 con 0x7f771c071400 2024-01-23T09:25:14.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.830+0000 7f7719ffb640 1 -- 172.21.15.46:0/3082618780 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77140a5e50 con 0x7f771c071400 2024-01-23T09:25:14.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.834+0000 7f772197f640 1 -- 172.21.15.46:0/3082618780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f771c071400 msgr2=0x7f771c071870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:14.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.834+0000 7f772197f640 1 --2- 172.21.15.46:0/3082618780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f771c071400 0x7f771c071870 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f771c06cb20 tx=0x7f771401c8e0 comp rx=0 tx=0).stop 2024-01-23T09:25:14.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.834+0000 7f772197f640 1 -- 172.21.15.46:0/3082618780 shutdown_connections 2024-01-23T09:25:14.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.834+0000 7f772197f640 1 --2- 172.21.15.46:0/3082618780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f771c071400 0x7f771c071870 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:14.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.834+0000 7f772197f640 1 --2- 172.21.15.46:0/3082618780 >> v2:172.21.15.46:3300/0 conn(0x7f771c151620 0x7f771c0c5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:14.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.834+0000 7f772197f640 1 --2- 172.21.15.46:0/3082618780 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f771c151240 0x7f771c0c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:14.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.834+0000 7f772197f640 1 -- 172.21.15.46:0/3082618780 >> 172.21.15.46:0/3082618780 conn(0x7f771c066860 msgr2=0x7f771c06d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:14.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.834+0000 7f772197f640 1 -- 172.21.15.46:0/3082618780 shutdown_connections 2024-01-23T09:25:14.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.834+0000 7f772197f640 1 -- 172.21.15.46:0/3082618780 wait complete. 2024-01-23T09:25:14.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.834+0000 7f772197f640 1 Processor -- start 2024-01-23T09:25:14.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.834+0000 7f772197f640 1 -- start start 2024-01-23T09:25:14.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.834+0000 7f772197f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f771c071400 0x7f771c14c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:14.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.834+0000 7f772197f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f771c151240 0x7f771c1f51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:14.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.834+0000 7f772197f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f771c151620 0x7f771c1f5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:14.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.834+0000 7f772197f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771c1619b0 con 0x7f771c071400 2024-01-23T09:25:14.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.834+0000 7f772197f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771c160420 con 0x7f771c151620 2024-01-23T09:25:14.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.834+0000 7f772197f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f771c160de0 con 0x7f771c151240 2024-01-23T09:25:14.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.834+0000 7f771affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f771c071400 0x7f771c14c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:14.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.838+0000 7f771affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f771c071400 0x7f771c14c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47724/0 (socket says 172.21.15.46:47724) 2024-01-23T09:25:14.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.838+0000 7f771affd640 1 -- 172.21.15.46:0/2527852391 learned_addr learned my addr 172.21.15.46:0/2527852391 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:14.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.838+0000 7f771a7fc640 1 --2- 172.21.15.46:0/2527852391 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f771c151240 0x7f771c1f51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:14.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.838+0000 7f771affd640 1 -- 172.21.15.46:0/2527852391 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f771c151240 msgr2=0x7f771c1f51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:14.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.838+0000 7f771affd640 1 --2- 172.21.15.46:0/2527852391 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f771c151240 0x7f771c1f51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:14.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.838+0000 7f771affd640 1 -- 172.21.15.46:0/2527852391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f771c151620 msgr2=0x7f771c1f5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:14.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.838+0000 7f771affd640 1 --2- 172.21.15.46:0/2527852391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f771c151620 0x7f771c1f5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:14.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.842+0000 7f771affd640 1 -- 172.21.15.46:0/2527852391 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7714009a70 con 0x7f771c071400 2024-01-23T09:25:14.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.842+0000 7f771affd640 1 --2- 172.21.15.46:0/2527852391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f771c071400 0x7f771c14c9d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f770c00e8c0 tx=0x7f770c00ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:14.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.846+0000 7f7703fff640 1 -- 172.21.15.46:0/2527852391 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c009620 con 0x7f771c071400 2024-01-23T09:25:14.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.846+0000 7f7703fff640 1 -- 172.21.15.46:0/2527852391 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770c00c8c0 con 0x7f771c071400 2024-01-23T09:25:14.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.846+0000 7f7703fff640 1 -- 172.21.15.46:0/2527852391 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c00cc70 con 0x7f771c071400 2024-01-23T09:25:14.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.846+0000 7f772197f640 1 -- 172.21.15.46:0/2527852391 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f771c161080 con 0x7f771c071400 2024-01-23T09:25:14.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.846+0000 7f772197f640 1 -- 172.21.15.46:0/2527852391 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f771c161640 con 0x7f771c071400 2024-01-23T09:25:14.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.846+0000 7f772197f640 1 -- 172.21.15.46:0/2527852391 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f771c157e10 con 0x7f771c071400 2024-01-23T09:25:14.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.866+0000 7f7703fff640 1 -- 172.21.15.46:0/2527852391 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f770c013470 con 0x7f771c071400 2024-01-23T09:25:14.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.870+0000 7f7703fff640 1 --2- 172.21.15.46:0/2527852391 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7708066580 0x7f7708068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:14.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.870+0000 7f771a7fc640 1 --2- 172.21.15.46:0/2527852391 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7708066580 0x7f7708068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:14.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.870+0000 7f771a7fc640 1 --2- 172.21.15.46:0/2527852391 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7708066580 0x7f7708068a40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f771c14f700 tx=0x7f7710006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:14.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.874+0000 7f7703fff640 1 -- 172.21.15.46:0/2527852391 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f770c055280 con 0x7f771c071400 2024-01-23T09:25:14.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.874+0000 7f7703fff640 1 --2- 172.21.15.46:0/2527852391 >> [v2:172.21.15.46:6802/3679152623,v1:172.21.15.46:6803/3679152623] conn(0x7f770806fc60 0x7f7708072100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:14.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.874+0000 7f7703fff640 1 -- 172.21.15.46:0/2527852391 --> [v2:172.21.15.46:6802/3679152623,v1:172.21.15.46:6803/3679152623] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f77080727d0 con 0x7f770806fc60 2024-01-23T09:25:14.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.874+0000 7f7703fff640 1 -- 172.21.15.46:0/2527852391 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f770c0515c0 con 0x7f771c071400 2024-01-23T09:25:14.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.874+0000 7f771b7fe640 1 --2- 172.21.15.46:0/2527852391 >> [v2:172.21.15.46:6802/3679152623,v1:172.21.15.46:6803/3679152623] conn(0x7f770806fc60 0x7f7708072100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:14.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.874+0000 7f771b7fe640 1 --2- 172.21.15.46:0/2527852391 >> [v2:172.21.15.46:6802/3679152623,v1:172.21.15.46:6803/3679152623] conn(0x7f770806fc60 0x7f7708072100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:14.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.878+0000 7f7703fff640 1 -- 172.21.15.46:0/2527852391 <== osd.1 v2:172.21.15.46:6802/3679152623 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f77080727d0 con 0x7f770806fc60 2024-01-23T09:25:14.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.890+0000 7f772197f640 1 -- 172.21.15.46:0/2527852391 --> [v2:172.21.15.46:6802/3679152623,v1:172.21.15.46:6803/3679152623] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f771c0cb520 con 0x7f770806fc60 2024-01-23T09:25:14.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.890+0000 7f7703fff640 1 -- 172.21.15.46:0/2527852391 <== osd.1 v2:172.21.15.46:6802/3679152623 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f77140ad440 con 0x7f770806fc60 2024-01-23T09:25:14.894 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-23T09:25:14.894 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-23T09:25:14.894 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-23T09:25:14.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.890+0000 7f772197f640 1 -- 172.21.15.46:0/2527852391 >> [v2:172.21.15.46:6802/3679152623,v1:172.21.15.46:6803/3679152623] conn(0x7f770806fc60 msgr2=0x7f7708072100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:14.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.890+0000 7f772197f640 1 --2- 172.21.15.46:0/2527852391 >> [v2:172.21.15.46:6802/3679152623,v1:172.21.15.46:6803/3679152623] conn(0x7f770806fc60 0x7f7708072100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:14.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.890+0000 7f772197f640 1 -- 172.21.15.46:0/2527852391 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7708066580 msgr2=0x7f7708068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:14.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.890+0000 7f772197f640 1 --2- 172.21.15.46:0/2527852391 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f7708066580 0x7f7708068a40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f771c14f700 tx=0x7f7710006f90 comp rx=0 tx=0).stop 2024-01-23T09:25:14.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.890+0000 7f772197f640 1 -- 172.21.15.46:0/2527852391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f771c071400 msgr2=0x7f771c14c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:14.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.890+0000 7f772197f640 1 --2- 172.21.15.46:0/2527852391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f771c071400 0x7f771c14c9d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f770c00e8c0 tx=0x7f770c00ed80 comp rx=0 tx=0).stop 2024-01-23T09:25:14.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.890+0000 7f771b7fe640 1 -- 172.21.15.46:0/2527852391 reap_dead start 2024-01-23T09:25:14.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.890+0000 7f772197f640 1 -- 172.21.15.46:0/2527852391 shutdown_connections 2024-01-23T09:25:14.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.890+0000 7f772197f640 1 -- 172.21.15.46:0/2527852391 >> 172.21.15.46:0/2527852391 conn(0x7f771c066860 msgr2=0x7f771c06d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:14.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.890+0000 7f772197f640 1 -- 172.21.15.46:0/2527852391 shutdown_connections 2024-01-23T09:25:14.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:14.890+0000 7f772197f640 1 -- 172.21.15.46:0/2527852391 wait complete. 2024-01-23T09:25:14.914 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-01-23T09:25:15.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.038+0000 7fd6c3244640 1 Processor -- start 2024-01-23T09:25:15.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.038+0000 7fd6c3244640 1 -- start start 2024-01-23T09:25:15.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.038+0000 7fd6c3244640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd6bc150500 0x7fd6bc0c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:15.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.038+0000 7fd6c3244640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6bc0c2e00 0x7fd6bc156250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:15.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.038+0000 7fd6c3244640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd6bc06e460 0x7fd6bc15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:15.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.038+0000 7fd6c3244640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6bc156790 con 0x7fd6bc150500 2024-01-23T09:25:15.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.038+0000 7fd6c3244640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6bc156a20 con 0x7fd6bc06e460 2024-01-23T09:25:15.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.038+0000 7fd6c3244640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc156d00 con 0x7fd6bc0c2e00 2024-01-23T09:25:15.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.082+0000 7fd6c0fe0640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd6bc150500 0x7fd6bc0c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:15.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.082+0000 7fd6c0fe0640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd6bc150500 0x7fd6bc0c5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47728/0 (socket says 172.21.15.46:47728) 2024-01-23T09:25:15.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.082+0000 7fd6c0fe0640 1 -- 172.21.15.46:0/2524370353 learned_addr learned my addr 172.21.15.46:0/2524370353 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:15.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.090+0000 7fd6c0fe0640 1 -- 172.21.15.46:0/2524370353 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6bc0c2e00 msgr2=0x7fd6bc156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:15.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.090+0000 7fd6c0fe0640 1 --2- 172.21.15.46:0/2524370353 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6bc0c2e00 0x7fd6bc156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:15.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.090+0000 7fd6c0fe0640 1 -- 172.21.15.46:0/2524370353 >> v2:172.21.15.175:3300/0 conn(0x7fd6bc06e460 msgr2=0x7fd6bc15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:15.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.090+0000 7fd6c0fe0640 1 --2- 172.21.15.46:0/2524370353 >> v2:172.21.15.175:3300/0 conn(0x7fd6bc06e460 0x7fd6bc15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:15.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.090+0000 7fd6c0fe0640 1 -- 172.21.15.46:0/2524370353 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6bc156fe0 con 0x7fd6bc150500 2024-01-23T09:25:15.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.094+0000 7fd6c0fe0640 1 --2- 172.21.15.46:0/2524370353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6bc150500 0x7fd6bc0c5f20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc072050 tx=0x7fd6ac01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e0f5d544d5136d server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:15.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.098+0000 7fd6bb7fe640 1 -- 172.21.15.46:0/2524370353 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac0a89b0 con 0x7fd6bc150500 2024-01-23T09:25:15.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.098+0000 7fd6bb7fe640 1 -- 172.21.15.46:0/2524370353 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ac0a8b10 con 0x7fd6bc150500 2024-01-23T09:25:15.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.098+0000 7fd6bb7fe640 1 -- 172.21.15.46:0/2524370353 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac0a8ea0 con 0x7fd6bc150500 2024-01-23T09:25:15.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.098+0000 7fd6c3244640 1 -- 172.21.15.46:0/2524370353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6bc150500 msgr2=0x7fd6bc0c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:15.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.098+0000 7fd6c3244640 1 --2- 172.21.15.46:0/2524370353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6bc150500 0x7fd6bc0c5f20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc072050 tx=0x7fd6ac01ecf0 comp rx=0 tx=0).stop 2024-01-23T09:25:15.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.098+0000 7fd6c3244640 1 -- 172.21.15.46:0/2524370353 shutdown_connections 2024-01-23T09:25:15.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.098+0000 7fd6c3244640 1 --2- 172.21.15.46:0/2524370353 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6bc0c2e00 0x7fd6bc156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:15.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.098+0000 7fd6c3244640 1 --2- 172.21.15.46:0/2524370353 >> v2:172.21.15.175:3300/0 conn(0x7fd6bc06e460 0x7fd6bc15a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:15.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.098+0000 7fd6c3244640 1 --2- 172.21.15.46:0/2524370353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6bc150500 0x7fd6bc0c5f20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:15.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.098+0000 7fd6c3244640 1 -- 172.21.15.46:0/2524370353 >> 172.21.15.46:0/2524370353 conn(0x7fd6bc06b770 msgr2=0x7fd6bc06bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:15.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.098+0000 7fd6c3244640 1 -- 172.21.15.46:0/2524370353 shutdown_connections 2024-01-23T09:25:15.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.098+0000 7fd6c3244640 1 -- 172.21.15.46:0/2524370353 wait complete. 2024-01-23T09:25:15.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.102+0000 7fd6c3244640 1 Processor -- start 2024-01-23T09:25:15.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.102+0000 7fd6c3244640 1 -- start start 2024-01-23T09:25:15.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.102+0000 7fd6c3244640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6bc06e460 0x7fd6bc155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:15.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.102+0000 7fd6c3244640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6bc0c2e00 0x7fd6bc14dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:15.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.102+0000 7fd6c3244640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6bc150500 0x7fd6bc157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:15.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.102+0000 7fd6c3244640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc158970 con 0x7fd6bc150500 2024-01-23T09:25:15.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.102+0000 7fd6c3244640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc159240 con 0x7fd6bc06e460 2024-01-23T09:25:15.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.102+0000 7fd6c3244640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc14f3f0 con 0x7fd6bc0c2e00 2024-01-23T09:25:15.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.102+0000 7fd6c17e1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6bc150500 0x7fd6bc157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:15.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.102+0000 7fd6c17e1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6bc150500 0x7fd6bc157670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47732/0 (socket says 172.21.15.46:47732) 2024-01-23T09:25:15.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.102+0000 7fd6c17e1640 1 -- 172.21.15.46:0/2973240142 learned_addr learned my addr 172.21.15.46:0/2973240142 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:15.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.106+0000 7fd6c17e1640 1 -- 172.21.15.46:0/2973240142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6bc0c2e00 msgr2=0x7fd6bc14dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:15.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.106+0000 7fd6c17e1640 1 --2- 172.21.15.46:0/2973240142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6bc0c2e00 0x7fd6bc14dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:15.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.106+0000 7fd6c17e1640 1 -- 172.21.15.46:0/2973240142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6bc06e460 msgr2=0x7fd6bc155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:15.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.106+0000 7fd6c17e1640 1 --2- 172.21.15.46:0/2973240142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6bc06e460 0x7fd6bc155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:15.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.106+0000 7fd6c17e1640 1 -- 172.21.15.46:0/2973240142 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ac0094d0 con 0x7fd6bc150500 2024-01-23T09:25:15.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.110+0000 7fd6c17e1640 1 --2- 172.21.15.46:0/2973240142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6bc150500 0x7fd6bc157670 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd6b400b430 tx=0x7fd6b400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:15.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.114+0000 7fd6b97fa640 1 -- 172.21.15.46:0/2973240142 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4011830 con 0x7fd6bc150500 2024-01-23T09:25:15.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.114+0000 7fd6b97fa640 1 -- 172.21.15.46:0/2973240142 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b4011990 con 0x7fd6bc150500 2024-01-23T09:25:15.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.114+0000 7fd6b97fa640 1 -- 172.21.15.46:0/2973240142 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4011d40 con 0x7fd6bc150500 2024-01-23T09:25:15.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.114+0000 7fd6c3244640 1 -- 172.21.15.46:0/2973240142 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6bc14f150 con 0x7fd6bc150500 2024-01-23T09:25:15.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.114+0000 7fd6c3244640 1 -- 172.21.15.46:0/2973240142 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6bc14eca0 con 0x7fd6bc150500 2024-01-23T09:25:15.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.114+0000 7fd6c3244640 1 -- 172.21.15.46:0/2973240142 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6bc074340 con 0x7fd6bc150500 2024-01-23T09:25:15.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.430+0000 7fd6b97fa640 1 -- 172.21.15.46:0/2973240142 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd6b401a400 con 0x7fd6bc150500 2024-01-23T09:25:15.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.434+0000 7fd6b97fa640 1 --2- 172.21.15.46:0/2973240142 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd6a8066580 0x7fd6a8068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:15.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.434+0000 7fd6c0fe0640 1 --2- 172.21.15.46:0/2973240142 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd6a8066580 0x7fd6a8068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:15.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.434+0000 7fd6c0fe0640 1 --2- 172.21.15.46:0/2973240142 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd6a8066580 0x7fd6a8068a40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac0b2000 tx=0x7fd6ac004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:15.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.518+0000 7fd6b97fa640 1 -- 172.21.15.46:0/2973240142 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fd6b4055ca0 con 0x7fd6bc150500 2024-01-23T09:25:15.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.518+0000 7fd6b97fa640 1 -- 172.21.15.46:0/2973240142 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd6b40518e0 con 0x7fd6bc150500 2024-01-23T09:25:15.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.706+0000 7fd6c3244640 1 -- 172.21.15.46:0/2973240142 --> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6bc1508e0 con 0x7fd6a8066580 2024-01-23T09:25:15.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.706+0000 7fd6b97fa640 1 -- 172.21.15.46:0/2973240142 <== mgr.4107 v2:172.21.15.46:6800/2324478006 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd6ac0a88d0 con 0x7fd6a8066580 2024-01-23T09:25:15.711 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 1 to deep-scrub 2024-01-23T09:25:15.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.710+0000 7fd6c3244640 1 -- 172.21.15.46:0/2973240142 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd6a8066580 msgr2=0x7fd6a8068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:15.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.710+0000 7fd6c3244640 1 --2- 172.21.15.46:0/2973240142 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd6a8066580 0x7fd6a8068a40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac0b2000 tx=0x7fd6ac004740 comp rx=0 tx=0).stop 2024-01-23T09:25:15.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.710+0000 7fd6c3244640 1 -- 172.21.15.46:0/2973240142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6bc150500 msgr2=0x7fd6bc157670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:15.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.710+0000 7fd6c3244640 1 --2- 172.21.15.46:0/2973240142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6bc150500 0x7fd6bc157670 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd6b400b430 tx=0x7fd6b400b8f0 comp rx=0 tx=0).stop 2024-01-23T09:25:15.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.710+0000 7fd6c3244640 1 -- 172.21.15.46:0/2973240142 shutdown_connections 2024-01-23T09:25:15.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.710+0000 7fd6c3244640 1 --2- 172.21.15.46:0/2973240142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6bc150500 0x7fd6bc157670 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:15.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.710+0000 7fd6c3244640 1 --2- 172.21.15.46:0/2973240142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6bc0c2e00 0x7fd6bc14dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:15.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.710+0000 7fd6c3244640 1 --2- 172.21.15.46:0/2973240142 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd6a8066580 0x7fd6a8068a40 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:15.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.710+0000 7fd6c3244640 1 --2- 172.21.15.46:0/2973240142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6bc06e460 0x7fd6bc155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:15.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.710+0000 7fd6c3244640 1 -- 172.21.15.46:0/2973240142 >> 172.21.15.46:0/2973240142 conn(0x7fd6bc06b770 msgr2=0x7fd6bc0c6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:15.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.710+0000 7fd6c3244640 1 -- 172.21.15.46:0/2973240142 shutdown_connections 2024-01-23T09:25:15.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.710+0000 7fd6c3244640 1 -- 172.21.15.46:0/2973240142 wait complete. 2024-01-23T09:25:15.732 INFO:tasks.ceph:Scrubbing osd.2 2024-01-23T09:25:15.732 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-01-23T09:25:15.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.862+0000 7f700bef9640 1 Processor -- start 2024-01-23T09:25:15.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.862+0000 7f700bef9640 1 -- start start 2024-01-23T09:25:15.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.862+0000 7f700bef9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7004155b20 0x7f700406e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:15.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.862+0000 7f700bef9640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7004071290 0x7f7004071700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:15.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.862+0000 7f700bef9640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f700406f650 con 0x7f700414fc70 2024-01-23T09:25:15.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.862+0000 7f700bef9640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70041595b0 con 0x7f7004071290 2024-01-23T09:25:15.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.862+0000 7f700bef9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f700406edb0 con 0x7f7004155b20 2024-01-23T09:25:15.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.866+0000 7f7009c95640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f700414fc70 0x7f7004159a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41510/0 (socket says 172.21.15.46:41510) 2024-01-23T09:25:15.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.866+0000 7f7009c95640 1 -- 172.21.15.46:0/845832106 learned_addr learned my addr 172.21.15.46:0/845832106 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T09:25:15.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.866+0000 7f700a496640 1 --2- 172.21.15.46:0/845832106 >> v2:172.21.15.46:3300/0 conn(0x7f7004071290 0x7f7004071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:15.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.866+0000 7f7009494640 1 --2- 172.21.15.46:0/845832106 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7004155b20 0x7f700406e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:15.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.870+0000 7f7008c93640 1 -- 172.21.15.46:0/845832106 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 120989614 0 0) 0x7f700406f650 con 0x7f700414fc70 2024-01-23T09:25:15.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.870+0000 7f7008c93640 1 -- 172.21.15.46:0/845832106 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ff0003530 con 0x7f700414fc70 2024-01-23T09:25:15.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.870+0000 7f700a496640 1 -- 172.21.15.46:0/845832106 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7004155b20 msgr2=0x7f700406e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:15.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.870+0000 7f700a496640 1 --2- 172.21.15.46:0/845832106 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7004155b20 0x7f700406e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:15.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.870+0000 7f700a496640 1 -- 172.21.15.46:0/845832106 >> v1:172.21.15.46:6789/0 conn(0x7f700414fc70 legacy=0x7f7004159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:15.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.870+0000 7f700a496640 1 -- 172.21.15.46:0/845832106 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700406f090 con 0x7f7004071290 2024-01-23T09:25:15.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.878+0000 7f700a496640 1 --2- 172.21.15.46:0/845832106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7004071290 0x7f7004071700 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc00aea0 tx=0x7f6ffc01d990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f03a4dc746b30c3 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:15.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.882+0000 7f7008c93640 1 -- 172.21.15.46:0/845832106 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc00a2d0 con 0x7f7004071290 2024-01-23T09:25:15.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.882+0000 7f7008c93640 1 -- 172.21.15.46:0/845832106 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ffc0a67d0 con 0x7f7004071290 2024-01-23T09:25:15.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.882+0000 7f7008c93640 1 -- 172.21.15.46:0/845832106 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc0a6b60 con 0x7f7004071290 2024-01-23T09:25:15.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.882+0000 7f700bef9640 1 -- 172.21.15.46:0/845832106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7004071290 msgr2=0x7f7004071700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:15.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.882+0000 7f700bef9640 1 --2- 172.21.15.46:0/845832106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7004071290 0x7f7004071700 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc00aea0 tx=0x7f6ffc01d990 comp rx=0 tx=0).stop 2024-01-23T09:25:15.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.882+0000 7f700bef9640 1 -- 172.21.15.46:0/845832106 shutdown_connections 2024-01-23T09:25:15.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.882+0000 7f700bef9640 1 --2- 172.21.15.46:0/845832106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7004071290 0x7f7004071700 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:15.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.882+0000 7f700bef9640 1 --2- 172.21.15.46:0/845832106 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7004155b20 0x7f700406e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:15.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.882+0000 7f700bef9640 1 -- 172.21.15.46:0/845832106 >> 172.21.15.46:0/845832106 conn(0x7f700406d590 msgr2=0x7f7004066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:15.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.882+0000 7f700bef9640 1 -- 172.21.15.46:0/845832106 shutdown_connections 2024-01-23T09:25:15.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.882+0000 7f700bef9640 1 -- 172.21.15.46:0/845832106 wait complete. 2024-01-23T09:25:15.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.882+0000 7f700bef9640 1 Processor -- start 2024-01-23T09:25:15.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.882+0000 7f700bef9640 1 -- start start 2024-01-23T09:25:15.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.882+0000 7f700bef9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7004071290 0x7f7004149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:15.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.882+0000 7f700bef9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f700414fc70 0x7f7004147420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:15.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.882+0000 7f700bef9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7004155b20 0x7f7004140760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:15.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.882+0000 7f700bef9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70041457d0 con 0x7f7004071290 2024-01-23T09:25:15.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.882+0000 7f700bef9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7004145a70 con 0x7f7004155b20 2024-01-23T09:25:15.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.882+0000 7f700bef9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7004145d10 con 0x7f700414fc70 2024-01-23T09:25:15.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.882+0000 7f7009c95640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7004071290 0x7f7004149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:15.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.886+0000 7f7009c95640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7004071290 0x7f7004149b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47748/0 (socket says 172.21.15.46:47748) 2024-01-23T09:25:15.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.886+0000 7f7009c95640 1 -- 172.21.15.46:0/3003382557 learned_addr learned my addr 172.21.15.46:0/3003382557 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:15.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.886+0000 7f7009494640 1 --2- 172.21.15.46:0/3003382557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f700414fc70 0x7f7004147420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:15.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.886+0000 7f700a496640 1 --2- 172.21.15.46:0/3003382557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7004155b20 0x7f7004140760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:15.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.890+0000 7f7009c95640 1 -- 172.21.15.46:0/3003382557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f700414fc70 msgr2=0x7f7004147420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:15.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.890+0000 7f7009c95640 1 --2- 172.21.15.46:0/3003382557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f700414fc70 0x7f7004147420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:15.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.890+0000 7f7009c95640 1 -- 172.21.15.46:0/3003382557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7004155b20 msgr2=0x7f7004140760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:15.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.890+0000 7f7009c95640 1 --2- 172.21.15.46:0/3003382557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7004155b20 0x7f7004140760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:15.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.890+0000 7f7009c95640 1 -- 172.21.15.46:0/3003382557 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ffc00ab80 con 0x7f7004071290 2024-01-23T09:25:15.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.890+0000 7f7009c95640 1 --2- 172.21.15.46:0/3003382557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7004071290 0x7f7004149b80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f700000c450 tx=0x7f700000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:15.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.894+0000 7f6ffa7fc640 1 -- 172.21.15.46:0/3003382557 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7000005cf0 con 0x7f7004071290 2024-01-23T09:25:15.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.894+0000 7f6ffa7fc640 1 -- 172.21.15.46:0/3003382557 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7000005e50 con 0x7f7004071290 2024-01-23T09:25:15.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.894+0000 7f6ffa7fc640 1 -- 172.21.15.46:0/3003382557 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7000007290 con 0x7f7004071290 2024-01-23T09:25:15.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.894+0000 7f700bef9640 1 -- 172.21.15.46:0/3003382557 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7004146c20 con 0x7f7004071290 2024-01-23T09:25:15.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.894+0000 7f700bef9640 1 -- 172.21.15.46:0/3003382557 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70040c8540 con 0x7f7004071290 2024-01-23T09:25:15.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.894+0000 7f700bef9640 1 -- 172.21.15.46:0/3003382557 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7004154f10 con 0x7f7004071290 2024-01-23T09:25:15.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.918+0000 7f6ffa7fc640 1 -- 172.21.15.46:0/3003382557 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f70000073f0 con 0x7f7004071290 2024-01-23T09:25:15.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.922+0000 7f6ffa7fc640 1 --2- 172.21.15.46:0/3003382557 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6fe8066580 0x7f6fe8068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:15.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.922+0000 7f7009494640 1 --2- 172.21.15.46:0/3003382557 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6fe8066580 0x7f6fe8068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:15.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.922+0000 7f7009494640 1 --2- 172.21.15.46:0/3003382557 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6fe8066580 0x7f6fe8068a40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f70040c5140 tx=0x7f6ff4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:15.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.922+0000 7f6ffa7fc640 1 -- 172.21.15.46:0/3003382557 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f70000548a0 con 0x7f7004071290 2024-01-23T09:25:15.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.922+0000 7f6ffa7fc640 1 --2- 172.21.15.46:0/3003382557 >> [v2:172.21.15.46:6810/3869652274,v1:172.21.15.46:6811/3869652274] conn(0x7f6fe806fc50 0x7f6fe80720f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:15.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.922+0000 7f6ffa7fc640 1 -- 172.21.15.46:0/3003382557 --> [v2:172.21.15.46:6810/3869652274,v1:172.21.15.46:6811/3869652274] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6fe80727c0 con 0x7f6fe806fc50 2024-01-23T09:25:15.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.922+0000 7f6ffa7fc640 1 -- 172.21.15.46:0/3003382557 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7000050be0 con 0x7f7004071290 2024-01-23T09:25:15.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.926+0000 7f700a496640 1 --2- 172.21.15.46:0/3003382557 >> [v2:172.21.15.46:6810/3869652274,v1:172.21.15.46:6811/3869652274] conn(0x7f6fe806fc50 0x7f6fe80720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:15.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.926+0000 7f700a496640 1 --2- 172.21.15.46:0/3003382557 >> [v2:172.21.15.46:6810/3869652274,v1:172.21.15.46:6811/3869652274] conn(0x7f6fe806fc50 0x7f6fe80720f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:15.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.926+0000 7f6ffa7fc640 1 -- 172.21.15.46:0/3003382557 <== osd.2 v2:172.21.15.46:6810/3869652274 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6fe80727c0 con 0x7f6fe806fc50 2024-01-23T09:25:15.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.938+0000 7f700bef9640 1 -- 172.21.15.46:0/3003382557 --> [v2:172.21.15.46:6810/3869652274,v1:172.21.15.46:6811/3869652274] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7004146a80 con 0x7f6fe806fc50 2024-01-23T09:25:15.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.938+0000 7f6ffa7fc640 1 -- 172.21.15.46:0/3003382557 <== osd.2 v2:172.21.15.46:6810/3869652274 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7004146a80 con 0x7f6fe806fc50 2024-01-23T09:25:15.943 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-23T09:25:15.943 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-23T09:25:15.943 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-23T09:25:15.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.938+0000 7f700bef9640 1 -- 172.21.15.46:0/3003382557 >> [v2:172.21.15.46:6810/3869652274,v1:172.21.15.46:6811/3869652274] conn(0x7f6fe806fc50 msgr2=0x7f6fe80720f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:15.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.938+0000 7f700bef9640 1 --2- 172.21.15.46:0/3003382557 >> [v2:172.21.15.46:6810/3869652274,v1:172.21.15.46:6811/3869652274] conn(0x7f6fe806fc50 0x7f6fe80720f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:15.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.938+0000 7f700bef9640 1 -- 172.21.15.46:0/3003382557 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6fe8066580 msgr2=0x7f6fe8068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:15.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.938+0000 7f700bef9640 1 --2- 172.21.15.46:0/3003382557 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6fe8066580 0x7f6fe8068a40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f70040c5140 tx=0x7f6ff4009190 comp rx=0 tx=0).stop 2024-01-23T09:25:15.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.938+0000 7f700bef9640 1 -- 172.21.15.46:0/3003382557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7004071290 msgr2=0x7f7004149b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:15.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.938+0000 7f700bef9640 1 --2- 172.21.15.46:0/3003382557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7004071290 0x7f7004149b80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f700000c450 tx=0x7f700000c910 comp rx=0 tx=0).stop 2024-01-23T09:25:15.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.938+0000 7f700a496640 1 -- 172.21.15.46:0/3003382557 reap_dead start 2024-01-23T09:25:15.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.938+0000 7f700bef9640 1 -- 172.21.15.46:0/3003382557 shutdown_connections 2024-01-23T09:25:15.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.938+0000 7f700bef9640 1 -- 172.21.15.46:0/3003382557 >> 172.21.15.46:0/3003382557 conn(0x7f700406d590 msgr2=0x7f70041552c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:15.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.942+0000 7f700bef9640 1 -- 172.21.15.46:0/3003382557 shutdown_connections 2024-01-23T09:25:15.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:15.942+0000 7f700bef9640 1 -- 172.21.15.46:0/3003382557 wait complete. 2024-01-23T09:25:15.964 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-01-23T09:25:16.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.086+0000 7fc7c8a9c640 1 Processor -- start 2024-01-23T09:25:16.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.086+0000 7fc7c8a9c640 1 -- start start 2024-01-23T09:25:16.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.086+0000 7fc7c8a9c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc7c41509f0 0x7fc7c4159a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:16.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.086+0000 7fc7c8a9c640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c40c0e90 con 0x7fc7c4070290 2024-01-23T09:25:16.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.086+0000 7fc7c8a9c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c4156d20 con 0x7fc7c406feb0 2024-01-23T09:25:16.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.086+0000 7fc7c8a9c640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c4156fc0 con 0x7fc7c41509f0 2024-01-23T09:25:16.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.138+0000 7fc7c1d9b640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc7c4070290 0x7fc7c41502e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41526/0 (socket says 172.21.15.46:41526) 2024-01-23T09:25:16.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.138+0000 7fc7c1d9b640 1 -- 172.21.15.46:0/2267532809 learned_addr learned my addr 172.21.15.46:0/2267532809 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T09:25:16.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.146+0000 7fc7c2d9d640 1 --2- 172.21.15.46:0/2267532809 >> v2:172.21.15.46:3300/0 conn(0x7fc7c41509f0 0x7fc7c4159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:16.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.166+0000 7fc7c2d9d640 1 -- 172.21.15.46:0/2267532809 >> v1:172.21.15.175:6789/0 conn(0x7fc7c406feb0 legacy=0x7fc7c4156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:16.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.166+0000 7fc7c2d9d640 1 -- 172.21.15.46:0/2267532809 >> v1:172.21.15.46:6789/0 conn(0x7fc7c4070290 legacy=0x7fc7c41502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:16.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.166+0000 7fc7c2d9d640 1 -- 172.21.15.46:0/2267532809 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c4157280 con 0x7fc7c41509f0 2024-01-23T09:25:16.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.202+0000 7fc7c2d9d640 1 --2- 172.21.15.46:0/2267532809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7c41509f0 0x7fc7c4159a20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009d90 tx=0x7fc7bc01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2941db34a2b96 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:16.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.214+0000 7fc7c159a640 1 -- 172.21.15.46:0/2267532809 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc0a5910 con 0x7fc7c41509f0 2024-01-23T09:25:16.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.214+0000 7fc7c159a640 1 -- 172.21.15.46:0/2267532809 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7bc0a5a70 con 0x7fc7c41509f0 2024-01-23T09:25:16.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.214+0000 7fc7c159a640 1 -- 172.21.15.46:0/2267532809 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc0a5e00 con 0x7fc7c41509f0 2024-01-23T09:25:16.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.214+0000 7fc7c8a9c640 1 -- 172.21.15.46:0/2267532809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7c41509f0 msgr2=0x7fc7c4159a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:16.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.214+0000 7fc7c8a9c640 1 --2- 172.21.15.46:0/2267532809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7c41509f0 0x7fc7c4159a20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009d90 tx=0x7fc7bc01c850 comp rx=0 tx=0).stop 2024-01-23T09:25:16.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.214+0000 7fc7c8a9c640 1 -- 172.21.15.46:0/2267532809 shutdown_connections 2024-01-23T09:25:16.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.214+0000 7fc7c8a9c640 1 --2- 172.21.15.46:0/2267532809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7c41509f0 0x7fc7c4159a20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:16.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.214+0000 7fc7c8a9c640 1 -- 172.21.15.46:0/2267532809 >> 172.21.15.46:0/2267532809 conn(0x7fc7c4072890 msgr2=0x7fc7c406e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:16.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.214+0000 7fc7c8a9c640 1 -- 172.21.15.46:0/2267532809 shutdown_connections 2024-01-23T09:25:16.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.214+0000 7fc7c8a9c640 1 -- 172.21.15.46:0/2267532809 wait complete. 2024-01-23T09:25:16.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.218+0000 7fc7c8a9c640 1 Processor -- start 2024-01-23T09:25:16.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.218+0000 7fc7c8a9c640 1 -- start start 2024-01-23T09:25:16.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.218+0000 7fc7c8a9c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7c406feb0 0x7fc7c406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:16.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.218+0000 7fc7c8a9c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7c4070290 0x7fc7c41f0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:16.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.218+0000 7fc7c8a9c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7c41509f0 0x7fc7c4150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:16.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.218+0000 7fc7c8a9c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c414cf40 con 0x7fc7c406feb0 2024-01-23T09:25:16.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.218+0000 7fc7c8a9c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c41f4600 con 0x7fc7c4070290 2024-01-23T09:25:16.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.218+0000 7fc7c8a9c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c41f48a0 con 0x7fc7c41509f0 2024-01-23T09:25:16.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.222+0000 7fc7c1d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7c4070290 0x7fc7c41f0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:16.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.222+0000 7fc7c2d9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7c41509f0 0x7fc7c4150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:16.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.222+0000 7fc7c1d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7c4070290 0x7fc7c41f0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:39644/0 (socket says 172.21.15.46:39644) 2024-01-23T09:25:16.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.222+0000 7fc7c1d9b640 1 -- 172.21.15.46:0/3008361323 learned_addr learned my addr 172.21.15.46:0/3008361323 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:16.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.230+0000 7fc7c1d9b640 1 -- 172.21.15.46:0/3008361323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7c41509f0 msgr2=0x7fc7c4150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:16.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.230+0000 7fc7c1d9b640 1 --2- 172.21.15.46:0/3008361323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7c41509f0 0x7fc7c4150f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:16.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.230+0000 7fc7c1d9b640 1 -- 172.21.15.46:0/3008361323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7c406feb0 msgr2=0x7fc7c406a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:16.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.230+0000 7fc7c1d9b640 1 --2- 172.21.15.46:0/3008361323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7c406feb0 0x7fc7c406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:16.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.230+0000 7fc7c1d9b640 1 -- 172.21.15.46:0/3008361323 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7bc009a70 con 0x7fc7c4070290 2024-01-23T09:25:16.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.238+0000 7fc7c1d9b640 1 --2- 172.21.15.46:0/3008361323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7c4070290 0x7fc7c41f0e50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800c420 tx=0x7fc7b800c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:16.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.246+0000 7fc7b2ffd640 1 -- 172.21.15.46:0/3008361323 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8005cf0 con 0x7fc7c4070290 2024-01-23T09:25:16.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.246+0000 7fc7b2ffd640 1 -- 172.21.15.46:0/3008361323 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b8005e50 con 0x7fc7c4070290 2024-01-23T09:25:16.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.246+0000 7fc7b2ffd640 1 -- 172.21.15.46:0/3008361323 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b80072f0 con 0x7fc7c4070290 2024-01-23T09:25:16.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.246+0000 7fc7c8a9c640 1 -- 172.21.15.46:0/3008361323 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c414d190 con 0x7fc7c4070290 2024-01-23T09:25:16.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.246+0000 7fc7c8a9c640 1 -- 172.21.15.46:0/3008361323 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c41f0930 con 0x7fc7c4070290 2024-01-23T09:25:16.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.246+0000 7fc7c8a9c640 1 -- 172.21.15.46:0/3008361323 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c41f0b50 con 0x7fc7c4070290 2024-01-23T09:25:16.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.558+0000 7fc7b2ffd640 1 -- 172.21.15.46:0/3008361323 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fc7b8007450 con 0x7fc7c4070290 2024-01-23T09:25:16.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.558+0000 7fc7b2ffd640 1 --2- 172.21.15.46:0/3008361323 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fc7a4066550 0x7fc7a4068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:16.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.562+0000 7fc7c259c640 1 --2- 172.21.15.46:0/3008361323 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fc7a4066550 0x7fc7a4068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:16.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.562+0000 7fc7c259c640 1 --2- 172.21.15.46:0/3008361323 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fc7a4066550 0x7fc7a4068a10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4007fd0 tx=0x7fc7b40079a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:16.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.566+0000 7fc7b2ffd640 1 -- 172.21.15.46:0/3008361323 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fc7b8054840 con 0x7fc7c4070290 2024-01-23T09:25:16.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.586+0000 7fc7b2ffd640 1 -- 172.21.15.46:0/3008361323 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fc7b8050b80 con 0x7fc7c4070290 2024-01-23T09:25:16.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.770+0000 7fc7c8a9c640 1 -- 172.21.15.46:0/3008361323 --> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7c41645e0 con 0x7fc7a4066550 2024-01-23T09:25:16.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.774+0000 7fc7b2ffd640 1 -- 172.21.15.46:0/3008361323 <== mgr.4107 v2:172.21.15.46:6800/2324478006 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc7b40050d0 con 0x7fc7a4066550 2024-01-23T09:25:16.776 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 2 to deep-scrub 2024-01-23T09:25:16.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.774+0000 7fc7c8a9c640 1 -- 172.21.15.46:0/3008361323 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fc7a4066550 msgr2=0x7fc7a4068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:16.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.774+0000 7fc7c8a9c640 1 --2- 172.21.15.46:0/3008361323 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fc7a4066550 0x7fc7a4068a10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4007fd0 tx=0x7fc7b40079a0 comp rx=0 tx=0).stop 2024-01-23T09:25:16.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.774+0000 7fc7c8a9c640 1 -- 172.21.15.46:0/3008361323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7c4070290 msgr2=0x7fc7c41f0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:16.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.774+0000 7fc7c8a9c640 1 --2- 172.21.15.46:0/3008361323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7c4070290 0x7fc7c41f0e50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800c420 tx=0x7fc7b800c8e0 comp rx=0 tx=0).stop 2024-01-23T09:25:16.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.774+0000 7fc7c8a9c640 1 -- 172.21.15.46:0/3008361323 shutdown_connections 2024-01-23T09:25:16.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.774+0000 7fc7c8a9c640 1 --2- 172.21.15.46:0/3008361323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7c41509f0 0x7fc7c4150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:16.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.774+0000 7fc7c8a9c640 1 --2- 172.21.15.46:0/3008361323 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fc7a4066550 0x7fc7a4068a10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:16.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.774+0000 7fc7c8a9c640 1 --2- 172.21.15.46:0/3008361323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7c4070290 0x7fc7c41f0e50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:16.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.774+0000 7fc7c8a9c640 1 --2- 172.21.15.46:0/3008361323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7c406feb0 0x7fc7c406a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:16.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.774+0000 7fc7c8a9c640 1 -- 172.21.15.46:0/3008361323 >> 172.21.15.46:0/3008361323 conn(0x7fc7c4072890 msgr2=0x7fc7c4158210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:16.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.774+0000 7fc7c8a9c640 1 -- 172.21.15.46:0/3008361323 shutdown_connections 2024-01-23T09:25:16.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.774+0000 7fc7c8a9c640 1 -- 172.21.15.46:0/3008361323 wait complete. 2024-01-23T09:25:16.798 INFO:tasks.ceph:Scrubbing osd.3 2024-01-23T09:25:16.798 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-01-23T09:25:16.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.925+0000 7f5bdcd74640 1 Processor -- start 2024-01-23T09:25:16.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.925+0000 7f5bdcd74640 1 -- start start 2024-01-23T09:25:16.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.929+0000 7f5bdcd74640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5bd80c6f10 0x7f5bd80c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:16.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.929+0000 7f5bdcd74640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd806afb0 con 0x7f5bd81506f0 2024-01-23T09:25:16.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.929+0000 7f5bdcd74640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd815dd10 con 0x7f5bd8150310 2024-01-23T09:25:16.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.929+0000 7f5bdcd74640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bd8070030 con 0x7f5bd80c6f10 2024-01-23T09:25:16.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.929+0000 7f5bd5d9b640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5bd81506f0 0x7f5bd80cbe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41536/0 (socket says 172.21.15.46:41536) 2024-01-23T09:25:16.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.929+0000 7f5bd5d9b640 1 -- 172.21.15.46:0/796060023 learned_addr learned my addr 172.21.15.46:0/796060023 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T09:25:16.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.929+0000 7f5bd6d9d640 1 --2- 172.21.15.46:0/796060023 >> v2:172.21.15.175:3300/0 conn(0x7f5bd80c6f10 0x7f5bd80c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:16.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.933+0000 7f5bd559a640 1 -- 172.21.15.46:0/796060023 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698365402 0 0) 0x7f5bd806afb0 con 0x7f5bd81506f0 2024-01-23T09:25:16.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.933+0000 7f5bd559a640 1 -- 172.21.15.46:0/796060023 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bc0003530 con 0x7f5bd81506f0 2024-01-23T09:25:16.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.937+0000 7f5bd559a640 1 -- 172.21.15.46:0/796060023 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3745091049 0 0) 0x7f5bc0003530 con 0x7f5bd81506f0 2024-01-23T09:25:16.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.937+0000 7f5bd559a640 1 -- 172.21.15.46:0/796060023 >> v2:172.21.15.175:3300/0 conn(0x7f5bd80c6f10 msgr2=0x7f5bd80c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:16.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.937+0000 7f5bd559a640 1 --2- 172.21.15.46:0/796060023 >> v2:172.21.15.175:3300/0 conn(0x7f5bd80c6f10 0x7f5bd80c68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:16.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.937+0000 7f5bd559a640 1 -- 172.21.15.46:0/796060023 >> v1:172.21.15.175:6789/0 conn(0x7f5bd8150310 legacy=0x7f5bd815d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:16.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.937+0000 7f5bd559a640 1 -- 172.21.15.46:0/796060023 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd806b1e0 con 0x7f5bd81506f0 2024-01-23T09:25:16.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.937+0000 7f5bd559a640 1 -- 172.21.15.46:0/796060023 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466917103 0 0) 0x7f5bcc001680 con 0x7f5bd81506f0 2024-01-23T09:25:16.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.937+0000 7f5bd559a640 1 -- 172.21.15.46:0/796060023 >> v1:172.21.15.46:6789/0 conn(0x7f5bd81506f0 legacy=0x7f5bd80cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:16.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.937+0000 7f5bd559a640 1 --2- 172.21.15.46:0/796060023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bc00039d0 0x7f5bc0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:16.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.937+0000 7f5bd559a640 1 --2- 172.21.15.46:0/796060023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bc00047d0 0x7f5bc0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:16.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.937+0000 7f5bd559a640 1 --2- 172.21.15.46:0/796060023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bc0005190 0x7f5bc000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:16.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.937+0000 7f5bd559a640 1 -- 172.21.15.46:0/796060023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd8070030 con 0x7f5bc0005190 2024-01-23T09:25:16.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.937+0000 7f5bd559a640 1 -- 172.21.15.46:0/796060023 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc000c0a0 con 0x7f5bc00047d0 2024-01-23T09:25:16.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.937+0000 7f5bd559a640 1 -- 172.21.15.46:0/796060023 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc000c260 con 0x7f5bc00039d0 2024-01-23T09:25:16.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.937+0000 7f5bd659c640 1 --2- 172.21.15.46:0/796060023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bc00039d0 0x7f5bc0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:16.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.941+0000 7f5bd6d9d640 1 --2- 172.21.15.46:0/796060023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bc0005190 0x7f5bc000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:16.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.945+0000 7f5bd6d9d640 1 -- 172.21.15.46:0/796060023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bc00039d0 msgr2=0x7f5bc0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:16.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.945+0000 7f5bd6d9d640 1 --2- 172.21.15.46:0/796060023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bc00039d0 0x7f5bc0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:16.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.945+0000 7f5bd6d9d640 1 -- 172.21.15.46:0/796060023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bc00047d0 msgr2=0x7f5bc0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:16.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.945+0000 7f5bd6d9d640 1 --2- 172.21.15.46:0/796060023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bc00047d0 0x7f5bc0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:16.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.945+0000 7f5bd6d9d640 1 -- 172.21.15.46:0/796060023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc0003530 con 0x7f5bc0005190 2024-01-23T09:25:16.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.945+0000 7f5bd6d9d640 1 -- 172.21.15.46:0/796060023 reap_dead start 2024-01-23T09:25:16.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.945+0000 7f5bd6d9d640 1 --2- 172.21.15.46:0/796060023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bc0005190 0x7f5bc000b990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0009ae0 tx=0x7f5bd001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9b4cded13bbd1a server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:16.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.949+0000 7f5bd559a640 1 -- 172.21.15.46:0/796060023 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0004020 con 0x7f5bc0005190 2024-01-23T09:25:16.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.949+0000 7f5bd559a640 1 -- 172.21.15.46:0/796060023 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd00041c0 con 0x7f5bc0005190 2024-01-23T09:25:16.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.949+0000 7f5bd559a640 1 -- 172.21.15.46:0/796060023 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd00a5680 con 0x7f5bc0005190 2024-01-23T09:25:16.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.953+0000 7f5bdcd74640 1 -- 172.21.15.46:0/796060023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bc0005190 msgr2=0x7f5bc000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:16.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.953+0000 7f5bdcd74640 1 --2- 172.21.15.46:0/796060023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bc0005190 0x7f5bc000b990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0009ae0 tx=0x7f5bd001ca90 comp rx=0 tx=0).stop 2024-01-23T09:25:16.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.953+0000 7f5bdcd74640 1 -- 172.21.15.46:0/796060023 shutdown_connections 2024-01-23T09:25:16.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.953+0000 7f5bdcd74640 1 --2- 172.21.15.46:0/796060023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bc0005190 0x7f5bc000b990 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:16.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.953+0000 7f5bdcd74640 1 -- 172.21.15.46:0/796060023 >> 172.21.15.46:0/796060023 conn(0x7f5bd80720a0 msgr2=0x7f5bd80724b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:16.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.953+0000 7f5bdcd74640 1 -- 172.21.15.46:0/796060023 shutdown_connections 2024-01-23T09:25:16.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.953+0000 7f5bdcd74640 1 -- 172.21.15.46:0/796060023 wait complete. 2024-01-23T09:25:16.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.953+0000 7f5bdcd74640 1 Processor -- start 2024-01-23T09:25:16.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.953+0000 7f5bdcd74640 1 -- start start 2024-01-23T09:25:16.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.953+0000 7f5bdcd74640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bc0005190 0x7f5bd8150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:16.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.953+0000 7f5bdcd74640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bd81efbf0 0x7f5bd814bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:16.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.953+0000 7f5bdcd74640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bd8155970 0x7f5bd8155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:16.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.953+0000 7f5bdcd74640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd81512f0 con 0x7f5bd81efbf0 2024-01-23T09:25:16.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.953+0000 7f5bdcd74640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd81557f0 con 0x7f5bc0005190 2024-01-23T09:25:16.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.953+0000 7f5bdcd74640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd81eef00 con 0x7f5bd8155970 2024-01-23T09:25:16.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.953+0000 7f5bd5d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bd81efbf0 0x7f5bd814bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:16.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.953+0000 7f5bd5d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bd81efbf0 0x7f5bd814bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47796/0 (socket says 172.21.15.46:47796) 2024-01-23T09:25:16.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.953+0000 7f5bd5d9b640 1 -- 172.21.15.46:0/1578852860 learned_addr learned my addr 172.21.15.46:0/1578852860 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:16.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.957+0000 7f5bd6d9d640 1 --2- 172.21.15.46:0/1578852860 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bd8155970 0x7f5bd8155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:16.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.957+0000 7f5bd659c640 1 --2- 172.21.15.46:0/1578852860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bc0005190 0x7f5bd8150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:16.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.957+0000 7f5bd5d9b640 1 -- 172.21.15.46:0/1578852860 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bd8155970 msgr2=0x7f5bd8155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:16.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.957+0000 7f5bd5d9b640 1 --2- 172.21.15.46:0/1578852860 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bd8155970 0x7f5bd8155ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:16.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.957+0000 7f5bd5d9b640 1 -- 172.21.15.46:0/1578852860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bc0005190 msgr2=0x7f5bd8150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:16.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.957+0000 7f5bd5d9b640 1 --2- 172.21.15.46:0/1578852860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bc0005190 0x7f5bd8150b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:16.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.957+0000 7f5bd5d9b640 1 -- 172.21.15.46:0/1578852860 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd81552a0 con 0x7f5bd81efbf0 2024-01-23T09:25:16.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.961+0000 7f5bd5d9b640 1 --2- 172.21.15.46:0/1578852860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bd81efbf0 0x7f5bd814bd30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc000fe0 tx=0x7f5bcc00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:16.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.965+0000 7f5bc6ffd640 1 -- 172.21.15.46:0/1578852860 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc0072d0 con 0x7f5bd81efbf0 2024-01-23T09:25:16.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.965+0000 7f5bc6ffd640 1 -- 172.21.15.46:0/1578852860 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bcc007430 con 0x7f5bd81efbf0 2024-01-23T09:25:16.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.965+0000 7f5bdcd74640 1 -- 172.21.15.46:0/1578852860 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd814c270 con 0x7f5bd81efbf0 2024-01-23T09:25:16.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.965+0000 7f5bc6ffd640 1 -- 172.21.15.46:0/1578852860 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc0047f0 con 0x7f5bd81efbf0 2024-01-23T09:25:16.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.965+0000 7f5bdcd74640 1 -- 172.21.15.46:0/1578852860 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd81ef110 con 0x7f5bd81efbf0 2024-01-23T09:25:16.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.969+0000 7f5bdcd74640 1 -- 172.21.15.46:0/1578852860 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5bd814f7e0 con 0x7f5bd81efbf0 2024-01-23T09:25:16.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.989+0000 7f5bc6ffd640 1 -- 172.21.15.46:0/1578852860 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5bcc00a610 con 0x7f5bd81efbf0 2024-01-23T09:25:16.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.989+0000 7f5bc6ffd640 1 --2- 172.21.15.46:0/1578852860 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5bb8066550 0x7f5bb8068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:16.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.989+0000 7f5bd659c640 1 --2- 172.21.15.46:0/1578852860 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5bb8066550 0x7f5bb8068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:16.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.989+0000 7f5bd659c640 1 --2- 172.21.15.46:0/1578852860 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5bb8066550 0x7f5bb8068a10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5bc8003f40 tx=0x7f5bc8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:16.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.989+0000 7f5bc6ffd640 1 -- 172.21.15.46:0/1578852860 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f5bcc054cd0 con 0x7f5bd81efbf0 2024-01-23T09:25:16.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.993+0000 7f5bc6ffd640 1 --2- 172.21.15.46:0/1578852860 >> [v2:172.21.15.46:6826/4168860822,v1:172.21.15.46:6827/4168860822] conn(0x7f5bb806fcb0 0x7f5bb8072150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:16.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.993+0000 7f5bc6ffd640 1 -- 172.21.15.46:0/1578852860 --> [v2:172.21.15.46:6826/4168860822,v1:172.21.15.46:6827/4168860822] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5bb8072820 con 0x7f5bb806fcb0 2024-01-23T09:25:16.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.993+0000 7f5bc6ffd640 1 -- 172.21.15.46:0/1578852860 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5bcc001ba0 con 0x7f5bd81efbf0 2024-01-23T09:25:16.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.993+0000 7f5bd6d9d640 1 --2- 172.21.15.46:0/1578852860 >> [v2:172.21.15.46:6826/4168860822,v1:172.21.15.46:6827/4168860822] conn(0x7f5bb806fcb0 0x7f5bb8072150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:16.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.993+0000 7f5bd6d9d640 1 --2- 172.21.15.46:0/1578852860 >> [v2:172.21.15.46:6826/4168860822,v1:172.21.15.46:6827/4168860822] conn(0x7f5bb806fcb0 0x7f5bb8072150 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:16.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:16.993+0000 7f5bc6ffd640 1 -- 172.21.15.46:0/1578852860 <== osd.3 v2:172.21.15.46:6826/4168860822 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5bb8072820 con 0x7f5bb806fcb0 2024-01-23T09:25:17.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.009+0000 7f5bdcd74640 1 -- 172.21.15.46:0/1578852860 --> [v2:172.21.15.46:6826/4168860822,v1:172.21.15.46:6827/4168860822] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5bd815d0e0 con 0x7f5bb806fcb0 2024-01-23T09:25:17.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.009+0000 7f5bc6ffd640 1 -- 172.21.15.46:0/1578852860 <== osd.3 v2:172.21.15.46:6826/4168860822 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5bd0004330 con 0x7f5bb806fcb0 2024-01-23T09:25:17.014 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-23T09:25:17.014 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-23T09:25:17.014 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-23T09:25:17.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.009+0000 7f5bdcd74640 1 -- 172.21.15.46:0/1578852860 >> [v2:172.21.15.46:6826/4168860822,v1:172.21.15.46:6827/4168860822] conn(0x7f5bb806fcb0 msgr2=0x7f5bb8072150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:17.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.009+0000 7f5bdcd74640 1 --2- 172.21.15.46:0/1578852860 >> [v2:172.21.15.46:6826/4168860822,v1:172.21.15.46:6827/4168860822] conn(0x7f5bb806fcb0 0x7f5bb8072150 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:17.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.009+0000 7f5bdcd74640 1 -- 172.21.15.46:0/1578852860 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5bb8066550 msgr2=0x7f5bb8068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:17.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.009+0000 7f5bdcd74640 1 --2- 172.21.15.46:0/1578852860 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5bb8066550 0x7f5bb8068a10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5bc8003f40 tx=0x7f5bc8009040 comp rx=0 tx=0).stop 2024-01-23T09:25:17.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.009+0000 7f5bdcd74640 1 -- 172.21.15.46:0/1578852860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bd81efbf0 msgr2=0x7f5bd814bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:17.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.009+0000 7f5bdcd74640 1 --2- 172.21.15.46:0/1578852860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5bd81efbf0 0x7f5bd814bd30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc000fe0 tx=0x7f5bcc00cb90 comp rx=0 tx=0).stop 2024-01-23T09:25:17.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.009+0000 7f5bd6d9d640 1 -- 172.21.15.46:0/1578852860 reap_dead start 2024-01-23T09:25:17.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.009+0000 7f5bdcd74640 1 -- 172.21.15.46:0/1578852860 shutdown_connections 2024-01-23T09:25:17.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.009+0000 7f5bdcd74640 1 -- 172.21.15.46:0/1578852860 >> 172.21.15.46:0/1578852860 conn(0x7f5bd80720a0 msgr2=0x7f5bd814fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:17.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.009+0000 7f5bdcd74640 1 -- 172.21.15.46:0/1578852860 shutdown_connections 2024-01-23T09:25:17.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.009+0000 7f5bdcd74640 1 -- 172.21.15.46:0/1578852860 wait complete. 2024-01-23T09:25:17.033 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-01-23T09:25:17.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.157+0000 7f4c3b1d7640 1 Processor -- start 2024-01-23T09:25:17.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.157+0000 7f4c3b1d7640 1 -- start start 2024-01-23T09:25:17.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.161+0000 7f4c3b1d7640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4c34153a00 0x7f4c34071d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:17.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.161+0000 7f4c3b1d7640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4c3406f640 0x7f4c340ad550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:17.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.161+0000 7f4c3b1d7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c340ada90 0x7f4c341599e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:17.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.161+0000 7f4c3b1d7640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c340c6000 con 0x7f4c34153a00 2024-01-23T09:25:17.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.161+0000 7f4c3b1d7640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c341595b0 con 0x7f4c3406f640 2024-01-23T09:25:17.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.161+0000 7f4c3b1d7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c340c73b0 con 0x7f4c340ada90 2024-01-23T09:25:17.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.161+0000 7f4c38f73640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4c34153a00 0x7f4c34071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:17.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.161+0000 7f4c38f73640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4c34153a00 0x7f4c34071d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47804/0 (socket says 172.21.15.46:47804) 2024-01-23T09:25:17.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.161+0000 7f4c38f73640 1 -- 172.21.15.46:0/4061203251 learned_addr learned my addr 172.21.15.46:0/4061203251 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:17.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.161+0000 7f4c38f73640 1 -- 172.21.15.46:0/4061203251 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c340ada90 msgr2=0x7f4c341599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:17.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.161+0000 7f4c38f73640 1 --2- 172.21.15.46:0/4061203251 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c340ada90 0x7f4c341599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:17.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.161+0000 7f4c38f73640 1 -- 172.21.15.46:0/4061203251 >> v2:172.21.15.175:3300/0 conn(0x7f4c3406f640 msgr2=0x7f4c340ad550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:17.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.161+0000 7f4c38f73640 1 --2- 172.21.15.46:0/4061203251 >> v2:172.21.15.175:3300/0 conn(0x7f4c3406f640 0x7f4c340ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:17.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.161+0000 7f4c38f73640 1 -- 172.21.15.46:0/4061203251 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c340c68c0 con 0x7f4c34153a00 2024-01-23T09:25:17.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.165+0000 7f4c38f73640 1 --2- 172.21.15.46:0/4061203251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c34153a00 0x7f4c34071d80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4c340cc1e0 tx=0x7f4c2401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d443b4b5810e872f server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:17.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.169+0000 7f4c337fe640 1 -- 172.21.15.46:0/4061203251 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c240af400 con 0x7f4c34153a00 2024-01-23T09:25:17.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.169+0000 7f4c337fe640 1 -- 172.21.15.46:0/4061203251 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c240ab050 con 0x7f4c34153a00 2024-01-23T09:25:17.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.169+0000 7f4c337fe640 1 -- 172.21.15.46:0/4061203251 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c240af780 con 0x7f4c34153a00 2024-01-23T09:25:17.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.169+0000 7f4c3b1d7640 1 -- 172.21.15.46:0/4061203251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c34153a00 msgr2=0x7f4c34071d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.169+0000 7f4c3b1d7640 1 --2- 172.21.15.46:0/4061203251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c34153a00 0x7f4c34071d80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4c340cc1e0 tx=0x7f4c2401f1c0 comp rx=0 tx=0).stop 2024-01-23T09:25:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.169+0000 7f4c3b1d7640 1 -- 172.21.15.46:0/4061203251 shutdown_connections 2024-01-23T09:25:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.169+0000 7f4c3b1d7640 1 --2- 172.21.15.46:0/4061203251 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c340ada90 0x7f4c341599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.169+0000 7f4c3b1d7640 1 --2- 172.21.15.46:0/4061203251 >> v2:172.21.15.175:3300/0 conn(0x7f4c3406f640 0x7f4c340ad550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.169+0000 7f4c3b1d7640 1 --2- 172.21.15.46:0/4061203251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c34153a00 0x7f4c34071d80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.169+0000 7f4c3b1d7640 1 -- 172.21.15.46:0/4061203251 >> 172.21.15.46:0/4061203251 conn(0x7f4c3406ac60 msgr2=0x7f4c3406ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.173+0000 7f4c3b1d7640 1 -- 172.21.15.46:0/4061203251 shutdown_connections 2024-01-23T09:25:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.173+0000 7f4c3b1d7640 1 -- 172.21.15.46:0/4061203251 wait complete. 2024-01-23T09:25:17.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.173+0000 7f4c3b1d7640 1 Processor -- start 2024-01-23T09:25:17.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.173+0000 7f4c3b1d7640 1 -- start start 2024-01-23T09:25:17.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.173+0000 7f4c3b1d7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c3406f640 0x7f4c341409c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:17.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.173+0000 7f4c3b1d7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c340ada90 0x7f4c341e4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:17.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.173+0000 7f4c3b1d7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c34153a00 0x7f4c341e3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:17.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.173+0000 7f4c3b1d7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c341f4090 con 0x7f4c34153a00 2024-01-23T09:25:17.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.173+0000 7f4c3b1d7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c341e3e70 con 0x7f4c340ada90 2024-01-23T09:25:17.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.173+0000 7f4c3b1d7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c341f3510 con 0x7f4c3406f640 2024-01-23T09:25:17.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.173+0000 7f4c39774640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c34153a00 0x7f4c341e3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:17.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.173+0000 7f4c39774640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c34153a00 0x7f4c341e3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47810/0 (socket says 172.21.15.46:47810) 2024-01-23T09:25:17.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.173+0000 7f4c39774640 1 -- 172.21.15.46:0/2319958087 learned_addr learned my addr 172.21.15.46:0/2319958087 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:17.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.177+0000 7f4c39774640 1 -- 172.21.15.46:0/2319958087 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c3406f640 msgr2=0x7f4c341409c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:17.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.177+0000 7f4c39774640 1 --2- 172.21.15.46:0/2319958087 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c3406f640 0x7f4c341409c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:17.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.177+0000 7f4c39774640 1 -- 172.21.15.46:0/2319958087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c340ada90 msgr2=0x7f4c341e4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:17.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.177+0000 7f4c39774640 1 --2- 172.21.15.46:0/2319958087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c340ada90 0x7f4c341e4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:17.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.177+0000 7f4c39774640 1 -- 172.21.15.46:0/2319958087 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c24009b30 con 0x7f4c34153a00 2024-01-23T09:25:17.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.181+0000 7f4c39774640 1 --2- 172.21.15.46:0/2319958087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c34153a00 0x7f4c341e3080 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c00b430 tx=0x7f4c2c00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:17.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.185+0000 7f4c317fa640 1 -- 172.21.15.46:0/2319958087 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c011830 con 0x7f4c34153a00 2024-01-23T09:25:17.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.185+0000 7f4c317fa640 1 -- 172.21.15.46:0/2319958087 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2c011990 con 0x7f4c34153a00 2024-01-23T09:25:17.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.185+0000 7f4c317fa640 1 -- 172.21.15.46:0/2319958087 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c011d40 con 0x7f4c34153a00 2024-01-23T09:25:17.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.185+0000 7f4c3b1d7640 1 -- 172.21.15.46:0/2319958087 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c341f37f0 con 0x7f4c34153a00 2024-01-23T09:25:17.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.185+0000 7f4c3b1d7640 1 -- 172.21.15.46:0/2319958087 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c341f3db0 con 0x7f4c34153a00 2024-01-23T09:25:17.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.185+0000 7f4c3b1d7640 1 -- 172.21.15.46:0/2319958087 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c34074340 con 0x7f4c34153a00 2024-01-23T09:25:17.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.477+0000 7f4c317fa640 1 -- 172.21.15.46:0/2319958087 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f4c2c01a400 con 0x7f4c34153a00 2024-01-23T09:25:17.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.477+0000 7f4c317fa640 1 --2- 172.21.15.46:0/2319958087 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4c20066550 0x7f4c20068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:17.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.481+0000 7f4c38f73640 1 --2- 172.21.15.46:0/2319958087 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4c20066550 0x7f4c20068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:17.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.481+0000 7f4c38f73640 1 --2- 172.21.15.46:0/2319958087 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4c20066550 0x7f4c20068a10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4c240b1000 tx=0x7f4c24004ac0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:17.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.565+0000 7f4c317fa640 1 -- 172.21.15.46:0/2319958087 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f4c2c025e50 con 0x7f4c34153a00 2024-01-23T09:25:17.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.565+0000 7f4c317fa640 1 -- 172.21.15.46:0/2319958087 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f4c2c051910 con 0x7f4c34153a00 2024-01-23T09:25:17.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.745+0000 7f4c3b1d7640 1 -- 172.21.15.46:0/2319958087 --> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c340c2380 con 0x7f4c20066550 2024-01-23T09:25:17.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.749+0000 7f4c317fa640 1 -- 172.21.15.46:0/2319958087 <== mgr.4107 v2:172.21.15.46:6800/2324478006 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4c340c2380 con 0x7f4c20066550 2024-01-23T09:25:17.752 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 3 to deep-scrub 2024-01-23T09:25:17.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.749+0000 7f4c3b1d7640 1 -- 172.21.15.46:0/2319958087 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4c20066550 msgr2=0x7f4c20068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:17.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.749+0000 7f4c3b1d7640 1 --2- 172.21.15.46:0/2319958087 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4c20066550 0x7f4c20068a10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4c240b1000 tx=0x7f4c24004ac0 comp rx=0 tx=0).stop 2024-01-23T09:25:17.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.749+0000 7f4c3b1d7640 1 -- 172.21.15.46:0/2319958087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c34153a00 msgr2=0x7f4c341e3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:17.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.749+0000 7f4c3b1d7640 1 --2- 172.21.15.46:0/2319958087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c34153a00 0x7f4c341e3080 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c00b430 tx=0x7f4c2c00b8f0 comp rx=0 tx=0).stop 2024-01-23T09:25:17.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.749+0000 7f4c3b1d7640 1 -- 172.21.15.46:0/2319958087 shutdown_connections 2024-01-23T09:25:17.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.749+0000 7f4c3b1d7640 1 --2- 172.21.15.46:0/2319958087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c34153a00 0x7f4c341e3080 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:17.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.749+0000 7f4c3b1d7640 1 --2- 172.21.15.46:0/2319958087 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4c20066550 0x7f4c20068a10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:17.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.749+0000 7f4c3b1d7640 1 --2- 172.21.15.46:0/2319958087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c340ada90 0x7f4c341e4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:17.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.749+0000 7f4c3b1d7640 1 --2- 172.21.15.46:0/2319958087 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c3406f640 0x7f4c341409c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:17.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.749+0000 7f4c3b1d7640 1 -- 172.21.15.46:0/2319958087 >> 172.21.15.46:0/2319958087 conn(0x7f4c3406ac60 msgr2=0x7f4c34142d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:17.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.749+0000 7f4c3b1d7640 1 -- 172.21.15.46:0/2319958087 shutdown_connections 2024-01-23T09:25:17.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.749+0000 7f4c3b1d7640 1 -- 172.21.15.46:0/2319958087 wait complete. 2024-01-23T09:25:17.773 INFO:tasks.ceph:Scrubbing osd.4 2024-01-23T09:25:17.773 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-01-23T09:25:17.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.893+0000 7fef07859640 1 Processor -- start 2024-01-23T09:25:17.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.893+0000 7fef07859640 1 -- start start 2024-01-23T09:25:17.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.893+0000 7fef07859640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef000ce370 0x7fef000ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:17.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.893+0000 7fef07859640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fef000cd250 0x7fef000cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:17.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.893+0000 7fef07859640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef000ce150 con 0x7fef000cb8a0 2024-01-23T09:25:17.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.893+0000 7fef07859640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef000cec90 con 0x7fef000cd250 2024-01-23T09:25:17.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.893+0000 7fef07859640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef001598a0 con 0x7fef000ce370 2024-01-23T09:25:17.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.893+0000 7fef04df4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fef000cd250 0x7fef000cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:17.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.897+0000 7fef055f5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef000ce370 0x7fef000ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:17.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.897+0000 7fef04df4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fef000cd250 0x7fef000cd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:39690/0 (socket says 172.21.15.46:39690) 2024-01-23T09:25:17.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.897+0000 7fef04df4640 1 -- 172.21.15.46:0/2318190077 learned_addr learned my addr 172.21.15.46:0/2318190077 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:17.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.901+0000 7fef04df4640 1 -- 172.21.15.46:0/2318190077 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef000ce370 msgr2=0x7fef000ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:17.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.901+0000 7fef04df4640 1 --2- 172.21.15.46:0/2318190077 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef000ce370 0x7fef000ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:17.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.901+0000 7fef04df4640 1 -- 172.21.15.46:0/2318190077 >> v1:172.21.15.175:6789/0 conn(0x7fef000cb8a0 legacy=0x7fef000cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:17.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.901+0000 7fef04df4640 1 -- 172.21.15.46:0/2318190077 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef00153ed0 con 0x7fef000cd250 2024-01-23T09:25:17.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.909+0000 7fef04df4640 1 --2- 172.21.15.46:0/2318190077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef000cd250 0x7fef000cd670 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feef4009870 tx=0x7feef401c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b64e7216d71187d7 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:17.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.921+0000 7feefffff640 1 -- 172.21.15.46:0/2318190077 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef40ac410 con 0x7fef000cd250 2024-01-23T09:25:17.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.921+0000 7feefffff640 1 -- 172.21.15.46:0/2318190077 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef40ac570 con 0x7fef000cd250 2024-01-23T09:25:17.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.921+0000 7feefffff640 1 -- 172.21.15.46:0/2318190077 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef40ac900 con 0x7fef000cd250 2024-01-23T09:25:17.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.921+0000 7fef07859640 1 -- 172.21.15.46:0/2318190077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef000cd250 msgr2=0x7fef000cd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:17.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.921+0000 7fef07859640 1 --2- 172.21.15.46:0/2318190077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef000cd250 0x7fef000cd670 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feef4009870 tx=0x7feef401c500 comp rx=0 tx=0).stop 2024-01-23T09:25:17.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.921+0000 7fef07859640 1 -- 172.21.15.46:0/2318190077 shutdown_connections 2024-01-23T09:25:17.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.921+0000 7fef07859640 1 --2- 172.21.15.46:0/2318190077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef000cd250 0x7fef000cd670 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:17.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.921+0000 7fef07859640 1 --2- 172.21.15.46:0/2318190077 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef000ce370 0x7fef000ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:17.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.921+0000 7fef07859640 1 -- 172.21.15.46:0/2318190077 >> 172.21.15.46:0/2318190077 conn(0x7fef000b09c0 msgr2=0x7fef000b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:17.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.921+0000 7fef07859640 1 -- 172.21.15.46:0/2318190077 shutdown_connections 2024-01-23T09:25:17.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.921+0000 7fef07859640 1 -- 172.21.15.46:0/2318190077 wait complete. 2024-01-23T09:25:17.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.921+0000 7fef07859640 1 Processor -- start 2024-01-23T09:25:17.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.921+0000 7fef07859640 1 -- start start 2024-01-23T09:25:17.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.925+0000 7fef07859640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef000cb8a0 0x7fef000b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:17.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.925+0000 7fef07859640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef000cd250 0x7fef00152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:17.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.925+0000 7fef07859640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef000ce370 0x7fef0015cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:17.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.925+0000 7fef07859640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0015b1c0 con 0x7fef000cb8a0 2024-01-23T09:25:17.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.925+0000 7fef07859640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef000b43f0 con 0x7fef000cd250 2024-01-23T09:25:17.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.925+0000 7fef07859640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef0015bd40 con 0x7fef000ce370 2024-01-23T09:25:17.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.925+0000 7fef055f5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef000cb8a0 0x7fef000b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:17.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.925+0000 7fef055f5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef000cb8a0 0x7fef000b3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47826/0 (socket says 172.21.15.46:47826) 2024-01-23T09:25:17.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.925+0000 7fef055f5640 1 -- 172.21.15.46:0/2985481570 learned_addr learned my addr 172.21.15.46:0/2985481570 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:17.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.925+0000 7fef05df6640 1 --2- 172.21.15.46:0/2985481570 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef000ce370 0x7fef0015cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:17.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.925+0000 7fef04df4640 1 --2- 172.21.15.46:0/2985481570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef000cd250 0x7fef00152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:17.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.929+0000 7fef055f5640 1 -- 172.21.15.46:0/2985481570 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef000ce370 msgr2=0x7fef0015cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:17.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.929+0000 7fef055f5640 1 --2- 172.21.15.46:0/2985481570 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef000ce370 0x7fef0015cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:17.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.929+0000 7fef055f5640 1 -- 172.21.15.46:0/2985481570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef000cd250 msgr2=0x7fef00152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:17.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.929+0000 7fef055f5640 1 --2- 172.21.15.46:0/2985481570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef000cd250 0x7fef00152640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:17.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.929+0000 7fef055f5640 1 -- 172.21.15.46:0/2985481570 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef40094d0 con 0x7fef000cb8a0 2024-01-23T09:25:17.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.929+0000 7fef055f5640 1 --2- 172.21.15.46:0/2985481570 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef000cb8a0 0x7fef000b3510 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7feef800efc0 tx=0x7feef800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:17.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.937+0000 7feefdffb640 1 -- 172.21.15.46:0/2985481570 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef8014480 con 0x7fef000cb8a0 2024-01-23T09:25:17.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.937+0000 7feefdffb640 1 -- 172.21.15.46:0/2985481570 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef800f040 con 0x7fef000cb8a0 2024-01-23T09:25:17.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.937+0000 7fef07859640 1 -- 172.21.15.46:0/2985481570 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef000b3a50 con 0x7fef000cb8a0 2024-01-23T09:25:17.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.937+0000 7feefdffb640 1 -- 172.21.15.46:0/2985481570 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef8014800 con 0x7fef000cb8a0 2024-01-23T09:25:17.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.937+0000 7fef07859640 1 -- 172.21.15.46:0/2985481570 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef000b46f0 con 0x7fef000cb8a0 2024-01-23T09:25:17.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.937+0000 7fef07859640 1 -- 172.21.15.46:0/2985481570 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fef0015a3e0 con 0x7fef000cb8a0 2024-01-23T09:25:17.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.957+0000 7feefdffb640 1 -- 172.21.15.46:0/2985481570 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7feef8014960 con 0x7fef000cb8a0 2024-01-23T09:25:17.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.961+0000 7feefdffb640 1 --2- 172.21.15.46:0/2985481570 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7feeec066550 0x7feeec068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:17.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.961+0000 7fef04df4640 1 --2- 172.21.15.46:0/2985481570 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7feeec066550 0x7feeec068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:17.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.961+0000 7fef04df4640 1 --2- 172.21.15.46:0/2985481570 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7feeec066550 0x7feeec068a10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7feef40ae000 tx=0x7feef4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:17.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.965+0000 7feefdffb640 1 -- 172.21.15.46:0/2985481570 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7feef80560a0 con 0x7fef000cb8a0 2024-01-23T09:25:17.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.965+0000 7feefdffb640 1 --2- 172.21.15.46:0/2985481570 >> [v2:172.21.15.175:6803/3115257412,v1:172.21.15.175:6805/3115257412] conn(0x7feeec06fcb0 0x7feeec072150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:17.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.965+0000 7feefdffb640 1 -- 172.21.15.46:0/2985481570 --> [v2:172.21.15.175:6803/3115257412,v1:172.21.15.175:6805/3115257412] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feeec072820 con 0x7feeec06fcb0 2024-01-23T09:25:17.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.965+0000 7feefdffb640 1 -- 172.21.15.46:0/2985481570 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7feef80523e0 con 0x7fef000cb8a0 2024-01-23T09:25:17.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.965+0000 7fef05df6640 1 --2- 172.21.15.46:0/2985481570 >> [v2:172.21.15.175:6803/3115257412,v1:172.21.15.175:6805/3115257412] conn(0x7feeec06fcb0 0x7feeec072150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:17.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.969+0000 7fef05df6640 1 --2- 172.21.15.46:0/2985481570 >> [v2:172.21.15.175:6803/3115257412,v1:172.21.15.175:6805/3115257412] conn(0x7feeec06fcb0 0x7feeec072150 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:17.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.969+0000 7feefdffb640 1 -- 172.21.15.46:0/2985481570 <== osd.4 v2:172.21.15.175:6803/3115257412 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7feeec072820 con 0x7feeec06fcb0 2024-01-23T09:25:17.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.985+0000 7fef07859640 1 -- 172.21.15.46:0/2985481570 --> [v2:172.21.15.175:6803/3115257412,v1:172.21.15.175:6805/3115257412] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fef0015a100 con 0x7feeec06fcb0 2024-01-23T09:25:17.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.985+0000 7feefdffb640 1 -- 172.21.15.46:0/2985481570 <== osd.4 v2:172.21.15.175:6803/3115257412 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7feef00094e0 con 0x7feeec06fcb0 2024-01-23T09:25:17.988 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-23T09:25:17.989 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-23T09:25:17.989 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-23T09:25:17.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.985+0000 7fef07859640 1 -- 172.21.15.46:0/2985481570 >> [v2:172.21.15.175:6803/3115257412,v1:172.21.15.175:6805/3115257412] conn(0x7feeec06fcb0 msgr2=0x7feeec072150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:17.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.985+0000 7fef07859640 1 --2- 172.21.15.46:0/2985481570 >> [v2:172.21.15.175:6803/3115257412,v1:172.21.15.175:6805/3115257412] conn(0x7feeec06fcb0 0x7feeec072150 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:17.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.985+0000 7fef07859640 1 -- 172.21.15.46:0/2985481570 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7feeec066550 msgr2=0x7feeec068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:17.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.985+0000 7fef07859640 1 --2- 172.21.15.46:0/2985481570 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7feeec066550 0x7feeec068a10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7feef40ae000 tx=0x7feef4009040 comp rx=0 tx=0).stop 2024-01-23T09:25:17.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.985+0000 7fef07859640 1 -- 172.21.15.46:0/2985481570 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef000cb8a0 msgr2=0x7fef000b3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:17.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.985+0000 7fef07859640 1 --2- 172.21.15.46:0/2985481570 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef000cb8a0 0x7fef000b3510 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7feef800efc0 tx=0x7feef800c490 comp rx=0 tx=0).stop 2024-01-23T09:25:17.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.985+0000 7fef05df6640 1 -- 172.21.15.46:0/2985481570 reap_dead start 2024-01-23T09:25:17.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.985+0000 7fef07859640 1 -- 172.21.15.46:0/2985481570 shutdown_connections 2024-01-23T09:25:17.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.985+0000 7fef07859640 1 -- 172.21.15.46:0/2985481570 >> 172.21.15.46:0/2985481570 conn(0x7fef000b09c0 msgr2=0x7fef00157600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:17.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.985+0000 7fef07859640 1 -- 172.21.15.46:0/2985481570 shutdown_connections 2024-01-23T09:25:17.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:17.985+0000 7fef07859640 1 -- 172.21.15.46:0/2985481570 wait complete. 2024-01-23T09:25:18.006 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-01-23T09:25:18.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.125+0000 7fd72a742640 1 Processor -- start 2024-01-23T09:25:18.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.125+0000 7fd72a742640 1 -- start start 2024-01-23T09:25:18.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.125+0000 7fd72a742640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd7241507a0 0x7fd7240c7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:18.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.125+0000 7fd72a742640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7240c7c10 con 0x7fd7240c5580 2024-01-23T09:25:18.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.125+0000 7fd72a742640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd724159850 con 0x7fd7240c51a0 2024-01-23T09:25:18.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.125+0000 7fd72a742640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd724159b30 con 0x7fd7241507a0 2024-01-23T09:25:18.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.125+0000 7fd723fff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd7240c51a0 0x7fd724150090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.46:49796/0 (socket says 172.21.15.46:49796) 2024-01-23T09:25:18.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.125+0000 7fd723fff640 1 -- 172.21.15.46:0/3561642176 learned_addr learned my addr 172.21.15.46:0/3561642176 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T09:25:18.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.153+0000 7fd7237fe640 1 --2- 172.21.15.46:0/3561642176 >> v2:172.21.15.46:3300/0 conn(0x7fd7241507a0 0x7fd7240c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:18.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.157+0000 7fd7237fe640 1 -- 172.21.15.46:0/3561642176 >> v1:172.21.15.175:6789/0 conn(0x7fd7240c51a0 legacy=0x7fd724150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:18.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.157+0000 7fd7237fe640 1 -- 172.21.15.46:0/3561642176 >> v1:172.21.15.46:6789/0 conn(0x7fd7240c5580 legacy=0x7fd7240c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:18.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.157+0000 7fd7237fe640 1 -- 172.21.15.46:0/3561642176 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd724159e10 con 0x7fd7241507a0 2024-01-23T09:25:18.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.165+0000 7fd7237fe640 1 --2- 172.21.15.46:0/3561642176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7241507a0 0x7fd7240c7620 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd7140097c0 tx=0x7fd71401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a53da0e7cd29b01a server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:18.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.173+0000 7fd722ffd640 1 -- 172.21.15.46:0/3561642176 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7140a8970 con 0x7fd7241507a0 2024-01-23T09:25:18.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.173+0000 7fd722ffd640 1 -- 172.21.15.46:0/3561642176 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7140a8ad0 con 0x7fd7241507a0 2024-01-23T09:25:18.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.173+0000 7fd722ffd640 1 -- 172.21.15.46:0/3561642176 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7140a8e60 con 0x7fd7241507a0 2024-01-23T09:25:18.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.173+0000 7fd72a742640 1 -- 172.21.15.46:0/3561642176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7241507a0 msgr2=0x7fd7240c7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:18.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.173+0000 7fd72a742640 1 --2- 172.21.15.46:0/3561642176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7241507a0 0x7fd7240c7620 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd7140097c0 tx=0x7fd71401ec70 comp rx=0 tx=0).stop 2024-01-23T09:25:18.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.173+0000 7fd72a742640 1 -- 172.21.15.46:0/3561642176 shutdown_connections 2024-01-23T09:25:18.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.173+0000 7fd72a742640 1 --2- 172.21.15.46:0/3561642176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7241507a0 0x7fd7240c7620 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:18.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.173+0000 7fd72a742640 1 -- 172.21.15.46:0/3561642176 >> 172.21.15.46:0/3561642176 conn(0x7fd7240cb3e0 msgr2=0x7fd7240cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:18.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.173+0000 7fd72a742640 1 -- 172.21.15.46:0/3561642176 shutdown_connections 2024-01-23T09:25:18.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.173+0000 7fd72a742640 1 -- 172.21.15.46:0/3561642176 wait complete. 2024-01-23T09:25:18.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.177+0000 7fd72a742640 1 Processor -- start 2024-01-23T09:25:18.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.177+0000 7fd72a742640 1 -- start start 2024-01-23T09:25:18.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.177+0000 7fd72a742640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7240c51a0 0x7fd724141290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:18.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.177+0000 7fd72a742640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7240c5580 0x7fd724149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:18.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.177+0000 7fd72a742640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7241507a0 0x7fd7241495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:18.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.177+0000 7fd72a742640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7241e2580 con 0x7fd7241507a0 2024-01-23T09:25:18.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.177+0000 7fd72a742640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7241dfe10 con 0x7fd7240c5580 2024-01-23T09:25:18.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.177+0000 7fd72a742640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd724148c00 con 0x7fd7240c51a0 2024-01-23T09:25:18.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.177+0000 7fd728cdf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7241507a0 0x7fd7241495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:18.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.177+0000 7fd728cdf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7241507a0 0x7fd7241495d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47838/0 (socket says 172.21.15.46:47838) 2024-01-23T09:25:18.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.177+0000 7fd728cdf640 1 -- 172.21.15.46:0/1922119559 learned_addr learned my addr 172.21.15.46:0/1922119559 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:18.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.181+0000 7fd728cdf640 1 -- 172.21.15.46:0/1922119559 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7240c51a0 msgr2=0x7fd724141290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:18.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.181+0000 7fd728cdf640 1 --2- 172.21.15.46:0/1922119559 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7240c51a0 0x7fd724141290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:18.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.181+0000 7fd728cdf640 1 -- 172.21.15.46:0/1922119559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7240c5580 msgr2=0x7fd724149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:18.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.181+0000 7fd728cdf640 1 --2- 172.21.15.46:0/1922119559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7240c5580 0x7fd724149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:18.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.181+0000 7fd728cdf640 1 -- 172.21.15.46:0/1922119559 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd714009420 con 0x7fd7241507a0 2024-01-23T09:25:18.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.185+0000 7fd728cdf640 1 --2- 172.21.15.46:0/1922119559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7241507a0 0x7fd7241495d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd71c00c770 tx=0x7fd71c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:18.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.189+0000 7fd720ff9640 1 -- 172.21.15.46:0/1922119559 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c003b80 con 0x7fd7241507a0 2024-01-23T09:25:18.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.189+0000 7fd720ff9640 1 -- 172.21.15.46:0/1922119559 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71c003ce0 con 0x7fd7241507a0 2024-01-23T09:25:18.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.189+0000 7fd720ff9640 1 -- 172.21.15.46:0/1922119559 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c00aa90 con 0x7fd7241507a0 2024-01-23T09:25:18.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.189+0000 7fd72a742640 1 -- 172.21.15.46:0/1922119559 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7241e1f20 con 0x7fd7241507a0 2024-01-23T09:25:18.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.189+0000 7fd72a742640 1 -- 172.21.15.46:0/1922119559 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7241417d0 con 0x7fd7241507a0 2024-01-23T09:25:18.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.189+0000 7fd72a742640 1 -- 172.21.15.46:0/1922119559 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd724074340 con 0x7fd7241507a0 2024-01-23T09:25:18.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.493+0000 7fd720ff9640 1 -- 172.21.15.46:0/1922119559 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fd71c00abf0 con 0x7fd7241507a0 2024-01-23T09:25:18.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.493+0000 7fd720ff9640 1 --2- 172.21.15.46:0/1922119559 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd704066550 0x7fd704068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:18.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.493+0000 7fd723fff640 1 --2- 172.21.15.46:0/1922119559 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd704066550 0x7fd704068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:18.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.493+0000 7fd723fff640 1 --2- 172.21.15.46:0/1922119559 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd704066550 0x7fd704068a10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd70c001600 tx=0x7fd70c007a50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:18.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.529+0000 7fd720ff9640 1 -- 172.21.15.46:0/1922119559 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fd71c055e60 con 0x7fd7241507a0 2024-01-23T09:25:18.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.529+0000 7fd720ff9640 1 -- 172.21.15.46:0/1922119559 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fd71c051aa0 con 0x7fd7241507a0 2024-01-23T09:25:18.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.741+0000 7fd72a742640 1 -- 172.21.15.46:0/1922119559 --> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd72415a6b0 con 0x7fd704066550 2024-01-23T09:25:18.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.741+0000 7fd720ff9640 1 -- 172.21.15.46:0/1922119559 <== mgr.4107 v2:172.21.15.46:6800/2324478006 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd70c0058c0 con 0x7fd704066550 2024-01-23T09:25:18.745 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 4 to deep-scrub 2024-01-23T09:25:18.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.745+0000 7fd72a742640 1 -- 172.21.15.46:0/1922119559 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd704066550 msgr2=0x7fd704068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:18.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.745+0000 7fd72a742640 1 --2- 172.21.15.46:0/1922119559 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd704066550 0x7fd704068a10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd70c001600 tx=0x7fd70c007a50 comp rx=0 tx=0).stop 2024-01-23T09:25:18.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.745+0000 7fd72a742640 1 -- 172.21.15.46:0/1922119559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7241507a0 msgr2=0x7fd7241495d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:18.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.745+0000 7fd72a742640 1 --2- 172.21.15.46:0/1922119559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7241507a0 0x7fd7241495d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd71c00c770 tx=0x7fd71c00cc30 comp rx=0 tx=0).stop 2024-01-23T09:25:18.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.745+0000 7fd72a742640 1 -- 172.21.15.46:0/1922119559 shutdown_connections 2024-01-23T09:25:18.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.745+0000 7fd72a742640 1 --2- 172.21.15.46:0/1922119559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7241507a0 0x7fd7241495d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:18.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.745+0000 7fd72a742640 1 --2- 172.21.15.46:0/1922119559 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fd704066550 0x7fd704068a10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:18.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.745+0000 7fd72a742640 1 --2- 172.21.15.46:0/1922119559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7240c5580 0x7fd724149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:18.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.745+0000 7fd72a742640 1 --2- 172.21.15.46:0/1922119559 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7240c51a0 0x7fd724141290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:18.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.745+0000 7fd72a742640 1 -- 172.21.15.46:0/1922119559 >> 172.21.15.46:0/1922119559 conn(0x7fd7240cb3e0 msgr2=0x7fd72414b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:18.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.745+0000 7fd72a742640 1 -- 172.21.15.46:0/1922119559 shutdown_connections 2024-01-23T09:25:18.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.745+0000 7fd72a742640 1 -- 172.21.15.46:0/1922119559 wait complete. 2024-01-23T09:25:18.766 INFO:tasks.ceph:Scrubbing osd.5 2024-01-23T09:25:18.766 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-01-23T09:25:18.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.889+0000 7f82c68de640 1 Processor -- start 2024-01-23T09:25:18.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.889+0000 7f82c68de640 1 -- start start 2024-01-23T09:25:18.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.889+0000 7f82c68de640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f82c006b770 0x7f82c00c2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:18.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.889+0000 7f82c68de640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82c00c7a90 0x7f82c006bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:18.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.889+0000 7f82c68de640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c00c3370 con 0x7f82c015cba0 2024-01-23T09:25:18.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.889+0000 7f82c68de640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82c00c26c0 con 0x7f82c006b770 2024-01-23T09:25:18.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.889+0000 7f82c68de640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c00c3c10 con 0x7f82c00c7a90 2024-01-23T09:25:18.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.893+0000 7f82bffff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f82c006b770 0x7f82c00c2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:18.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.893+0000 7f82c4e7b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82c00c7a90 0x7f82c006bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:18.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.893+0000 7f82bf7fe640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f82c015cba0 0x7f82c006cd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.46:49808/0 (socket says 172.21.15.46:49808) 2024-01-23T09:25:18.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.893+0000 7f82bf7fe640 1 -- 172.21.15.46:0/4176098648 learned_addr learned my addr 172.21.15.46:0/4176098648 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T09:25:18.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.901+0000 7f82c4e7b640 1 -- 172.21.15.46:0/4176098648 >> v2:172.21.15.175:3300/0 conn(0x7f82c006b770 msgr2=0x7f82c00c2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:18.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.901+0000 7f82c4e7b640 1 --2- 172.21.15.46:0/4176098648 >> v2:172.21.15.175:3300/0 conn(0x7f82c006b770 0x7f82c00c2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:18.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.901+0000 7f82c4e7b640 1 -- 172.21.15.46:0/4176098648 >> v1:172.21.15.175:6789/0 conn(0x7f82c015cba0 legacy=0x7f82c006cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:18.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.901+0000 7f82c4e7b640 1 -- 172.21.15.46:0/4176098648 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c00c3650 con 0x7f82c00c7a90 2024-01-23T09:25:18.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.905+0000 7f82c4e7b640 1 --2- 172.21.15.46:0/4176098648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82c00c7a90 0x7f82c006bb50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f82b8009d90 tx=0x7f82b801c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61e2e3c36625945 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:18.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.913+0000 7f82beffd640 1 -- 172.21.15.46:0/4176098648 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b80a5810 con 0x7f82c00c7a90 2024-01-23T09:25:18.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.913+0000 7f82beffd640 1 -- 172.21.15.46:0/4176098648 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b80a5970 con 0x7f82c00c7a90 2024-01-23T09:25:18.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.913+0000 7f82beffd640 1 -- 172.21.15.46:0/4176098648 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b80a5d00 con 0x7f82c00c7a90 2024-01-23T09:25:18.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.913+0000 7f82c68de640 1 -- 172.21.15.46:0/4176098648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82c00c7a90 msgr2=0x7f82c006bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:18.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.913+0000 7f82c68de640 1 --2- 172.21.15.46:0/4176098648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82c00c7a90 0x7f82c006bb50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f82b8009d90 tx=0x7f82b801c950 comp rx=0 tx=0).stop 2024-01-23T09:25:18.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.913+0000 7f82c68de640 1 -- 172.21.15.46:0/4176098648 shutdown_connections 2024-01-23T09:25:18.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.913+0000 7f82c68de640 1 --2- 172.21.15.46:0/4176098648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82c00c7a90 0x7f82c006bb50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:18.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.913+0000 7f82c68de640 1 --2- 172.21.15.46:0/4176098648 >> v2:172.21.15.175:3300/0 conn(0x7f82c006b770 0x7f82c00c2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:18.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.913+0000 7f82c68de640 1 -- 172.21.15.46:0/4176098648 >> 172.21.15.46:0/4176098648 conn(0x7f82c006a660 msgr2=0x7f82c006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:18.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.913+0000 7f82c68de640 1 -- 172.21.15.46:0/4176098648 shutdown_connections 2024-01-23T09:25:18.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.913+0000 7f82c68de640 1 -- 172.21.15.46:0/4176098648 wait complete. 2024-01-23T09:25:18.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.913+0000 7f82c68de640 1 Processor -- start 2024-01-23T09:25:18.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.913+0000 7f82c68de640 1 -- start start 2024-01-23T09:25:18.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.917+0000 7f82c68de640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82c006b770 0x7f82c0152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:18.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.917+0000 7f82c68de640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82c00c7a90 0x7f82c01f3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:18.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.917+0000 7f82c68de640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82c015cba0 0x7f82c01f4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:18.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.917+0000 7f82c68de640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c00c70a0 con 0x7f82c006b770 2024-01-23T09:25:18.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.917+0000 7f82c68de640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c014ebc0 con 0x7f82c015cba0 2024-01-23T09:25:18.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.917+0000 7f82c68de640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c014f8e0 con 0x7f82c00c7a90 2024-01-23T09:25:18.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.917+0000 7f82bffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82c006b770 0x7f82c0152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:18.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.917+0000 7f82bffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82c006b770 0x7f82c0152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47854/0 (socket says 172.21.15.46:47854) 2024-01-23T09:25:18.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.917+0000 7f82bffff640 1 -- 172.21.15.46:0/552661769 learned_addr learned my addr 172.21.15.46:0/552661769 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:18.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.917+0000 7f82bf7fe640 1 --2- 172.21.15.46:0/552661769 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82c00c7a90 0x7f82c01f3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:18.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.917+0000 7f82c4e7b640 1 --2- 172.21.15.46:0/552661769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82c015cba0 0x7f82c01f4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:18.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.921+0000 7f82bffff640 1 -- 172.21.15.46:0/552661769 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82c00c7a90 msgr2=0x7f82c01f3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:18.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.921+0000 7f82bffff640 1 --2- 172.21.15.46:0/552661769 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82c00c7a90 0x7f82c01f3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:18.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.921+0000 7f82bffff640 1 -- 172.21.15.46:0/552661769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82c015cba0 msgr2=0x7f82c01f4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:18.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.921+0000 7f82bffff640 1 --2- 172.21.15.46:0/552661769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82c015cba0 0x7f82c01f4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:18.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.921+0000 7f82bffff640 1 -- 172.21.15.46:0/552661769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b8009a70 con 0x7f82c006b770 2024-01-23T09:25:18.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.925+0000 7f82bffff640 1 --2- 172.21.15.46:0/552661769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82c006b770 0x7f82c0152be0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f82b000e930 tx=0x7f82b000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:18.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.933+0000 7f82bcff9640 1 -- 172.21.15.46:0/552661769 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b0009690 con 0x7f82c006b770 2024-01-23T09:25:18.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.933+0000 7f82bcff9640 1 -- 172.21.15.46:0/552661769 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b000ca00 con 0x7f82c006b770 2024-01-23T09:25:18.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.933+0000 7f82bcff9640 1 -- 172.21.15.46:0/552661769 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b000cd70 con 0x7f82c006b770 2024-01-23T09:25:18.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.933+0000 7f82c68de640 1 -- 172.21.15.46:0/552661769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c014e2d0 con 0x7f82c006b770 2024-01-23T09:25:18.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.933+0000 7f82c68de640 1 -- 172.21.15.46:0/552661769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c014fb80 con 0x7f82c006b770 2024-01-23T09:25:18.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.933+0000 7f82c68de640 1 -- 172.21.15.46:0/552661769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f82c0166750 con 0x7f82c006b770 2024-01-23T09:25:18.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.961+0000 7f82bcff9640 1 -- 172.21.15.46:0/552661769 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f82b0026480 con 0x7f82c006b770 2024-01-23T09:25:18.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.961+0000 7f82bcff9640 1 --2- 172.21.15.46:0/552661769 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f82ac066550 0x7f82ac068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:18.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.961+0000 7f82bf7fe640 1 --2- 172.21.15.46:0/552661769 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f82ac066550 0x7f82ac068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:18.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.965+0000 7f82bf7fe640 1 --2- 172.21.15.46:0/552661769 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f82ac066550 0x7f82ac068a10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f82c0149900 tx=0x7f82b4007e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:18.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.965+0000 7f82bcff9640 1 -- 172.21.15.46:0/552661769 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f82b00558e0 con 0x7f82c006b770 2024-01-23T09:25:18.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.965+0000 7f82bcff9640 1 --2- 172.21.15.46:0/552661769 >> [v2:172.21.15.175:6816/3146473948,v1:172.21.15.175:6818/3146473948] conn(0x7f82ac06fc30 0x7f82ac0720d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:18.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.965+0000 7f82bcff9640 1 -- 172.21.15.46:0/552661769 --> [v2:172.21.15.175:6816/3146473948,v1:172.21.15.175:6818/3146473948] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f82ac0727a0 con 0x7f82ac06fc30 2024-01-23T09:25:18.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.965+0000 7f82c4e7b640 1 --2- 172.21.15.46:0/552661769 >> [v2:172.21.15.175:6816/3146473948,v1:172.21.15.175:6818/3146473948] conn(0x7f82ac06fc30 0x7f82ac0720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:18.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.965+0000 7f82c4e7b640 1 --2- 172.21.15.46:0/552661769 >> [v2:172.21.15.175:6816/3146473948,v1:172.21.15.175:6818/3146473948] conn(0x7f82ac06fc30 0x7f82ac0720d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:18.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.969+0000 7f82bcff9640 1 -- 172.21.15.46:0/552661769 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82b0051c20 con 0x7f82c006b770 2024-01-23T09:25:18.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.969+0000 7f82bcff9640 1 -- 172.21.15.46:0/552661769 <== osd.5 v2:172.21.15.175:6816/3146473948 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f82ac0727a0 con 0x7f82ac06fc30 2024-01-23T09:25:18.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.985+0000 7f82c68de640 1 -- 172.21.15.46:0/552661769 --> [v2:172.21.15.175:6816/3146473948,v1:172.21.15.175:6818/3146473948] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f82c014ed00 con 0x7f82ac06fc30 2024-01-23T09:25:18.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.985+0000 7f82bcff9640 1 -- 172.21.15.46:0/552661769 <== osd.5 v2:172.21.15.175:6816/3146473948 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f82c014ed00 con 0x7f82ac06fc30 2024-01-23T09:25:18.989 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-23T09:25:18.989 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-23T09:25:18.989 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-23T09:25:18.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.985+0000 7f82c68de640 1 -- 172.21.15.46:0/552661769 >> [v2:172.21.15.175:6816/3146473948,v1:172.21.15.175:6818/3146473948] conn(0x7f82ac06fc30 msgr2=0x7f82ac0720d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:18.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.985+0000 7f82c68de640 1 --2- 172.21.15.46:0/552661769 >> [v2:172.21.15.175:6816/3146473948,v1:172.21.15.175:6818/3146473948] conn(0x7f82ac06fc30 0x7f82ac0720d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:18.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.985+0000 7f82c68de640 1 -- 172.21.15.46:0/552661769 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f82ac066550 msgr2=0x7f82ac068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:18.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.985+0000 7f82c68de640 1 --2- 172.21.15.46:0/552661769 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f82ac066550 0x7f82ac068a10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f82c0149900 tx=0x7f82b4007e90 comp rx=0 tx=0).stop 2024-01-23T09:25:18.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.985+0000 7f82c68de640 1 -- 172.21.15.46:0/552661769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82c006b770 msgr2=0x7f82c0152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:18.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.985+0000 7f82c68de640 1 --2- 172.21.15.46:0/552661769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82c006b770 0x7f82c0152be0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f82b000e930 tx=0x7f82b000edf0 comp rx=0 tx=0).stop 2024-01-23T09:25:18.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.985+0000 7f82c4e7b640 1 -- 172.21.15.46:0/552661769 reap_dead start 2024-01-23T09:25:18.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.985+0000 7f82c68de640 1 -- 172.21.15.46:0/552661769 shutdown_connections 2024-01-23T09:25:18.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.985+0000 7f82c68de640 1 -- 172.21.15.46:0/552661769 >> 172.21.15.46:0/552661769 conn(0x7f82c006a660 msgr2=0x7f82c0157a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:18.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.985+0000 7f82c68de640 1 -- 172.21.15.46:0/552661769 shutdown_connections 2024-01-23T09:25:18.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:18.985+0000 7f82c68de640 1 -- 172.21.15.46:0/552661769 wait complete. 2024-01-23T09:25:19.009 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-01-23T09:25:19.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.137+0000 7facd887d640 1 Processor -- start 2024-01-23T09:25:19.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.137+0000 7facd887d640 1 -- start start 2024-01-23T09:25:19.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.137+0000 7facd887d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7facd40ca3a0 0x7facd415b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:19.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.137+0000 7facd887d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7facd40c7dd0 0x7facd40ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:19.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.137+0000 7facd887d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd40c8e10 con 0x7facd4151840 2024-01-23T09:25:19.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.137+0000 7facd887d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd40c9f10 con 0x7facd40ca3a0 2024-01-23T09:25:19.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.137+0000 7facd887d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd40c9040 con 0x7facd40c7dd0 2024-01-23T09:25:19.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.137+0000 7facd259c640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7facd4151840 0x7facd40c1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41558/0 (socket says 172.21.15.46:41558) 2024-01-23T09:25:19.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.137+0000 7facd259c640 1 -- 172.21.15.46:0/3170999603 learned_addr learned my addr 172.21.15.46:0/3170999603 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T09:25:19.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.141+0000 7facd1d9b640 1 --2- 172.21.15.46:0/3170999603 >> v2:172.21.15.175:3300/0 conn(0x7facd40ca3a0 0x7facd415b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:19.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.141+0000 7facd2d9d640 1 --2- 172.21.15.46:0/3170999603 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7facd40c7dd0 0x7facd40ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:19.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.141+0000 7facd159a640 1 -- 172.21.15.46:0/3170999603 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256053041 0 0) 0x7facd40c8e10 con 0x7facd4151840 2024-01-23T09:25:19.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.141+0000 7facd159a640 1 -- 172.21.15.46:0/3170999603 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facc0003530 con 0x7facd4151840 2024-01-23T09:25:19.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.145+0000 7facd1d9b640 1 -- 172.21.15.46:0/3170999603 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7facd40c7dd0 msgr2=0x7facd40ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:19.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.145+0000 7facd1d9b640 1 --2- 172.21.15.46:0/3170999603 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7facd40c7dd0 0x7facd40ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:19.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.145+0000 7facd1d9b640 1 -- 172.21.15.46:0/3170999603 >> v1:172.21.15.46:6789/0 conn(0x7facd4151840 legacy=0x7facd40c1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:19.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.145+0000 7facd1d9b640 1 -- 172.21.15.46:0/3170999603 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd40c9300 con 0x7facd40ca3a0 2024-01-23T09:25:19.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.153+0000 7facd1d9b640 1 --2- 172.21.15.46:0/3170999603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facd40ca3a0 0x7facd415b360 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7facbc0097c0 tx=0x7facbc01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92a472840a25081e server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:19.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.217+0000 7facd159a640 1 -- 172.21.15.46:0/3170999603 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc0a6040 con 0x7facd40ca3a0 2024-01-23T09:25:19.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.217+0000 7facd159a640 1 -- 172.21.15.46:0/3170999603 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facbc0aa600 con 0x7facd40ca3a0 2024-01-23T09:25:19.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.217+0000 7facd159a640 1 -- 172.21.15.46:0/3170999603 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc0aa990 con 0x7facd40ca3a0 2024-01-23T09:25:19.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.217+0000 7facd887d640 1 -- 172.21.15.46:0/3170999603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facd40ca3a0 msgr2=0x7facd415b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:19.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.217+0000 7facd887d640 1 --2- 172.21.15.46:0/3170999603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facd40ca3a0 0x7facd415b360 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7facbc0097c0 tx=0x7facbc01c480 comp rx=0 tx=0).stop 2024-01-23T09:25:19.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.217+0000 7facd887d640 1 -- 172.21.15.46:0/3170999603 shutdown_connections 2024-01-23T09:25:19.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.217+0000 7facd887d640 1 --2- 172.21.15.46:0/3170999603 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7facd40c7dd0 0x7facd40ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:19.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.217+0000 7facd887d640 1 --2- 172.21.15.46:0/3170999603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facd40ca3a0 0x7facd415b360 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:19.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.217+0000 7facd887d640 1 -- 172.21.15.46:0/3170999603 >> 172.21.15.46:0/3170999603 conn(0x7facd406a660 msgr2=0x7facd406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:19.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.217+0000 7facd887d640 1 -- 172.21.15.46:0/3170999603 shutdown_connections 2024-01-23T09:25:19.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.217+0000 7facd887d640 1 -- 172.21.15.46:0/3170999603 wait complete. 2024-01-23T09:25:19.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.221+0000 7facd887d640 1 Processor -- start 2024-01-23T09:25:19.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.221+0000 7facd887d640 1 -- start start 2024-01-23T09:25:19.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.221+0000 7facd887d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facd40c7dd0 0x7facd40c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:19.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.221+0000 7facd887d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facd40ca3a0 0x7facd40c3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:19.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.221+0000 7facd887d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7facd4151840 0x7facd414d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:19.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.221+0000 7facd887d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd40b2b20 con 0x7facd40c7dd0 2024-01-23T09:25:19.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.221+0000 7facd887d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd40b1c50 con 0x7facd40ca3a0 2024-01-23T09:25:19.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.221+0000 7facd887d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd40c4cf0 con 0x7facd4151840 2024-01-23T09:25:19.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.225+0000 7facd1d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facd40ca3a0 0x7facd40c3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:19.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.225+0000 7facd2d9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7facd4151840 0x7facd414d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:19.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.225+0000 7facd1d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facd40ca3a0 0x7facd40c3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:39740/0 (socket says 172.21.15.46:39740) 2024-01-23T09:25:19.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.225+0000 7facd1d9b640 1 -- 172.21.15.46:0/2992473181 learned_addr learned my addr 172.21.15.46:0/2992473181 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:19.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.233+0000 7facd1d9b640 1 -- 172.21.15.46:0/2992473181 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7facd4151840 msgr2=0x7facd414d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:19.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.233+0000 7facd1d9b640 1 --2- 172.21.15.46:0/2992473181 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7facd4151840 0x7facd414d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:19.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.233+0000 7facd1d9b640 1 -- 172.21.15.46:0/2992473181 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facd40c7dd0 msgr2=0x7facd40c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:19.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.233+0000 7facd1d9b640 1 --2- 172.21.15.46:0/2992473181 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facd40c7dd0 0x7facd40c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:19.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.233+0000 7facd1d9b640 1 -- 172.21.15.46:0/2992473181 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc009420 con 0x7facd40ca3a0 2024-01-23T09:25:19.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.241+0000 7facd1d9b640 1 --2- 172.21.15.46:0/2992473181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facd40ca3a0 0x7facd40c3180 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7facbc0097c0 tx=0x7facbc01acc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:19.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.257+0000 7faccaffd640 1 -- 172.21.15.46:0/2992473181 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc0b3600 con 0x7facd40ca3a0 2024-01-23T09:25:19.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.257+0000 7faccaffd640 1 -- 172.21.15.46:0/2992473181 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facbc0b3780 con 0x7facd40ca3a0 2024-01-23T09:25:19.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.257+0000 7faccaffd640 1 -- 172.21.15.46:0/2992473181 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc0b3b30 con 0x7facd40ca3a0 2024-01-23T09:25:19.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.257+0000 7facd887d640 1 -- 172.21.15.46:0/2992473181 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd4143440 con 0x7facd40ca3a0 2024-01-23T09:25:19.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.257+0000 7facd887d640 1 -- 172.21.15.46:0/2992473181 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd40b2180 con 0x7facd40ca3a0 2024-01-23T09:25:19.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.257+0000 7facd887d640 1 -- 172.21.15.46:0/2992473181 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facd40c3ce0 con 0x7facd40ca3a0 2024-01-23T09:25:19.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.613+0000 7faccaffd640 1 -- 172.21.15.46:0/2992473181 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7facbc0b3c90 con 0x7facd40ca3a0 2024-01-23T09:25:19.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.613+0000 7faccaffd640 1 --2- 172.21.15.46:0/2992473181 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7facb4066550 0x7facb4068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:19.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.613+0000 7facd259c640 1 --2- 172.21.15.46:0/2992473181 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7facb4066550 0x7facb4068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:19.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.617+0000 7facd259c640 1 --2- 172.21.15.46:0/2992473181 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7facb4066550 0x7facb4068a10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faccc0012f0 tx=0x7faccc0015c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:19.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.621+0000 7faccaffd640 1 -- 172.21.15.46:0/2992473181 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7facbc0ef640 con 0x7facd40ca3a0 2024-01-23T09:25:19.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.649+0000 7faccaffd640 1 -- 172.21.15.46:0/2992473181 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7facbc0eb980 con 0x7facd40ca3a0 2024-01-23T09:25:19.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.829+0000 7facd887d640 1 -- 172.21.15.46:0/2992473181 --> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7facd4074340 con 0x7facb4066550 2024-01-23T09:25:19.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.829+0000 7faccaffd640 1 -- 172.21.15.46:0/2992473181 <== mgr.4107 v2:172.21.15.46:6800/2324478006 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7facd4074340 con 0x7facb4066550 2024-01-23T09:25:19.834 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 5 to deep-scrub 2024-01-23T09:25:19.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.833+0000 7facd887d640 1 -- 172.21.15.46:0/2992473181 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7facb4066550 msgr2=0x7facb4068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:19.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.833+0000 7facd887d640 1 --2- 172.21.15.46:0/2992473181 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7facb4066550 0x7facb4068a10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faccc0012f0 tx=0x7faccc0015c0 comp rx=0 tx=0).stop 2024-01-23T09:25:19.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.833+0000 7facd887d640 1 -- 172.21.15.46:0/2992473181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facd40ca3a0 msgr2=0x7facd40c3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:19.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.833+0000 7facd887d640 1 --2- 172.21.15.46:0/2992473181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facd40ca3a0 0x7facd40c3180 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7facbc0097c0 tx=0x7facbc01acc0 comp rx=0 tx=0).stop 2024-01-23T09:25:19.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.833+0000 7facd887d640 1 -- 172.21.15.46:0/2992473181 shutdown_connections 2024-01-23T09:25:19.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.833+0000 7facd887d640 1 --2- 172.21.15.46:0/2992473181 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7facd4151840 0x7facd414d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:19.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.833+0000 7facd887d640 1 --2- 172.21.15.46:0/2992473181 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7facb4066550 0x7facb4068a10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:19.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.833+0000 7facd887d640 1 --2- 172.21.15.46:0/2992473181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facd40ca3a0 0x7facd40c3180 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:19.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.833+0000 7facd887d640 1 --2- 172.21.15.46:0/2992473181 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7facd40c7dd0 0x7facd40c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:19.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.833+0000 7facd887d640 1 -- 172.21.15.46:0/2992473181 >> 172.21.15.46:0/2992473181 conn(0x7facd406a660 msgr2=0x7facd414fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:19.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.833+0000 7facd887d640 1 -- 172.21.15.46:0/2992473181 shutdown_connections 2024-01-23T09:25:19.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.833+0000 7facd887d640 1 -- 172.21.15.46:0/2992473181 wait complete. 2024-01-23T09:25:19.854 INFO:tasks.ceph:Scrubbing osd.6 2024-01-23T09:25:19.855 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-01-23T09:25:19.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.977+0000 7f41cca52640 1 Processor -- start 2024-01-23T09:25:19.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.977+0000 7f41cca52640 1 -- start start 2024-01-23T09:25:19.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.981+0000 7f41cca52640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f41c80c8ce0 0x7f41c80c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:19.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.981+0000 7f41cca52640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f41c80c8100 0x7f41c815daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:19.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.981+0000 7f41cca52640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c80c34f0 con 0x7f41c8157ba0 2024-01-23T09:25:19.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.981+0000 7f41cca52640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c80c8510 con 0x7f41c80c8100 2024-01-23T09:25:19.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.981+0000 7f41cca52640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c8157f80 con 0x7f41c80c8ce0 2024-01-23T09:25:19.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.981+0000 7f41c6d9d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f41c80c8100 0x7f41c815daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:19.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.981+0000 7f41c6d9d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f41c80c8100 0x7f41c815daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47864/0 (socket says 172.21.15.46:47864) 2024-01-23T09:25:19.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.981+0000 7f41c6d9d640 1 -- 172.21.15.46:0/1404158602 learned_addr learned my addr 172.21.15.46:0/1404158602 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:19.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.985+0000 7f41c6d9d640 1 -- 172.21.15.46:0/1404158602 >> v2:172.21.15.175:3300/0 conn(0x7f41c80c8ce0 msgr2=0x7f41c80c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:19.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.985+0000 7f41c6d9d640 1 --2- 172.21.15.46:0/1404158602 >> v2:172.21.15.175:3300/0 conn(0x7f41c80c8ce0 0x7f41c80c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:19.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.985+0000 7f41c6d9d640 1 -- 172.21.15.46:0/1404158602 >> v1:172.21.15.175:6789/0 conn(0x7f41c8157ba0 legacy=0x7f41c80c2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:19.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.985+0000 7f41c6d9d640 1 -- 172.21.15.46:0/1404158602 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c815e680 con 0x7f41c80c8100 2024-01-23T09:25:19.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.985+0000 7f41c6d9d640 1 --2- 172.21.15.46:0/1404158602 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41c80c8100 0x7f41c815daf0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f41c80c3f10 tx=0x7f41c001ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a492d136b3821341 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:19.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.993+0000 7f41c559a640 1 -- 172.21.15.46:0/1404158602 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c00a89b0 con 0x7f41c80c8100 2024-01-23T09:25:19.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.993+0000 7f41c559a640 1 -- 172.21.15.46:0/1404158602 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c00a8b10 con 0x7f41c80c8100 2024-01-23T09:25:19.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.993+0000 7f41c559a640 1 -- 172.21.15.46:0/1404158602 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c00a8ea0 con 0x7f41c80c8100 2024-01-23T09:25:19.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.993+0000 7f41cca52640 1 -- 172.21.15.46:0/1404158602 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41c80c8100 msgr2=0x7f41c815daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:19.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.993+0000 7f41cca52640 1 --2- 172.21.15.46:0/1404158602 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41c80c8100 0x7f41c815daf0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f41c80c3f10 tx=0x7f41c001ecb0 comp rx=0 tx=0).stop 2024-01-23T09:25:19.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.993+0000 7f41cca52640 1 -- 172.21.15.46:0/1404158602 shutdown_connections 2024-01-23T09:25:19.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.993+0000 7f41cca52640 1 --2- 172.21.15.46:0/1404158602 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41c80c8100 0x7f41c815daf0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:19.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.993+0000 7f41cca52640 1 --2- 172.21.15.46:0/1404158602 >> v2:172.21.15.175:3300/0 conn(0x7f41c80c8ce0 0x7f41c80c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:19.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.993+0000 7f41cca52640 1 -- 172.21.15.46:0/1404158602 >> 172.21.15.46:0/1404158602 conn(0x7f41c806efc0 msgr2=0x7f41c806f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:19.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.993+0000 7f41cca52640 1 -- 172.21.15.46:0/1404158602 shutdown_connections 2024-01-23T09:25:19.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.993+0000 7f41cca52640 1 -- 172.21.15.46:0/1404158602 wait complete. 2024-01-23T09:25:20.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.997+0000 7f41cca52640 1 Processor -- start 2024-01-23T09:25:20.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.997+0000 7f41cca52640 1 -- start start 2024-01-23T09:25:20.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.997+0000 7f41cca52640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41c80c8100 0x7f41c81545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:20.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.997+0000 7f41cca52640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41c80c8ce0 0x7f41c80b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:20.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.997+0000 7f41cca52640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41c8157ba0 0x7f41c80b2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:20.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.997+0000 7f41cca52640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c80b28d0 con 0x7f41c80c8ce0 2024-01-23T09:25:20.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.997+0000 7f41cca52640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c8152e80 con 0x7f41c80c8100 2024-01-23T09:25:20.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.997+0000 7f41cca52640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c8151d60 con 0x7f41c8157ba0 2024-01-23T09:25:20.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.997+0000 7f41c5d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41c80c8ce0 0x7f41c80b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:20.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.997+0000 7f41c5d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41c80c8ce0 0x7f41c80b1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47876/0 (socket says 172.21.15.46:47876) 2024-01-23T09:25:20.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:19.997+0000 7f41c5d9b640 1 -- 172.21.15.46:0/1166207314 learned_addr learned my addr 172.21.15.46:0/1166207314 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:20.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.001+0000 7f41c5d9b640 1 -- 172.21.15.46:0/1166207314 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41c8157ba0 msgr2=0x7f41c80b2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:20.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.001+0000 7f41c5d9b640 1 --2- 172.21.15.46:0/1166207314 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41c8157ba0 0x7f41c80b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:20.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.001+0000 7f41c5d9b640 1 -- 172.21.15.46:0/1166207314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41c80c8100 msgr2=0x7f41c81545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:20.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.001+0000 7f41c5d9b640 1 --2- 172.21.15.46:0/1166207314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41c80c8100 0x7f41c81545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:20.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.001+0000 7f41c5d9b640 1 -- 172.21.15.46:0/1166207314 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c00094d0 con 0x7f41c80c8ce0 2024-01-23T09:25:20.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.005+0000 7f41c5d9b640 1 --2- 172.21.15.46:0/1166207314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41c80c8ce0 0x7f41c80b1e50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f41b000ba50 tx=0x7f41b000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:20.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.009+0000 7f41beffd640 1 -- 172.21.15.46:0/1166207314 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b000cb60 con 0x7f41c80c8ce0 2024-01-23T09:25:20.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.009+0000 7f41beffd640 1 -- 172.21.15.46:0/1166207314 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b000cce0 con 0x7f41c80c8ce0 2024-01-23T09:25:20.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.009+0000 7f41beffd640 1 -- 172.21.15.46:0/1166207314 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b0014680 con 0x7f41c80c8ce0 2024-01-23T09:25:20.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.009+0000 7f41cca52640 1 -- 172.21.15.46:0/1166207314 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c8152020 con 0x7f41c80c8ce0 2024-01-23T09:25:20.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.009+0000 7f41cca52640 1 -- 172.21.15.46:0/1166207314 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c81525e0 con 0x7f41c80c8ce0 2024-01-23T09:25:20.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.009+0000 7f41cca52640 1 -- 172.21.15.46:0/1166207314 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f41c81613c0 con 0x7f41c80c8ce0 2024-01-23T09:25:20.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.033+0000 7f41beffd640 1 -- 172.21.15.46:0/1166207314 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f41b001d3b0 con 0x7f41c80c8ce0 2024-01-23T09:25:20.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.033+0000 7f41beffd640 1 --2- 172.21.15.46:0/1166207314 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f41a8066550 0x7f41a8068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:20.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.033+0000 7f41c659c640 1 --2- 172.21.15.46:0/1166207314 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f41a8066550 0x7f41a8068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:20.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.033+0000 7f41c659c640 1 --2- 172.21.15.46:0/1166207314 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f41a8066550 0x7f41a8068a10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f41b8007fd0 tx=0x7f41b80079a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:20.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.033+0000 7f41beffd640 1 -- 172.21.15.46:0/1166207314 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f41b0055bc0 con 0x7f41c80c8ce0 2024-01-23T09:25:20.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.033+0000 7f41beffd640 1 --2- 172.21.15.46:0/1166207314 >> [v2:172.21.15.175:6800/4161180058,v1:172.21.15.175:6801/4161180058] conn(0x7f41a806fc30 0x7f41a80720d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:20.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.033+0000 7f41beffd640 1 -- 172.21.15.46:0/1166207314 --> [v2:172.21.15.175:6800/4161180058,v1:172.21.15.175:6801/4161180058] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f41a80727a0 con 0x7f41a806fc30 2024-01-23T09:25:20.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.033+0000 7f41beffd640 1 -- 172.21.15.46:0/1166207314 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41b0051800 con 0x7f41c80c8ce0 2024-01-23T09:25:20.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.033+0000 7f41c6d9d640 1 --2- 172.21.15.46:0/1166207314 >> [v2:172.21.15.175:6800/4161180058,v1:172.21.15.175:6801/4161180058] conn(0x7f41a806fc30 0x7f41a80720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:20.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.037+0000 7f41c6d9d640 1 --2- 172.21.15.46:0/1166207314 >> [v2:172.21.15.175:6800/4161180058,v1:172.21.15.175:6801/4161180058] conn(0x7f41a806fc30 0x7f41a80720d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:20.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.037+0000 7f41beffd640 1 -- 172.21.15.46:0/1166207314 <== osd.6 v2:172.21.15.175:6800/4161180058 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f41a80727a0 con 0x7f41a806fc30 2024-01-23T09:25:20.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.053+0000 7f41cca52640 1 -- 172.21.15.46:0/1166207314 --> [v2:172.21.15.175:6800/4161180058,v1:172.21.15.175:6801/4161180058] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f41c81610e0 con 0x7f41a806fc30 2024-01-23T09:25:20.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.053+0000 7f41beffd640 1 -- 172.21.15.46:0/1166207314 <== osd.6 v2:172.21.15.175:6800/4161180058 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f41c00b0440 con 0x7f41a806fc30 2024-01-23T09:25:20.058 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-23T09:25:20.058 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-23T09:25:20.058 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-23T09:25:20.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.053+0000 7f41cca52640 1 -- 172.21.15.46:0/1166207314 >> [v2:172.21.15.175:6800/4161180058,v1:172.21.15.175:6801/4161180058] conn(0x7f41a806fc30 msgr2=0x7f41a80720d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:20.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.053+0000 7f41cca52640 1 --2- 172.21.15.46:0/1166207314 >> [v2:172.21.15.175:6800/4161180058,v1:172.21.15.175:6801/4161180058] conn(0x7f41a806fc30 0x7f41a80720d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:20.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.053+0000 7f41cca52640 1 -- 172.21.15.46:0/1166207314 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f41a8066550 msgr2=0x7f41a8068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:20.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.053+0000 7f41cca52640 1 --2- 172.21.15.46:0/1166207314 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f41a8066550 0x7f41a8068a10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f41b8007fd0 tx=0x7f41b80079a0 comp rx=0 tx=0).stop 2024-01-23T09:25:20.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.053+0000 7f41cca52640 1 -- 172.21.15.46:0/1166207314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41c80c8ce0 msgr2=0x7f41c80b1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:20.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.053+0000 7f41cca52640 1 --2- 172.21.15.46:0/1166207314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41c80c8ce0 0x7f41c80b1e50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f41b000ba50 tx=0x7f41b000bf10 comp rx=0 tx=0).stop 2024-01-23T09:25:20.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.053+0000 7f41c6d9d640 1 -- 172.21.15.46:0/1166207314 reap_dead start 2024-01-23T09:25:20.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.053+0000 7f41cca52640 1 -- 172.21.15.46:0/1166207314 shutdown_connections 2024-01-23T09:25:20.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.053+0000 7f41cca52640 1 -- 172.21.15.46:0/1166207314 >> 172.21.15.46:0/1166207314 conn(0x7f41c806efc0 msgr2=0x7f41c80c3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:20.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.053+0000 7f41cca52640 1 -- 172.21.15.46:0/1166207314 shutdown_connections 2024-01-23T09:25:20.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.053+0000 7f41cca52640 1 -- 172.21.15.46:0/1166207314 wait complete. 2024-01-23T09:25:20.079 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-01-23T09:25:20.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.201+0000 7f1129d0d640 1 Processor -- start 2024-01-23T09:25:20.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.201+0000 7f1129d0d640 1 -- start start 2024-01-23T09:25:20.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.201+0000 7f1129d0d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11241503c0 0x7f11240c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:20.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.201+0000 7f1129d0d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1124072760 0x7f1124156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:20.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.201+0000 7f1129d0d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1124156760 con 0x7f11240c7cd0 2024-01-23T09:25:20.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.201+0000 7f1129d0d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11241507a0 con 0x7f1124072760 2024-01-23T09:25:20.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.201+0000 7f1129d0d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1124071a10 con 0x7f11241503c0 2024-01-23T09:25:20.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.201+0000 7f111affd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1124072760 0x7f1124156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:20.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.201+0000 7f111affd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1124072760 0x7f1124156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47880/0 (socket says 172.21.15.46:47880) 2024-01-23T09:25:20.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.201+0000 7f111affd640 1 -- 172.21.15.46:0/1137954937 learned_addr learned my addr 172.21.15.46:0/1137954937 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:20.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.201+0000 7f11237fe640 1 --2- 172.21.15.46:0/1137954937 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11241503c0 0x7f11240c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:20.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.205+0000 7f111affd640 1 -- 172.21.15.46:0/1137954937 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11241503c0 msgr2=0x7f11240c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:20.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.205+0000 7f111affd640 1 --2- 172.21.15.46:0/1137954937 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11241503c0 0x7f11240c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:20.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.205+0000 7f111affd640 1 -- 172.21.15.46:0/1137954937 >> v1:172.21.15.175:6789/0 conn(0x7f11240c7cd0 legacy=0x7f11241598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:20.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.205+0000 7f111affd640 1 -- 172.21.15.46:0/1137954937 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1124071cf0 con 0x7f1124072760 2024-01-23T09:25:20.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.209+0000 7f111affd640 1 --2- 172.21.15.46:0/1137954937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1124072760 0x7f1124156bf0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f110c009870 tx=0x7f110c01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a8f09dddf6c3a5 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:20.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.213+0000 7f1122ffd640 1 -- 172.21.15.46:0/1137954937 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c0a8a30 con 0x7f1124072760 2024-01-23T09:25:20.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.213+0000 7f1122ffd640 1 -- 172.21.15.46:0/1137954937 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110c0a8b90 con 0x7f1124072760 2024-01-23T09:25:20.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.213+0000 7f1122ffd640 1 -- 172.21.15.46:0/1137954937 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c0b0440 con 0x7f1124072760 2024-01-23T09:25:20.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.213+0000 7f1129d0d640 1 -- 172.21.15.46:0/1137954937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1124072760 msgr2=0x7f1124156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:20.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.213+0000 7f1129d0d640 1 --2- 172.21.15.46:0/1137954937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1124072760 0x7f1124156bf0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f110c009870 tx=0x7f110c01ed30 comp rx=0 tx=0).stop 2024-01-23T09:25:20.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.213+0000 7f1129d0d640 1 -- 172.21.15.46:0/1137954937 shutdown_connections 2024-01-23T09:25:20.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.213+0000 7f1129d0d640 1 --2- 172.21.15.46:0/1137954937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1124072760 0x7f1124156bf0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:20.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.213+0000 7f1129d0d640 1 --2- 172.21.15.46:0/1137954937 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11241503c0 0x7f11240c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:20.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.213+0000 7f1129d0d640 1 -- 172.21.15.46:0/1137954937 >> 172.21.15.46:0/1137954937 conn(0x7f112406aa60 msgr2=0x7f112406ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:20.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.213+0000 7f1129d0d640 1 -- 172.21.15.46:0/1137954937 shutdown_connections 2024-01-23T09:25:20.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.213+0000 7f1129d0d640 1 -- 172.21.15.46:0/1137954937 wait complete. 2024-01-23T09:25:20.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.217+0000 7f1129d0d640 1 Processor -- start 2024-01-23T09:25:20.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.217+0000 7f1129d0d640 1 -- start start 2024-01-23T09:25:20.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.217+0000 7f1129d0d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124072760 0x7f1124154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:20.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.217+0000 7f1129d0d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11240c7cd0 0x7f11241f29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:20.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.217+0000 7f1129d0d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11241503c0 0x7f11241f2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:20.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.217+0000 7f1129d0d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11240ca9a0 con 0x7f11241503c0 2024-01-23T09:25:20.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.217+0000 7f1129d0d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1124143e40 con 0x7f11240c7cd0 2024-01-23T09:25:20.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.217+0000 7f1129d0d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112414b520 con 0x7f1124072760 2024-01-23T09:25:20.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.217+0000 7f1123fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11241503c0 0x7f11241f2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:20.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.217+0000 7f1123fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11241503c0 0x7f11241f2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47894/0 (socket says 172.21.15.46:47894) 2024-01-23T09:25:20.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.217+0000 7f1123fff640 1 -- 172.21.15.46:0/2704241372 learned_addr learned my addr 172.21.15.46:0/2704241372 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:20.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.217+0000 7f111affd640 1 --2- 172.21.15.46:0/2704241372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11240c7cd0 0x7f11241f29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:20.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.217+0000 7f11237fe640 1 --2- 172.21.15.46:0/2704241372 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124072760 0x7f1124154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:20.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.221+0000 7f1123fff640 1 -- 172.21.15.46:0/2704241372 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124072760 msgr2=0x7f1124154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:20.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.221+0000 7f1123fff640 1 --2- 172.21.15.46:0/2704241372 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124072760 0x7f1124154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:20.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.221+0000 7f1123fff640 1 -- 172.21.15.46:0/2704241372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11240c7cd0 msgr2=0x7f11241f29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:20.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.221+0000 7f1123fff640 1 --2- 172.21.15.46:0/2704241372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11240c7cd0 0x7f11241f29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:20.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.221+0000 7f1123fff640 1 -- 172.21.15.46:0/2704241372 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110c0094d0 con 0x7f11241503c0 2024-01-23T09:25:20.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.225+0000 7f1123fff640 1 --2- 172.21.15.46:0/2704241372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11241503c0 0x7f11241f2ef0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f111c00c770 tx=0x7f111c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:20.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.229+0000 7f1120ff9640 1 -- 172.21.15.46:0/2704241372 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c003b80 con 0x7f11241503c0 2024-01-23T09:25:20.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.229+0000 7f1120ff9640 1 -- 172.21.15.46:0/2704241372 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111c003ce0 con 0x7f11241503c0 2024-01-23T09:25:20.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.229+0000 7f1129d0d640 1 -- 172.21.15.46:0/2704241372 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f112414b800 con 0x7f11241503c0 2024-01-23T09:25:20.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.229+0000 7f1120ff9640 1 -- 172.21.15.46:0/2704241372 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c00aa90 con 0x7f11241503c0 2024-01-23T09:25:20.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.229+0000 7f1129d0d640 1 -- 172.21.15.46:0/2704241372 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f112414bdc0 con 0x7f11241503c0 2024-01-23T09:25:20.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.229+0000 7f1129d0d640 1 -- 172.21.15.46:0/2704241372 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f112414bfb0 con 0x7f11241503c0 2024-01-23T09:25:20.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.525+0000 7f1120ff9640 1 -- 172.21.15.46:0/2704241372 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f111c00abf0 con 0x7f11241503c0 2024-01-23T09:25:20.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.529+0000 7f1120ff9640 1 --2- 172.21.15.46:0/2704241372 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f1104066550 0x7f1104068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:20.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.529+0000 7f11237fe640 1 --2- 172.21.15.46:0/2704241372 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f1104066550 0x7f1104068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:20.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.529+0000 7f11237fe640 1 --2- 172.21.15.46:0/2704241372 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f1104066550 0x7f1104068a10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f11140079c0 tx=0x7f1114008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:20.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.569+0000 7f1120ff9640 1 -- 172.21.15.46:0/2704241372 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f111c0556e0 con 0x7f11241503c0 2024-01-23T09:25:20.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.589+0000 7f1120ff9640 1 -- 172.21.15.46:0/2704241372 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f111c051a20 con 0x7f11241503c0 2024-01-23T09:25:20.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.757+0000 7f1129d0d640 1 -- 172.21.15.46:0/2704241372 --> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f11241563f0 con 0x7f1104066550 2024-01-23T09:25:20.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.757+0000 7f1120ff9640 1 -- 172.21.15.46:0/2704241372 <== mgr.4107 v2:172.21.15.46:6800/2324478006 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f11140108d0 con 0x7f1104066550 2024-01-23T09:25:20.763 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 6 to deep-scrub 2024-01-23T09:25:20.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.761+0000 7f1129d0d640 1 -- 172.21.15.46:0/2704241372 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f1104066550 msgr2=0x7f1104068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:20.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.761+0000 7f1129d0d640 1 --2- 172.21.15.46:0/2704241372 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f1104066550 0x7f1104068a10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f11140079c0 tx=0x7f1114008040 comp rx=0 tx=0).stop 2024-01-23T09:25:20.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.761+0000 7f1129d0d640 1 -- 172.21.15.46:0/2704241372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11241503c0 msgr2=0x7f11241f2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:20.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.761+0000 7f1129d0d640 1 --2- 172.21.15.46:0/2704241372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11241503c0 0x7f11241f2ef0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f111c00c770 tx=0x7f111c00cc30 comp rx=0 tx=0).stop 2024-01-23T09:25:20.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.761+0000 7f1129d0d640 1 -- 172.21.15.46:0/2704241372 shutdown_connections 2024-01-23T09:25:20.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.761+0000 7f1129d0d640 1 --2- 172.21.15.46:0/2704241372 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11241503c0 0x7f11241f2ef0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:20.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.761+0000 7f1129d0d640 1 --2- 172.21.15.46:0/2704241372 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f1104066550 0x7f1104068a10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:20.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.761+0000 7f1129d0d640 1 --2- 172.21.15.46:0/2704241372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11240c7cd0 0x7f11241f29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:20.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.761+0000 7f1129d0d640 1 --2- 172.21.15.46:0/2704241372 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124072760 0x7f1124154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:20.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.761+0000 7f1129d0d640 1 -- 172.21.15.46:0/2704241372 >> 172.21.15.46:0/2704241372 conn(0x7f112406aa60 msgr2=0x7f112414f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:20.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.761+0000 7f1129d0d640 1 -- 172.21.15.46:0/2704241372 shutdown_connections 2024-01-23T09:25:20.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.761+0000 7f1129d0d640 1 -- 172.21.15.46:0/2704241372 wait complete. 2024-01-23T09:25:20.784 INFO:tasks.ceph:Scrubbing osd.7 2024-01-23T09:25:20.784 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-01-23T09:25:20.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.921+0000 7f693272d640 1 Processor -- start 2024-01-23T09:25:20.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.921+0000 7f693272d640 1 -- start start 2024-01-23T09:25:20.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.921+0000 7f693272d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f692c1505a0 0x7f692c0c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:20.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.921+0000 7f693272d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f692c06f110 0x7f692c06b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:20.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.921+0000 7f693272d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f692c06e9c0 con 0x7f692c0c2ce0 2024-01-23T09:25:20.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.921+0000 7f693272d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f692c150980 con 0x7f692c06f110 2024-01-23T09:25:20.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.921+0000 7f693272d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692c0c6a50 con 0x7f692c1505a0 2024-01-23T09:25:20.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.925+0000 7f692bfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f692c1505a0 0x7f692c0c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:20.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.925+0000 7f692bfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f692c1505a0 0x7f692c0c5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:57768/0 (socket says 172.21.15.46:57768) 2024-01-23T09:25:20.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.925+0000 7f692bfff640 1 -- 172.21.15.46:0/1505759371 learned_addr learned my addr 172.21.15.46:0/1505759371 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:20.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.985+0000 7f692b7fe640 1 --2- 172.21.15.46:0/1505759371 >> v2:172.21.15.46:3300/0 conn(0x7f692c06f110 0x7f692c06b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:20.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.993+0000 7f692b7fe640 1 -- 172.21.15.46:0/1505759371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f692c1505a0 msgr2=0x7f692c0c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:20.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.993+0000 7f692b7fe640 1 --2- 172.21.15.46:0/1505759371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f692c1505a0 0x7f692c0c5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:20.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.993+0000 7f692b7fe640 1 -- 172.21.15.46:0/1505759371 >> v1:172.21.15.46:6789/0 conn(0x7f692c0c2ce0 legacy=0x7f692c0c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:20.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:20.993+0000 7f692b7fe640 1 -- 172.21.15.46:0/1505759371 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692c06e400 con 0x7f692c06f110 2024-01-23T09:25:21.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.001+0000 7f692b7fe640 1 --2- 172.21.15.46:0/1505759371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f692c06f110 0x7f692c06b770 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f69140097c0 tx=0x7f691401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1394e1b8588afe92 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:21.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.009+0000 7f692affd640 1 -- 172.21.15.46:0/1505759371 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69140ad640 con 0x7f692c06f110 2024-01-23T09:25:21.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.009+0000 7f692affd640 1 -- 172.21.15.46:0/1505759371 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69140ad7a0 con 0x7f692c06f110 2024-01-23T09:25:21.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.009+0000 7f692affd640 1 -- 172.21.15.46:0/1505759371 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69140adb30 con 0x7f692c06f110 2024-01-23T09:25:21.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.009+0000 7f693272d640 1 -- 172.21.15.46:0/1505759371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f692c06f110 msgr2=0x7f692c06b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:21.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.009+0000 7f693272d640 1 --2- 172.21.15.46:0/1505759371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f692c06f110 0x7f692c06b770 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f69140097c0 tx=0x7f691401c480 comp rx=0 tx=0).stop 2024-01-23T09:25:21.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.009+0000 7f693272d640 1 -- 172.21.15.46:0/1505759371 shutdown_connections 2024-01-23T09:25:21.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.009+0000 7f693272d640 1 --2- 172.21.15.46:0/1505759371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f692c06f110 0x7f692c06b770 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:21.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.009+0000 7f693272d640 1 --2- 172.21.15.46:0/1505759371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f692c1505a0 0x7f692c0c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:21.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.009+0000 7f693272d640 1 -- 172.21.15.46:0/1505759371 >> 172.21.15.46:0/1505759371 conn(0x7f692c0cbe70 msgr2=0x7f692c0cc280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:21.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.009+0000 7f693272d640 1 -- 172.21.15.46:0/1505759371 shutdown_connections 2024-01-23T09:25:21.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.009+0000 7f693272d640 1 -- 172.21.15.46:0/1505759371 wait complete. 2024-01-23T09:25:21.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.013+0000 7f693272d640 1 Processor -- start 2024-01-23T09:25:21.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.013+0000 7f693272d640 1 -- start start 2024-01-23T09:25:21.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.013+0000 7f693272d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f692c06f110 0x7f692c152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:21.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.013+0000 7f693272d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f692c0c2ce0 0x7f692c1f3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:21.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.013+0000 7f693272d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f692c1505a0 0x7f692c06fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:21.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.013+0000 7f693272d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692c152da0 con 0x7f692c06f110 2024-01-23T09:25:21.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.013+0000 7f693272d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692c1f3a70 con 0x7f692c0c2ce0 2024-01-23T09:25:21.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.013+0000 7f693272d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692c144180 con 0x7f692c1505a0 2024-01-23T09:25:21.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.013+0000 7f692b7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f692c0c2ce0 0x7f692c1f3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:21.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.017+0000 7f692b7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f692c0c2ce0 0x7f692c1f3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:39774/0 (socket says 172.21.15.46:39774) 2024-01-23T09:25:21.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.017+0000 7f692b7fe640 1 -- 172.21.15.46:0/775213744 learned_addr learned my addr 172.21.15.46:0/775213744 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:21.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.021+0000 7f692b7fe640 1 -- 172.21.15.46:0/775213744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f692c1505a0 msgr2=0x7f692c06fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:21.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.021+0000 7f692b7fe640 1 --2- 172.21.15.46:0/775213744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f692c1505a0 0x7f692c06fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:21.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.021+0000 7f692b7fe640 1 -- 172.21.15.46:0/775213744 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f692c06f110 msgr2=0x7f692c152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:21.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.021+0000 7f692b7fe640 1 --2- 172.21.15.46:0/775213744 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f692c06f110 0x7f692c152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:21.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.021+0000 7f692b7fe640 1 -- 172.21.15.46:0/775213744 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6914009420 con 0x7f692c0c2ce0 2024-01-23T09:25:21.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.025+0000 7f692b7fe640 1 --2- 172.21.15.46:0/775213744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f692c0c2ce0 0x7f692c1f3530 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f69140b0040 tx=0x7f6914019220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:21.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.033+0000 7f6928ff9640 1 -- 172.21.15.46:0/775213744 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69140b6610 con 0x7f692c0c2ce0 2024-01-23T09:25:21.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.033+0000 7f6928ff9640 1 -- 172.21.15.46:0/775213744 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69140a6040 con 0x7f692c0c2ce0 2024-01-23T09:25:21.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.033+0000 7f6928ff9640 1 -- 172.21.15.46:0/775213744 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69140b69b0 con 0x7f692c0c2ce0 2024-01-23T09:25:21.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.033+0000 7f693272d640 1 -- 172.21.15.46:0/775213744 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f692c153b70 con 0x7f692c0c2ce0 2024-01-23T09:25:21.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.033+0000 7f693272d640 1 -- 172.21.15.46:0/775213744 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692c1ef7a0 con 0x7f692c0c2ce0 2024-01-23T09:25:21.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.033+0000 7f693272d640 1 -- 172.21.15.46:0/775213744 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f692c1ef600 con 0x7f692c0c2ce0 2024-01-23T09:25:21.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.069+0000 7f6928ff9640 1 -- 172.21.15.46:0/775213744 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f69140b4040 con 0x7f692c0c2ce0 2024-01-23T09:25:21.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.069+0000 7f6928ff9640 1 --2- 172.21.15.46:0/775213744 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f690c066550 0x7f690c068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:21.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.069+0000 7f692bfff640 1 --2- 172.21.15.46:0/775213744 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f690c066550 0x7f690c068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:21.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.069+0000 7f692bfff640 1 --2- 172.21.15.46:0/775213744 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f690c066550 0x7f690c068a10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6924009770 tx=0x7f6924008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:21.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.081+0000 7f6928ff9640 1 -- 172.21.15.46:0/775213744 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f69140f01d0 con 0x7f692c0c2ce0 2024-01-23T09:25:21.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.081+0000 7f6928ff9640 1 --2- 172.21.15.46:0/775213744 >> [v2:172.21.15.175:6817/2670236415,v1:172.21.15.175:6819/2670236415] conn(0x7f690c06fc30 0x7f690c0720d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:21.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.081+0000 7f6928ff9640 1 -- 172.21.15.46:0/775213744 --> [v2:172.21.15.175:6817/2670236415,v1:172.21.15.175:6819/2670236415] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f690c0727a0 con 0x7f690c06fc30 2024-01-23T09:25:21.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.081+0000 7f6928ff9640 1 -- 172.21.15.46:0/775213744 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69140ebe10 con 0x7f692c0c2ce0 2024-01-23T09:25:21.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.081+0000 7f6930cca640 1 --2- 172.21.15.46:0/775213744 >> [v2:172.21.15.175:6817/2670236415,v1:172.21.15.175:6819/2670236415] conn(0x7f690c06fc30 0x7f690c0720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:21.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.081+0000 7f6930cca640 1 --2- 172.21.15.46:0/775213744 >> [v2:172.21.15.175:6817/2670236415,v1:172.21.15.175:6819/2670236415] conn(0x7f690c06fc30 0x7f690c0720d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:21.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.085+0000 7f6928ff9640 1 -- 172.21.15.46:0/775213744 <== osd.7 v2:172.21.15.175:6817/2670236415 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f690c0727a0 con 0x7f690c06fc30 2024-01-23T09:25:21.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.109+0000 7f693272d640 1 -- 172.21.15.46:0/775213744 --> [v2:172.21.15.175:6817/2670236415,v1:172.21.15.175:6819/2670236415] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f692c074340 con 0x7f690c06fc30 2024-01-23T09:25:21.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.109+0000 7f6928ff9640 1 -- 172.21.15.46:0/775213744 <== osd.7 v2:172.21.15.175:6817/2670236415 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f692c074340 con 0x7f690c06fc30 2024-01-23T09:25:21.113 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-23T09:25:21.113 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-23T09:25:21.113 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-23T09:25:21.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.109+0000 7f693272d640 1 -- 172.21.15.46:0/775213744 >> [v2:172.21.15.175:6817/2670236415,v1:172.21.15.175:6819/2670236415] conn(0x7f690c06fc30 msgr2=0x7f690c0720d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:21.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.109+0000 7f693272d640 1 --2- 172.21.15.46:0/775213744 >> [v2:172.21.15.175:6817/2670236415,v1:172.21.15.175:6819/2670236415] conn(0x7f690c06fc30 0x7f690c0720d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:21.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.109+0000 7f693272d640 1 -- 172.21.15.46:0/775213744 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f690c066550 msgr2=0x7f690c068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:21.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.109+0000 7f693272d640 1 --2- 172.21.15.46:0/775213744 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f690c066550 0x7f690c068a10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6924009770 tx=0x7f6924008040 comp rx=0 tx=0).stop 2024-01-23T09:25:21.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.109+0000 7f693272d640 1 -- 172.21.15.46:0/775213744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f692c0c2ce0 msgr2=0x7f692c1f3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:21.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.109+0000 7f693272d640 1 --2- 172.21.15.46:0/775213744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f692c0c2ce0 0x7f692c1f3530 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f69140b0040 tx=0x7f6914019220 comp rx=0 tx=0).stop 2024-01-23T09:25:21.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.109+0000 7f6930cca640 1 -- 172.21.15.46:0/775213744 reap_dead start 2024-01-23T09:25:21.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.109+0000 7f693272d640 1 -- 172.21.15.46:0/775213744 shutdown_connections 2024-01-23T09:25:21.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.109+0000 7f693272d640 1 -- 172.21.15.46:0/775213744 >> 172.21.15.46:0/775213744 conn(0x7f692c0cbe70 msgr2=0x7f692c0c0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:21.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.109+0000 7f693272d640 1 -- 172.21.15.46:0/775213744 shutdown_connections 2024-01-23T09:25:21.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.109+0000 7f693272d640 1 -- 172.21.15.46:0/775213744 wait complete. 2024-01-23T09:25:21.139 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-01-23T09:25:21.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.269+0000 7fa13fc49640 1 Processor -- start 2024-01-23T09:25:21.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.269+0000 7fa13fc49640 1 -- start start 2024-01-23T09:25:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.269+0000 7fa13fc49640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa13815b070 0x7fa1380c3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.269+0000 7fa13fc49640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1380c3200 con 0x7fa1380c8160 2024-01-23T09:25:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.269+0000 7fa13fc49640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa13815b4f0 con 0x7fa138151640 2024-01-23T09:25:21.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.269+0000 7fa13fc49640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1380b0530 con 0x7fa13815b070 2024-01-23T09:25:21.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.273+0000 7fa13e1e6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa13815b070 0x7fa1380c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:21.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.273+0000 7fa13d9e5640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fa138151640 0x7fa1380ccd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.46:49836/0 (socket says 172.21.15.46:49836) 2024-01-23T09:25:21.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.273+0000 7fa13d9e5640 1 -- 172.21.15.46:0/3414255691 learned_addr learned my addr 172.21.15.46:0/3414255691 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T09:25:21.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.281+0000 7fa13e1e6640 1 -- 172.21.15.46:0/3414255691 >> v1:172.21.15.175:6789/0 conn(0x7fa138151640 legacy=0x7fa1380ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:21.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.281+0000 7fa13e1e6640 1 -- 172.21.15.46:0/3414255691 >> v1:172.21.15.46:6789/0 conn(0x7fa1380c8160 legacy=0x7fa13815a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:21.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.281+0000 7fa13e1e6640 1 -- 172.21.15.46:0/3414255691 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13815b7d0 con 0x7fa13815b070 2024-01-23T09:25:21.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.285+0000 7fa13e1e6640 1 --2- 172.21.15.46:0/3414255691 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa13815b070 0x7fa1380c3690 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa130009dc0 tx=0x7fa13001f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa073012d3b01871 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:21.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.297+0000 7fa13c9e3640 1 -- 172.21.15.46:0/3414255691 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1300af600 con 0x7fa13815b070 2024-01-23T09:25:21.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.297+0000 7fa13c9e3640 1 -- 172.21.15.46:0/3414255691 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1300ab050 con 0x7fa13815b070 2024-01-23T09:25:21.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.297+0000 7fa13c9e3640 1 -- 172.21.15.46:0/3414255691 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1300af980 con 0x7fa13815b070 2024-01-23T09:25:21.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.297+0000 7fa13fc49640 1 -- 172.21.15.46:0/3414255691 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa13815b070 msgr2=0x7fa1380c3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:21.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.297+0000 7fa13fc49640 1 --2- 172.21.15.46:0/3414255691 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa13815b070 0x7fa1380c3690 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa130009dc0 tx=0x7fa13001f150 comp rx=0 tx=0).stop 2024-01-23T09:25:21.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.297+0000 7fa13fc49640 1 -- 172.21.15.46:0/3414255691 shutdown_connections 2024-01-23T09:25:21.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.297+0000 7fa13fc49640 1 --2- 172.21.15.46:0/3414255691 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa13815b070 0x7fa1380c3690 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:21.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.297+0000 7fa13fc49640 1 -- 172.21.15.46:0/3414255691 >> 172.21.15.46:0/3414255691 conn(0x7fa13806a660 msgr2=0x7fa13806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:21.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.297+0000 7fa13fc49640 1 -- 172.21.15.46:0/3414255691 shutdown_connections 2024-01-23T09:25:21.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.297+0000 7fa13fc49640 1 -- 172.21.15.46:0/3414255691 wait complete. 2024-01-23T09:25:21.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.301+0000 7fa13fc49640 1 Processor -- start 2024-01-23T09:25:21.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.301+0000 7fa13fc49640 1 -- start start 2024-01-23T09:25:21.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.301+0000 7fa13fc49640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1380c8160 0x7fa1381f07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:21.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.301+0000 7fa13fc49640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa138151640 0x7fa1381f0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:21.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.301+0000 7fa13fc49640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa13815b070 0x7fa138151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:21.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.301+0000 7fa13fc49640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1381f0330 con 0x7fa138151640 2024-01-23T09:25:21.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.301+0000 7fa13fc49640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1381540b0 con 0x7fa1380c8160 2024-01-23T09:25:21.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.301+0000 7fa13fc49640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa138154390 con 0x7fa13815b070 2024-01-23T09:25:21.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.301+0000 7fa13d1e4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa138151640 0x7fa1381f0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:21.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.301+0000 7fa13d1e4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa138151640 0x7fa1381f0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47916/0 (socket says 172.21.15.46:47916) 2024-01-23T09:25:21.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.301+0000 7fa13d1e4640 1 -- 172.21.15.46:0/306278985 learned_addr learned my addr 172.21.15.46:0/306278985 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:21.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.305+0000 7fa13e1e6640 1 --2- 172.21.15.46:0/306278985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa13815b070 0x7fa138151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:21.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.305+0000 7fa13d1e4640 1 -- 172.21.15.46:0/306278985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa13815b070 msgr2=0x7fa138151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:21.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.305+0000 7fa13d1e4640 1 --2- 172.21.15.46:0/306278985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa13815b070 0x7fa138151fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:21.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.305+0000 7fa13d1e4640 1 -- 172.21.15.46:0/306278985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1380c8160 msgr2=0x7fa1381f07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:21.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.305+0000 7fa13d1e4640 1 --2- 172.21.15.46:0/306278985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1380c8160 0x7fa1381f07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:21.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.305+0000 7fa13d1e4640 1 -- 172.21.15.46:0/306278985 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa130009a70 con 0x7fa138151640 2024-01-23T09:25:21.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.309+0000 7fa13d1e4640 1 --2- 172.21.15.46:0/306278985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa138151640 0x7fa1381f0d00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa12800c420 tx=0x7fa12800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:21.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.317+0000 7fa12e7fc640 1 -- 172.21.15.46:0/306278985 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1280052d0 con 0x7fa138151640 2024-01-23T09:25:21.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.317+0000 7fa12e7fc640 1 -- 172.21.15.46:0/306278985 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa128005430 con 0x7fa138151640 2024-01-23T09:25:21.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.317+0000 7fa13fc49640 1 -- 172.21.15.46:0/306278985 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa138154670 con 0x7fa138151640 2024-01-23T09:25:21.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.317+0000 7fa12e7fc640 1 -- 172.21.15.46:0/306278985 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128007260 con 0x7fa138151640 2024-01-23T09:25:21.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.317+0000 7fa13fc49640 1 -- 172.21.15.46:0/306278985 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa138154c30 con 0x7fa138151640 2024-01-23T09:25:21.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.317+0000 7fa13fc49640 1 -- 172.21.15.46:0/306278985 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa138074340 con 0x7fa138151640 2024-01-23T09:25:21.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.337+0000 7fa12e7fc640 1 -- 172.21.15.46:0/306278985 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa1280073c0 con 0x7fa138151640 2024-01-23T09:25:21.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.337+0000 7fa12e7fc640 1 --2- 172.21.15.46:0/306278985 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa11c066580 0x7fa11c068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:21.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.341+0000 7fa13d9e5640 1 --2- 172.21.15.46:0/306278985 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa11c066580 0x7fa11c068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:21.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.341+0000 7fa13d9e5640 1 --2- 172.21.15.46:0/306278985 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa11c066580 0x7fa11c068a40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa134001600 tx=0x7fa134007a50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:21.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.649+0000 7fa12e7fc640 1 -- 172.21.15.46:0/306278985 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fa128055160 con 0x7fa138151640 2024-01-23T09:25:21.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.649+0000 7fa12e7fc640 1 -- 172.21.15.46:0/306278985 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa128050da0 con 0x7fa138151640 2024-01-23T09:25:21.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.829+0000 7fa13fc49640 1 -- 172.21.15.46:0/306278985 --> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1380c2e90 con 0x7fa11c066580 2024-01-23T09:25:21.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.829+0000 7fa12e7fc640 1 -- 172.21.15.46:0/306278985 <== mgr.4107 v2:172.21.15.46:6800/2324478006 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa1340058c0 con 0x7fa11c066580 2024-01-23T09:25:21.833 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 7 to deep-scrub 2024-01-23T09:25:21.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.829+0000 7fa13fc49640 1 -- 172.21.15.46:0/306278985 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa11c066580 msgr2=0x7fa11c068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:21.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.829+0000 7fa13fc49640 1 --2- 172.21.15.46:0/306278985 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa11c066580 0x7fa11c068a40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa134001600 tx=0x7fa134007a50 comp rx=0 tx=0).stop 2024-01-23T09:25:21.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.829+0000 7fa13fc49640 1 -- 172.21.15.46:0/306278985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa138151640 msgr2=0x7fa1381f0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:21.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.829+0000 7fa13fc49640 1 --2- 172.21.15.46:0/306278985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa138151640 0x7fa1381f0d00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa12800c420 tx=0x7fa12800c8e0 comp rx=0 tx=0).stop 2024-01-23T09:25:21.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.829+0000 7fa13fc49640 1 -- 172.21.15.46:0/306278985 shutdown_connections 2024-01-23T09:25:21.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.829+0000 7fa13fc49640 1 --2- 172.21.15.46:0/306278985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa13815b070 0x7fa138151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:21.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.829+0000 7fa13fc49640 1 --2- 172.21.15.46:0/306278985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa138151640 0x7fa1381f0d00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:21.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.829+0000 7fa13fc49640 1 --2- 172.21.15.46:0/306278985 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa11c066580 0x7fa11c068a40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:21.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.829+0000 7fa13fc49640 1 --2- 172.21.15.46:0/306278985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1380c8160 0x7fa1381f07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:21.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.829+0000 7fa13fc49640 1 -- 172.21.15.46:0/306278985 >> 172.21.15.46:0/306278985 conn(0x7fa13806a660 msgr2=0x7fa138150640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:21.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.829+0000 7fa13fc49640 1 -- 172.21.15.46:0/306278985 shutdown_connections 2024-01-23T09:25:21.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.829+0000 7fa13fc49640 1 -- 172.21.15.46:0/306278985 wait complete. 2024-01-23T09:25:21.854 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-23T09:25:21.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.981+0000 7fa7c3963640 1 Processor -- start 2024-01-23T09:25:21.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.981+0000 7fa7c3963640 1 -- start start 2024-01-23T09:25:21.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.981+0000 7fa7c3963640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa7bc14e1b0 0x7fa7bc0c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:21.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.981+0000 7fa7c3963640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa7bc066860 0x7fa7bc0c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:21.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.981+0000 7fa7c3963640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7bc06a7e0 con 0x7fa7bc06b7c0 2024-01-23T09:25:21.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.981+0000 7fa7c3963640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7bc06c0c0 con 0x7fa7bc066860 2024-01-23T09:25:21.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.981+0000 7fa7c3963640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7bc0c7940 con 0x7fa7bc14e1b0 2024-01-23T09:25:21.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.985+0000 7fa7c0efe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa7bc066860 0x7fa7bc0c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:21.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.985+0000 7fa7c0efe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa7bc066860 0x7fa7bc0c50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47928/0 (socket says 172.21.15.46:47928) 2024-01-23T09:25:21.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.985+0000 7fa7c0efe640 1 -- 172.21.15.46:0/2890234316 learned_addr learned my addr 172.21.15.46:0/2890234316 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:21.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.985+0000 7fa7c0efe640 1 -- 172.21.15.46:0/2890234316 >> v2:172.21.15.175:3300/0 conn(0x7fa7bc14e1b0 msgr2=0x7fa7bc0c4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:21.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.985+0000 7fa7c0efe640 1 --2- 172.21.15.46:0/2890234316 >> v2:172.21.15.175:3300/0 conn(0x7fa7bc14e1b0 0x7fa7bc0c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:21.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.985+0000 7fa7c0efe640 1 -- 172.21.15.46:0/2890234316 >> v1:172.21.15.175:6789/0 conn(0x7fa7bc06b7c0 legacy=0x7fa7bc071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:21.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.985+0000 7fa7c0efe640 1 -- 172.21.15.46:0/2890234316 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7bc157ec0 con 0x7fa7bc066860 2024-01-23T09:25:21.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.989+0000 7fa7c0efe640 1 --2- 172.21.15.46:0/2890234316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7bc066860 0x7fa7bc0c50a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc0c9010 tx=0x7fa7ac01ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2900d29d463107e server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:21.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.993+0000 7fa7b3fff640 1 -- 172.21.15.46:0/2890234316 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac0a89b0 con 0x7fa7bc066860 2024-01-23T09:25:21.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.993+0000 7fa7b3fff640 1 -- 172.21.15.46:0/2890234316 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ac0a8b10 con 0x7fa7bc066860 2024-01-23T09:25:21.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.993+0000 7fa7b3fff640 1 -- 172.21.15.46:0/2890234316 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac0a8ea0 con 0x7fa7bc066860 2024-01-23T09:25:22.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.997+0000 7fa7c3963640 1 -- 172.21.15.46:0/2890234316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7bc066860 msgr2=0x7fa7bc0c50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:22.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.997+0000 7fa7c3963640 1 --2- 172.21.15.46:0/2890234316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7bc066860 0x7fa7bc0c50a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc0c9010 tx=0x7fa7ac01ecb0 comp rx=0 tx=0).stop 2024-01-23T09:25:22.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.997+0000 7fa7c3963640 1 -- 172.21.15.46:0/2890234316 shutdown_connections 2024-01-23T09:25:22.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.997+0000 7fa7c3963640 1 --2- 172.21.15.46:0/2890234316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7bc066860 0x7fa7bc0c50a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:22.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.997+0000 7fa7c3963640 1 --2- 172.21.15.46:0/2890234316 >> v2:172.21.15.175:3300/0 conn(0x7fa7bc14e1b0 0x7fa7bc0c4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:22.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.997+0000 7fa7c3963640 1 -- 172.21.15.46:0/2890234316 >> 172.21.15.46:0/2890234316 conn(0x7fa7bc0cba50 msgr2=0x7fa7bc0c7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:22.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.997+0000 7fa7c3963640 1 -- 172.21.15.46:0/2890234316 shutdown_connections 2024-01-23T09:25:22.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.997+0000 7fa7c3963640 1 -- 172.21.15.46:0/2890234316 wait complete. 2024-01-23T09:25:22.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.997+0000 7fa7c3963640 1 Processor -- start 2024-01-23T09:25:22.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.997+0000 7fa7c3963640 1 -- start start 2024-01-23T09:25:22.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.997+0000 7fa7c3963640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7bc066860 0x7fa7bc1f3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:22.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.997+0000 7fa7c3963640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7bc06b7c0 0x7fa7bc1496f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:22.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.997+0000 7fa7c3963640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7bc14e1b0 0x7fa7bc0c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:22.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.997+0000 7fa7c3963640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc14d930 con 0x7fa7bc06b7c0 2024-01-23T09:25:22.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.997+0000 7fa7c3963640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc0c34d0 con 0x7fa7bc066860 2024-01-23T09:25:22.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.997+0000 7fa7c3963640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc0c2ea0 con 0x7fa7bc14e1b0 2024-01-23T09:25:22.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.997+0000 7fa7c0efe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7bc06b7c0 0x7fa7bc1496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:22.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.997+0000 7fa7c0efe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7bc06b7c0 0x7fa7bc1496f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47942/0 (socket says 172.21.15.46:47942) 2024-01-23T09:25:22.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:21.997+0000 7fa7c0efe640 1 -- 172.21.15.46:0/3254466164 learned_addr learned my addr 172.21.15.46:0/3254466164 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:22.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.001+0000 7fa7c0efe640 1 -- 172.21.15.46:0/3254466164 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7bc14e1b0 msgr2=0x7fa7bc0c38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:22.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.001+0000 7fa7c0efe640 1 --2- 172.21.15.46:0/3254466164 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7bc14e1b0 0x7fa7bc0c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:22.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.001+0000 7fa7c0efe640 1 -- 172.21.15.46:0/3254466164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7bc066860 msgr2=0x7fa7bc1f3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:22.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.001+0000 7fa7c0efe640 1 --2- 172.21.15.46:0/3254466164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7bc066860 0x7fa7bc1f3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:22.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.001+0000 7fa7c0efe640 1 -- 172.21.15.46:0/3254466164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ac0094d0 con 0x7fa7bc06b7c0 2024-01-23T09:25:22.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.005+0000 7fa7c0efe640 1 --2- 172.21.15.46:0/3254466164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7bc06b7c0 0x7fa7bc1496f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac01b8c0 tx=0x7fa7ac01ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:22.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.009+0000 7fa7b1ffb640 1 -- 172.21.15.46:0/3254466164 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac0b0e60 con 0x7fa7bc06b7c0 2024-01-23T09:25:22.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.009+0000 7fa7b1ffb640 1 -- 172.21.15.46:0/3254466164 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ac0ba440 con 0x7fa7bc06b7c0 2024-01-23T09:25:22.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.009+0000 7fa7b1ffb640 1 -- 172.21.15.46:0/3254466164 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac0ba7f0 con 0x7fa7bc06b7c0 2024-01-23T09:25:22.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.009+0000 7fa7c3963640 1 -- 172.21.15.46:0/3254466164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7bc1f3940 con 0x7fa7bc06b7c0 2024-01-23T09:25:22.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.009+0000 7fa7c3963640 1 -- 172.21.15.46:0/3254466164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7bc153ac0 con 0x7fa7bc06b7c0 2024-01-23T09:25:22.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.009+0000 7fa7c3963640 1 -- 172.21.15.46:0/3254466164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7bc0c3610 con 0x7fa7bc06b7c0 2024-01-23T09:25:22.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.301+0000 7fa7b1ffb640 1 -- 172.21.15.46:0/3254466164 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa7ac0ba950 con 0x7fa7bc06b7c0 2024-01-23T09:25:22.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.301+0000 7fa7b1ffb640 1 --2- 172.21.15.46:0/3254466164 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa7a0066550 0x7fa7a0068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:22.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.301+0000 7fa7c16ff640 1 --2- 172.21.15.46:0/3254466164 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa7a0066550 0x7fa7a0068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:22.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.301+0000 7fa7c16ff640 1 --2- 172.21.15.46:0/3254466164 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa7a0066550 0x7fa7a0068a10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8009690 tx=0x7fa7b8006c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:22.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.337+0000 7fa7b1ffb640 1 -- 172.21.15.46:0/3254466164 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fa7ac0f3cc0 con 0x7fa7bc06b7c0 2024-01-23T09:25:22.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.337+0000 7fa7b1ffb640 1 -- 172.21.15.46:0/3254466164 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa7ac0ef900 con 0x7fa7bc06b7c0 2024-01-23T09:25:22.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.517+0000 7fa7c3963640 1 -- 172.21.15.46:0/3254466164 --> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa7bc071900 con 0x7fa7a0066550 2024-01-23T09:25:22.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.537+0000 7fa7b1ffb640 1 -- 172.21.15.46:0/3254466164 <== mgr.4107 v2:172.21.15.46:6800/2324478006 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+366689 (secure 0 0 0) 0x7fa7b800b3d0 con 0x7fa7a0066550 2024-01-23T09:25:22.543 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T09:25:22.546 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-01-23T09:25:22.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.541+0000 7fa7c3963640 1 -- 172.21.15.46:0/3254466164 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa7a0066550 msgr2=0x7fa7a0068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:22.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.541+0000 7fa7c3963640 1 --2- 172.21.15.46:0/3254466164 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa7a0066550 0x7fa7a0068a10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8009690 tx=0x7fa7b8006c00 comp rx=0 tx=0).stop 2024-01-23T09:25:22.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.541+0000 7fa7c3963640 1 -- 172.21.15.46:0/3254466164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7bc06b7c0 msgr2=0x7fa7bc1496f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:22.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.541+0000 7fa7c3963640 1 --2- 172.21.15.46:0/3254466164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7bc06b7c0 0x7fa7bc1496f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac01b8c0 tx=0x7fa7ac01ba50 comp rx=0 tx=0).stop 2024-01-23T09:25:22.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.541+0000 7fa7c3963640 1 -- 172.21.15.46:0/3254466164 shutdown_connections 2024-01-23T09:25:22.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.541+0000 7fa7c3963640 1 --2- 172.21.15.46:0/3254466164 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7bc14e1b0 0x7fa7bc0c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:22.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.541+0000 7fa7c3963640 1 --2- 172.21.15.46:0/3254466164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7bc06b7c0 0x7fa7bc1496f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:22.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.541+0000 7fa7c3963640 1 --2- 172.21.15.46:0/3254466164 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa7a0066550 0x7fa7a0068a10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:22.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.541+0000 7fa7c3963640 1 --2- 172.21.15.46:0/3254466164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7bc066860 0x7fa7bc1f3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:22.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.541+0000 7fa7c3963640 1 -- 172.21.15.46:0/3254466164 >> 172.21.15.46:0/3254466164 conn(0x7fa7bc0cba50 msgr2=0x7fa7bc1487a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:22.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.541+0000 7fa7c3963640 1 -- 172.21.15.46:0/3254466164 shutdown_connections 2024-01-23T09:25:22.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:22.541+0000 7fa7c3963640 1 -- 172.21.15.46:0/3254466164 wait complete. 2024-01-23T09:25:22.567 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":968,"stamp":"2024-01-23T09:25:21.380464+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23779489,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":635,"num_read_kb":642,"num_write":7834,"num_write_kb":280431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9035,"ondisk_log_size":9035,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":302760,"kb_used_data":49192,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754671960,"statfs":{"total":773094113280,"available":772784087040,"internally_reserved":0,"allocated":50372608,"data_stored":48606202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004591"},"pg_stats":[{"pgid":"2.1f","version":"30'621","reported_seq":656,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:53.809154+0000","last_change":"2024-01-23T08:54:40.661700+0000","last_active":"2024-01-23T09:23:53.809154+0000","last_peered":"2024-01-23T09:23:53.809154+0000","last_clean":"2024-01-23T09:23:53.809154+0000","last_became_active":"2024-01-23T08:54:40.660901+0000","last_became_peered":"2024-01-23T08:54:40.660901+0000","last_unstale":"2024-01-23T09:23:53.809154+0000","last_undegraded":"2024-01-23T09:23:53.809154+0000","last_fullsized":"2024-01-23T09:23:53.809154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:59:22.804479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":621,"num_write_kb":4439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"30'17","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.608355+0000","last_change":"2024-01-23T08:54:42.159130+0000","last_active":"2024-01-23T09:25:03.608355+0000","last_peered":"2024-01-23T09:25:03.608355+0000","last_clean":"2024-01-23T09:25:03.608355+0000","last_became_active":"2024-01-23T08:54:42.158776+0000","last_became_peered":"2024-01-23T08:54:42.158776+0000","last_unstale":"2024-01-23T09:25:03.608355+0000","last_undegraded":"2024-01-23T09:25:03.608355+0000","last_fullsized":"2024-01-23T09:25:03.608355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:06.320845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"30'65","reported_seq":92,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:53.759886+0000","last_change":"2024-01-23T08:54:49.752558+0000","last_active":"2024-01-23T09:23:53.759886+0000","last_peered":"2024-01-23T09:23:53.759886+0000","last_clean":"2024-01-23T09:23:53.759886+0000","last_became_active":"2024-01-23T08:54:49.752077+0000","last_became_peered":"2024-01-23T08:54:49.752077+0000","last_unstale":"2024-01-23T09:23:53.759886+0000","last_undegraded":"2024-01-23T09:23:53.759886+0000","last_fullsized":"2024-01-23T09:23:53.759886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:20:50.653881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":3048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"30'229","reported_seq":265,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.245082+0000","last_change":"2024-01-23T08:54:40.700164+0000","last_active":"2024-01-23T09:25:03.245082+0000","last_peered":"2024-01-23T09:25:03.245082+0000","last_clean":"2024-01-23T09:25:03.245082+0000","last_became_active":"2024-01-23T08:54:40.699449+0000","last_became_peered":"2024-01-23T08:54:40.699449+0000","last_unstale":"2024-01-23T09:25:03.245082+0000","last_undegraded":"2024-01-23T09:25:03.245082+0000","last_fullsized":"2024-01-23T09:25:03.245082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:16:32.814250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2084932,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":2149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"30'24","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.647865+0000","last_change":"2024-01-23T08:54:42.092833+0000","last_active":"2024-01-23T09:25:03.647865+0000","last_peered":"2024-01-23T09:25:03.647865+0000","last_clean":"2024-01-23T09:25:03.647865+0000","last_became_active":"2024-01-23T08:54:42.091950+0000","last_became_peered":"2024-01-23T08:54:42.091950+0000","last_unstale":"2024-01-23T09:25:03.647865+0000","last_undegraded":"2024-01-23T09:25:03.647865+0000","last_fullsized":"2024-01-23T09:25:03.647865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:46.594970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"30'80","reported_seq":108,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:54.782195+0000","last_change":"2024-01-23T08:54:49.747131+0000","last_active":"2024-01-23T09:23:54.782195+0000","last_peered":"2024-01-23T09:23:54.782195+0000","last_clean":"2024-01-23T09:23:54.782195+0000","last_became_active":"2024-01-23T08:54:49.746481+0000","last_became_peered":"2024-01-23T08:54:49.746481+0000","last_unstale":"2024-01-23T09:23:54.782195+0000","last_undegraded":"2024-01-23T09:23:54.782195+0000","last_fullsized":"2024-01-23T09:23:54.782195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":5137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"30'18","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:54.282887+0000","last_change":"2024-01-23T08:54:40.687614+0000","last_active":"2024-01-23T09:24:54.282887+0000","last_peered":"2024-01-23T09:24:54.282887+0000","last_clean":"2024-01-23T09:24:54.282887+0000","last_became_active":"2024-01-23T08:54:40.687234+0000","last_became_peered":"2024-01-23T08:54:40.687234+0000","last_unstale":"2024-01-23T09:24:54.282887+0000","last_undegraded":"2024-01-23T09:24:54.282887+0000","last_fullsized":"2024-01-23T09:24:54.282887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"30'21","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.689327+0000","last_change":"2024-01-23T08:55:47.540221+0000","last_active":"2024-01-23T09:25:03.689327+0000","last_peered":"2024-01-23T09:25:03.689327+0000","last_clean":"2024-01-23T09:25:03.689327+0000","last_became_active":"2024-01-23T08:55:47.539657+0000","last_became_peered":"2024-01-23T08:55:47.539657+0000","last_unstale":"2024-01-23T09:25:03.689327+0000","last_undegraded":"2024-01-23T09:25:03.689327+0000","last_fullsized":"2024-01-23T09:25:03.689327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"30'86","reported_seq":114,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:48.618051+0000","last_change":"2024-01-23T08:54:49.747332+0000","last_active":"2024-01-23T09:24:48.618051+0000","last_peered":"2024-01-23T09:24:48.618051+0000","last_clean":"2024-01-23T09:24:48.618051+0000","last_became_active":"2024-01-23T08:54:49.746474+0000","last_became_peered":"2024-01-23T08:54:49.746474+0000","last_unstale":"2024-01-23T09:24:48.618051+0000","last_undegraded":"2024-01-23T09:24:48.618051+0000","last_fullsized":"2024-01-23T09:24:48.618051+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":12223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"30'11","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:18.069668+0000","last_change":"2024-01-23T09:25:18.069721+0000","last_active":"2024-01-23T09:25:18.069668+0000","last_peered":"2024-01-23T09:25:18.069668+0000","last_clean":"2024-01-23T09:25:18.069668+0000","last_became_active":"2024-01-23T08:54:40.686903+0000","last_became_peered":"2024-01-23T08:54:40.686903+0000","last_unstale":"2024-01-23T09:25:18.069668+0000","last_undegraded":"2024-01-23T09:25:18.069668+0000","last_fullsized":"2024-01-23T09:25:18.069668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'11","last_scrub_stamp":"2024-01-23T09:25:18.069558+0000","last_deep_scrub":"30'11","last_deep_scrub_stamp":"2024-01-23T09:25:18.069558+0000","last_clean_scrub_stamp":"2024-01-23T09:25:18.069558+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:40:53.574638+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"30'36","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.726370+0000","last_change":"2024-01-23T08:54:42.109485+0000","last_active":"2024-01-23T09:25:03.726370+0000","last_peered":"2024-01-23T09:25:03.726370+0000","last_clean":"2024-01-23T09:25:03.726370+0000","last_became_active":"2024-01-23T08:54:42.108182+0000","last_became_peered":"2024-01-23T08:54:42.108182+0000","last_unstale":"2024-01-23T09:25:03.726370+0000","last_undegraded":"2024-01-23T09:25:03.726370+0000","last_fullsized":"2024-01-23T09:25:03.726370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"30'61","reported_seq":89,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:48.618009+0000","last_change":"2024-01-23T08:54:49.747949+0000","last_active":"2024-01-23T09:24:48.618009+0000","last_peered":"2024-01-23T09:24:48.618009+0000","last_clean":"2024-01-23T09:24:48.618009+0000","last_became_active":"2024-01-23T08:54:49.746880+0000","last_became_peered":"2024-01-23T08:54:49.746880+0000","last_unstale":"2024-01-23T09:24:48.618009+0000","last_undegraded":"2024-01-23T09:24:48.618009+0000","last_fullsized":"2024-01-23T09:24:48.618009+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":7433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"30'19","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:13.550994+0000","last_change":"2024-01-23T08:54:42.088786+0000","last_active":"2024-01-23T09:25:13.550994+0000","last_peered":"2024-01-23T09:25:13.550994+0000","last_clean":"2024-01-23T09:25:13.550994+0000","last_became_active":"2024-01-23T08:54:42.088068+0000","last_became_peered":"2024-01-23T08:54:42.088068+0000","last_unstale":"2024-01-23T09:25:13.550994+0000","last_undegraded":"2024-01-23T09:25:13.550994+0000","last_fullsized":"2024-01-23T09:25:13.550994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"30'671","reported_seq":706,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:53.546300+0000","last_change":"2024-01-23T08:54:40.612044+0000","last_active":"2024-01-23T09:24:53.546300+0000","last_peered":"2024-01-23T09:24:53.546300+0000","last_clean":"2024-01-23T09:24:53.546300+0000","last_became_active":"2024-01-23T08:54:40.611589+0000","last_became_peered":"2024-01-23T08:54:40.611589+0000","last_unstale":"2024-01-23T09:24:53.546300+0000","last_undegraded":"2024-01-23T09:24:53.546300+0000","last_fullsized":"2024-01-23T09:24:53.546300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":666,"num_write_kb":4421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'70","reported_seq":99,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:03.538683+0000","last_change":"2024-01-23T08:54:49.716713+0000","last_active":"2024-01-23T09:24:03.538683+0000","last_peered":"2024-01-23T09:24:03.538683+0000","last_clean":"2024-01-23T09:24:03.538683+0000","last_became_active":"2024-01-23T08:54:49.715843+0000","last_became_peered":"2024-01-23T08:54:49.715843+0000","last_unstale":"2024-01-23T09:24:03.538683+0000","last_undegraded":"2024-01-23T09:24:03.538683+0000","last_fullsized":"2024-01-23T09:24:03.538683+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":10371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"30'21","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.634669+0000","last_change":"2024-01-23T08:54:42.230199+0000","last_active":"2024-01-23T09:25:03.634669+0000","last_peered":"2024-01-23T09:25:03.634669+0000","last_clean":"2024-01-23T09:25:03.634669+0000","last_became_active":"2024-01-23T08:54:42.229547+0000","last_became_peered":"2024-01-23T08:54:42.229547+0000","last_unstale":"2024-01-23T09:25:03.634669+0000","last_undegraded":"2024-01-23T09:25:03.634669+0000","last_fullsized":"2024-01-23T09:25:03.634669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:07:07.781698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"30'4","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:15.214045+0000","last_change":"2024-01-23T08:54:40.688971+0000","last_active":"2024-01-23T09:24:15.214045+0000","last_peered":"2024-01-23T09:24:15.214045+0000","last_clean":"2024-01-23T09:24:15.214045+0000","last_became_active":"2024-01-23T08:54:40.688230+0000","last_became_peered":"2024-01-23T08:54:40.688230+0000","last_unstale":"2024-01-23T09:24:15.214045+0000","last_undegraded":"2024-01-23T09:24:15.214045+0000","last_fullsized":"2024-01-23T09:24:15.214045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:40:12.245110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"30'94","reported_seq":123,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:03.585476+0000","last_change":"2024-01-23T08:54:49.748471+0000","last_active":"2024-01-23T09:24:03.585476+0000","last_peered":"2024-01-23T09:24:03.585476+0000","last_clean":"2024-01-23T09:24:03.585476+0000","last_became_active":"2024-01-23T08:54:49.747958+0000","last_became_peered":"2024-01-23T08:54:49.747958+0000","last_unstale":"2024-01-23T09:24:03.585476+0000","last_undegraded":"2024-01-23T09:24:03.585476+0000","last_fullsized":"2024-01-23T09:24:03.585476+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":8657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"30'23","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.718611+0000","last_change":"2024-01-23T08:54:42.194148+0000","last_active":"2024-01-23T09:25:03.718611+0000","last_peered":"2024-01-23T09:25:03.718611+0000","last_clean":"2024-01-23T09:25:03.718611+0000","last_became_active":"2024-01-23T08:54:42.193403+0000","last_became_peered":"2024-01-23T08:54:42.193403+0000","last_unstale":"2024-01-23T09:25:03.718611+0000","last_undegraded":"2024-01-23T09:25:03.718611+0000","last_fullsized":"2024-01-23T09:25:03.718611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:38:42.543776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"30'11","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:48.195751+0000","last_change":"2024-01-23T08:54:40.688897+0000","last_active":"2024-01-23T09:24:48.195751+0000","last_peered":"2024-01-23T09:24:48.195751+0000","last_clean":"2024-01-23T09:24:48.195751+0000","last_became_active":"2024-01-23T08:54:40.688122+0000","last_became_peered":"2024-01-23T08:54:40.688122+0000","last_unstale":"2024-01-23T09:24:48.195751+0000","last_undegraded":"2024-01-23T09:24:48.195751+0000","last_fullsized":"2024-01-23T09:24:48.195751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:19:16.760424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'73","reported_seq":101,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:57.989453+0000","last_change":"2024-01-23T08:54:49.738331+0000","last_active":"2024-01-23T09:23:57.989453+0000","last_peered":"2024-01-23T09:23:57.989453+0000","last_clean":"2024-01-23T09:23:57.989453+0000","last_became_active":"2024-01-23T08:54:49.737442+0000","last_became_peered":"2024-01-23T08:54:49.737442+0000","last_unstale":"2024-01-23T09:23:57.989453+0000","last_undegraded":"2024-01-23T09:23:57.989453+0000","last_fullsized":"2024-01-23T09:23:57.989453+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:59:20.106849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":10395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"30'19","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.707917+0000","last_change":"2024-01-23T08:54:42.192681+0000","last_active":"2024-01-23T09:25:03.707917+0000","last_peered":"2024-01-23T09:25:03.707917+0000","last_clean":"2024-01-23T09:25:03.707917+0000","last_became_active":"2024-01-23T08:54:42.192225+0000","last_became_peered":"2024-01-23T08:54:42.192225+0000","last_unstale":"2024-01-23T09:25:03.707917+0000","last_undegraded":"2024-01-23T09:25:03.707917+0000","last_fullsized":"2024-01-23T09:25:03.707917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"30'8","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:17.020198+0000","last_change":"2024-01-23T09:25:17.020226+0000","last_active":"2024-01-23T09:25:17.020198+0000","last_peered":"2024-01-23T09:25:17.020198+0000","last_clean":"2024-01-23T09:25:17.020198+0000","last_became_active":"2024-01-23T08:54:40.686654+0000","last_became_peered":"2024-01-23T08:54:40.686654+0000","last_unstale":"2024-01-23T09:25:17.020198+0000","last_undegraded":"2024-01-23T09:25:17.020198+0000","last_fullsized":"2024-01-23T09:25:17.020198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'8","last_scrub_stamp":"2024-01-23T09:25:17.020124+0000","last_deep_scrub":"30'8","last_deep_scrub_stamp":"2024-01-23T09:25:17.020124+0000","last_clean_scrub_stamp":"2024-01-23T09:25:17.020124+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:13:09.335460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"30'83","reported_seq":112,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:03.611166+0000","last_change":"2024-01-23T08:54:49.736471+0000","last_active":"2024-01-23T09:24:03.611166+0000","last_peered":"2024-01-23T09:24:03.611166+0000","last_clean":"2024-01-23T09:24:03.611166+0000","last_became_active":"2024-01-23T08:54:49.735971+0000","last_became_peered":"2024-01-23T08:54:49.735971+0000","last_unstale":"2024-01-23T09:24:03.611166+0000","last_undegraded":"2024-01-23T09:24:03.611166+0000","last_fullsized":"2024-01-23T09:24:03.611166+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":6293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"30'30","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.734411+0000","last_change":"2024-01-23T08:54:42.195854+0000","last_active":"2024-01-23T09:25:03.734411+0000","last_peered":"2024-01-23T09:25:03.734411+0000","last_clean":"2024-01-23T09:25:03.734411+0000","last_became_active":"2024-01-23T08:54:42.195052+0000","last_became_peered":"2024-01-23T08:54:42.195052+0000","last_unstale":"2024-01-23T09:25:03.734411+0000","last_undegraded":"2024-01-23T09:25:03.734411+0000","last_fullsized":"2024-01-23T09:25:03.734411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:54:18.859903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"30'9","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.549293+0000","last_change":"2024-01-23T08:54:40.694194+0000","last_active":"2024-01-23T09:25:03.549293+0000","last_peered":"2024-01-23T09:25:03.549293+0000","last_clean":"2024-01-23T09:25:03.549293+0000","last_became_active":"2024-01-23T08:54:40.693610+0000","last_became_peered":"2024-01-23T08:54:40.693610+0000","last_unstale":"2024-01-23T09:25:03.549293+0000","last_undegraded":"2024-01-23T09:25:03.549293+0000","last_fullsized":"2024-01-23T09:25:03.549293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"30'40","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:58.610049+0000","last_change":"2024-01-23T08:54:49.747205+0000","last_active":"2024-01-23T09:23:58.610049+0000","last_peered":"2024-01-23T09:23:58.610049+0000","last_clean":"2024-01-23T09:23:58.610049+0000","last_became_active":"2024-01-23T08:54:49.746792+0000","last_became_peered":"2024-01-23T08:54:49.746792+0000","last_unstale":"2024-01-23T09:23:58.610049+0000","last_undegraded":"2024-01-23T09:23:58.610049+0000","last_fullsized":"2024-01-23T09:23:58.610049+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":6755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.751593+0000","last_change":"2024-01-23T08:54:42.233783+0000","last_active":"2024-01-23T09:25:03.751593+0000","last_peered":"2024-01-23T09:25:03.751593+0000","last_clean":"2024-01-23T09:25:03.751593+0000","last_became_active":"2024-01-23T08:54:42.233018+0000","last_became_peered":"2024-01-23T08:54:42.233018+0000","last_unstale":"2024-01-23T09:25:03.751593+0000","last_undegraded":"2024-01-23T09:25:03.751593+0000","last_fullsized":"2024-01-23T09:25:03.751593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:04:58.998914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"30'336","reported_seq":371,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:02.817611+0000","last_change":"2024-01-23T08:54:40.690385+0000","last_active":"2024-01-23T09:25:02.817611+0000","last_peered":"2024-01-23T09:25:02.817611+0000","last_clean":"2024-01-23T09:25:02.817611+0000","last_became_active":"2024-01-23T08:54:40.689528+0000","last_became_peered":"2024-01-23T08:54:40.689528+0000","last_unstale":"2024-01-23T09:25:02.817611+0000","last_undegraded":"2024-01-23T09:25:02.817611+0000","last_fullsized":"2024-01-23T09:25:02.817611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:59:11.006550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":906,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"30'90","reported_seq":120,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:56.578837+0000","last_change":"2024-01-23T08:54:49.731870+0000","last_active":"2024-01-23T09:23:56.578837+0000","last_peered":"2024-01-23T09:23:56.578837+0000","last_clean":"2024-01-23T09:23:56.578837+0000","last_became_active":"2024-01-23T08:54:49.731414+0000","last_became_peered":"2024-01-23T08:54:49.731414+0000","last_unstale":"2024-01-23T09:23:56.578837+0000","last_undegraded":"2024-01-23T09:23:56.578837+0000","last_fullsized":"2024-01-23T09:23:56.578837+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:30.315625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":11197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.581262+0000","last_change":"2024-01-23T08:54:42.227885+0000","last_active":"2024-01-23T09:25:03.581262+0000","last_peered":"2024-01-23T09:25:03.581262+0000","last_clean":"2024-01-23T09:25:03.581262+0000","last_became_active":"2024-01-23T08:54:42.227188+0000","last_became_peered":"2024-01-23T08:54:42.227188+0000","last_unstale":"2024-01-23T09:25:03.581262+0000","last_undegraded":"2024-01-23T09:25:03.581262+0000","last_fullsized":"2024-01-23T09:25:03.581262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:02:13.790208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"30'7","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:47.009161+0000","last_change":"2024-01-23T08:54:40.658365+0000","last_active":"2024-01-23T09:24:47.009161+0000","last_peered":"2024-01-23T09:24:47.009161+0000","last_clean":"2024-01-23T09:24:47.009161+0000","last_became_active":"2024-01-23T08:54:40.657616+0000","last_became_peered":"2024-01-23T08:54:40.657616+0000","last_unstale":"2024-01-23T09:24:47.009161+0000","last_undegraded":"2024-01-23T09:24:47.009161+0000","last_fullsized":"2024-01-23T09:24:47.009161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"30'59","reported_seq":88,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:58.800322+0000","last_change":"2024-01-23T08:54:49.739474+0000","last_active":"2024-01-23T09:23:58.800322+0000","last_peered":"2024-01-23T09:23:58.800322+0000","last_clean":"2024-01-23T09:23:58.800322+0000","last_became_active":"2024-01-23T08:54:49.738579+0000","last_became_peered":"2024-01-23T08:54:49.738579+0000","last_unstale":"2024-01-23T09:23:58.800322+0000","last_undegraded":"2024-01-23T09:23:58.800322+0000","last_fullsized":"2024-01-23T09:23:58.800322+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:23:32.238072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":6541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"30'19","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.752274+0000","last_change":"2024-01-23T08:54:42.228302+0000","last_active":"2024-01-23T09:25:03.752274+0000","last_peered":"2024-01-23T09:25:03.752274+0000","last_clean":"2024-01-23T09:25:03.752274+0000","last_became_active":"2024-01-23T08:54:42.227558+0000","last_became_peered":"2024-01-23T08:54:42.227558+0000","last_unstale":"2024-01-23T09:25:03.752274+0000","last_undegraded":"2024-01-23T09:25:03.752274+0000","last_fullsized":"2024-01-23T09:25:03.752274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:24.630053+0000","last_change":"2024-01-23T08:54:40.697453+0000","last_active":"2024-01-23T09:24:24.630053+0000","last_peered":"2024-01-23T09:24:24.630053+0000","last_clean":"2024-01-23T09:24:24.630053+0000","last_became_active":"2024-01-23T08:54:40.696688+0000","last_became_peered":"2024-01-23T08:54:40.696688+0000","last_unstale":"2024-01-23T09:24:24.630053+0000","last_undegraded":"2024-01-23T09:24:24.630053+0000","last_fullsized":"2024-01-23T09:24:24.630053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:59:22.804479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'81","reported_seq":110,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:57.989602+0000","last_change":"2024-01-23T08:54:49.726678+0000","last_active":"2024-01-23T09:23:57.989602+0000","last_peered":"2024-01-23T09:23:57.989602+0000","last_clean":"2024-01-23T09:23:57.989602+0000","last_became_active":"2024-01-23T08:54:49.725830+0000","last_became_peered":"2024-01-23T08:54:49.725830+0000","last_unstale":"2024-01-23T09:23:57.989602+0000","last_undegraded":"2024-01-23T09:23:57.989602+0000","last_fullsized":"2024-01-23T09:23:57.989602+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:12:34.009779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":6498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"30'21","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.867670+0000","last_change":"2024-01-23T08:54:42.149751+0000","last_active":"2024-01-23T09:25:03.867670+0000","last_peered":"2024-01-23T09:25:03.867670+0000","last_clean":"2024-01-23T09:25:03.867670+0000","last_became_active":"2024-01-23T08:54:42.149019+0000","last_became_peered":"2024-01-23T08:54:42.149019+0000","last_unstale":"2024-01-23T09:25:03.867670+0000","last_undegraded":"2024-01-23T09:25:03.867670+0000","last_fullsized":"2024-01-23T09:25:03.867670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"30'8","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:35.559232+0000","last_change":"2024-01-23T08:54:40.680243+0000","last_active":"2024-01-23T09:24:35.559232+0000","last_peered":"2024-01-23T09:24:35.559232+0000","last_clean":"2024-01-23T09:24:35.559232+0000","last_became_active":"2024-01-23T08:54:40.679839+0000","last_became_peered":"2024-01-23T08:54:40.679839+0000","last_unstale":"2024-01-23T09:24:35.559232+0000","last_undegraded":"2024-01-23T09:24:35.559232+0000","last_fullsized":"2024-01-23T09:24:35.559232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"30'52","reported_seq":90,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:54.728488+0000","last_change":"2024-01-23T08:55:47.750803+0000","last_active":"2024-01-23T09:23:54.728488+0000","last_peered":"2024-01-23T09:23:54.728488+0000","last_clean":"2024-01-23T09:23:54.728488+0000","last_became_active":"2024-01-23T08:55:47.749227+0000","last_became_peered":"2024-01-23T08:55:47.749227+0000","last_unstale":"2024-01-23T09:23:54.728488+0000","last_undegraded":"2024-01-23T09:23:54.728488+0000","last_fullsized":"2024-01-23T09:23:54.728488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:52:35.422787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":3470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,5],"acting":[6,7,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"30'22","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.609765+0000","last_change":"2024-01-23T08:54:42.108793+0000","last_active":"2024-01-23T09:25:03.609765+0000","last_peered":"2024-01-23T09:25:03.609765+0000","last_clean":"2024-01-23T09:25:03.609765+0000","last_became_active":"2024-01-23T08:54:42.108346+0000","last_became_peered":"2024-01-23T08:54:42.108346+0000","last_unstale":"2024-01-23T09:25:03.609765+0000","last_undegraded":"2024-01-23T09:25:03.609765+0000","last_fullsized":"2024-01-23T09:25:03.609765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:18:02.486206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"30'534","reported_seq":1088,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:00.345864+0000","last_change":"2024-01-23T08:54:40.708494+0000","last_active":"2024-01-23T09:25:00.345864+0000","last_peered":"2024-01-23T09:25:00.345864+0000","last_clean":"2024-01-23T09:25:00.345864+0000","last_became_active":"2024-01-23T08:54:40.707841+0000","last_became_peered":"2024-01-23T08:54:40.707841+0000","last_unstale":"2024-01-23T09:25:00.345864+0000","last_undegraded":"2024-01-23T09:25:00.345864+0000","last_fullsized":"2024-01-23T09:25:00.345864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":534,"log_dups_size":0,"ondisk_log_size":534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:53:17.764440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123944,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":519,"num_read_kb":542,"num_write":528,"num_write_kb":547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"30'72","reported_seq":101,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:55.538498+0000","last_change":"2024-01-23T08:54:49.738198+0000","last_active":"2024-01-23T09:23:55.538498+0000","last_peered":"2024-01-23T09:23:55.538498+0000","last_clean":"2024-01-23T09:23:55.538498+0000","last_became_active":"2024-01-23T08:54:49.737677+0000","last_became_peered":"2024-01-23T08:54:49.737677+0000","last_unstale":"2024-01-23T09:23:55.538498+0000","last_undegraded":"2024-01-23T09:23:55.538498+0000","last_fullsized":"2024-01-23T09:23:55.538498+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:57:26.436916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"30'12","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.591042+0000","last_change":"2024-01-23T08:54:42.228222+0000","last_active":"2024-01-23T09:25:03.591042+0000","last_peered":"2024-01-23T09:25:03.591042+0000","last_clean":"2024-01-23T09:25:03.591042+0000","last_became_active":"2024-01-23T08:54:42.227335+0000","last_became_peered":"2024-01-23T08:54:42.227335+0000","last_unstale":"2024-01-23T09:25:03.591042+0000","last_undegraded":"2024-01-23T09:25:03.591042+0000","last_fullsized":"2024-01-23T09:25:03.591042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:29:51.842390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"30'11","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:53.547065+0000","last_change":"2024-01-23T08:54:40.679852+0000","last_active":"2024-01-23T09:24:53.547065+0000","last_peered":"2024-01-23T09:24:53.547065+0000","last_clean":"2024-01-23T09:24:53.547065+0000","last_became_active":"2024-01-23T08:54:40.679467+0000","last_became_peered":"2024-01-23T08:54:40.679467+0000","last_unstale":"2024-01-23T09:24:53.547065+0000","last_undegraded":"2024-01-23T09:24:53.547065+0000","last_fullsized":"2024-01-23T09:24:53.547065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"30'96","reported_seq":125,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:57.955841+0000","last_change":"2024-01-23T08:54:49.730538+0000","last_active":"2024-01-23T09:23:57.955841+0000","last_peered":"2024-01-23T09:23:57.955841+0000","last_clean":"2024-01-23T09:23:57.955841+0000","last_became_active":"2024-01-23T08:54:49.729861+0000","last_became_peered":"2024-01-23T08:54:49.729861+0000","last_unstale":"2024-01-23T09:23:57.955841+0000","last_undegraded":"2024-01-23T09:23:57.955841+0000","last_fullsized":"2024-01-23T09:23:57.955841+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:46:36.583078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":9432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"30'21","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.718567+0000","last_change":"2024-01-23T08:54:42.196505+0000","last_active":"2024-01-23T09:25:03.718567+0000","last_peered":"2024-01-23T09:25:03.718567+0000","last_clean":"2024-01-23T09:25:03.718567+0000","last_became_active":"2024-01-23T08:54:42.195555+0000","last_became_peered":"2024-01-23T08:54:42.195555+0000","last_unstale":"2024-01-23T09:25:03.718567+0000","last_undegraded":"2024-01-23T09:25:03.718567+0000","last_fullsized":"2024-01-23T09:25:03.718567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:57:24.296384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"30'8","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:47.038761+0000","last_change":"2024-01-23T08:54:40.612594+0000","last_active":"2024-01-23T09:24:47.038761+0000","last_peered":"2024-01-23T09:24:47.038761+0000","last_clean":"2024-01-23T09:24:47.038761+0000","last_became_active":"2024-01-23T08:54:40.611932+0000","last_became_peered":"2024-01-23T08:54:40.611932+0000","last_unstale":"2024-01-23T09:24:47.038761+0000","last_undegraded":"2024-01-23T09:24:47.038761+0000","last_fullsized":"2024-01-23T09:24:47.038761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"30'119","reported_seq":199,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:15.768753+0000","last_change":"2024-01-23T09:25:15.768792+0000","last_active":"2024-01-23T09:25:15.768753+0000","last_peered":"2024-01-23T09:25:15.768753+0000","last_clean":"2024-01-23T09:25:15.768753+0000","last_became_active":"2024-01-23T08:54:01.490869+0000","last_became_peered":"2024-01-23T08:54:01.490869+0000","last_unstale":"2024-01-23T09:25:15.768753+0000","last_undegraded":"2024-01-23T09:25:15.768753+0000","last_fullsized":"2024-01-23T09:25:15.768753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'119","last_scrub_stamp":"2024-01-23T09:25:15.768666+0000","last_deep_scrub":"30'119","last_deep_scrub_stamp":"2024-01-23T09:25:15.768666+0000","last_clean_scrub_stamp":"2024-01-23T09:25:15.768666+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:08:16.784078+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"30'73","reported_seq":103,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:08.539819+0000","last_change":"2024-01-23T08:54:49.716297+0000","last_active":"2024-01-23T09:24:08.539819+0000","last_peered":"2024-01-23T09:24:08.539819+0000","last_clean":"2024-01-23T09:24:08.539819+0000","last_became_active":"2024-01-23T08:54:49.715231+0000","last_became_peered":"2024-01-23T08:54:49.715231+0000","last_unstale":"2024-01-23T09:24:08.539819+0000","last_undegraded":"2024-01-23T09:24:08.539819+0000","last_fullsized":"2024-01-23T09:24:08.539819+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"30'24","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.726166+0000","last_change":"2024-01-23T08:54:42.089174+0000","last_active":"2024-01-23T09:25:03.726166+0000","last_peered":"2024-01-23T09:25:03.726166+0000","last_clean":"2024-01-23T09:25:03.726166+0000","last_became_active":"2024-01-23T08:54:42.088303+0000","last_became_peered":"2024-01-23T08:54:42.088303+0000","last_unstale":"2024-01-23T09:25:03.726166+0000","last_undegraded":"2024-01-23T09:25:03.726166+0000","last_fullsized":"2024-01-23T09:25:03.726166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"30'9","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:53.537619+0000","last_change":"2024-01-23T08:54:40.690720+0000","last_active":"2024-01-23T09:24:53.537619+0000","last_peered":"2024-01-23T09:24:53.537619+0000","last_clean":"2024-01-23T09:24:53.537619+0000","last_became_active":"2024-01-23T08:54:40.689895+0000","last_became_peered":"2024-01-23T08:54:40.689895+0000","last_unstale":"2024-01-23T09:24:53.537619+0000","last_undegraded":"2024-01-23T09:24:53.537619+0000","last_fullsized":"2024-01-23T09:24:53.537619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:33:12.542607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1751,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"30'84","reported_seq":114,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:16.777947+0000","last_change":"2024-01-23T08:54:49.736539+0000","last_active":"2024-01-23T09:25:16.777947+0000","last_peered":"2024-01-23T09:25:16.777947+0000","last_clean":"2024-01-23T09:25:16.777947+0000","last_became_active":"2024-01-23T08:54:49.735777+0000","last_became_peered":"2024-01-23T08:54:49.735777+0000","last_unstale":"2024-01-23T09:25:16.777947+0000","last_undegraded":"2024-01-23T09:25:16.777947+0000","last_fullsized":"2024-01-23T09:25:16.777947+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":8939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'22","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.870785+0000","last_change":"2024-01-23T08:54:42.107066+0000","last_active":"2024-01-23T09:25:03.870785+0000","last_peered":"2024-01-23T09:25:03.870785+0000","last_clean":"2024-01-23T09:25:03.870785+0000","last_became_active":"2024-01-23T08:54:42.106757+0000","last_became_peered":"2024-01-23T08:54:42.106757+0000","last_unstale":"2024-01-23T09:25:03.870785+0000","last_undegraded":"2024-01-23T09:25:03.870785+0000","last_fullsized":"2024-01-23T09:25:03.870785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"30'7","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:46.123009+0000","last_change":"2024-01-23T08:54:40.687942+0000","last_active":"2024-01-23T09:24:46.123009+0000","last_peered":"2024-01-23T09:24:46.123009+0000","last_clean":"2024-01-23T09:24:46.123009+0000","last_became_active":"2024-01-23T08:54:40.686860+0000","last_became_peered":"2024-01-23T08:54:40.686860+0000","last_unstale":"2024-01-23T09:24:46.123009+0000","last_undegraded":"2024-01-23T09:24:46.123009+0000","last_fullsized":"2024-01-23T09:24:46.123009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:04:57.766717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'92","reported_seq":120,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:55.592422+0000","last_change":"2024-01-23T08:54:49.727416+0000","last_active":"2024-01-23T09:23:55.592422+0000","last_peered":"2024-01-23T09:23:55.592422+0000","last_clean":"2024-01-23T09:23:55.592422+0000","last_became_active":"2024-01-23T08:54:49.721494+0000","last_became_peered":"2024-01-23T08:54:49.721494+0000","last_unstale":"2024-01-23T09:23:55.592422+0000","last_undegraded":"2024-01-23T09:23:55.592422+0000","last_fullsized":"2024-01-23T09:23:55.592422+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:52:20.767279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":9285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"30'25","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.873923+0000","last_change":"2024-01-23T08:54:42.117785+0000","last_active":"2024-01-23T09:25:03.873923+0000","last_peered":"2024-01-23T09:25:03.873923+0000","last_clean":"2024-01-23T09:25:03.873923+0000","last_became_active":"2024-01-23T08:54:42.117317+0000","last_became_peered":"2024-01-23T08:54:42.117317+0000","last_unstale":"2024-01-23T09:25:03.873923+0000","last_undegraded":"2024-01-23T09:25:03.873923+0000","last_fullsized":"2024-01-23T09:25:03.873923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"30'7","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:19.375993+0000","last_change":"2024-01-23T08:54:40.682656+0000","last_active":"2024-01-23T09:24:19.375993+0000","last_peered":"2024-01-23T09:24:19.375993+0000","last_clean":"2024-01-23T09:24:19.375993+0000","last_became_active":"2024-01-23T08:54:40.681954+0000","last_became_peered":"2024-01-23T08:54:40.681954+0000","last_unstale":"2024-01-23T09:24:19.375993+0000","last_undegraded":"2024-01-23T09:24:19.375993+0000","last_fullsized":"2024-01-23T09:24:19.375993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:20:41.553582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"30'57","reported_seq":87,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:08.550075+0000","last_change":"2024-01-23T08:54:49.716316+0000","last_active":"2024-01-23T09:25:08.550075+0000","last_peered":"2024-01-23T09:25:08.550075+0000","last_clean":"2024-01-23T09:25:08.550075+0000","last_became_active":"2024-01-23T08:54:49.715917+0000","last_became_peered":"2024-01-23T08:54:49.715917+0000","last_unstale":"2024-01-23T09:25:08.550075+0000","last_undegraded":"2024-01-23T09:25:08.550075+0000","last_fullsized":"2024-01-23T09:25:08.550075+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":5210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"30'17","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.757357+0000","last_change":"2024-01-23T08:54:42.158814+0000","last_active":"2024-01-23T09:25:03.757357+0000","last_peered":"2024-01-23T09:25:03.757357+0000","last_clean":"2024-01-23T09:25:03.757357+0000","last_became_active":"2024-01-23T08:54:42.155411+0000","last_became_peered":"2024-01-23T08:54:42.155411+0000","last_unstale":"2024-01-23T09:25:03.757357+0000","last_undegraded":"2024-01-23T09:25:03.757357+0000","last_fullsized":"2024-01-23T09:25:03.757357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"30'5","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:48.166835+0000","last_change":"2024-01-23T08:54:40.696522+0000","last_active":"2024-01-23T09:24:48.166835+0000","last_peered":"2024-01-23T09:24:48.166835+0000","last_clean":"2024-01-23T09:24:48.166835+0000","last_became_active":"2024-01-23T08:54:40.696128+0000","last_became_peered":"2024-01-23T08:54:40.696128+0000","last_unstale":"2024-01-23T09:24:48.166835+0000","last_undegraded":"2024-01-23T09:24:48.166835+0000","last_fullsized":"2024-01-23T09:24:48.166835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"30'112","reported_seq":142,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:08.788035+0000","last_change":"2024-01-23T08:54:49.724660+0000","last_active":"2024-01-23T09:25:08.788035+0000","last_peered":"2024-01-23T09:25:08.788035+0000","last_clean":"2024-01-23T09:25:08.788035+0000","last_became_active":"2024-01-23T08:54:49.723038+0000","last_became_peered":"2024-01-23T08:54:49.723038+0000","last_unstale":"2024-01-23T09:25:08.788035+0000","last_undegraded":"2024-01-23T09:25:08.788035+0000","last_fullsized":"2024-01-23T09:25:08.788035+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":12618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"30'22","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.726169+0000","last_change":"2024-01-23T08:54:42.149978+0000","last_active":"2024-01-23T09:25:03.726169+0000","last_peered":"2024-01-23T09:25:03.726169+0000","last_clean":"2024-01-23T09:25:03.726169+0000","last_became_active":"2024-01-23T08:54:42.149180+0000","last_became_peered":"2024-01-23T08:54:42.149180+0000","last_unstale":"2024-01-23T09:25:03.726169+0000","last_undegraded":"2024-01-23T09:25:03.726169+0000","last_fullsized":"2024-01-23T09:25:03.726169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"30'22","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:00.353895+0000","last_change":"2024-01-23T08:54:40.699997+0000","last_active":"2024-01-23T09:25:00.353895+0000","last_peered":"2024-01-23T09:25:00.353895+0000","last_clean":"2024-01-23T09:25:00.353895+0000","last_became_active":"2024-01-23T08:54:40.699246+0000","last_became_peered":"2024-01-23T08:54:40.699246+0000","last_unstale":"2024-01-23T09:25:00.353895+0000","last_undegraded":"2024-01-23T09:25:00.353895+0000","last_fullsized":"2024-01-23T09:25:00.353895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:19:24.486048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"30'97","reported_seq":124,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:54.636016+0000","last_change":"2024-01-23T08:54:49.729218+0000","last_active":"2024-01-23T09:23:54.636016+0000","last_peered":"2024-01-23T09:23:54.636016+0000","last_clean":"2024-01-23T09:23:54.636016+0000","last_became_active":"2024-01-23T08:54:49.728448+0000","last_became_peered":"2024-01-23T08:54:49.728448+0000","last_unstale":"2024-01-23T09:23:54.636016+0000","last_undegraded":"2024-01-23T09:23:54.636016+0000","last_fullsized":"2024-01-23T09:23:54.636016+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:56:52.671943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":7067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"30'23","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:17.766169+0000","last_change":"2024-01-23T09:25:17.766225+0000","last_active":"2024-01-23T09:25:17.766169+0000","last_peered":"2024-01-23T09:25:17.766169+0000","last_clean":"2024-01-23T09:25:17.766169+0000","last_became_active":"2024-01-23T08:54:42.087328+0000","last_became_peered":"2024-01-23T08:54:42.087328+0000","last_unstale":"2024-01-23T09:25:17.766169+0000","last_undegraded":"2024-01-23T09:25:17.766169+0000","last_fullsized":"2024-01-23T09:25:17.766169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'23","last_scrub_stamp":"2024-01-23T09:25:17.766025+0000","last_deep_scrub":"30'23","last_deep_scrub_stamp":"2024-01-23T09:25:17.766025+0000","last_clean_scrub_stamp":"2024-01-23T09:25:17.766025+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:19:01.754874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"30'11","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.594257+0000","last_change":"2024-01-23T08:54:40.693906+0000","last_active":"2024-01-23T09:25:03.594257+0000","last_peered":"2024-01-23T09:25:03.594257+0000","last_clean":"2024-01-23T09:25:03.594257+0000","last_became_active":"2024-01-23T08:54:40.693530+0000","last_became_peered":"2024-01-23T08:54:40.693530+0000","last_unstale":"2024-01-23T09:25:03.594257+0000","last_undegraded":"2024-01-23T09:25:03.594257+0000","last_fullsized":"2024-01-23T09:25:03.594257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"30'73","reported_seq":109,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:54.780082+0000","last_change":"2024-01-23T08:55:47.750297+0000","last_active":"2024-01-23T09:23:54.780082+0000","last_peered":"2024-01-23T09:23:54.780082+0000","last_clean":"2024-01-23T09:23:54.780082+0000","last_became_active":"2024-01-23T08:55:47.749074+0000","last_became_peered":"2024-01-23T08:55:47.749074+0000","last_unstale":"2024-01-23T09:23:54.780082+0000","last_undegraded":"2024-01-23T09:23:54.780082+0000","last_fullsized":"2024-01-23T09:23:54.780082+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:29:47.219931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":8234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,6,4],"acting":[5,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'36","reported_seq":78,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:18.293208+0000","last_change":"2024-01-23T09:25:18.293250+0000","last_active":"2024-01-23T09:25:18.293208+0000","last_peered":"2024-01-23T09:25:18.293208+0000","last_clean":"2024-01-23T09:25:18.293208+0000","last_became_active":"2024-01-23T08:54:42.108253+0000","last_became_peered":"2024-01-23T08:54:42.108253+0000","last_unstale":"2024-01-23T09:25:18.293208+0000","last_undegraded":"2024-01-23T09:25:18.293208+0000","last_fullsized":"2024-01-23T09:25:18.293208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'36","last_scrub_stamp":"2024-01-23T09:25:18.293105+0000","last_deep_scrub":"30'36","last_deep_scrub_stamp":"2024-01-23T09:25:18.293105+0000","last_clean_scrub_stamp":"2024-01-23T09:25:18.293105+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:42:38.839525+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"30'11","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.549079+0000","last_change":"2024-01-23T08:54:40.696080+0000","last_active":"2024-01-23T09:25:03.549079+0000","last_peered":"2024-01-23T09:25:03.549079+0000","last_clean":"2024-01-23T09:25:03.549079+0000","last_became_active":"2024-01-23T08:54:40.695699+0000","last_became_peered":"2024-01-23T08:54:40.695699+0000","last_unstale":"2024-01-23T09:25:03.549079+0000","last_undegraded":"2024-01-23T09:25:03.549079+0000","last_fullsized":"2024-01-23T09:25:03.549079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"30'63","reported_seq":90,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:51.986229+0000","last_change":"2024-01-23T08:54:49.740480+0000","last_active":"2024-01-23T09:23:51.986229+0000","last_peered":"2024-01-23T09:23:51.986229+0000","last_clean":"2024-01-23T09:23:51.986229+0000","last_became_active":"2024-01-23T08:54:49.739524+0000","last_became_peered":"2024-01-23T08:54:49.739524+0000","last_unstale":"2024-01-23T09:23:51.986229+0000","last_undegraded":"2024-01-23T09:23:51.986229+0000","last_fullsized":"2024-01-23T09:23:51.986229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:45:25.447987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":7121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.588272+0000","last_change":"2024-01-23T08:54:42.230659+0000","last_active":"2024-01-23T09:25:03.588272+0000","last_peered":"2024-01-23T09:25:03.588272+0000","last_clean":"2024-01-23T09:25:03.588272+0000","last_became_active":"2024-01-23T08:54:42.229952+0000","last_became_peered":"2024-01-23T08:54:42.229952+0000","last_unstale":"2024-01-23T09:25:03.588272+0000","last_undegraded":"2024-01-23T09:25:03.588272+0000","last_fullsized":"2024-01-23T09:25:03.588272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:41:53.265527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"30'14","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:30.107136+0000","last_change":"2024-01-23T08:54:40.698779+0000","last_active":"2024-01-23T09:24:30.107136+0000","last_peered":"2024-01-23T09:24:30.107136+0000","last_clean":"2024-01-23T09:24:30.107136+0000","last_became_active":"2024-01-23T08:54:40.698059+0000","last_became_peered":"2024-01-23T08:54:40.698059+0000","last_unstale":"2024-01-23T09:24:30.107136+0000","last_undegraded":"2024-01-23T09:24:30.107136+0000","last_fullsized":"2024-01-23T09:24:30.107136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:24:40.655839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"30'67","reported_seq":95,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:55.586381+0000","last_change":"2024-01-23T08:54:49.708388+0000","last_active":"2024-01-23T09:23:55.586381+0000","last_peered":"2024-01-23T09:23:55.586381+0000","last_clean":"2024-01-23T09:23:55.586381+0000","last_became_active":"2024-01-23T08:54:49.707837+0000","last_became_peered":"2024-01-23T08:54:49.707837+0000","last_unstale":"2024-01-23T09:23:55.586381+0000","last_undegraded":"2024-01-23T09:23:55.586381+0000","last_fullsized":"2024-01-23T09:23:55.586381+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":5283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'21","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.867965+0000","last_change":"2024-01-23T08:54:42.229836+0000","last_active":"2024-01-23T09:25:03.867965+0000","last_peered":"2024-01-23T09:25:03.867965+0000","last_clean":"2024-01-23T09:25:03.867965+0000","last_became_active":"2024-01-23T08:54:42.229252+0000","last_became_peered":"2024-01-23T08:54:42.229252+0000","last_unstale":"2024-01-23T09:25:03.867965+0000","last_undegraded":"2024-01-23T09:25:03.867965+0000","last_fullsized":"2024-01-23T09:25:03.867965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"30'838","reported_seq":881,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:17.160368+0000","last_change":"2024-01-23T09:25:17.160407+0000","last_active":"2024-01-23T09:25:17.160368+0000","last_peered":"2024-01-23T09:25:17.160368+0000","last_clean":"2024-01-23T09:25:17.160368+0000","last_became_active":"2024-01-23T08:54:40.657711+0000","last_became_peered":"2024-01-23T08:54:40.657711+0000","last_unstale":"2024-01-23T09:25:17.160368+0000","last_undegraded":"2024-01-23T09:25:17.160368+0000","last_fullsized":"2024-01-23T09:25:17.160368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'838","last_scrub_stamp":"2024-01-23T09:25:17.160297+0000","last_deep_scrub":"30'838","last_deep_scrub_stamp":"2024-01-23T09:25:17.160297+0000","last_clean_scrub_stamp":"2024-01-23T09:25:17.160297+0000","objects_scrubbed":6,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:26:03.412965+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":833,"num_write_kb":4568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"30'86","reported_seq":114,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:58.839813+0000","last_change":"2024-01-23T08:54:49.737210+0000","last_active":"2024-01-23T09:23:58.839813+0000","last_peered":"2024-01-23T09:23:58.839813+0000","last_clean":"2024-01-23T09:23:58.839813+0000","last_became_active":"2024-01-23T08:54:49.735023+0000","last_became_peered":"2024-01-23T08:54:49.735023+0000","last_unstale":"2024-01-23T09:23:58.839813+0000","last_undegraded":"2024-01-23T09:23:58.839813+0000","last_fullsized":"2024-01-23T09:23:58.839813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:27.015436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":9278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"30'25","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:13.551032+0000","last_change":"2024-01-23T08:54:42.154453+0000","last_active":"2024-01-23T09:25:13.551032+0000","last_peered":"2024-01-23T09:25:13.551032+0000","last_clean":"2024-01-23T09:25:13.551032+0000","last_became_active":"2024-01-23T08:54:42.153735+0000","last_became_peered":"2024-01-23T08:54:42.153735+0000","last_unstale":"2024-01-23T09:25:13.551032+0000","last_undegraded":"2024-01-23T09:25:13.551032+0000","last_fullsized":"2024-01-23T09:25:13.551032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"30'361","reported_seq":394,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:54.303102+0000","last_change":"2024-01-23T08:54:40.702888+0000","last_active":"2024-01-23T09:24:54.303102+0000","last_peered":"2024-01-23T09:24:54.303102+0000","last_clean":"2024-01-23T09:24:54.303102+0000","last_became_active":"2024-01-23T08:54:40.701827+0000","last_became_peered":"2024-01-23T08:54:40.701827+0000","last_unstale":"2024-01-23T09:24:54.303102+0000","last_undegraded":"2024-01-23T09:24:54.303102+0000","last_fullsized":"2024-01-23T09:24:54.303102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:18:17.748052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"30'124","reported_seq":153,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:08.621558+0000","last_change":"2024-01-23T08:54:49.736262+0000","last_active":"2024-01-23T09:25:08.621558+0000","last_peered":"2024-01-23T09:25:08.621558+0000","last_clean":"2024-01-23T09:25:08.621558+0000","last_became_active":"2024-01-23T08:54:49.735765+0000","last_became_peered":"2024-01-23T08:54:49.735765+0000","last_unstale":"2024-01-23T09:25:08.621558+0000","last_undegraded":"2024-01-23T09:25:08.621558+0000","last_fullsized":"2024-01-23T09:25:08.621558+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":11379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"30'28","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.616372+0000","last_change":"2024-01-23T08:54:42.071292+0000","last_active":"2024-01-23T09:25:03.616372+0000","last_peered":"2024-01-23T09:25:03.616372+0000","last_clean":"2024-01-23T09:25:03.616372+0000","last_became_active":"2024-01-23T08:54:42.070703+0000","last_became_peered":"2024-01-23T08:54:42.070703+0000","last_unstale":"2024-01-23T09:25:03.616372+0000","last_undegraded":"2024-01-23T09:25:03.616372+0000","last_fullsized":"2024-01-23T09:25:03.616372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:37.410041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"30'6","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:31.116683+0000","last_change":"2024-01-23T08:54:40.687946+0000","last_active":"2024-01-23T09:24:31.116683+0000","last_peered":"2024-01-23T09:24:31.116683+0000","last_clean":"2024-01-23T09:24:31.116683+0000","last_became_active":"2024-01-23T08:54:40.687656+0000","last_became_peered":"2024-01-23T08:54:40.687656+0000","last_unstale":"2024-01-23T09:24:31.116683+0000","last_undegraded":"2024-01-23T09:24:31.116683+0000","last_fullsized":"2024-01-23T09:24:31.116683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'70","reported_seq":98,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:41.205524+0000","last_change":"2024-01-23T08:54:49.729434+0000","last_active":"2024-01-23T09:23:41.205524+0000","last_peered":"2024-01-23T09:23:41.205524+0000","last_clean":"2024-01-23T09:23:41.205524+0000","last_became_active":"2024-01-23T08:54:49.728191+0000","last_became_peered":"2024-01-23T08:54:49.728191+0000","last_unstale":"2024-01-23T09:23:41.205524+0000","last_undegraded":"2024-01-23T09:23:41.205524+0000","last_fullsized":"2024-01-23T09:23:41.205524+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:30:27.390400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":6489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"30'28","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:18.151732+0000","last_change":"2024-01-23T09:25:18.151755+0000","last_active":"2024-01-23T09:25:18.151732+0000","last_peered":"2024-01-23T09:25:18.151732+0000","last_clean":"2024-01-23T09:25:18.151732+0000","last_became_active":"2024-01-23T08:54:42.153539+0000","last_became_peered":"2024-01-23T08:54:42.153539+0000","last_unstale":"2024-01-23T09:25:18.151732+0000","last_undegraded":"2024-01-23T09:25:18.151732+0000","last_fullsized":"2024-01-23T09:25:18.151732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2024-01-23T09:25:18.151656+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2024-01-23T09:25:18.151656+0000","last_clean_scrub_stamp":"2024-01-23T09:25:18.151656+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:37:55.811976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"30'13","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:16.762509+0000","last_change":"2024-01-23T09:25:16.762573+0000","last_active":"2024-01-23T09:25:16.762509+0000","last_peered":"2024-01-23T09:25:16.762509+0000","last_clean":"2024-01-23T09:25:16.762509+0000","last_became_active":"2024-01-23T08:54:40.682765+0000","last_became_peered":"2024-01-23T08:54:40.682765+0000","last_unstale":"2024-01-23T09:25:16.762509+0000","last_undegraded":"2024-01-23T09:25:16.762509+0000","last_fullsized":"2024-01-23T09:25:16.762509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'13","last_scrub_stamp":"2024-01-23T09:25:16.762362+0000","last_deep_scrub":"30'13","last_deep_scrub_stamp":"2024-01-23T09:25:16.762362+0000","last_clean_scrub_stamp":"2024-01-23T09:25:16.762362+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:53:52.249532+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"30'72","reported_seq":100,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:57.975282+0000","last_change":"2024-01-23T08:54:49.728962+0000","last_active":"2024-01-23T09:23:57.975282+0000","last_peered":"2024-01-23T09:23:57.975282+0000","last_clean":"2024-01-23T09:23:57.975282+0000","last_became_active":"2024-01-23T08:54:49.724121+0000","last_became_peered":"2024-01-23T08:54:49.724121+0000","last_unstale":"2024-01-23T09:23:57.975282+0000","last_undegraded":"2024-01-23T09:23:57.975282+0000","last_fullsized":"2024-01-23T09:23:57.975282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:07:14.188947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":8509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"30'65","reported_seq":95,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:54.910192+0000","last_change":"2024-01-23T08:54:49.735678+0000","last_active":"2024-01-23T09:23:54.910192+0000","last_peered":"2024-01-23T09:23:54.910192+0000","last_clean":"2024-01-23T09:23:54.910192+0000","last_became_active":"2024-01-23T08:54:49.732632+0000","last_became_peered":"2024-01-23T08:54:49.732632+0000","last_unstale":"2024-01-23T09:23:54.910192+0000","last_undegraded":"2024-01-23T09:23:54.910192+0000","last_fullsized":"2024-01-23T09:23:54.910192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:22:54.463072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":5816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"30'26","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.753551+0000","last_change":"2024-01-23T08:54:42.196434+0000","last_active":"2024-01-23T09:25:03.753551+0000","last_peered":"2024-01-23T09:25:03.753551+0000","last_clean":"2024-01-23T09:25:03.753551+0000","last_became_active":"2024-01-23T08:54:42.195570+0000","last_became_peered":"2024-01-23T08:54:42.195570+0000","last_unstale":"2024-01-23T09:25:03.753551+0000","last_undegraded":"2024-01-23T09:25:03.753551+0000","last_fullsized":"2024-01-23T09:25:03.753551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:04:44.856358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"30'6","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:35.511319+0000","last_change":"2024-01-23T08:54:40.678920+0000","last_active":"2024-01-23T09:24:35.511319+0000","last_peered":"2024-01-23T09:24:35.511319+0000","last_clean":"2024-01-23T09:24:35.511319+0000","last_became_active":"2024-01-23T08:54:40.678527+0000","last_became_peered":"2024-01-23T08:54:40.678527+0000","last_unstale":"2024-01-23T09:24:35.511319+0000","last_undegraded":"2024-01-23T09:24:35.511319+0000","last_fullsized":"2024-01-23T09:24:35.511319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'89","reported_seq":119,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:58.537641+0000","last_change":"2024-01-23T08:54:49.719401+0000","last_active":"2024-01-23T09:23:58.537641+0000","last_peered":"2024-01-23T09:23:58.537641+0000","last_clean":"2024-01-23T09:23:58.537641+0000","last_became_active":"2024-01-23T08:54:49.717116+0000","last_became_peered":"2024-01-23T08:54:49.717116+0000","last_unstale":"2024-01-23T09:23:58.537641+0000","last_undegraded":"2024-01-23T09:23:58.537641+0000","last_fullsized":"2024-01-23T09:23:58.537641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":12319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"30'30","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.632552+0000","last_change":"2024-01-23T08:54:42.235843+0000","last_active":"2024-01-23T09:25:03.632552+0000","last_peered":"2024-01-23T09:25:03.632552+0000","last_clean":"2024-01-23T09:25:03.632552+0000","last_became_active":"2024-01-23T08:54:42.235116+0000","last_became_peered":"2024-01-23T08:54:42.235116+0000","last_unstale":"2024-01-23T09:25:03.632552+0000","last_undegraded":"2024-01-23T09:25:03.632552+0000","last_fullsized":"2024-01-23T09:25:03.632552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:43:27.674658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"30'7","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:31.174876+0000","last_change":"2024-01-23T08:54:40.690150+0000","last_active":"2024-01-23T09:24:31.174876+0000","last_peered":"2024-01-23T09:24:31.174876+0000","last_clean":"2024-01-23T09:24:31.174876+0000","last_became_active":"2024-01-23T08:54:40.689433+0000","last_became_peered":"2024-01-23T08:54:40.689433+0000","last_unstale":"2024-01-23T09:24:31.174876+0000","last_undegraded":"2024-01-23T09:24:31.174876+0000","last_fullsized":"2024-01-23T09:24:31.174876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:35:11.315349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"30'511","reported_seq":545,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:43.545458+0000","last_change":"2024-01-23T08:54:40.686731+0000","last_active":"2024-01-23T09:24:43.545458+0000","last_peered":"2024-01-23T09:24:43.545458+0000","last_clean":"2024-01-23T09:24:43.545458+0000","last_became_active":"2024-01-23T08:54:40.686371+0000","last_became_peered":"2024-01-23T08:54:40.686371+0000","last_unstale":"2024-01-23T09:24:43.545458+0000","last_undegraded":"2024-01-23T09:24:43.545458+0000","last_fullsized":"2024-01-23T09:24:43.545458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":507,"num_write_kb":4372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"30'22","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.736889+0000","last_change":"2024-01-23T08:54:42.200428+0000","last_active":"2024-01-23T09:25:03.736889+0000","last_peered":"2024-01-23T09:25:03.736889+0000","last_clean":"2024-01-23T09:25:03.736889+0000","last_became_active":"2024-01-23T08:54:42.198648+0000","last_became_peered":"2024-01-23T08:54:42.198648+0000","last_unstale":"2024-01-23T09:25:03.736889+0000","last_undegraded":"2024-01-23T09:25:03.736889+0000","last_fullsized":"2024-01-23T09:25:03.736889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:45:11.802421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"30'54","reported_seq":81,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:54.793810+0000","last_change":"2024-01-23T08:54:49.742269+0000","last_active":"2024-01-23T09:23:54.793810+0000","last_peered":"2024-01-23T09:23:54.793810+0000","last_clean":"2024-01-23T09:23:54.793810+0000","last_became_active":"2024-01-23T08:54:49.741692+0000","last_became_peered":"2024-01-23T08:54:49.741692+0000","last_unstale":"2024-01-23T09:23:54.793810+0000","last_undegraded":"2024-01-23T09:23:54.793810+0000","last_fullsized":"2024-01-23T09:23:54.793810+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:25:45.278144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":4034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"30'585","reported_seq":618,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:47.051020+0000","last_change":"2024-01-23T08:54:40.687352+0000","last_active":"2024-01-23T09:24:47.051020+0000","last_peered":"2024-01-23T09:24:47.051020+0000","last_clean":"2024-01-23T09:24:47.051020+0000","last_became_active":"2024-01-23T08:54:40.686125+0000","last_became_peered":"2024-01-23T08:54:40.686125+0000","last_unstale":"2024-01-23T09:24:47.051020+0000","last_undegraded":"2024-01-23T09:24:47.051020+0000","last_fullsized":"2024-01-23T09:24:47.051020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:39.101885+0000","last_clean_scrub_stamp":"2024-01-23T08:54:39.101885+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:38:41.311580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195507,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":4397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"30'19","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:18.732089+0000","last_change":"2024-01-23T09:25:18.732145+0000","last_active":"2024-01-23T09:25:18.732089+0000","last_peered":"2024-01-23T09:25:18.732089+0000","last_clean":"2024-01-23T09:25:18.732089+0000","last_became_active":"2024-01-23T08:54:42.089826+0000","last_became_peered":"2024-01-23T08:54:42.089826+0000","last_unstale":"2024-01-23T09:25:18.732089+0000","last_undegraded":"2024-01-23T09:25:18.732089+0000","last_fullsized":"2024-01-23T09:25:18.732089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2024-01-23T09:25:18.731941+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2024-01-23T09:25:18.731941+0000","last_clean_scrub_stamp":"2024-01-23T09:25:18.731941+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:17:03.716474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"30'96","reported_seq":120,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:54.888109+0000","last_change":"2024-01-23T08:55:47.749137+0000","last_active":"2024-01-23T09:23:54.888109+0000","last_peered":"2024-01-23T09:23:54.888109+0000","last_clean":"2024-01-23T09:23:54.888109+0000","last_became_active":"2024-01-23T08:55:47.747327+0000","last_became_peered":"2024-01-23T08:55:47.747327+0000","last_unstale":"2024-01-23T09:23:54.888109+0000","last_undegraded":"2024-01-23T09:23:54.888109+0000","last_fullsized":"2024-01-23T09:23:54.888109+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":8062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"30'35","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.753116+0000","last_change":"2024-01-23T08:54:42.228128+0000","last_active":"2024-01-23T09:25:03.753116+0000","last_peered":"2024-01-23T09:25:03.753116+0000","last_clean":"2024-01-23T09:25:03.753116+0000","last_became_active":"2024-01-23T08:54:42.227421+0000","last_became_peered":"2024-01-23T08:54:42.227421+0000","last_unstale":"2024-01-23T09:25:03.753116+0000","last_undegraded":"2024-01-23T09:25:03.753116+0000","last_fullsized":"2024-01-23T09:25:03.753116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"30'25","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.639997+0000","last_change":"2024-01-23T08:54:42.112162+0000","last_active":"2024-01-23T09:25:03.639997+0000","last_peered":"2024-01-23T09:25:03.639997+0000","last_clean":"2024-01-23T09:25:03.639997+0000","last_became_active":"2024-01-23T08:54:42.111635+0000","last_became_peered":"2024-01-23T08:54:42.111635+0000","last_unstale":"2024-01-23T09:25:03.639997+0000","last_undegraded":"2024-01-23T09:25:03.639997+0000","last_fullsized":"2024-01-23T09:25:03.639997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:13:11.423278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"30'28","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.723357+0000","last_change":"2024-01-23T08:54:42.069982+0000","last_active":"2024-01-23T09:25:03.723357+0000","last_peered":"2024-01-23T09:25:03.723357+0000","last_clean":"2024-01-23T09:25:03.723357+0000","last_became_active":"2024-01-23T08:54:42.069262+0000","last_became_peered":"2024-01-23T08:54:42.069262+0000","last_unstale":"2024-01-23T09:25:03.723357+0000","last_undegraded":"2024-01-23T09:25:03.723357+0000","last_fullsized":"2024-01-23T09:25:03.723357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"30'23","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.630718+0000","last_change":"2024-01-23T08:54:42.108709+0000","last_active":"2024-01-23T09:25:03.630718+0000","last_peered":"2024-01-23T09:25:03.630718+0000","last_clean":"2024-01-23T09:25:03.630718+0000","last_became_active":"2024-01-23T08:54:42.107985+0000","last_became_peered":"2024-01-23T08:54:42.107985+0000","last_unstale":"2024-01-23T09:25:03.630718+0000","last_undegraded":"2024-01-23T09:25:03.630718+0000","last_fullsized":"2024-01-23T09:25:03.630718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:27:28.770059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"30'17","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.599762+0000","last_change":"2024-01-23T08:54:42.229100+0000","last_active":"2024-01-23T09:25:03.599762+0000","last_peered":"2024-01-23T09:25:03.599762+0000","last_clean":"2024-01-23T09:25:03.599762+0000","last_became_active":"2024-01-23T08:54:42.227918+0000","last_became_peered":"2024-01-23T08:54:42.227918+0000","last_unstale":"2024-01-23T09:25:03.599762+0000","last_undegraded":"2024-01-23T09:25:03.599762+0000","last_fullsized":"2024-01-23T09:25:03.599762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:54:47.705445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"30'20","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.584500+0000","last_change":"2024-01-23T08:54:42.231357+0000","last_active":"2024-01-23T09:25:03.584500+0000","last_peered":"2024-01-23T09:25:03.584500+0000","last_clean":"2024-01-23T09:25:03.584500+0000","last_became_active":"2024-01-23T08:54:42.230615+0000","last_became_peered":"2024-01-23T08:54:42.230615+0000","last_unstale":"2024-01-23T09:25:03.584500+0000","last_undegraded":"2024-01-23T09:25:03.584500+0000","last_fullsized":"2024-01-23T09:25:03.584500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:12:12.757498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"30'35","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.757001+0000","last_change":"2024-01-23T08:54:42.158739+0000","last_active":"2024-01-23T09:25:03.757001+0000","last_peered":"2024-01-23T09:25:03.757001+0000","last_clean":"2024-01-23T09:25:03.757001+0000","last_became_active":"2024-01-23T08:54:42.157106+0000","last_became_peered":"2024-01-23T08:54:42.157106+0000","last_unstale":"2024-01-23T09:25:03.757001+0000","last_undegraded":"2024-01-23T09:25:03.757001+0000","last_fullsized":"2024-01-23T09:25:03.757001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"30'20","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.609816+0000","last_change":"2024-01-23T08:54:42.092942+0000","last_active":"2024-01-23T09:25:03.609816+0000","last_peered":"2024-01-23T09:25:03.609816+0000","last_clean":"2024-01-23T09:25:03.609816+0000","last_became_active":"2024-01-23T08:54:42.092149+0000","last_became_peered":"2024-01-23T08:54:42.092149+0000","last_unstale":"2024-01-23T09:25:03.609816+0000","last_undegraded":"2024-01-23T09:25:03.609816+0000","last_fullsized":"2024-01-23T09:25:03.609816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:10:19.147334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"30'19","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:13.550946+0000","last_change":"2024-01-23T08:54:42.069948+0000","last_active":"2024-01-23T09:25:13.550946+0000","last_peered":"2024-01-23T09:25:13.550946+0000","last_clean":"2024-01-23T09:25:13.550946+0000","last_became_active":"2024-01-23T08:54:42.069305+0000","last_became_peered":"2024-01-23T08:54:42.069305+0000","last_unstale":"2024-01-23T09:25:13.550946+0000","last_undegraded":"2024-01-23T09:25:13.550946+0000","last_fullsized":"2024-01-23T09:25:13.550946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"30'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.626304+0000","last_change":"2024-01-23T08:54:42.158120+0000","last_active":"2024-01-23T09:25:03.626304+0000","last_peered":"2024-01-23T09:25:03.626304+0000","last_clean":"2024-01-23T09:25:03.626304+0000","last_became_active":"2024-01-23T08:54:42.157647+0000","last_became_peered":"2024-01-23T08:54:42.157647+0000","last_unstale":"2024-01-23T09:25:03.626304+0000","last_undegraded":"2024-01-23T09:25:03.626304+0000","last_fullsized":"2024-01-23T09:25:03.626304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:28:50.107504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"30'28","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.700746+0000","last_change":"2024-01-23T08:54:42.119253+0000","last_active":"2024-01-23T09:25:03.700746+0000","last_peered":"2024-01-23T09:25:03.700746+0000","last_clean":"2024-01-23T09:25:03.700746+0000","last_became_active":"2024-01-23T08:54:42.118528+0000","last_became_peered":"2024-01-23T08:54:42.118528+0000","last_unstale":"2024-01-23T09:25:03.700746+0000","last_undegraded":"2024-01-23T09:25:03.700746+0000","last_fullsized":"2024-01-23T09:25:03.700746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"30'35","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.736189+0000","last_change":"2024-01-23T08:54:42.197561+0000","last_active":"2024-01-23T09:25:03.736189+0000","last_peered":"2024-01-23T09:25:03.736189+0000","last_clean":"2024-01-23T09:25:03.736189+0000","last_became_active":"2024-01-23T08:54:42.196809+0000","last_became_peered":"2024-01-23T08:54:42.196809+0000","last_unstale":"2024-01-23T09:25:03.736189+0000","last_undegraded":"2024-01-23T09:25:03.736189+0000","last_fullsized":"2024-01-23T09:25:03.736189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:16:34.046447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"30'27","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:16.030305+0000","last_change":"2024-01-23T09:25:16.030364+0000","last_active":"2024-01-23T09:25:16.030305+0000","last_peered":"2024-01-23T09:25:16.030305+0000","last_clean":"2024-01-23T09:25:16.030305+0000","last_became_active":"2024-01-23T08:54:42.111207+0000","last_became_peered":"2024-01-23T08:54:42.111207+0000","last_unstale":"2024-01-23T09:25:16.030305+0000","last_undegraded":"2024-01-23T09:25:16.030305+0000","last_fullsized":"2024-01-23T09:25:16.030305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2024-01-23T09:25:16.030126+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2024-01-23T09:25:16.030126+0000","last_clean_scrub_stamp":"2024-01-23T09:25:16.030126+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:06:10.211565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"30'22","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.725176+0000","last_change":"2024-01-23T08:54:42.195803+0000","last_active":"2024-01-23T09:25:03.725176+0000","last_peered":"2024-01-23T09:25:03.725176+0000","last_clean":"2024-01-23T09:25:03.725176+0000","last_became_active":"2024-01-23T08:54:42.194562+0000","last_became_peered":"2024-01-23T08:54:42.194562+0000","last_unstale":"2024-01-23T09:25:03.725176+0000","last_undegraded":"2024-01-23T09:25:03.725176+0000","last_fullsized":"2024-01-23T09:25:03.725176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"30'33","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.641853+0000","last_change":"2024-01-23T08:54:42.161219+0000","last_active":"2024-01-23T09:25:03.641853+0000","last_peered":"2024-01-23T09:25:03.641853+0000","last_clean":"2024-01-23T09:25:03.641853+0000","last_became_active":"2024-01-23T08:54:42.160570+0000","last_became_peered":"2024-01-23T08:54:42.160570+0000","last_unstale":"2024-01-23T09:25:03.641853+0000","last_undegraded":"2024-01-23T09:25:03.641853+0000","last_fullsized":"2024-01-23T09:25:03.641853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:47:09.171802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"30'24","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.722822+0000","last_change":"2024-01-23T08:54:42.115468+0000","last_active":"2024-01-23T09:25:03.722822+0000","last_peered":"2024-01-23T09:25:03.722822+0000","last_clean":"2024-01-23T09:25:03.722822+0000","last_became_active":"2024-01-23T08:54:42.114759+0000","last_became_peered":"2024-01-23T08:54:42.114759+0000","last_unstale":"2024-01-23T09:25:03.722822+0000","last_undegraded":"2024-01-23T09:25:03.722822+0000","last_fullsized":"2024-01-23T09:25:03.722822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"30'26","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.726775+0000","last_change":"2024-01-23T08:54:42.150054+0000","last_active":"2024-01-23T09:25:03.726775+0000","last_peered":"2024-01-23T09:25:03.726775+0000","last_clean":"2024-01-23T09:25:03.726775+0000","last_became_active":"2024-01-23T08:54:42.149278+0000","last_became_peered":"2024-01-23T08:54:42.149278+0000","last_unstale":"2024-01-23T09:25:03.726775+0000","last_undegraded":"2024-01-23T09:25:03.726775+0000","last_fullsized":"2024-01-23T09:25:03.726775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"30'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.618372+0000","last_change":"2024-01-23T08:54:42.110442+0000","last_active":"2024-01-23T09:25:03.618372+0000","last_peered":"2024-01-23T09:25:03.618372+0000","last_clean":"2024-01-23T09:25:03.618372+0000","last_became_active":"2024-01-23T08:54:42.109743+0000","last_became_peered":"2024-01-23T08:54:42.109743+0000","last_unstale":"2024-01-23T09:25:03.618372+0000","last_undegraded":"2024-01-23T09:25:03.618372+0000","last_fullsized":"2024-01-23T09:25:03.618372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:58:34.376942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"30'25","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.593331+0000","last_change":"2024-01-23T08:54:42.228264+0000","last_active":"2024-01-23T09:25:03.593331+0000","last_peered":"2024-01-23T09:25:03.593331+0000","last_clean":"2024-01-23T09:25:03.593331+0000","last_became_active":"2024-01-23T08:54:42.227537+0000","last_became_peered":"2024-01-23T08:54:42.227537+0000","last_unstale":"2024-01-23T09:25:03.593331+0000","last_undegraded":"2024-01-23T09:25:03.593331+0000","last_fullsized":"2024-01-23T09:25:03.593331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:54:25.960679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"30'33","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.599333+0000","last_change":"2024-01-23T08:54:42.225968+0000","last_active":"2024-01-23T09:25:03.599333+0000","last_peered":"2024-01-23T09:25:03.599333+0000","last_clean":"2024-01-23T09:25:03.599333+0000","last_became_active":"2024-01-23T08:54:42.224541+0000","last_became_peered":"2024-01-23T08:54:42.224541+0000","last_unstale":"2024-01-23T09:25:03.599333+0000","last_undegraded":"2024-01-23T09:25:03.599333+0000","last_fullsized":"2024-01-23T09:25:03.599333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:04:03.310087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"30'18","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.873689+0000","last_change":"2024-01-23T08:54:42.111363+0000","last_active":"2024-01-23T09:25:03.873689+0000","last_peered":"2024-01-23T09:25:03.873689+0000","last_clean":"2024-01-23T09:25:03.873689+0000","last_became_active":"2024-01-23T08:54:42.111043+0000","last_became_peered":"2024-01-23T08:54:42.111043+0000","last_unstale":"2024-01-23T09:25:03.873689+0000","last_undegraded":"2024-01-23T09:25:03.873689+0000","last_fullsized":"2024-01-23T09:25:03.873689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"30'19","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:15.052340+0000","last_change":"2024-01-23T09:25:15.052362+0000","last_active":"2024-01-23T09:25:15.052340+0000","last_peered":"2024-01-23T09:25:15.052340+0000","last_clean":"2024-01-23T09:25:15.052340+0000","last_became_active":"2024-01-23T08:54:42.115911+0000","last_became_peered":"2024-01-23T08:54:42.115911+0000","last_unstale":"2024-01-23T09:25:15.052340+0000","last_undegraded":"2024-01-23T09:25:15.052340+0000","last_fullsized":"2024-01-23T09:25:15.052340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2024-01-23T09:25:15.052273+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2024-01-23T09:25:15.052273+0000","last_clean_scrub_stamp":"2024-01-23T09:25:15.052273+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:49:29.534124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"30'33","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.873621+0000","last_change":"2024-01-23T08:54:42.158134+0000","last_active":"2024-01-23T09:25:03.873621+0000","last_peered":"2024-01-23T09:25:03.873621+0000","last_clean":"2024-01-23T09:25:03.873621+0000","last_became_active":"2024-01-23T08:54:42.157331+0000","last_became_peered":"2024-01-23T08:54:42.157331+0000","last_unstale":"2024-01-23T09:25:03.873621+0000","last_undegraded":"2024-01-23T09:25:03.873621+0000","last_fullsized":"2024-01-23T09:25:03.873621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"30'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.713718+0000","last_change":"2024-01-23T08:54:42.092495+0000","last_active":"2024-01-23T09:25:03.713718+0000","last_peered":"2024-01-23T09:25:03.713718+0000","last_clean":"2024-01-23T09:25:03.713718+0000","last_became_active":"2024-01-23T08:54:42.091726+0000","last_became_peered":"2024-01-23T08:54:42.091726+0000","last_unstale":"2024-01-23T09:25:03.713718+0000","last_undegraded":"2024-01-23T09:25:03.713718+0000","last_fullsized":"2024-01-23T09:25:03.713718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"30'19","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.647706+0000","last_change":"2024-01-23T08:54:42.120617+0000","last_active":"2024-01-23T09:25:03.647706+0000","last_peered":"2024-01-23T09:25:03.647706+0000","last_clean":"2024-01-23T09:25:03.647706+0000","last_became_active":"2024-01-23T08:54:42.119847+0000","last_became_peered":"2024-01-23T08:54:42.119847+0000","last_unstale":"2024-01-23T09:25:03.647706+0000","last_undegraded":"2024-01-23T09:25:03.647706+0000","last_fullsized":"2024-01-23T09:25:03.647706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:29:51.323223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"30'18","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.866917+0000","last_change":"2024-01-23T08:54:42.197133+0000","last_active":"2024-01-23T09:25:03.866917+0000","last_peered":"2024-01-23T09:25:03.866917+0000","last_clean":"2024-01-23T09:25:03.866917+0000","last_became_active":"2024-01-23T08:54:42.195743+0000","last_became_peered":"2024-01-23T08:54:42.195743+0000","last_unstale":"2024-01-23T09:25:03.866917+0000","last_undegraded":"2024-01-23T09:25:03.866917+0000","last_fullsized":"2024-01-23T09:25:03.866917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"30'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.751986+0000","last_change":"2024-01-23T08:54:42.195979+0000","last_active":"2024-01-23T09:25:03.751986+0000","last_peered":"2024-01-23T09:25:03.751986+0000","last_clean":"2024-01-23T09:25:03.751986+0000","last_became_active":"2024-01-23T08:54:42.194846+0000","last_became_peered":"2024-01-23T08:54:42.194846+0000","last_unstale":"2024-01-23T09:25:03.751986+0000","last_undegraded":"2024-01-23T09:25:03.751986+0000","last_fullsized":"2024-01-23T09:25:03.751986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"30'23","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.867544+0000","last_change":"2024-01-23T08:54:42.118056+0000","last_active":"2024-01-23T09:25:03.867544+0000","last_peered":"2024-01-23T09:25:03.867544+0000","last_clean":"2024-01-23T09:25:03.867544+0000","last_became_active":"2024-01-23T08:54:42.117735+0000","last_became_peered":"2024-01-23T08:54:42.117735+0000","last_unstale":"2024-01-23T09:25:03.867544+0000","last_undegraded":"2024-01-23T09:25:03.867544+0000","last_fullsized":"2024-01-23T09:25:03.867544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"30'16","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.752883+0000","last_change":"2024-01-23T08:54:42.195159+0000","last_active":"2024-01-23T09:25:03.752883+0000","last_peered":"2024-01-23T09:25:03.752883+0000","last_clean":"2024-01-23T09:25:03.752883+0000","last_became_active":"2024-01-23T08:54:42.194331+0000","last_became_peered":"2024-01-23T08:54:42.194331+0000","last_unstale":"2024-01-23T09:25:03.752883+0000","last_undegraded":"2024-01-23T09:25:03.752883+0000","last_fullsized":"2024-01-23T09:25:03.752883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"30'25","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.634628+0000","last_change":"2024-01-23T08:54:42.197096+0000","last_active":"2024-01-23T09:25:03.634628+0000","last_peered":"2024-01-23T09:25:03.634628+0000","last_clean":"2024-01-23T09:25:03.634628+0000","last_became_active":"2024-01-23T08:54:42.196391+0000","last_became_peered":"2024-01-23T08:54:42.196391+0000","last_unstale":"2024-01-23T09:25:03.634628+0000","last_undegraded":"2024-01-23T09:25:03.634628+0000","last_fullsized":"2024-01-23T09:25:03.634628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:31:22.447523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"30'18","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.601398+0000","last_change":"2024-01-23T08:54:42.231430+0000","last_active":"2024-01-23T09:25:03.601398+0000","last_peered":"2024-01-23T09:25:03.601398+0000","last_clean":"2024-01-23T09:25:03.601398+0000","last_became_active":"2024-01-23T08:54:42.229220+0000","last_became_peered":"2024-01-23T08:54:42.229220+0000","last_unstale":"2024-01-23T09:25:03.601398+0000","last_undegraded":"2024-01-23T09:25:03.601398+0000","last_fullsized":"2024-01-23T09:25:03.601398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:48:04.040139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"30'24","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:03.870458+0000","last_change":"2024-01-23T08:54:42.118613+0000","last_active":"2024-01-23T09:25:03.870458+0000","last_peered":"2024-01-23T09:25:03.870458+0000","last_clean":"2024-01-23T09:25:03.870458+0000","last_became_active":"2024-01-23T08:54:42.118233+0000","last_became_peered":"2024-01-23T08:54:42.118233+0000","last_unstale":"2024-01-23T09:25:03.870458+0000","last_undegraded":"2024-01-23T09:25:03.870458+0000","last_fullsized":"2024-01-23T09:25:03.870458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:40.334082+0000","last_clean_scrub_stamp":"2024-01-23T08:54:40.334082+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2304,"num_write_kb":252373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2476,"ondisk_log_size":2476,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1536,"ondisk_log_size":1536,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":23189121,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":519,"num_read_kb":542,"num_write":5371,"num_write_kb":25642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":46628864,"data_stored":46378242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4904,"ondisk_log_size":4904,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509821,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29528,"kb_used_data":2512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342312,"statfs":{"total":96636764160,"available":96606527488,"internally_reserved":0,"allocated":2572288,"data_stored":2340721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.89200000000000002,"15min":0.88200000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.46100000000000002},"max":{"1min":1.4039999999999999,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.93500000000000005,"15min":0.91400000000000003},"min":{"1min":0.61799999999999999,"5min":0.56599999999999995,"15min":0.46300000000000002},"max":{"1min":1.3999999999999999,"5min":1.456,"15min":1.456},"last":0.60599999999999998}]},{"osd":1,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.97599999999999998,"15min":0.95499999999999996},"min":{"1min":0.66100000000000003,"5min":0.52900000000000003,"15min":0.49399999999999999},"max":{"1min":1.419,"5min":1.425,"15min":1.754},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.97499999999999998,"15min":0.97299999999999998},"min":{"1min":0.67900000000000005,"5min":0.54400000000000004,"15min":0.51900000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.597},"last":0.80100000000000005}]},{"osd":2,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.96999999999999997,"15min":0.93400000000000005},"min":{"1min":0.66700000000000004,"5min":0.53000000000000003,"15min":0.47099999999999997},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":1.113},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0369999999999999,"15min":1.014},"min":{"1min":0.73599999999999999,"5min":0.59999999999999998,"15min":0.55000000000000004},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.0720000000000001}]},{"osd":3,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0069999999999999,"15min":0.99099999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.7190000000000001},"last":1.016},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.052,"15min":1.073},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57099999999999995},"max":{"1min":1.587,"5min":1.587,"15min":1.889},"last":0.97799999999999998}]},{"osd":4,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":0.97099999999999997,"15min":0.97199999999999998},"min":{"1min":0.68200000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.645},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.99199999999999999,"15min":0.98999999999999999},"min":{"1min":0.60699999999999998,"5min":0.48899999999999999,"15min":0.46800000000000003},"max":{"1min":1.4259999999999999,"5min":1.621,"15min":1.982},"last":1.1819999999999999}]},{"osd":5,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0760000000000001,"15min":1.0820000000000001},"min":{"1min":0.71099999999999997,"5min":0.63,"15min":0.57299999999999995},"max":{"1min":1.4570000000000001,"5min":1.613,"15min":1.9710000000000001},"last":1.149},{"interface":"front","average":{"1min":1.115,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.72299999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.8260000000000001},"last":0.875}]},{"osd":6,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.147,"15min":1.1399999999999999},"min":{"1min":0.86499999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.613,"5min":1.613,"15min":1.9399999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.123,"5min":1.131,"15min":1.1319999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.752,"5min":1.752,"15min":1.883},"last":1.2330000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509820,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38352,"kb_used_data":7176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333488,"statfs":{"total":96636764160,"available":96597491712,"internally_reserved":0,"allocated":7348224,"data_stored":7125746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.89300000000000002,"15min":0.88200000000000001},"min":{"1min":0.62,"5min":0.54300000000000004,"15min":0.501},"max":{"1min":1.212,"5min":1.296,"15min":1.5269999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.98799999999999999,"15min":0.98099999999999998},"min":{"1min":0.59099999999999997,"5min":0.58899999999999997,"15min":0.53100000000000003},"max":{"1min":1.276,"5min":1.552,"15min":1.552},"last":0.97999999999999998}]},{"osd":1,"last update":"Tue Jan 23 09:25:12 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.97999999999999998,"15min":0.96299999999999997},"min":{"1min":0.58799999999999997,"5min":0.51600000000000001,"15min":0.498},"max":{"1min":1.2889999999999999,"5min":1.4019999999999999,"15min":1.413},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.96199999999999997,"15min":0.93899999999999995},"min":{"1min":0.65700000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2729999999999999,"5min":1.292,"15min":1.542},"last":1.0389999999999999}]},{"osd":2,"last update":"Tue Jan 23 09:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.93899999999999995,"15min":0.91400000000000003},"min":{"1min":0.65900000000000003,"5min":0.58599999999999997,"15min":0.51100000000000001},"max":{"1min":1.3700000000000001,"5min":1.421,"15min":1.46},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0369999999999999,"15min":1.0189999999999999},"min":{"1min":0.69699999999999995,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.61199999999999999}]},{"osd":3,"last update":"Tue Jan 23 09:25:12 2024","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.036,"15min":1.034},"min":{"1min":0.76100000000000001,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3220000000000001,"5min":1.431,"15min":1.677},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.133,"5min":1.0880000000000001,"15min":1.0529999999999999},"min":{"1min":0.86399999999999999,"5min":0.76100000000000001,"15min":0.49199999999999999},"max":{"1min":1.4670000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.1830000000000001}]},{"osd":4,"last update":"Tue Jan 23 09:25:12 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.98199999999999998,"15min":0.99199999999999999},"min":{"1min":0.65500000000000003,"5min":0.61799999999999999,"15min":0.48599999999999999},"max":{"1min":1.3300000000000001,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.0209999999999999,"15min":1.01},"min":{"1min":0.64700000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.4490000000000001,"5min":1.468,"15min":1.468},"last":1.2669999999999999}]},{"osd":6,"last update":"Tue Jan 23 09:25:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.0509999999999999,"15min":1.048},"min":{"1min":0.73799999999999999,"5min":0.65900000000000003,"15min":0.55300000000000005},"max":{"1min":1.3799999999999999,"5min":1.4690000000000001,"15min":1.823},"last":1.016},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.123,"15min":1.1120000000000001},"min":{"1min":0.91700000000000004,"5min":0.72299999999999998,"15min":0.42599999999999999},"max":{"1min":1.4610000000000001,"5min":1.4930000000000001,"15min":1.641},"last":1.3460000000000001}]},{"osd":7,"last update":"Tue Jan 23 09:25:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.121,"15min":1.1399999999999999},"min":{"1min":0.71899999999999997,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.4139999999999999,"5min":1.518,"15min":1.919},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.294,"5min":1.1879999999999999,"15min":1.175},"min":{"1min":0.874,"5min":0.76500000000000001,"15min":0.67800000000000005},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.637},"last":1.306}]}]},{"osd":4,"up_from":15,"seq":64424509819,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39732,"kb_used_data":8556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332108,"statfs":{"total":96636764160,"available":96596078592,"internally_reserved":0,"allocated":8761344,"data_stored":8522021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.92400000000000004,"15min":0.91300000000000003},"min":{"1min":0.56599999999999995,"5min":0.50700000000000001,"15min":0.46600000000000003},"max":{"1min":1.3129999999999999,"5min":1.3799999999999999,"15min":1.583},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.95499999999999996,"15min":0.91800000000000004},"min":{"1min":0.60499999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.282,"5min":1.329,"15min":1.5629999999999999},"last":0.90600000000000003}]},{"osd":1,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.97699999999999998,"15min":0.93000000000000005},"min":{"1min":0.74099999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3640000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.94099999999999995,"15min":0.95299999999999996},"min":{"1min":0.66100000000000003,"5min":0.59999999999999998,"15min":0.5},"max":{"1min":1.232,"5min":1.415,"15min":1.415},"last":1.1719999999999999}]},{"osd":2,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.96099999999999997,"15min":0.93700000000000006},"min":{"1min":0.625,"5min":0.56599999999999995,"15min":0.54000000000000004},"max":{"1min":1.3460000000000001,"5min":1.387,"15min":1.387},"last":0.72699999999999998},{"interface":"front","average":{"1min":1,"5min":1.0589999999999999,"15min":1.0329999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.498},"max":{"1min":1.296,"5min":1.411,"15min":1.736},"last":1.042}]},{"osd":3,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0009999999999999,"15min":0.98199999999999998},"min":{"1min":0.70199999999999996,"5min":0.58899999999999997,"15min":0.55300000000000005},"max":{"1min":1.3720000000000001,"5min":1.3779999999999999,"15min":1.7509999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.101,"5min":1.0840000000000001,"15min":1.0680000000000001},"min":{"1min":0.78800000000000003,"5min":0.77100000000000002,"15min":0.60799999999999998},"max":{"1min":1.349,"5min":1.3859999999999999,"15min":1.482},"last":1.206}]},{"osd":5,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.96599999999999997,"15min":0.98299999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3100000000000001,"5min":1.5549999999999999,"15min":1.643},"last":1.24},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.98699999999999999,"15min":0.98899999999999999},"min":{"1min":0.64300000000000002,"5min":0.57999999999999996,"15min":0.52300000000000002},"max":{"1min":1.417,"5min":1.4330000000000001,"15min":1.986},"last":1.0029999999999999}]},{"osd":6,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.0289999999999999,"15min":1.0309999999999999},"min":{"1min":0.64900000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.4279999999999999,"5min":1.446,"15min":1.825},"last":1.121},{"interface":"front","average":{"1min":1.139,"5min":1.1160000000000001,"15min":1.1180000000000001},"min":{"1min":0.86599999999999999,"5min":0.77000000000000002,"15min":0.45700000000000002},"max":{"1min":1.373,"5min":1.5049999999999999,"15min":1.7749999999999999},"last":1.2909999999999999}]},{"osd":7,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.0549999999999999,"15min":1.0629999999999999},"min":{"1min":0.72999999999999998,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.573,"5min":1.573,"15min":1.673},"last":1.085},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.1950000000000001,"15min":1.173},"min":{"1min":0.94399999999999995,"5min":0.71099999999999997,"15min":0.69399999999999995},"max":{"1min":1.4850000000000001,"5min":1.5369999999999999,"15min":1.5629999999999999},"last":1.27}]}]},{"osd":2,"up_from":15,"seq":64424509821,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39696,"kb_used_data":8520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332144,"statfs":{"total":96636764160,"available":96596115456,"internally_reserved":0,"allocated":8724480,"data_stored":8520251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.74299999999999999,"15min":0.72899999999999998},"min":{"1min":0.44600000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.1890000000000001,"5min":1.528,"15min":1.5820000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.877,"15min":0.82499999999999996},"min":{"1min":0.54000000000000004,"5min":0.40200000000000002,"15min":0.248},"max":{"1min":1.534,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":0.42799999999999999}]},{"osd":1,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90800000000000003,"15min":0.88900000000000001},"min":{"1min":0.51900000000000002,"5min":0.42799999999999999,"15min":0.376},"max":{"1min":1.401,"5min":1.974,"15min":1.974},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.995,"5min":0.89800000000000002,"15min":0.88600000000000001},"min":{"1min":0.61399999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.393,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.53800000000000003}]},{"osd":3,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.86299999999999999,"15min":0.85199999999999998},"min":{"1min":0.55800000000000005,"5min":0.36499999999999999,"15min":0.36199999999999999},"max":{"1min":1.7310000000000001,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":0.5},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0549999999999999,"15min":1.0109999999999999},"min":{"1min":0.67100000000000004,"5min":0.38,"15min":0.38},"max":{"1min":1.591,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.69899999999999995}]},{"osd":4,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.1499999999999999,"15min":1.123},"min":{"1min":0.78900000000000003,"5min":0.59699999999999998,"15min":0.55000000000000004},"max":{"1min":1.446,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.23,"5min":1.1559999999999999,"15min":1.153},"min":{"1min":0.82499999999999996,"5min":0.61599999999999999,"15min":0.60399999999999998},"max":{"1min":1.754,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.92200000000000004}]},{"osd":5,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1020000000000001,"15min":1.091},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53700000000000003},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.9379999999999999},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.2430000000000001,"15min":1.2130000000000001},"min":{"1min":0.79300000000000004,"5min":0.68899999999999995,"15min":0.624},"max":{"1min":1.681,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.1559999999999999}]},{"osd":6,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.202,"15min":1.198},"min":{"1min":0.71499999999999997,"5min":0.60899999999999999,"15min":0.59499999999999997},"max":{"1min":1.796,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.2,"5min":1.1919999999999999,"15min":1.175},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.577,"5min":1.6519999999999999,"15min":1.843},"last":1.119}]},{"osd":7,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.2849999999999999,"15min":1.262},"min":{"1min":0.79600000000000004,"5min":0.77100000000000002,"15min":0.59499999999999997},"max":{"1min":2,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.26,"15min":1.2370000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.0580000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509820,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":933888,"data_stored":722685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73599999999999999,"15min":0.72899999999999998},"min":{"1min":0.52100000000000002,"5min":0.36599999999999999,"15min":0.28599999999999998},"max":{"1min":1.107,"5min":1.371,"15min":1.681},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82899999999999996,"15min":0.80500000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.36399999999999999},"max":{"1min":1.2270000000000001,"5min":1.5569999999999999,"15min":2.0049999999999999},"last":0.58299999999999996}]},{"osd":2,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77600000000000002,"15min":0.73399999999999999},"min":{"1min":0.55900000000000005,"5min":0.46600000000000003,"15min":0.375},"max":{"1min":1.218,"5min":1.262,"15min":1.5960000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.96599999999999997,"15min":0.92600000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.30499999999999999},"max":{"1min":1.367,"5min":1.4470000000000001,"15min":1.6919999999999999},"last":0.88900000000000001}]},{"osd":3,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.97099999999999997,"15min":0.93200000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.40400000000000003},"max":{"1min":1.4099999999999999,"5min":1.569,"15min":1.8069999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.97899999999999998,"15min":0.96299999999999997},"min":{"1min":0.53300000000000003,"5min":0.51200000000000001,"15min":0.35599999999999998},"max":{"1min":1.3680000000000001,"5min":1.657,"15min":2.1589999999999998},"last":0.82399999999999995}]},{"osd":4,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0840000000000001,"15min":1.077},"min":{"1min":0.80800000000000005,"5min":0.65900000000000003,"15min":0.54300000000000004},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6799999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2090000000000001,"15min":1.1759999999999999},"min":{"1min":0.80800000000000005,"5min":0.64000000000000001,"15min":0.50600000000000001},"max":{"1min":1.736,"5min":1.736,"15min":2.2450000000000001},"last":0.96899999999999997}]},{"osd":5,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.1850000000000001,"15min":1.1699999999999999},"min":{"1min":0.83799999999999997,"5min":0.73899999999999999,"15min":0.63},"max":{"1min":1.7829999999999999,"5min":1.8260000000000001,"15min":2.1110000000000002},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.1990000000000001,"15min":1.1619999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.66200000000000003},"max":{"1min":1.538,"5min":1.802,"15min":1.802},"last":0.68999999999999995}]},{"osd":6,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.254,"15min":1.236},"min":{"1min":0.79400000000000004,"5min":0.77300000000000002,"15min":0.58699999999999997},"max":{"1min":1.6779999999999999,"5min":1.829,"15min":2.2000000000000002},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2350000000000001,"15min":1.2050000000000001},"min":{"1min":0.82699999999999996,"5min":0.76100000000000001,"15min":0.66700000000000004},"max":{"1min":1.631,"5min":1.857,"15min":1.857},"last":1.169}]},{"osd":7,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.306,"15min":1.282},"min":{"1min":0.84999999999999998,"5min":0.77600000000000002,"15min":0.65500000000000003},"max":{"1min":1.6259999999999999,"5min":1.913,"15min":2.1110000000000002},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.28,"5min":1.3029999999999999,"15min":1.286},"min":{"1min":0.96799999999999997,"5min":0.90800000000000003,"15min":0.72099999999999997},"max":{"1min":1.883,"5min":1.9279999999999999,"15min":2.238},"last":1.0049999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509820,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":4444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":4550656,"data_stored":4328911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 23 09:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":0.81299999999999994,"15min":0.747},"min":{"1min":0.39300000000000002,"5min":0.32800000000000001,"15min":0.29499999999999998},"max":{"1min":9.5459999999999994,"5min":9.5459999999999994,"15min":9.5459999999999994},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.85099999999999998,"15min":0.83999999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.26500000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":2.21},"last":0.65000000000000002}]},{"osd":2,"last update":"Tue Jan 23 09:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.86599999999999999,"15min":0.80500000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.312},"max":{"1min":5.5199999999999996,"5min":5.5199999999999996,"15min":5.5199999999999996},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.91500000000000004,"15min":0.89700000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.40400000000000003},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":2.1440000000000001},"last":0.872}]},{"osd":3,"last update":"Tue Jan 23 09:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.002,"15min":0.93899999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.32200000000000001},"max":{"1min":9.6470000000000002,"5min":9.6470000000000002,"15min":9.6470000000000002},"last":0.83599999999999997},{"interface":"front","average":{"1min":3.391,"5min":1.4690000000000001,"15min":1.1040000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":42.942,"5min":42.942,"15min":42.942},"last":1.002}]},{"osd":4,"last update":"Tue Jan 23 09:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.1060000000000001,"15min":1.1020000000000001},"min":{"1min":0.64800000000000002,"5min":0.51900000000000002,"15min":0.47299999999999998},"max":{"1min":1.407,"5min":1.8979999999999999,"15min":2.3050000000000002},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.1739999999999999,"15min":1.151},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.6619999999999999,"5min":3.6619999999999999,"15min":3.6619999999999999},"last":1.1339999999999999}]},{"osd":5,"last update":"Tue Jan 23 09:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.1830000000000001,"15min":1.137},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.5},"max":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.23,"5min":1.244,"15min":1.2350000000000001},"min":{"1min":0.77000000000000002,"5min":0.67900000000000005,"15min":0.51700000000000002},"max":{"1min":1.76,"5min":1.8460000000000001,"15min":2.1080000000000001},"last":1.2450000000000001}]},{"osd":6,"last update":"Tue Jan 23 09:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.258,"15min":1.2390000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.59599999999999997},"max":{"1min":3.5609999999999999,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.27,"5min":1.25,"15min":1.2270000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":1.103}]},{"osd":7,"last update":"Tue Jan 23 09:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2909999999999999,"15min":1.298},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.54400000000000004},"max":{"1min":1.8879999999999999,"5min":1.98,"15min":2.2160000000000002},"last":1.161},{"interface":"front","average":{"1min":1.425,"5min":1.3460000000000001,"15min":1.306},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.57699999999999996},"max":{"1min":4.3330000000000002,"5min":4.3330000000000002,"15min":4.3330000000000002},"last":1.0309999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509822,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47980,"kb_used_data":12644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323860,"statfs":{"total":96636764160,"available":96587632640,"internally_reserved":0,"allocated":12947456,"data_stored":12717118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.755,"15min":0.73699999999999999},"min":{"1min":0.54400000000000004,"5min":0.434,"15min":0.28100000000000003},"max":{"1min":1.1850000000000001,"5min":1.492,"15min":1.514},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.78100000000000003,"15min":0.751},"min":{"1min":0.51800000000000002,"5min":0.45800000000000002,"15min":0.34799999999999998},"max":{"1min":1.155,"5min":1.2450000000000001,"15min":1.641},"last":0.34399999999999997}]},{"osd":1,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.83899999999999997,"15min":0.79700000000000004},"min":{"1min":0.53600000000000003,"5min":0.42099999999999999,"15min":0.309},"max":{"1min":1.0820000000000001,"5min":1.782,"15min":1.782},"last":0.56599999999999995},{"interface":"front","average":{"1min":1.026,"5min":0.95999999999999996,"15min":0.90500000000000003},"min":{"1min":0.70199999999999996,"5min":0.437,"15min":0.32900000000000001},"max":{"1min":1.367,"5min":2.698,"15min":2.698},"last":0.42599999999999999}]},{"osd":2,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.95899999999999996,"15min":0.91200000000000003},"min":{"1min":0.67600000000000005,"5min":0.54800000000000004,"15min":0.379},"max":{"1min":1.3879999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.018,"15min":0.96499999999999997},"min":{"1min":0.56100000000000005,"5min":0.49399999999999999,"15min":0.312},"max":{"1min":1.405,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":0.46600000000000003}]},{"osd":4,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.093,"15min":1.0720000000000001},"min":{"1min":0.85399999999999998,"5min":0.624,"15min":0.57099999999999995},"max":{"1min":1.53,"5min":1.53,"15min":1.736},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1439999999999999,"15min":1.1000000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.499},"max":{"1min":1.4419999999999999,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":0.68999999999999995}]},{"osd":5,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1890000000000001,"15min":1.1499999999999999},"min":{"1min":0.873,"5min":0.72199999999999998,"15min":0.51800000000000002},"max":{"1min":1.5800000000000001,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.256,"5min":1.284,"15min":1.24},"min":{"1min":0.88700000000000001,"5min":0.69399999999999995,"15min":0.47999999999999998},"max":{"1min":1.7549999999999999,"5min":2.794,"15min":2.794},"last":0.84799999999999998}]},{"osd":6,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3160000000000001,"15min":1.2669999999999999},"min":{"1min":0.94499999999999995,"5min":0.77200000000000002,"15min":0.61399999999999999},"max":{"1min":1.877,"5min":2.8730000000000002,"15min":2.8730000000000002},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.1970000000000001,"15min":1.1859999999999999},"min":{"1min":0.87,"5min":0.68000000000000005,"15min":0.60699999999999998},"max":{"1min":1.577,"5min":1.5880000000000001,"15min":2.3170000000000002},"last":0.83199999999999996}]},{"osd":7,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.258,"15min":1.224},"min":{"1min":1.1319999999999999,"5min":0.91100000000000003,"15min":0.68000000000000005},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":2.1960000000000002},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.331,"5min":1.2969999999999999,"15min":1.262},"min":{"1min":1.004,"5min":0.90700000000000003,"15min":0.63400000000000001},"max":{"1min":1.679,"5min":1.9330000000000001,"15min":2.0910000000000002},"last":0.746}]}]},{"osd":6,"up_from":14,"seq":60129542524,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43924,"kb_used_data":4428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327916,"statfs":{"total":96636764160,"available":96591785984,"internally_reserved":0,"allocated":4534272,"data_stored":4328749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.879,"15min":0.874},"min":{"1min":0.53500000000000003,"5min":0.48099999999999998,"15min":0.44},"max":{"1min":1.2969999999999999,"5min":1.3520000000000001,"15min":1.4199999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.91600000000000004,"15min":0.90200000000000002},"min":{"1min":0.67400000000000004,"5min":0.501,"15min":0.39600000000000002},"max":{"1min":1.4079999999999999,"5min":1.575,"15min":1.575},"last":1.1890000000000001}]},{"osd":1,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.96899999999999997,"15min":0.93700000000000006},"min":{"1min":0.79200000000000004,"5min":0.58899999999999997,"15min":0.55000000000000004},"max":{"1min":1.3089999999999999,"5min":1.3169999999999999,"15min":1.3400000000000001},"last":1.224},{"interface":"front","average":{"1min":0.995,"5min":1.032,"15min":0.98599999999999999},"min":{"1min":0.70199999999999996,"5min":0.67800000000000005,"15min":0.48399999999999999},"max":{"1min":1.2250000000000001,"5min":1.5209999999999999,"15min":1.548},"last":0.97799999999999998}]},{"osd":2,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.92300000000000004,"15min":0.92000000000000004},"min":{"1min":0.58699999999999997,"5min":0.502,"15min":0.502},"max":{"1min":1.3460000000000001,"5min":1.484,"15min":2.1219999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":1,"5min":0.95099999999999996,"15min":0.93400000000000005},"min":{"1min":0.63,"5min":0.58599999999999997,"15min":0.46700000000000003},"max":{"1min":1.377,"5min":1.377,"15min":1.429},"last":1.0580000000000001}]},{"osd":3,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.032,"15min":1.0429999999999999},"min":{"1min":0.72399999999999998,"5min":0.72099999999999997,"15min":0.625},"max":{"1min":1.3460000000000001,"5min":1.4390000000000001,"15min":1.4850000000000001},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.0309999999999999,"15min":1.0249999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.53900000000000003},"max":{"1min":1.2949999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.1559999999999999}]},{"osd":4,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.94999999999999996,"15min":0.95499999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4299999999999999,"5min":1.4419999999999999,"15min":1.518},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.145,"5min":1.103,"15min":1.1020000000000001},"min":{"1min":0.73399999999999999,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.3080000000000001}]},{"osd":5,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.96099999999999997,"15min":0.95799999999999996},"min":{"1min":0.59999999999999998,"5min":0.54200000000000004,"15min":0.497},"max":{"1min":1.718,"5min":1.718,"15min":1.734},"last":1.006},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.147,"15min":1.1399999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.4419999999999999,"5min":1.601,"15min":2.278},"last":1.113}]},{"osd":7,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0600000000000001,"15min":1.048},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.53900000000000003},"max":{"1min":1.4810000000000001,"5min":1.659,"15min":1.659},"last":1.355},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.0940000000000001,"15min":1.0800000000000001},"min":{"1min":0.80400000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.657,"5min":1.657,"15min":1.6599999999999999},"last":1.28}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4231168,"data_stored":4198008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12627968,"data_stored":12586215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8441856,"data_stored":8391118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6434816,"data_stored":6404475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4214784,"data_stored":4197846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2252800,"data_stored":2209818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-23T09:25:22.575 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-01-23T08:54:39.101885+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=39, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.575 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.575 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.575 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-01-23T08:54:39.101885+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=39, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.575 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.576 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.576 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-01-23T08:54:39.101885+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=39, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.576 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.576 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.576 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.576 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.576 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.576 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-01-23T08:54:39.101885+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=39, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.576 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.577 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.577 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-01-23T08:54:39.101885+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=39, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.577 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.577 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.577 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-01-23T08:54:39.101885+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=39, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.577 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.577 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.577 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.577 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.577 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-01-23T08:54:39.101885+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=39, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.577 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.578 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.578 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-01-23T08:54:39.101885+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=39, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.578 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.578 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.578 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-01-23T08:54:39.101885+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=39, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.578 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.578 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.578 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-01-23T08:54:39.101885+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=39, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.578 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.578 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.579 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-01-23T08:54:39.101885+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=39, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.579 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.579 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.579 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-01-23T08:54:39.101885+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=39, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.579 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.579 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.579 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-01-23T08:54:39.101885+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=39, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.579 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.579 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.579 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-01-23T08:54:39.101885+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=39, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.580 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.580 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.580 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-01-23T08:54:39.101885+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=39, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.580 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.580 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.580 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-01-23T08:54:39.101885+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=39, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.580 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.580 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.580 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-01-23T08:54:39.101885+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=39, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.580 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.581 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.581 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-01-23T08:54:39.101885+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=39, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.581 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.581 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.581 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-01-23T08:54:39.101885+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=39, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.581 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.581 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-01-23T08:54:39.101885+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=39, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.581 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.582 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-01-23T08:54:39.101885+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=39, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.582 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.582 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.582 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-01-23T08:54:39.101885+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=39, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.582 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.582 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.582 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.582 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.582 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-01-23T08:54:39.101885+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=39, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.583 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.583 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.583 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-01-23T08:54:39.101885+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=39, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.583 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.583 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.583 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.583 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.583 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-01-23T08:54:39.101885+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=39, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.584 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.584 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.584 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-01-23T08:54:39.101885+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=39, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.584 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-01-23T08:54:39.101885+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=39, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.584 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.584 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.584 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-01-23T08:54:39.101885+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=39, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.584 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.585 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.585 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.585 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.585 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.585 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.585 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.585 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.585 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.586 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.586 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.586 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.586 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.586 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.586 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.586 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.586 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.587 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.587 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.587 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.587 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.587 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.587 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.587 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.587 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.587 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.588 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.588 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.588 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.588 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.588 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-01-23T08:54:40.334082+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=40, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:22.588 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-01-23T09:25:23.854 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:25:23.857 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:25:42.589 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-23T09:25:42.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.729+0000 7fb77b47a640 1 Processor -- start 2024-01-23T09:25:42.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.729+0000 7fb77b47a640 1 -- start start 2024-01-23T09:25:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.729+0000 7fb77b47a640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb774151600 0x7fb77415b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.729+0000 7fb77b47a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb77406f350 0x7fb7740c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.729+0000 7fb77b47a640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb774158390 con 0x7fb7741519e0 2024-01-23T09:25:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.729+0000 7fb77b47a640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77415b0e0 con 0x7fb774151600 2024-01-23T09:25:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.729+0000 7fb77b47a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb774157b70 con 0x7fb77406f350 2024-01-23T09:25:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.729+0000 7fb779216640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb774151600 0x7fb77415b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:42.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.729+0000 7fb778a15640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb7741519e0 0x7fb774157460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57714/0 (socket says 172.21.15.46:57714) 2024-01-23T09:25:42.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.729+0000 7fb778a15640 1 -- 172.21.15.46:0/1039485883 learned_addr learned my addr 172.21.15.46:0/1039485883 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T09:25:42.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.729+0000 7fb779a17640 1 --2- 172.21.15.46:0/1039485883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb77406f350 0x7fb7740c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:42.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.733+0000 7fb779216640 1 -- 172.21.15.46:0/1039485883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb77406f350 msgr2=0x7fb7740c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:42.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.733+0000 7fb779216640 1 --2- 172.21.15.46:0/1039485883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb77406f350 0x7fb7740c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:42.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.733+0000 7fb779216640 1 -- 172.21.15.46:0/1039485883 >> v1:172.21.15.46:6789/0 conn(0x7fb7741519e0 legacy=0x7fb774157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:25:42.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.733+0000 7fb779216640 1 -- 172.21.15.46:0/1039485883 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb774157dd0 con 0x7fb774151600 2024-01-23T09:25:42.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.737+0000 7fb779216640 1 --2- 172.21.15.46:0/1039485883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb774151600 0x7fb77415b570 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb76c009d90 tx=0x7fb76c01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f768ea6834575ac server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:42.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.745+0000 7fb773fff640 1 -- 172.21.15.46:0/1039485883 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c0a57f0 con 0x7fb774151600 2024-01-23T09:25:42.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.745+0000 7fb773fff640 1 -- 172.21.15.46:0/1039485883 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76c0a5950 con 0x7fb774151600 2024-01-23T09:25:42.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.745+0000 7fb773fff640 1 -- 172.21.15.46:0/1039485883 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c0a5ce0 con 0x7fb774151600 2024-01-23T09:25:42.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.745+0000 7fb77b47a640 1 -- 172.21.15.46:0/1039485883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb774151600 msgr2=0x7fb77415b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:42.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.745+0000 7fb77b47a640 1 --2- 172.21.15.46:0/1039485883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb774151600 0x7fb77415b570 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb76c009d90 tx=0x7fb76c01c880 comp rx=0 tx=0).stop 2024-01-23T09:25:42.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.745+0000 7fb77b47a640 1 -- 172.21.15.46:0/1039485883 shutdown_connections 2024-01-23T09:25:42.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.745+0000 7fb77b47a640 1 --2- 172.21.15.46:0/1039485883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb77406f350 0x7fb7740c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:42.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.745+0000 7fb77b47a640 1 --2- 172.21.15.46:0/1039485883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb774151600 0x7fb77415b570 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:42.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.745+0000 7fb77b47a640 1 -- 172.21.15.46:0/1039485883 >> 172.21.15.46:0/1039485883 conn(0x7fb77406d590 msgr2=0x7fb774066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:42.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.745+0000 7fb77b47a640 1 -- 172.21.15.46:0/1039485883 shutdown_connections 2024-01-23T09:25:42.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.745+0000 7fb77b47a640 1 -- 172.21.15.46:0/1039485883 wait complete. 2024-01-23T09:25:42.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.749+0000 7fb77b47a640 1 Processor -- start 2024-01-23T09:25:42.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.749+0000 7fb77b47a640 1 -- start start 2024-01-23T09:25:42.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.749+0000 7fb77b47a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb77406f350 0x7fb77415a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:42.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.749+0000 7fb77b47a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb774151600 0x7fb7741468d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:42.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.749+0000 7fb77b47a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7741585c0 0x7fb774146e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:42.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.749+0000 7fb77b47a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7740cac20 con 0x7fb7741585c0 2024-01-23T09:25:42.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.749+0000 7fb77b47a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb774159750 con 0x7fb774151600 2024-01-23T09:25:42.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.749+0000 7fb77b47a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb774146440 con 0x7fb77406f350 2024-01-23T09:25:42.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.749+0000 7fb779a17640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7741585c0 0x7fb774146e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:42.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.749+0000 7fb779a17640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7741585c0 0x7fb774146e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53422/0 (socket says 172.21.15.46:53422) 2024-01-23T09:25:42.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.749+0000 7fb779a17640 1 -- 172.21.15.46:0/64838914 learned_addr learned my addr 172.21.15.46:0/64838914 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:25:42.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.749+0000 7fb779216640 1 --2- 172.21.15.46:0/64838914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb77406f350 0x7fb77415a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:42.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.749+0000 7fb778a15640 1 --2- 172.21.15.46:0/64838914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb774151600 0x7fb7741468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:42.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.753+0000 7fb779a17640 1 -- 172.21.15.46:0/64838914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb77406f350 msgr2=0x7fb77415a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:42.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.753+0000 7fb779a17640 1 --2- 172.21.15.46:0/64838914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb77406f350 0x7fb77415a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:42.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.753+0000 7fb779a17640 1 -- 172.21.15.46:0/64838914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb774151600 msgr2=0x7fb7741468d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:42.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.753+0000 7fb779a17640 1 --2- 172.21.15.46:0/64838914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb774151600 0x7fb7741468d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:42.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.753+0000 7fb779a17640 1 -- 172.21.15.46:0/64838914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76c009a70 con 0x7fb7741585c0 2024-01-23T09:25:42.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.757+0000 7fb779a17640 1 --2- 172.21.15.46:0/64838914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7741585c0 0x7fb774146e10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb76400e850 tx=0x7fb76400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:42.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.761+0000 7fb771ffb640 1 -- 172.21.15.46:0/64838914 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb764009530 con 0x7fb7741585c0 2024-01-23T09:25:42.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.761+0000 7fb771ffb640 1 -- 172.21.15.46:0/64838914 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76400c940 con 0x7fb7741585c0 2024-01-23T09:25:42.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.761+0000 7fb77b47a640 1 -- 172.21.15.46:0/64838914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7741477d0 con 0x7fb7741585c0 2024-01-23T09:25:42.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.761+0000 7fb771ffb640 1 -- 172.21.15.46:0/64838914 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76400ccd0 con 0x7fb7741585c0 2024-01-23T09:25:42.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.761+0000 7fb77b47a640 1 -- 172.21.15.46:0/64838914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb774145b10 con 0x7fb7741585c0 2024-01-23T09:25:42.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:42.761+0000 7fb77b47a640 1 -- 172.21.15.46:0/64838914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7741465f0 con 0x7fb7741585c0 2024-01-23T09:25:43.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:43.061+0000 7fb771ffb640 1 -- 172.21.15.46:0/64838914 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fb764013470 con 0x7fb7741585c0 2024-01-23T09:25:43.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:43.065+0000 7fb771ffb640 1 --2- 172.21.15.46:0/64838914 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fb760066550 0x7fb760068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:25:43.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:43.065+0000 7fb779216640 1 --2- 172.21.15.46:0/64838914 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fb760066550 0x7fb760068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:25:43.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:43.065+0000 7fb779216640 1 --2- 172.21.15.46:0/64838914 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fb760066550 0x7fb760068a10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb76c0af000 tx=0x7fb76c0a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:25:43.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:43.101+0000 7fb771ffb640 1 -- 172.21.15.46:0/64838914 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fb764055470 con 0x7fb7741585c0 2024-01-23T09:25:43.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:43.101+0000 7fb771ffb640 1 -- 172.21.15.46:0/64838914 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fb7640517b0 con 0x7fb7741585c0 2024-01-23T09:25:43.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:43.273+0000 7fb77b47a640 1 -- 172.21.15.46:0/64838914 --> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb7741465f0 con 0x7fb760066550 2024-01-23T09:25:43.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:43.285+0000 7fb771ffb640 1 -- 172.21.15.46:0/64838914 <== mgr.4107 v2:172.21.15.46:6800/2324478006 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368987 (secure 0 0 0) 0x7fb7741465f0 con 0x7fb760066550 2024-01-23T09:25:43.293 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T09:25:43.295 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-01-23T09:25:43.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:43.289+0000 7fb77b47a640 1 -- 172.21.15.46:0/64838914 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fb760066550 msgr2=0x7fb760068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:43.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:43.289+0000 7fb77b47a640 1 --2- 172.21.15.46:0/64838914 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fb760066550 0x7fb760068a10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb76c0af000 tx=0x7fb76c0a7070 comp rx=0 tx=0).stop 2024-01-23T09:25:43.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:43.289+0000 7fb77b47a640 1 -- 172.21.15.46:0/64838914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7741585c0 msgr2=0x7fb774146e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:25:43.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:43.289+0000 7fb77b47a640 1 --2- 172.21.15.46:0/64838914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7741585c0 0x7fb774146e10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb76400e850 tx=0x7fb76400ed10 comp rx=0 tx=0).stop 2024-01-23T09:25:43.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:43.289+0000 7fb77b47a640 1 -- 172.21.15.46:0/64838914 shutdown_connections 2024-01-23T09:25:43.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:43.289+0000 7fb77b47a640 1 --2- 172.21.15.46:0/64838914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7741585c0 0x7fb774146e10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:43.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:43.289+0000 7fb77b47a640 1 --2- 172.21.15.46:0/64838914 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fb760066550 0x7fb760068a10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:43.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:43.289+0000 7fb77b47a640 1 --2- 172.21.15.46:0/64838914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb774151600 0x7fb7741468d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:43.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:43.289+0000 7fb77b47a640 1 --2- 172.21.15.46:0/64838914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb77406f350 0x7fb77415a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:25:43.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:43.289+0000 7fb77b47a640 1 -- 172.21.15.46:0/64838914 >> 172.21.15.46:0/64838914 conn(0x7fb77406d590 msgr2=0x7fb774066460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:25:43.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:43.289+0000 7fb77b47a640 1 -- 172.21.15.46:0/64838914 shutdown_connections 2024-01-23T09:25:43.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:25:43.289+0000 7fb77b47a640 1 -- 172.21.15.46:0/64838914 wait complete. 2024-01-23T09:25:43.314 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":978,"stamp":"2024-01-23T09:25:41.390228+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23779489,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":635,"num_read_kb":642,"num_write":7834,"num_write_kb":280431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9118,"ondisk_log_size":9118,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":306920,"kb_used_data":49192,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754667800,"statfs":{"total":773094113280,"available":772779827200,"internally_reserved":0,"allocated":50372608,"data_stored":48606202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006252"},"pg_stats":[{"pgid":"2.1f","version":"30'628","reported_seq":672,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:20.555912+0000","last_change":"2024-01-23T09:25:20.556054+0000","last_active":"2024-01-23T09:25:20.555912+0000","last_peered":"2024-01-23T09:25:20.555912+0000","last_clean":"2024-01-23T09:25:20.555912+0000","last_became_active":"2024-01-23T08:54:40.660901+0000","last_became_peered":"2024-01-23T08:54:40.660901+0000","last_unstale":"2024-01-23T09:25:20.555912+0000","last_undegraded":"2024-01-23T09:25:20.555912+0000","last_fullsized":"2024-01-23T09:25:20.555912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'628","last_scrub_stamp":"2024-01-23T09:25:20.555726+0000","last_deep_scrub":"30'628","last_deep_scrub_stamp":"2024-01-23T09:25:20.555726+0000","last_clean_scrub_stamp":"2024-01-23T09:25:20.555726+0000","objects_scrubbed":7,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:35:53.365512+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":621,"num_write_kb":4439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"30'17","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:31.790223+0000","last_change":"2024-01-23T09:25:31.790325+0000","last_active":"2024-01-23T09:25:31.790223+0000","last_peered":"2024-01-23T09:25:31.790223+0000","last_clean":"2024-01-23T09:25:31.790223+0000","last_became_active":"2024-01-23T08:54:42.158776+0000","last_became_peered":"2024-01-23T08:54:42.158776+0000","last_unstale":"2024-01-23T09:25:31.790223+0000","last_undegraded":"2024-01-23T09:25:31.790223+0000","last_fullsized":"2024-01-23T09:25:31.790223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'17","last_scrub_stamp":"2024-01-23T09:25:31.790053+0000","last_deep_scrub":"30'17","last_deep_scrub_stamp":"2024-01-23T09:25:31.790053+0000","last_clean_scrub_stamp":"2024-01-23T09:25:31.790053+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:19:53.372142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"30'65","reported_seq":101,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:30.178936+0000","last_change":"2024-01-23T09:25:30.179070+0000","last_active":"2024-01-23T09:25:30.178936+0000","last_peered":"2024-01-23T09:25:30.178936+0000","last_clean":"2024-01-23T09:25:30.178936+0000","last_became_active":"2024-01-23T08:54:49.752077+0000","last_became_peered":"2024-01-23T08:54:49.752077+0000","last_unstale":"2024-01-23T09:25:30.178936+0000","last_undegraded":"2024-01-23T09:25:30.178936+0000","last_fullsized":"2024-01-23T09:25:30.178936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'65","last_scrub_stamp":"2024-01-23T09:25:30.178745+0000","last_deep_scrub":"30'65","last_deep_scrub_stamp":"2024-01-23T09:25:30.178745+0000","last_clean_scrub_stamp":"2024-01-23T09:25:30.178745+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:49:44.660596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":3048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"30'229","reported_seq":274,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:26.944083+0000","last_change":"2024-01-23T09:25:26.944145+0000","last_active":"2024-01-23T09:25:26.944083+0000","last_peered":"2024-01-23T09:25:26.944083+0000","last_clean":"2024-01-23T09:25:26.944083+0000","last_became_active":"2024-01-23T08:54:40.699449+0000","last_became_peered":"2024-01-23T08:54:40.699449+0000","last_unstale":"2024-01-23T09:25:26.944083+0000","last_undegraded":"2024-01-23T09:25:26.944083+0000","last_fullsized":"2024-01-23T09:25:26.944083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'229","last_scrub_stamp":"2024-01-23T09:25:26.943916+0000","last_deep_scrub":"30'229","last_deep_scrub_stamp":"2024-01-23T09:25:26.943916+0000","last_clean_scrub_stamp":"2024-01-23T09:25:26.943916+0000","objects_scrubbed":1,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:42:47.490337+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2084932,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":2149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"30'24","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:28.907647+0000","last_change":"2024-01-23T09:25:28.907752+0000","last_active":"2024-01-23T09:25:28.907647+0000","last_peered":"2024-01-23T09:25:28.907647+0000","last_clean":"2024-01-23T09:25:28.907647+0000","last_became_active":"2024-01-23T08:54:42.091950+0000","last_became_peered":"2024-01-23T08:54:42.091950+0000","last_unstale":"2024-01-23T09:25:28.907647+0000","last_undegraded":"2024-01-23T09:25:28.907647+0000","last_fullsized":"2024-01-23T09:25:28.907647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2024-01-23T09:25:28.907473+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2024-01-23T09:25:28.907473+0000","last_clean_scrub_stamp":"2024-01-23T09:25:28.907473+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:30:44.049714+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"30'80","reported_seq":116,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:28.360476+0000","last_change":"2024-01-23T09:25:28.360542+0000","last_active":"2024-01-23T09:25:28.360476+0000","last_peered":"2024-01-23T09:25:28.360476+0000","last_clean":"2024-01-23T09:25:28.360476+0000","last_became_active":"2024-01-23T08:54:49.746481+0000","last_became_peered":"2024-01-23T08:54:49.746481+0000","last_unstale":"2024-01-23T09:25:28.360476+0000","last_undegraded":"2024-01-23T09:25:28.360476+0000","last_fullsized":"2024-01-23T09:25:28.360476+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'80","last_scrub_stamp":"2024-01-23T09:25:28.360291+0000","last_deep_scrub":"30'80","last_deep_scrub_stamp":"2024-01-23T09:25:28.360291+0000","last_clean_scrub_stamp":"2024-01-23T09:25:28.360291+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:37:36.601326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":5137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"30'25","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:19.079670+0000","last_change":"2024-01-23T09:25:19.079728+0000","last_active":"2024-01-23T09:25:19.079670+0000","last_peered":"2024-01-23T09:25:19.079670+0000","last_clean":"2024-01-23T09:25:19.079670+0000","last_became_active":"2024-01-23T08:54:40.687234+0000","last_became_peered":"2024-01-23T08:54:40.687234+0000","last_unstale":"2024-01-23T09:25:19.079670+0000","last_undegraded":"2024-01-23T09:25:19.079670+0000","last_fullsized":"2024-01-23T09:25:19.079670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2024-01-23T09:25:19.079562+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2024-01-23T09:25:19.079562+0000","last_clean_scrub_stamp":"2024-01-23T09:25:19.079562+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:03:58.729582+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"30'21","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:22.811974+0000","last_change":"2024-01-23T09:25:22.812036+0000","last_active":"2024-01-23T09:25:22.811974+0000","last_peered":"2024-01-23T09:25:22.811974+0000","last_clean":"2024-01-23T09:25:22.811974+0000","last_became_active":"2024-01-23T08:55:47.539657+0000","last_became_peered":"2024-01-23T08:55:47.539657+0000","last_unstale":"2024-01-23T09:25:22.811974+0000","last_undegraded":"2024-01-23T09:25:22.811974+0000","last_fullsized":"2024-01-23T09:25:22.811974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2024-01-23T09:25:22.811804+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2024-01-23T09:25:22.811804+0000","last_clean_scrub_stamp":"2024-01-23T09:25:22.811804+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:26:09.064472+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"30'86","reported_seq":122,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:30.362799+0000","last_change":"2024-01-23T09:25:30.362863+0000","last_active":"2024-01-23T09:25:30.362799+0000","last_peered":"2024-01-23T09:25:30.362799+0000","last_clean":"2024-01-23T09:25:30.362799+0000","last_became_active":"2024-01-23T08:54:49.746474+0000","last_became_peered":"2024-01-23T08:54:49.746474+0000","last_unstale":"2024-01-23T09:25:30.362799+0000","last_undegraded":"2024-01-23T09:25:30.362799+0000","last_fullsized":"2024-01-23T09:25:30.362799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'86","last_scrub_stamp":"2024-01-23T09:25:30.362633+0000","last_deep_scrub":"30'86","last_deep_scrub_stamp":"2024-01-23T09:25:30.362633+0000","last_clean_scrub_stamp":"2024-01-23T09:25:30.362633+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:42:50.909053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":12223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"30'11","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:18.069668+0000","last_change":"2024-01-23T09:25:18.069721+0000","last_active":"2024-01-23T09:25:18.069668+0000","last_peered":"2024-01-23T09:25:18.069668+0000","last_clean":"2024-01-23T09:25:18.069668+0000","last_became_active":"2024-01-23T08:54:40.686903+0000","last_became_peered":"2024-01-23T08:54:40.686903+0000","last_unstale":"2024-01-23T09:25:18.069668+0000","last_undegraded":"2024-01-23T09:25:18.069668+0000","last_fullsized":"2024-01-23T09:25:18.069668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'11","last_scrub_stamp":"2024-01-23T09:25:18.069558+0000","last_deep_scrub":"30'11","last_deep_scrub_stamp":"2024-01-23T09:25:18.069558+0000","last_clean_scrub_stamp":"2024-01-23T09:25:18.069558+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:40:53.574638+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"30'36","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:20.378405+0000","last_change":"2024-01-23T09:25:20.378461+0000","last_active":"2024-01-23T09:25:20.378405+0000","last_peered":"2024-01-23T09:25:20.378405+0000","last_clean":"2024-01-23T09:25:20.378405+0000","last_became_active":"2024-01-23T08:54:42.108182+0000","last_became_peered":"2024-01-23T08:54:42.108182+0000","last_unstale":"2024-01-23T09:25:20.378405+0000","last_undegraded":"2024-01-23T09:25:20.378405+0000","last_fullsized":"2024-01-23T09:25:20.378405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'36","last_scrub_stamp":"2024-01-23T09:25:20.378241+0000","last_deep_scrub":"30'36","last_deep_scrub_stamp":"2024-01-23T09:25:20.378241+0000","last_clean_scrub_stamp":"2024-01-23T09:25:20.378241+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:10:50.365882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"30'61","reported_seq":97,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:31.399126+0000","last_change":"2024-01-23T09:25:31.399175+0000","last_active":"2024-01-23T09:25:31.399126+0000","last_peered":"2024-01-23T09:25:31.399126+0000","last_clean":"2024-01-23T09:25:31.399126+0000","last_became_active":"2024-01-23T08:54:49.746880+0000","last_became_peered":"2024-01-23T08:54:49.746880+0000","last_unstale":"2024-01-23T09:25:31.399126+0000","last_undegraded":"2024-01-23T09:25:31.399126+0000","last_fullsized":"2024-01-23T09:25:31.399126+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'61","last_scrub_stamp":"2024-01-23T09:25:31.399039+0000","last_deep_scrub":"30'61","last_deep_scrub_stamp":"2024-01-23T09:25:31.399039+0000","last_clean_scrub_stamp":"2024-01-23T09:25:31.399039+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:50:21.840699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":7433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"30'19","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:21.422655+0000","last_change":"2024-01-23T09:25:21.422715+0000","last_active":"2024-01-23T09:25:21.422655+0000","last_peered":"2024-01-23T09:25:21.422655+0000","last_clean":"2024-01-23T09:25:21.422655+0000","last_became_active":"2024-01-23T08:54:42.088068+0000","last_became_peered":"2024-01-23T08:54:42.088068+0000","last_unstale":"2024-01-23T09:25:21.422655+0000","last_undegraded":"2024-01-23T09:25:21.422655+0000","last_fullsized":"2024-01-23T09:25:21.422655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2024-01-23T09:25:21.422496+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2024-01-23T09:25:21.422496+0000","last_clean_scrub_stamp":"2024-01-23T09:25:21.422496+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:14:07.698218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"30'674","reported_seq":717,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:28.316499+0000","last_change":"2024-01-23T09:25:28.316572+0000","last_active":"2024-01-23T09:25:28.316499+0000","last_peered":"2024-01-23T09:25:28.316499+0000","last_clean":"2024-01-23T09:25:28.316499+0000","last_became_active":"2024-01-23T08:54:40.611589+0000","last_became_peered":"2024-01-23T08:54:40.611589+0000","last_unstale":"2024-01-23T09:25:28.316499+0000","last_undegraded":"2024-01-23T09:25:28.316499+0000","last_fullsized":"2024-01-23T09:25:28.316499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'674","last_scrub_stamp":"2024-01-23T09:25:28.316338+0000","last_deep_scrub":"30'674","last_deep_scrub_stamp":"2024-01-23T09:25:28.316338+0000","last_clean_scrub_stamp":"2024-01-23T09:25:28.316338+0000","objects_scrubbed":3,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:35:07.859385+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":666,"num_write_kb":4421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'70","reported_seq":99,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:03.538683+0000","last_change":"2024-01-23T08:54:49.716713+0000","last_active":"2024-01-23T09:24:03.538683+0000","last_peered":"2024-01-23T09:24:03.538683+0000","last_clean":"2024-01-23T09:24:03.538683+0000","last_became_active":"2024-01-23T08:54:49.715843+0000","last_became_peered":"2024-01-23T08:54:49.715843+0000","last_unstale":"2024-01-23T09:24:03.538683+0000","last_undegraded":"2024-01-23T09:24:03.538683+0000","last_fullsized":"2024-01-23T09:24:03.538683+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":10371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"30'21","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:27.114619+0000","last_change":"2024-01-23T09:25:27.114677+0000","last_active":"2024-01-23T09:25:27.114619+0000","last_peered":"2024-01-23T09:25:27.114619+0000","last_clean":"2024-01-23T09:25:27.114619+0000","last_became_active":"2024-01-23T08:54:42.229547+0000","last_became_peered":"2024-01-23T08:54:42.229547+0000","last_unstale":"2024-01-23T09:25:27.114619+0000","last_undegraded":"2024-01-23T09:25:27.114619+0000","last_fullsized":"2024-01-23T09:25:27.114619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2024-01-23T09:25:27.114448+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2024-01-23T09:25:27.114448+0000","last_clean_scrub_stamp":"2024-01-23T09:25:27.114448+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T21:02:15.627668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"30'6","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:21.239263+0000","last_change":"2024-01-23T09:25:21.239309+0000","last_active":"2024-01-23T09:25:21.239263+0000","last_peered":"2024-01-23T09:25:21.239263+0000","last_clean":"2024-01-23T09:25:21.239263+0000","last_became_active":"2024-01-23T08:54:40.688230+0000","last_became_peered":"2024-01-23T08:54:40.688230+0000","last_unstale":"2024-01-23T09:25:21.239263+0000","last_undegraded":"2024-01-23T09:25:21.239263+0000","last_fullsized":"2024-01-23T09:25:21.239263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'6","last_scrub_stamp":"2024-01-23T09:25:21.239149+0000","last_deep_scrub":"30'6","last_deep_scrub_stamp":"2024-01-23T09:25:21.239149+0000","last_clean_scrub_stamp":"2024-01-23T09:25:21.239149+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:44:15.197898+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"30'94","reported_seq":131,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:31.940004+0000","last_change":"2024-01-23T09:25:31.940071+0000","last_active":"2024-01-23T09:25:31.940004+0000","last_peered":"2024-01-23T09:25:31.940004+0000","last_clean":"2024-01-23T09:25:31.940004+0000","last_became_active":"2024-01-23T08:54:49.747958+0000","last_became_peered":"2024-01-23T08:54:49.747958+0000","last_unstale":"2024-01-23T09:25:31.940004+0000","last_undegraded":"2024-01-23T09:25:31.940004+0000","last_fullsized":"2024-01-23T09:25:31.940004+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'94","last_scrub_stamp":"2024-01-23T09:25:31.939833+0000","last_deep_scrub":"30'94","last_deep_scrub_stamp":"2024-01-23T09:25:31.939833+0000","last_clean_scrub_stamp":"2024-01-23T09:25:31.939833+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:28:57.873112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":8657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"30'23","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:25.558986+0000","last_change":"2024-01-23T09:25:25.559050+0000","last_active":"2024-01-23T09:25:25.558986+0000","last_peered":"2024-01-23T09:25:25.558986+0000","last_clean":"2024-01-23T09:25:25.558986+0000","last_became_active":"2024-01-23T08:54:42.193403+0000","last_became_peered":"2024-01-23T08:54:42.193403+0000","last_unstale":"2024-01-23T09:25:25.558986+0000","last_undegraded":"2024-01-23T09:25:25.558986+0000","last_fullsized":"2024-01-23T09:25:25.558986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'23","last_scrub_stamp":"2024-01-23T09:25:25.558806+0000","last_deep_scrub":"30'23","last_deep_scrub_stamp":"2024-01-23T09:25:25.558806+0000","last_clean_scrub_stamp":"2024-01-23T09:25:25.558806+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:04:05.208827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"30'15","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:22.510214+0000","last_change":"2024-01-23T09:25:22.510295+0000","last_active":"2024-01-23T09:25:22.510214+0000","last_peered":"2024-01-23T09:25:22.510214+0000","last_clean":"2024-01-23T09:25:22.510214+0000","last_became_active":"2024-01-23T08:54:40.688122+0000","last_became_peered":"2024-01-23T08:54:40.688122+0000","last_unstale":"2024-01-23T09:25:22.510214+0000","last_undegraded":"2024-01-23T09:25:22.510214+0000","last_fullsized":"2024-01-23T09:25:22.510214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'15","last_scrub_stamp":"2024-01-23T09:25:22.510026+0000","last_deep_scrub":"30'15","last_deep_scrub_stamp":"2024-01-23T09:25:22.510026+0000","last_clean_scrub_stamp":"2024-01-23T09:25:22.510026+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:06:16.691465+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'73","reported_seq":110,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:29.201149+0000","last_change":"2024-01-23T09:25:29.201213+0000","last_active":"2024-01-23T09:25:29.201149+0000","last_peered":"2024-01-23T09:25:29.201149+0000","last_clean":"2024-01-23T09:25:29.201149+0000","last_became_active":"2024-01-23T08:54:49.737442+0000","last_became_peered":"2024-01-23T08:54:49.737442+0000","last_unstale":"2024-01-23T09:25:29.201149+0000","last_undegraded":"2024-01-23T09:25:29.201149+0000","last_fullsized":"2024-01-23T09:25:29.201149+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'73","last_scrub_stamp":"2024-01-23T09:25:29.200987+0000","last_deep_scrub":"30'73","last_deep_scrub_stamp":"2024-01-23T09:25:29.200987+0000","last_clean_scrub_stamp":"2024-01-23T09:25:29.200987+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:10:06.313584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":10395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"30'19","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:37.383174+0000","last_change":"2024-01-23T09:25:37.383211+0000","last_active":"2024-01-23T09:25:37.383174+0000","last_peered":"2024-01-23T09:25:37.383174+0000","last_clean":"2024-01-23T09:25:37.383174+0000","last_became_active":"2024-01-23T08:54:42.192225+0000","last_became_peered":"2024-01-23T08:54:42.192225+0000","last_unstale":"2024-01-23T09:25:37.383174+0000","last_undegraded":"2024-01-23T09:25:37.383174+0000","last_fullsized":"2024-01-23T09:25:37.383174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2024-01-23T09:25:37.383064+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2024-01-23T09:25:37.383064+0000","last_clean_scrub_stamp":"2024-01-23T09:25:37.383064+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:34:53.112850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"30'8","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:17.020198+0000","last_change":"2024-01-23T09:25:17.020226+0000","last_active":"2024-01-23T09:25:17.020198+0000","last_peered":"2024-01-23T09:25:17.020198+0000","last_clean":"2024-01-23T09:25:17.020198+0000","last_became_active":"2024-01-23T08:54:40.686654+0000","last_became_peered":"2024-01-23T08:54:40.686654+0000","last_unstale":"2024-01-23T09:25:17.020198+0000","last_undegraded":"2024-01-23T09:25:17.020198+0000","last_fullsized":"2024-01-23T09:25:17.020198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'8","last_scrub_stamp":"2024-01-23T09:25:17.020124+0000","last_deep_scrub":"30'8","last_deep_scrub_stamp":"2024-01-23T09:25:17.020124+0000","last_clean_scrub_stamp":"2024-01-23T09:25:17.020124+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:13:09.335460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"30'83","reported_seq":120,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:26.339084+0000","last_change":"2024-01-23T09:25:26.339146+0000","last_active":"2024-01-23T09:25:26.339084+0000","last_peered":"2024-01-23T09:25:26.339084+0000","last_clean":"2024-01-23T09:25:26.339084+0000","last_became_active":"2024-01-23T08:54:49.735971+0000","last_became_peered":"2024-01-23T08:54:49.735971+0000","last_unstale":"2024-01-23T09:25:26.339084+0000","last_undegraded":"2024-01-23T09:25:26.339084+0000","last_fullsized":"2024-01-23T09:25:26.339084+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'83","last_scrub_stamp":"2024-01-23T09:25:26.338846+0000","last_deep_scrub":"30'83","last_deep_scrub_stamp":"2024-01-23T09:25:26.338846+0000","last_clean_scrub_stamp":"2024-01-23T09:25:26.338846+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:04:05.988867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":6293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"30'30","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:26.568153+0000","last_change":"2024-01-23T09:25:26.568265+0000","last_active":"2024-01-23T09:25:26.568153+0000","last_peered":"2024-01-23T09:25:26.568153+0000","last_clean":"2024-01-23T09:25:26.568153+0000","last_became_active":"2024-01-23T08:54:42.195052+0000","last_became_peered":"2024-01-23T08:54:42.195052+0000","last_unstale":"2024-01-23T09:25:26.568153+0000","last_undegraded":"2024-01-23T09:25:26.568153+0000","last_fullsized":"2024-01-23T09:25:26.568153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2024-01-23T09:25:26.567965+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2024-01-23T09:25:26.567965+0000","last_clean_scrub_stamp":"2024-01-23T09:25:26.567965+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:25:41.566911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"30'13","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:35.379910+0000","last_change":"2024-01-23T09:25:35.379982+0000","last_active":"2024-01-23T09:25:35.379910+0000","last_peered":"2024-01-23T09:25:35.379910+0000","last_clean":"2024-01-23T09:25:35.379910+0000","last_became_active":"2024-01-23T08:54:40.693610+0000","last_became_peered":"2024-01-23T08:54:40.693610+0000","last_unstale":"2024-01-23T09:25:35.379910+0000","last_undegraded":"2024-01-23T09:25:35.379910+0000","last_fullsized":"2024-01-23T09:25:35.379910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'13","last_scrub_stamp":"2024-01-23T09:25:35.379738+0000","last_deep_scrub":"30'13","last_deep_scrub_stamp":"2024-01-23T09:25:35.379738+0000","last_clean_scrub_stamp":"2024-01-23T09:25:35.379738+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:11:57.530358+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"30'40","reported_seq":78,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:29.387850+0000","last_change":"2024-01-23T09:25:29.387913+0000","last_active":"2024-01-23T09:25:29.387850+0000","last_peered":"2024-01-23T09:25:29.387850+0000","last_clean":"2024-01-23T09:25:29.387850+0000","last_became_active":"2024-01-23T08:54:49.746792+0000","last_became_peered":"2024-01-23T08:54:49.746792+0000","last_unstale":"2024-01-23T09:25:29.387850+0000","last_undegraded":"2024-01-23T09:25:29.387850+0000","last_fullsized":"2024-01-23T09:25:29.387850+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'40","last_scrub_stamp":"2024-01-23T09:25:29.387684+0000","last_deep_scrub":"30'40","last_deep_scrub_stamp":"2024-01-23T09:25:29.387684+0000","last_clean_scrub_stamp":"2024-01-23T09:25:29.387684+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:06:56.096186+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":6755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"30'21","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:30.569562+0000","last_change":"2024-01-23T09:25:30.569671+0000","last_active":"2024-01-23T09:25:30.569562+0000","last_peered":"2024-01-23T09:25:30.569562+0000","last_clean":"2024-01-23T09:25:30.569562+0000","last_became_active":"2024-01-23T08:54:42.233018+0000","last_became_peered":"2024-01-23T08:54:42.233018+0000","last_unstale":"2024-01-23T09:25:30.569562+0000","last_undegraded":"2024-01-23T09:25:30.569562+0000","last_fullsized":"2024-01-23T09:25:30.569562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2024-01-23T09:25:30.569295+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2024-01-23T09:25:30.569295+0000","last_clean_scrub_stamp":"2024-01-23T09:25:30.569295+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:50:21.010955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"30'339","reported_seq":383,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:23.502230+0000","last_change":"2024-01-23T09:25:23.502356+0000","last_active":"2024-01-23T09:25:23.502230+0000","last_peered":"2024-01-23T09:25:23.502230+0000","last_clean":"2024-01-23T09:25:23.502230+0000","last_became_active":"2024-01-23T08:54:40.689528+0000","last_became_peered":"2024-01-23T08:54:40.689528+0000","last_unstale":"2024-01-23T09:25:23.502230+0000","last_undegraded":"2024-01-23T09:25:23.502230+0000","last_fullsized":"2024-01-23T09:25:23.502230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'339","last_scrub_stamp":"2024-01-23T09:25:23.502022+0000","last_deep_scrub":"30'339","last_deep_scrub_stamp":"2024-01-23T09:25:23.502022+0000","last_clean_scrub_stamp":"2024-01-23T09:25:23.502022+0000","objects_scrubbed":4,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:13:15.817358+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":906,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"30'90","reported_seq":129,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:32.556234+0000","last_change":"2024-01-23T09:25:32.556298+0000","last_active":"2024-01-23T09:25:32.556234+0000","last_peered":"2024-01-23T09:25:32.556234+0000","last_clean":"2024-01-23T09:25:32.556234+0000","last_became_active":"2024-01-23T08:54:49.731414+0000","last_became_peered":"2024-01-23T08:54:49.731414+0000","last_unstale":"2024-01-23T09:25:32.556234+0000","last_undegraded":"2024-01-23T09:25:32.556234+0000","last_fullsized":"2024-01-23T09:25:32.556234+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'90","last_scrub_stamp":"2024-01-23T09:25:32.556059+0000","last_deep_scrub":"30'90","last_deep_scrub_stamp":"2024-01-23T09:25:32.556059+0000","last_clean_scrub_stamp":"2024-01-23T09:25:32.556059+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:14:18.831781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":11197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"30'21","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:25.321593+0000","last_change":"2024-01-23T09:25:25.321652+0000","last_active":"2024-01-23T09:25:25.321593+0000","last_peered":"2024-01-23T09:25:25.321593+0000","last_clean":"2024-01-23T09:25:25.321593+0000","last_became_active":"2024-01-23T08:54:42.227188+0000","last_became_peered":"2024-01-23T08:54:42.227188+0000","last_unstale":"2024-01-23T09:25:25.321593+0000","last_undegraded":"2024-01-23T09:25:25.321593+0000","last_fullsized":"2024-01-23T09:25:25.321593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2024-01-23T09:25:25.321336+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2024-01-23T09:25:25.321336+0000","last_clean_scrub_stamp":"2024-01-23T09:25:25.321336+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:48:05.691281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"30'10","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:30.294168+0000","last_change":"2024-01-23T09:25:30.294229+0000","last_active":"2024-01-23T09:25:30.294168+0000","last_peered":"2024-01-23T09:25:30.294168+0000","last_clean":"2024-01-23T09:25:30.294168+0000","last_became_active":"2024-01-23T08:54:40.657616+0000","last_became_peered":"2024-01-23T08:54:40.657616+0000","last_unstale":"2024-01-23T09:25:30.294168+0000","last_undegraded":"2024-01-23T09:25:30.294168+0000","last_fullsized":"2024-01-23T09:25:30.294168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'10","last_scrub_stamp":"2024-01-23T09:25:30.294038+0000","last_deep_scrub":"30'10","last_deep_scrub_stamp":"2024-01-23T09:25:30.294038+0000","last_clean_scrub_stamp":"2024-01-23T09:25:30.294038+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:42:29.066740+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"30'59","reported_seq":97,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:33.322774+0000","last_change":"2024-01-23T09:25:33.322884+0000","last_active":"2024-01-23T09:25:33.322774+0000","last_peered":"2024-01-23T09:25:33.322774+0000","last_clean":"2024-01-23T09:25:33.322774+0000","last_became_active":"2024-01-23T08:54:49.738579+0000","last_became_peered":"2024-01-23T08:54:49.738579+0000","last_unstale":"2024-01-23T09:25:33.322774+0000","last_undegraded":"2024-01-23T09:25:33.322774+0000","last_fullsized":"2024-01-23T09:25:33.322774+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'59","last_scrub_stamp":"2024-01-23T09:25:33.322594+0000","last_deep_scrub":"30'59","last_deep_scrub_stamp":"2024-01-23T09:25:33.322594+0000","last_clean_scrub_stamp":"2024-01-23T09:25:33.322594+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:21:01.329570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":6541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"30'19","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:24.303129+0000","last_change":"2024-01-23T09:25:24.303188+0000","last_active":"2024-01-23T09:25:24.303129+0000","last_peered":"2024-01-23T09:25:24.303129+0000","last_clean":"2024-01-23T09:25:24.303129+0000","last_became_active":"2024-01-23T08:54:42.227558+0000","last_became_peered":"2024-01-23T08:54:42.227558+0000","last_unstale":"2024-01-23T09:25:24.303129+0000","last_undegraded":"2024-01-23T09:25:24.303129+0000","last_fullsized":"2024-01-23T09:25:24.303129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2024-01-23T09:25:24.302965+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2024-01-23T09:25:24.302965+0000","last_clean_scrub_stamp":"2024-01-23T09:25:24.302965+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:13:16.618301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"30'5","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:25.904257+0000","last_change":"2024-01-23T09:25:25.904322+0000","last_active":"2024-01-23T09:25:25.904257+0000","last_peered":"2024-01-23T09:25:25.904257+0000","last_clean":"2024-01-23T09:25:25.904257+0000","last_became_active":"2024-01-23T08:54:40.696688+0000","last_became_peered":"2024-01-23T08:54:40.696688+0000","last_unstale":"2024-01-23T09:25:25.904257+0000","last_undegraded":"2024-01-23T09:25:25.904257+0000","last_fullsized":"2024-01-23T09:25:25.904257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2024-01-23T09:25:25.904086+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2024-01-23T09:25:25.904086+0000","last_clean_scrub_stamp":"2024-01-23T09:25:25.904086+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:53:06.280459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'81","reported_seq":119,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:31.372412+0000","last_change":"2024-01-23T09:25:31.372526+0000","last_active":"2024-01-23T09:25:31.372412+0000","last_peered":"2024-01-23T09:25:31.372412+0000","last_clean":"2024-01-23T09:25:31.372412+0000","last_became_active":"2024-01-23T08:54:49.725830+0000","last_became_peered":"2024-01-23T08:54:49.725830+0000","last_unstale":"2024-01-23T09:25:31.372412+0000","last_undegraded":"2024-01-23T09:25:31.372412+0000","last_fullsized":"2024-01-23T09:25:31.372412+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'81","last_scrub_stamp":"2024-01-23T09:25:31.372229+0000","last_deep_scrub":"30'81","last_deep_scrub_stamp":"2024-01-23T09:25:31.372229+0000","last_clean_scrub_stamp":"2024-01-23T09:25:31.372229+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:42:08.426759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":6498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"30'21","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:27.971078+0000","last_change":"2024-01-23T09:25:27.971107+0000","last_active":"2024-01-23T09:25:27.971078+0000","last_peered":"2024-01-23T09:25:27.971078+0000","last_clean":"2024-01-23T09:25:27.971078+0000","last_became_active":"2024-01-23T08:54:42.149019+0000","last_became_peered":"2024-01-23T08:54:42.149019+0000","last_unstale":"2024-01-23T09:25:27.971078+0000","last_undegraded":"2024-01-23T09:25:27.971078+0000","last_fullsized":"2024-01-23T09:25:27.971078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2024-01-23T09:25:27.970994+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2024-01-23T09:25:27.970994+0000","last_clean_scrub_stamp":"2024-01-23T09:25:27.970994+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:55:09.354462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"30'10","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:33.343212+0000","last_change":"2024-01-23T09:25:33.343361+0000","last_active":"2024-01-23T09:25:33.343212+0000","last_peered":"2024-01-23T09:25:33.343212+0000","last_clean":"2024-01-23T09:25:33.343212+0000","last_became_active":"2024-01-23T08:54:40.679839+0000","last_became_peered":"2024-01-23T08:54:40.679839+0000","last_unstale":"2024-01-23T09:25:33.343212+0000","last_undegraded":"2024-01-23T09:25:33.343212+0000","last_fullsized":"2024-01-23T09:25:33.343212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'10","last_scrub_stamp":"2024-01-23T09:25:33.343004+0000","last_deep_scrub":"30'10","last_deep_scrub_stamp":"2024-01-23T09:25:33.343004+0000","last_clean_scrub_stamp":"2024-01-23T09:25:33.343004+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:10:56.823878+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"30'52","reported_seq":99,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:35.336223+0000","last_change":"2024-01-23T09:25:35.336351+0000","last_active":"2024-01-23T09:25:35.336223+0000","last_peered":"2024-01-23T09:25:35.336223+0000","last_clean":"2024-01-23T09:25:35.336223+0000","last_became_active":"2024-01-23T08:55:47.749227+0000","last_became_peered":"2024-01-23T08:55:47.749227+0000","last_unstale":"2024-01-23T09:25:35.336223+0000","last_undegraded":"2024-01-23T09:25:35.336223+0000","last_fullsized":"2024-01-23T09:25:35.336223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'52","last_scrub_stamp":"2024-01-23T09:25:35.336002+0000","last_deep_scrub":"30'52","last_deep_scrub_stamp":"2024-01-23T09:25:35.336002+0000","last_clean_scrub_stamp":"2024-01-23T09:25:35.336002+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:18:59.173232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":3470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,5],"acting":[6,7,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"30'22","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:22.957687+0000","last_change":"2024-01-23T09:25:22.957801+0000","last_active":"2024-01-23T09:25:22.957687+0000","last_peered":"2024-01-23T09:25:22.957687+0000","last_clean":"2024-01-23T09:25:22.957687+0000","last_became_active":"2024-01-23T08:54:42.108346+0000","last_became_peered":"2024-01-23T08:54:42.108346+0000","last_unstale":"2024-01-23T09:25:22.957687+0000","last_undegraded":"2024-01-23T09:25:22.957687+0000","last_fullsized":"2024-01-23T09:25:22.957687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'22","last_scrub_stamp":"2024-01-23T09:25:22.957427+0000","last_deep_scrub":"30'22","last_deep_scrub_stamp":"2024-01-23T09:25:22.957427+0000","last_clean_scrub_stamp":"2024-01-23T09:25:22.957427+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:22:55.279751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"30'536","reported_seq":1099,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:24.184546+0000","last_change":"2024-01-23T09:25:24.184616+0000","last_active":"2024-01-23T09:25:24.184546+0000","last_peered":"2024-01-23T09:25:24.184546+0000","last_clean":"2024-01-23T09:25:24.184546+0000","last_became_active":"2024-01-23T08:54:40.707841+0000","last_became_peered":"2024-01-23T08:54:40.707841+0000","last_unstale":"2024-01-23T09:25:24.184546+0000","last_undegraded":"2024-01-23T09:25:24.184546+0000","last_fullsized":"2024-01-23T09:25:24.184546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'536","last_scrub_stamp":"2024-01-23T09:25:24.184377+0000","last_deep_scrub":"30'536","last_deep_scrub_stamp":"2024-01-23T09:25:24.184377+0000","last_clean_scrub_stamp":"2024-01-23T09:25:24.184377+0000","objects_scrubbed":4,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:34:44.761939+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123944,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":519,"num_read_kb":542,"num_write":528,"num_write_kb":547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"30'72","reported_seq":110,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:32.327893+0000","last_change":"2024-01-23T09:25:32.327954+0000","last_active":"2024-01-23T09:25:32.327893+0000","last_peered":"2024-01-23T09:25:32.327893+0000","last_clean":"2024-01-23T09:25:32.327893+0000","last_became_active":"2024-01-23T08:54:49.737677+0000","last_became_peered":"2024-01-23T08:54:49.737677+0000","last_unstale":"2024-01-23T09:25:32.327893+0000","last_undegraded":"2024-01-23T09:25:32.327893+0000","last_fullsized":"2024-01-23T09:25:32.327893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'72","last_scrub_stamp":"2024-01-23T09:25:32.327717+0000","last_deep_scrub":"30'72","last_deep_scrub_stamp":"2024-01-23T09:25:32.327717+0000","last_clean_scrub_stamp":"2024-01-23T09:25:32.327717+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:44:10.288444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"30'12","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:26.301484+0000","last_change":"2024-01-23T09:25:26.301543+0000","last_active":"2024-01-23T09:25:26.301484+0000","last_peered":"2024-01-23T09:25:26.301484+0000","last_clean":"2024-01-23T09:25:26.301484+0000","last_became_active":"2024-01-23T08:54:42.227335+0000","last_became_peered":"2024-01-23T08:54:42.227335+0000","last_unstale":"2024-01-23T09:25:26.301484+0000","last_undegraded":"2024-01-23T09:25:26.301484+0000","last_fullsized":"2024-01-23T09:25:26.301484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'12","last_scrub_stamp":"2024-01-23T09:25:26.301320+0000","last_deep_scrub":"30'12","last_deep_scrub_stamp":"2024-01-23T09:25:26.301320+0000","last_clean_scrub_stamp":"2024-01-23T09:25:26.301320+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:47:59.718403+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"30'12","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:32.334994+0000","last_change":"2024-01-23T09:25:32.335057+0000","last_active":"2024-01-23T09:25:32.334994+0000","last_peered":"2024-01-23T09:25:32.334994+0000","last_clean":"2024-01-23T09:25:32.334994+0000","last_became_active":"2024-01-23T08:54:40.679467+0000","last_became_peered":"2024-01-23T08:54:40.679467+0000","last_unstale":"2024-01-23T09:25:32.334994+0000","last_undegraded":"2024-01-23T09:25:32.334994+0000","last_fullsized":"2024-01-23T09:25:32.334994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'12","last_scrub_stamp":"2024-01-23T09:25:32.334832+0000","last_deep_scrub":"30'12","last_deep_scrub_stamp":"2024-01-23T09:25:32.334832+0000","last_clean_scrub_stamp":"2024-01-23T09:25:32.334832+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:49:33.631080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"30'96","reported_seq":134,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:37.867994+0000","last_change":"2024-01-23T09:25:37.868082+0000","last_active":"2024-01-23T09:25:37.867994+0000","last_peered":"2024-01-23T09:25:37.867994+0000","last_clean":"2024-01-23T09:25:37.867994+0000","last_became_active":"2024-01-23T08:54:49.729861+0000","last_became_peered":"2024-01-23T08:54:49.729861+0000","last_unstale":"2024-01-23T09:25:37.867994+0000","last_undegraded":"2024-01-23T09:25:37.867994+0000","last_fullsized":"2024-01-23T09:25:37.867994+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'96","last_scrub_stamp":"2024-01-23T09:25:37.867811+0000","last_deep_scrub":"30'96","last_deep_scrub_stamp":"2024-01-23T09:25:37.867811+0000","last_clean_scrub_stamp":"2024-01-23T09:25:37.867811+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:09:39.201070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":9432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"30'21","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:19.548630+0000","last_change":"2024-01-23T09:25:19.548688+0000","last_active":"2024-01-23T09:25:19.548630+0000","last_peered":"2024-01-23T09:25:19.548630+0000","last_clean":"2024-01-23T09:25:19.548630+0000","last_became_active":"2024-01-23T08:54:42.195555+0000","last_became_peered":"2024-01-23T08:54:42.195555+0000","last_unstale":"2024-01-23T09:25:19.548630+0000","last_undegraded":"2024-01-23T09:25:19.548630+0000","last_fullsized":"2024-01-23T09:25:19.548630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2024-01-23T09:25:19.548477+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2024-01-23T09:25:19.548477+0000","last_clean_scrub_stamp":"2024-01-23T09:25:19.548477+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:09:56.661075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"30'13","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:29.339433+0000","last_change":"2024-01-23T09:25:29.339505+0000","last_active":"2024-01-23T09:25:29.339433+0000","last_peered":"2024-01-23T09:25:29.339433+0000","last_clean":"2024-01-23T09:25:29.339433+0000","last_became_active":"2024-01-23T08:54:40.611932+0000","last_became_peered":"2024-01-23T08:54:40.611932+0000","last_unstale":"2024-01-23T09:25:29.339433+0000","last_undegraded":"2024-01-23T09:25:29.339433+0000","last_fullsized":"2024-01-23T09:25:29.339433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'13","last_scrub_stamp":"2024-01-23T09:25:29.339275+0000","last_deep_scrub":"30'13","last_deep_scrub_stamp":"2024-01-23T09:25:29.339275+0000","last_clean_scrub_stamp":"2024-01-23T09:25:29.339275+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:09:30.672533+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"30'119","reported_seq":199,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:15.768753+0000","last_change":"2024-01-23T09:25:15.768792+0000","last_active":"2024-01-23T09:25:15.768753+0000","last_peered":"2024-01-23T09:25:15.768753+0000","last_clean":"2024-01-23T09:25:15.768753+0000","last_became_active":"2024-01-23T08:54:01.490869+0000","last_became_peered":"2024-01-23T08:54:01.490869+0000","last_unstale":"2024-01-23T09:25:15.768753+0000","last_undegraded":"2024-01-23T09:25:15.768753+0000","last_fullsized":"2024-01-23T09:25:15.768753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'119","last_scrub_stamp":"2024-01-23T09:25:15.768666+0000","last_deep_scrub":"30'119","last_deep_scrub_stamp":"2024-01-23T09:25:15.768666+0000","last_clean_scrub_stamp":"2024-01-23T09:25:15.768666+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:08:16.784078+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"30'73","reported_seq":103,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:24:08.539819+0000","last_change":"2024-01-23T08:54:49.716297+0000","last_active":"2024-01-23T09:24:08.539819+0000","last_peered":"2024-01-23T09:24:08.539819+0000","last_clean":"2024-01-23T09:24:08.539819+0000","last_became_active":"2024-01-23T08:54:49.715231+0000","last_became_peered":"2024-01-23T08:54:49.715231+0000","last_unstale":"2024-01-23T09:24:08.539819+0000","last_undegraded":"2024-01-23T09:24:08.539819+0000","last_fullsized":"2024-01-23T09:24:08.539819+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"30'24","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:19.340644+0000","last_change":"2024-01-23T09:25:19.340701+0000","last_active":"2024-01-23T09:25:19.340644+0000","last_peered":"2024-01-23T09:25:19.340644+0000","last_clean":"2024-01-23T09:25:19.340644+0000","last_became_active":"2024-01-23T08:54:42.088303+0000","last_became_peered":"2024-01-23T08:54:42.088303+0000","last_unstale":"2024-01-23T09:25:19.340644+0000","last_undegraded":"2024-01-23T09:25:19.340644+0000","last_fullsized":"2024-01-23T09:25:19.340644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2024-01-23T09:25:19.340492+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2024-01-23T09:25:19.340492+0000","last_clean_scrub_stamp":"2024-01-23T09:25:19.340492+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:55:17.547212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"30'11","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:23.323144+0000","last_change":"2024-01-23T09:25:23.323267+0000","last_active":"2024-01-23T09:25:23.323144+0000","last_peered":"2024-01-23T09:25:23.323144+0000","last_clean":"2024-01-23T09:25:23.323144+0000","last_became_active":"2024-01-23T08:54:40.689895+0000","last_became_peered":"2024-01-23T08:54:40.689895+0000","last_unstale":"2024-01-23T09:25:23.323144+0000","last_undegraded":"2024-01-23T09:25:23.323144+0000","last_fullsized":"2024-01-23T09:25:23.323144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'11","last_scrub_stamp":"2024-01-23T09:25:23.322980+0000","last_deep_scrub":"30'11","last_deep_scrub_stamp":"2024-01-23T09:25:23.322980+0000","last_clean_scrub_stamp":"2024-01-23T09:25:23.322980+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:51:37.946405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1751,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"30'84","reported_seq":122,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:27.320738+0000","last_change":"2024-01-23T09:25:27.320800+0000","last_active":"2024-01-23T09:25:27.320738+0000","last_peered":"2024-01-23T09:25:27.320738+0000","last_clean":"2024-01-23T09:25:27.320738+0000","last_became_active":"2024-01-23T08:54:49.735777+0000","last_became_peered":"2024-01-23T08:54:49.735777+0000","last_unstale":"2024-01-23T09:25:27.320738+0000","last_undegraded":"2024-01-23T09:25:27.320738+0000","last_fullsized":"2024-01-23T09:25:27.320738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'84","last_scrub_stamp":"2024-01-23T09:25:27.320577+0000","last_deep_scrub":"30'84","last_deep_scrub_stamp":"2024-01-23T09:25:27.320577+0000","last_clean_scrub_stamp":"2024-01-23T09:25:27.320577+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:25:42.319524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":8939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'22","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:23.031216+0000","last_change":"2024-01-23T09:25:23.031338+0000","last_active":"2024-01-23T09:25:23.031216+0000","last_peered":"2024-01-23T09:25:23.031216+0000","last_clean":"2024-01-23T09:25:23.031216+0000","last_became_active":"2024-01-23T08:54:42.106757+0000","last_became_peered":"2024-01-23T08:54:42.106757+0000","last_unstale":"2024-01-23T09:25:23.031216+0000","last_undegraded":"2024-01-23T09:25:23.031216+0000","last_fullsized":"2024-01-23T09:25:23.031216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'22","last_scrub_stamp":"2024-01-23T09:25:23.030956+0000","last_deep_scrub":"30'22","last_deep_scrub_stamp":"2024-01-23T09:25:23.030956+0000","last_clean_scrub_stamp":"2024-01-23T09:25:23.030956+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:42:43.577376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"30'8","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:24.955987+0000","last_change":"2024-01-23T09:25:24.956049+0000","last_active":"2024-01-23T09:25:24.955987+0000","last_peered":"2024-01-23T09:25:24.955987+0000","last_clean":"2024-01-23T09:25:24.955987+0000","last_became_active":"2024-01-23T08:54:40.686860+0000","last_became_peered":"2024-01-23T08:54:40.686860+0000","last_unstale":"2024-01-23T09:25:24.955987+0000","last_undegraded":"2024-01-23T09:25:24.955987+0000","last_fullsized":"2024-01-23T09:25:24.955987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'8","last_scrub_stamp":"2024-01-23T09:25:24.955826+0000","last_deep_scrub":"30'8","last_deep_scrub_stamp":"2024-01-23T09:25:24.955826+0000","last_clean_scrub_stamp":"2024-01-23T09:25:24.955826+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:37:33.196861+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'92","reported_seq":129,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:35.873435+0000","last_change":"2024-01-23T09:25:35.873496+0000","last_active":"2024-01-23T09:25:35.873435+0000","last_peered":"2024-01-23T09:25:35.873435+0000","last_clean":"2024-01-23T09:25:35.873435+0000","last_became_active":"2024-01-23T08:54:49.721494+0000","last_became_peered":"2024-01-23T08:54:49.721494+0000","last_unstale":"2024-01-23T09:25:35.873435+0000","last_undegraded":"2024-01-23T09:25:35.873435+0000","last_fullsized":"2024-01-23T09:25:35.873435+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'92","last_scrub_stamp":"2024-01-23T09:25:35.873266+0000","last_deep_scrub":"30'92","last_deep_scrub_stamp":"2024-01-23T09:25:35.873266+0000","last_clean_scrub_stamp":"2024-01-23T09:25:35.873266+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:57:13.966564+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":9285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"30'25","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:25.045168+0000","last_change":"2024-01-23T09:25:25.045228+0000","last_active":"2024-01-23T09:25:25.045168+0000","last_peered":"2024-01-23T09:25:25.045168+0000","last_clean":"2024-01-23T09:25:25.045168+0000","last_became_active":"2024-01-23T08:54:42.117317+0000","last_became_peered":"2024-01-23T08:54:42.117317+0000","last_unstale":"2024-01-23T09:25:25.045168+0000","last_undegraded":"2024-01-23T09:25:25.045168+0000","last_fullsized":"2024-01-23T09:25:25.045168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2024-01-23T09:25:25.044995+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2024-01-23T09:25:25.044995+0000","last_clean_scrub_stamp":"2024-01-23T09:25:25.044995+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:10:55.032636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"30'9","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:21.544601+0000","last_change":"2024-01-23T09:25:21.544675+0000","last_active":"2024-01-23T09:25:21.544601+0000","last_peered":"2024-01-23T09:25:21.544601+0000","last_clean":"2024-01-23T09:25:21.544601+0000","last_became_active":"2024-01-23T08:54:40.681954+0000","last_became_peered":"2024-01-23T08:54:40.681954+0000","last_unstale":"2024-01-23T09:25:21.544601+0000","last_undegraded":"2024-01-23T09:25:21.544601+0000","last_fullsized":"2024-01-23T09:25:21.544601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'9","last_scrub_stamp":"2024-01-23T09:25:21.544421+0000","last_deep_scrub":"30'9","last_deep_scrub_stamp":"2024-01-23T09:25:21.544421+0000","last_clean_scrub_stamp":"2024-01-23T09:25:21.544421+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:54:59.625654+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"30'57","reported_seq":87,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:08.550075+0000","last_change":"2024-01-23T08:54:49.716316+0000","last_active":"2024-01-23T09:25:08.550075+0000","last_peered":"2024-01-23T09:25:08.550075+0000","last_clean":"2024-01-23T09:25:08.550075+0000","last_became_active":"2024-01-23T08:54:49.715917+0000","last_became_peered":"2024-01-23T08:54:49.715917+0000","last_unstale":"2024-01-23T09:25:08.550075+0000","last_undegraded":"2024-01-23T09:25:08.550075+0000","last_fullsized":"2024-01-23T09:25:08.550075+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":5210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"30'17","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:20.184250+0000","last_change":"2024-01-23T09:25:20.184307+0000","last_active":"2024-01-23T09:25:20.184250+0000","last_peered":"2024-01-23T09:25:20.184250+0000","last_clean":"2024-01-23T09:25:20.184250+0000","last_became_active":"2024-01-23T08:54:42.155411+0000","last_became_peered":"2024-01-23T08:54:42.155411+0000","last_unstale":"2024-01-23T09:25:20.184250+0000","last_undegraded":"2024-01-23T09:25:20.184250+0000","last_fullsized":"2024-01-23T09:25:20.184250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'17","last_scrub_stamp":"2024-01-23T09:25:20.184069+0000","last_deep_scrub":"30'17","last_deep_scrub_stamp":"2024-01-23T09:25:20.184069+0000","last_clean_scrub_stamp":"2024-01-23T09:25:20.184069+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:09:57.296666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"30'7","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:22.056712+0000","last_change":"2024-01-23T09:25:22.056762+0000","last_active":"2024-01-23T09:25:22.056712+0000","last_peered":"2024-01-23T09:25:22.056712+0000","last_clean":"2024-01-23T09:25:22.056712+0000","last_became_active":"2024-01-23T08:54:40.696128+0000","last_became_peered":"2024-01-23T08:54:40.696128+0000","last_unstale":"2024-01-23T09:25:22.056712+0000","last_undegraded":"2024-01-23T09:25:22.056712+0000","last_fullsized":"2024-01-23T09:25:22.056712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'7","last_scrub_stamp":"2024-01-23T09:25:22.056607+0000","last_deep_scrub":"30'7","last_deep_scrub_stamp":"2024-01-23T09:25:22.056607+0000","last_clean_scrub_stamp":"2024-01-23T09:25:22.056607+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:06:48.765109+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"30'112","reported_seq":150,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:21.806794+0000","last_change":"2024-01-23T09:25:21.806913+0000","last_active":"2024-01-23T09:25:21.806794+0000","last_peered":"2024-01-23T09:25:21.806794+0000","last_clean":"2024-01-23T09:25:21.806794+0000","last_became_active":"2024-01-23T08:54:49.723038+0000","last_became_peered":"2024-01-23T08:54:49.723038+0000","last_unstale":"2024-01-23T09:25:21.806794+0000","last_undegraded":"2024-01-23T09:25:21.806794+0000","last_fullsized":"2024-01-23T09:25:21.806794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'112","last_scrub_stamp":"2024-01-23T09:25:21.806533+0000","last_deep_scrub":"30'112","last_deep_scrub_stamp":"2024-01-23T09:25:21.806533+0000","last_clean_scrub_stamp":"2024-01-23T09:25:21.806533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:09:40.303945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":12618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"30'22","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:24.428684+0000","last_change":"2024-01-23T09:25:24.428743+0000","last_active":"2024-01-23T09:25:24.428684+0000","last_peered":"2024-01-23T09:25:24.428684+0000","last_clean":"2024-01-23T09:25:24.428684+0000","last_became_active":"2024-01-23T08:54:42.149180+0000","last_became_peered":"2024-01-23T08:54:42.149180+0000","last_unstale":"2024-01-23T09:25:24.428684+0000","last_undegraded":"2024-01-23T09:25:24.428684+0000","last_fullsized":"2024-01-23T09:25:24.428684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'22","last_scrub_stamp":"2024-01-23T09:25:24.428505+0000","last_deep_scrub":"30'22","last_deep_scrub_stamp":"2024-01-23T09:25:24.428505+0000","last_clean_scrub_stamp":"2024-01-23T09:25:24.428505+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:00:40.192053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"30'30","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:24.525911+0000","last_change":"2024-01-23T09:25:24.525986+0000","last_active":"2024-01-23T09:25:24.525911+0000","last_peered":"2024-01-23T09:25:24.525911+0000","last_clean":"2024-01-23T09:25:24.525911+0000","last_became_active":"2024-01-23T08:54:40.699246+0000","last_became_peered":"2024-01-23T08:54:40.699246+0000","last_unstale":"2024-01-23T09:25:24.525911+0000","last_undegraded":"2024-01-23T09:25:24.525911+0000","last_fullsized":"2024-01-23T09:25:24.525911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2024-01-23T09:25:24.525762+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2024-01-23T09:25:24.525762+0000","last_clean_scrub_stamp":"2024-01-23T09:25:24.525762+0000","objects_scrubbed":8,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:41:00.030842+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"30'97","reported_seq":133,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:36.862300+0000","last_change":"2024-01-23T09:25:36.862373+0000","last_active":"2024-01-23T09:25:36.862300+0000","last_peered":"2024-01-23T09:25:36.862300+0000","last_clean":"2024-01-23T09:25:36.862300+0000","last_became_active":"2024-01-23T08:54:49.728448+0000","last_became_peered":"2024-01-23T08:54:49.728448+0000","last_unstale":"2024-01-23T09:25:36.862300+0000","last_undegraded":"2024-01-23T09:25:36.862300+0000","last_fullsized":"2024-01-23T09:25:36.862300+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'97","last_scrub_stamp":"2024-01-23T09:25:36.862113+0000","last_deep_scrub":"30'97","last_deep_scrub_stamp":"2024-01-23T09:25:36.862113+0000","last_clean_scrub_stamp":"2024-01-23T09:25:36.862113+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:57:29.954357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":7067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"30'23","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:17.766169+0000","last_change":"2024-01-23T09:25:17.766225+0000","last_active":"2024-01-23T09:25:17.766169+0000","last_peered":"2024-01-23T09:25:17.766169+0000","last_clean":"2024-01-23T09:25:17.766169+0000","last_became_active":"2024-01-23T08:54:42.087328+0000","last_became_peered":"2024-01-23T08:54:42.087328+0000","last_unstale":"2024-01-23T09:25:17.766169+0000","last_undegraded":"2024-01-23T09:25:17.766169+0000","last_fullsized":"2024-01-23T09:25:17.766169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'23","last_scrub_stamp":"2024-01-23T09:25:17.766025+0000","last_deep_scrub":"30'23","last_deep_scrub_stamp":"2024-01-23T09:25:17.766025+0000","last_clean_scrub_stamp":"2024-01-23T09:25:17.766025+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:19:01.754874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"30'13","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:21.058458+0000","last_change":"2024-01-23T09:25:21.058556+0000","last_active":"2024-01-23T09:25:21.058458+0000","last_peered":"2024-01-23T09:25:21.058458+0000","last_clean":"2024-01-23T09:25:21.058458+0000","last_became_active":"2024-01-23T08:54:40.693530+0000","last_became_peered":"2024-01-23T08:54:40.693530+0000","last_unstale":"2024-01-23T09:25:21.058458+0000","last_undegraded":"2024-01-23T09:25:21.058458+0000","last_fullsized":"2024-01-23T09:25:21.058458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'13","last_scrub_stamp":"2024-01-23T09:25:21.058238+0000","last_deep_scrub":"30'13","last_deep_scrub_stamp":"2024-01-23T09:25:21.058238+0000","last_clean_scrub_stamp":"2024-01-23T09:25:21.058238+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:37:29.299273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"30'73","reported_seq":110,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:57.956071+0000","last_change":"2024-01-23T08:55:47.750297+0000","last_active":"2024-01-23T09:23:57.956071+0000","last_peered":"2024-01-23T09:23:57.956071+0000","last_clean":"2024-01-23T09:23:57.956071+0000","last_became_active":"2024-01-23T08:55:47.749074+0000","last_became_peered":"2024-01-23T08:55:47.749074+0000","last_unstale":"2024-01-23T09:23:57.956071+0000","last_undegraded":"2024-01-23T09:23:57.956071+0000","last_fullsized":"2024-01-23T09:23:57.956071+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":8234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,6,4],"acting":[5,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'36","reported_seq":78,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:18.293208+0000","last_change":"2024-01-23T09:25:18.293250+0000","last_active":"2024-01-23T09:25:18.293208+0000","last_peered":"2024-01-23T09:25:18.293208+0000","last_clean":"2024-01-23T09:25:18.293208+0000","last_became_active":"2024-01-23T08:54:42.108253+0000","last_became_peered":"2024-01-23T08:54:42.108253+0000","last_unstale":"2024-01-23T09:25:18.293208+0000","last_undegraded":"2024-01-23T09:25:18.293208+0000","last_fullsized":"2024-01-23T09:25:18.293208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'36","last_scrub_stamp":"2024-01-23T09:25:18.293105+0000","last_deep_scrub":"30'36","last_deep_scrub_stamp":"2024-01-23T09:25:18.293105+0000","last_clean_scrub_stamp":"2024-01-23T09:25:18.293105+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:42:38.839525+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"30'14","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:27.348593+0000","last_change":"2024-01-23T09:25:27.348669+0000","last_active":"2024-01-23T09:25:27.348593+0000","last_peered":"2024-01-23T09:25:27.348593+0000","last_clean":"2024-01-23T09:25:27.348593+0000","last_became_active":"2024-01-23T08:54:40.695699+0000","last_became_peered":"2024-01-23T08:54:40.695699+0000","last_unstale":"2024-01-23T09:25:27.348593+0000","last_undegraded":"2024-01-23T09:25:27.348593+0000","last_fullsized":"2024-01-23T09:25:27.348593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'14","last_scrub_stamp":"2024-01-23T09:25:27.348332+0000","last_deep_scrub":"30'14","last_deep_scrub_stamp":"2024-01-23T09:25:27.348332+0000","last_clean_scrub_stamp":"2024-01-23T09:25:27.348332+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:28:53.281611+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"30'63","reported_seq":100,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:34.322970+0000","last_change":"2024-01-23T09:25:34.323031+0000","last_active":"2024-01-23T09:25:34.322970+0000","last_peered":"2024-01-23T09:25:34.322970+0000","last_clean":"2024-01-23T09:25:34.322970+0000","last_became_active":"2024-01-23T08:54:49.739524+0000","last_became_peered":"2024-01-23T08:54:49.739524+0000","last_unstale":"2024-01-23T09:25:34.322970+0000","last_undegraded":"2024-01-23T09:25:34.322970+0000","last_fullsized":"2024-01-23T09:25:34.322970+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'63","last_scrub_stamp":"2024-01-23T09:25:34.322788+0000","last_deep_scrub":"30'63","last_deep_scrub_stamp":"2024-01-23T09:25:34.322788+0000","last_clean_scrub_stamp":"2024-01-23T09:25:34.322788+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:28:12.741373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":7121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"30'26","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:28.360764+0000","last_change":"2024-01-23T09:25:28.360808+0000","last_active":"2024-01-23T09:25:28.360764+0000","last_peered":"2024-01-23T09:25:28.360764+0000","last_clean":"2024-01-23T09:25:28.360764+0000","last_became_active":"2024-01-23T08:54:42.229952+0000","last_became_peered":"2024-01-23T08:54:42.229952+0000","last_unstale":"2024-01-23T09:25:28.360764+0000","last_undegraded":"2024-01-23T09:25:28.360764+0000","last_fullsized":"2024-01-23T09:25:28.360764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2024-01-23T09:25:28.360636+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2024-01-23T09:25:28.360636+0000","last_clean_scrub_stamp":"2024-01-23T09:25:28.360636+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:12:21.904213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"30'20","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:22.177792+0000","last_change":"2024-01-23T09:25:22.177870+0000","last_active":"2024-01-23T09:25:22.177792+0000","last_peered":"2024-01-23T09:25:22.177792+0000","last_clean":"2024-01-23T09:25:22.177792+0000","last_became_active":"2024-01-23T08:54:40.698059+0000","last_became_peered":"2024-01-23T08:54:40.698059+0000","last_unstale":"2024-01-23T09:25:22.177792+0000","last_undegraded":"2024-01-23T09:25:22.177792+0000","last_fullsized":"2024-01-23T09:25:22.177792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2024-01-23T09:25:22.177632+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2024-01-23T09:25:22.177632+0000","last_clean_scrub_stamp":"2024-01-23T09:25:22.177632+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:19:06.166482+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"30'67","reported_seq":95,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:55.586381+0000","last_change":"2024-01-23T08:54:49.708388+0000","last_active":"2024-01-23T09:23:55.586381+0000","last_peered":"2024-01-23T09:23:55.586381+0000","last_clean":"2024-01-23T09:23:55.586381+0000","last_became_active":"2024-01-23T08:54:49.707837+0000","last_became_peered":"2024-01-23T08:54:49.707837+0000","last_unstale":"2024-01-23T09:23:55.586381+0000","last_undegraded":"2024-01-23T09:23:55.586381+0000","last_fullsized":"2024-01-23T09:23:55.586381+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":5283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'21","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:30.943039+0000","last_change":"2024-01-23T09:25:30.943099+0000","last_active":"2024-01-23T09:25:30.943039+0000","last_peered":"2024-01-23T09:25:30.943039+0000","last_clean":"2024-01-23T09:25:30.943039+0000","last_became_active":"2024-01-23T08:54:42.229252+0000","last_became_peered":"2024-01-23T08:54:42.229252+0000","last_unstale":"2024-01-23T09:25:30.943039+0000","last_undegraded":"2024-01-23T09:25:30.943039+0000","last_fullsized":"2024-01-23T09:25:30.943039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2024-01-23T09:25:30.942872+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2024-01-23T09:25:30.942872+0000","last_clean_scrub_stamp":"2024-01-23T09:25:30.942872+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:31:24.553827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"30'838","reported_seq":881,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:17.160368+0000","last_change":"2024-01-23T09:25:17.160407+0000","last_active":"2024-01-23T09:25:17.160368+0000","last_peered":"2024-01-23T09:25:17.160368+0000","last_clean":"2024-01-23T09:25:17.160368+0000","last_became_active":"2024-01-23T08:54:40.657711+0000","last_became_peered":"2024-01-23T08:54:40.657711+0000","last_unstale":"2024-01-23T09:25:17.160368+0000","last_undegraded":"2024-01-23T09:25:17.160368+0000","last_fullsized":"2024-01-23T09:25:17.160368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'838","last_scrub_stamp":"2024-01-23T09:25:17.160297+0000","last_deep_scrub":"30'838","last_deep_scrub_stamp":"2024-01-23T09:25:17.160297+0000","last_clean_scrub_stamp":"2024-01-23T09:25:17.160297+0000","objects_scrubbed":6,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:26:03.412965+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":833,"num_write_kb":4568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"30'86","reported_seq":123,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:34.561207+0000","last_change":"2024-01-23T09:25:34.561244+0000","last_active":"2024-01-23T09:25:34.561207+0000","last_peered":"2024-01-23T09:25:34.561207+0000","last_clean":"2024-01-23T09:25:34.561207+0000","last_became_active":"2024-01-23T08:54:49.735023+0000","last_became_peered":"2024-01-23T08:54:49.735023+0000","last_unstale":"2024-01-23T09:25:34.561207+0000","last_undegraded":"2024-01-23T09:25:34.561207+0000","last_fullsized":"2024-01-23T09:25:34.561207+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'86","last_scrub_stamp":"2024-01-23T09:25:34.561102+0000","last_deep_scrub":"30'86","last_deep_scrub_stamp":"2024-01-23T09:25:34.561102+0000","last_clean_scrub_stamp":"2024-01-23T09:25:34.561102+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:55:15.944571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":9278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"30'25","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:36.389455+0000","last_change":"2024-01-23T09:25:36.389522+0000","last_active":"2024-01-23T09:25:36.389455+0000","last_peered":"2024-01-23T09:25:36.389455+0000","last_clean":"2024-01-23T09:25:36.389455+0000","last_became_active":"2024-01-23T08:54:42.153735+0000","last_became_peered":"2024-01-23T08:54:42.153735+0000","last_unstale":"2024-01-23T09:25:36.389455+0000","last_undegraded":"2024-01-23T09:25:36.389455+0000","last_fullsized":"2024-01-23T09:25:36.389455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2024-01-23T09:25:36.389290+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2024-01-23T09:25:36.389290+0000","last_clean_scrub_stamp":"2024-01-23T09:25:36.389290+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:41:39.923379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"30'364","reported_seq":406,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:23.221748+0000","last_change":"2024-01-23T09:25:23.221812+0000","last_active":"2024-01-23T09:25:23.221748+0000","last_peered":"2024-01-23T09:25:23.221748+0000","last_clean":"2024-01-23T09:25:23.221748+0000","last_became_active":"2024-01-23T08:54:40.701827+0000","last_became_peered":"2024-01-23T08:54:40.701827+0000","last_unstale":"2024-01-23T09:25:23.221748+0000","last_undegraded":"2024-01-23T09:25:23.221748+0000","last_fullsized":"2024-01-23T09:25:23.221748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'364","last_scrub_stamp":"2024-01-23T09:25:23.221601+0000","last_deep_scrub":"30'364","last_deep_scrub_stamp":"2024-01-23T09:25:23.221601+0000","last_clean_scrub_stamp":"2024-01-23T09:25:23.221601+0000","objects_scrubbed":4,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:59:57.030217+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"30'124","reported_seq":161,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:25.319246+0000","last_change":"2024-01-23T09:25:25.319306+0000","last_active":"2024-01-23T09:25:25.319246+0000","last_peered":"2024-01-23T09:25:25.319246+0000","last_clean":"2024-01-23T09:25:25.319246+0000","last_became_active":"2024-01-23T08:54:49.735765+0000","last_became_peered":"2024-01-23T08:54:49.735765+0000","last_unstale":"2024-01-23T09:25:25.319246+0000","last_undegraded":"2024-01-23T09:25:25.319246+0000","last_fullsized":"2024-01-23T09:25:25.319246+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'124","last_scrub_stamp":"2024-01-23T09:25:25.319086+0000","last_deep_scrub":"30'124","last_deep_scrub_stamp":"2024-01-23T09:25:25.319086+0000","last_clean_scrub_stamp":"2024-01-23T09:25:25.319086+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:41:00.824166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":11379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"30'28","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:27.923358+0000","last_change":"2024-01-23T09:25:27.923415+0000","last_active":"2024-01-23T09:25:27.923358+0000","last_peered":"2024-01-23T09:25:27.923358+0000","last_clean":"2024-01-23T09:25:27.923358+0000","last_became_active":"2024-01-23T08:54:42.070703+0000","last_became_peered":"2024-01-23T08:54:42.070703+0000","last_unstale":"2024-01-23T09:25:27.923358+0000","last_undegraded":"2024-01-23T09:25:27.923358+0000","last_fullsized":"2024-01-23T09:25:27.923358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2024-01-23T09:25:27.923206+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2024-01-23T09:25:27.923206+0000","last_clean_scrub_stamp":"2024-01-23T09:25:27.923206+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:50:18.364866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"30'8","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:20.069341+0000","last_change":"2024-01-23T09:25:20.069379+0000","last_active":"2024-01-23T09:25:20.069341+0000","last_peered":"2024-01-23T09:25:20.069341+0000","last_clean":"2024-01-23T09:25:20.069341+0000","last_became_active":"2024-01-23T08:54:40.687656+0000","last_became_peered":"2024-01-23T08:54:40.687656+0000","last_unstale":"2024-01-23T09:25:20.069341+0000","last_undegraded":"2024-01-23T09:25:20.069341+0000","last_fullsized":"2024-01-23T09:25:20.069341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'8","last_scrub_stamp":"2024-01-23T09:25:20.069266+0000","last_deep_scrub":"30'8","last_deep_scrub_stamp":"2024-01-23T09:25:20.069266+0000","last_clean_scrub_stamp":"2024-01-23T09:25:20.069266+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:25:35.068212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'70","reported_seq":107,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:28.161290+0000","last_change":"2024-01-23T09:25:28.161436+0000","last_active":"2024-01-23T09:25:28.161290+0000","last_peered":"2024-01-23T09:25:28.161290+0000","last_clean":"2024-01-23T09:25:28.161290+0000","last_became_active":"2024-01-23T08:54:49.728191+0000","last_became_peered":"2024-01-23T08:54:49.728191+0000","last_unstale":"2024-01-23T09:25:28.161290+0000","last_undegraded":"2024-01-23T09:25:28.161290+0000","last_fullsized":"2024-01-23T09:25:28.161290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'70","last_scrub_stamp":"2024-01-23T09:25:28.160951+0000","last_deep_scrub":"30'70","last_deep_scrub_stamp":"2024-01-23T09:25:28.160951+0000","last_clean_scrub_stamp":"2024-01-23T09:25:28.160951+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:37:31.276776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":6489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"30'28","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:18.151732+0000","last_change":"2024-01-23T09:25:18.151755+0000","last_active":"2024-01-23T09:25:18.151732+0000","last_peered":"2024-01-23T09:25:18.151732+0000","last_clean":"2024-01-23T09:25:18.151732+0000","last_became_active":"2024-01-23T08:54:42.153539+0000","last_became_peered":"2024-01-23T08:54:42.153539+0000","last_unstale":"2024-01-23T09:25:18.151732+0000","last_undegraded":"2024-01-23T09:25:18.151732+0000","last_fullsized":"2024-01-23T09:25:18.151732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2024-01-23T09:25:18.151656+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2024-01-23T09:25:18.151656+0000","last_clean_scrub_stamp":"2024-01-23T09:25:18.151656+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:37:55.811976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"30'13","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:16.762509+0000","last_change":"2024-01-23T09:25:16.762573+0000","last_active":"2024-01-23T09:25:16.762509+0000","last_peered":"2024-01-23T09:25:16.762509+0000","last_clean":"2024-01-23T09:25:16.762509+0000","last_became_active":"2024-01-23T08:54:40.682765+0000","last_became_peered":"2024-01-23T08:54:40.682765+0000","last_unstale":"2024-01-23T09:25:16.762509+0000","last_undegraded":"2024-01-23T09:25:16.762509+0000","last_fullsized":"2024-01-23T09:25:16.762509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'13","last_scrub_stamp":"2024-01-23T09:25:16.762362+0000","last_deep_scrub":"30'13","last_deep_scrub_stamp":"2024-01-23T09:25:16.762362+0000","last_clean_scrub_stamp":"2024-01-23T09:25:16.762362+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:53:52.249532+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"30'72","reported_seq":109,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:31.528792+0000","last_change":"2024-01-23T09:25:31.528858+0000","last_active":"2024-01-23T09:25:31.528792+0000","last_peered":"2024-01-23T09:25:31.528792+0000","last_clean":"2024-01-23T09:25:31.528792+0000","last_became_active":"2024-01-23T08:54:49.724121+0000","last_became_peered":"2024-01-23T08:54:49.724121+0000","last_unstale":"2024-01-23T09:25:31.528792+0000","last_undegraded":"2024-01-23T09:25:31.528792+0000","last_fullsized":"2024-01-23T09:25:31.528792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'72","last_scrub_stamp":"2024-01-23T09:25:31.528632+0000","last_deep_scrub":"30'72","last_deep_scrub_stamp":"2024-01-23T09:25:31.528632+0000","last_clean_scrub_stamp":"2024-01-23T09:25:31.528632+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:11:01.516274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":8509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"30'65","reported_seq":104,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:33.546218+0000","last_change":"2024-01-23T09:25:33.546285+0000","last_active":"2024-01-23T09:25:33.546218+0000","last_peered":"2024-01-23T09:25:33.546218+0000","last_clean":"2024-01-23T09:25:33.546218+0000","last_became_active":"2024-01-23T08:54:49.732632+0000","last_became_peered":"2024-01-23T08:54:49.732632+0000","last_unstale":"2024-01-23T09:25:33.546218+0000","last_undegraded":"2024-01-23T09:25:33.546218+0000","last_fullsized":"2024-01-23T09:25:33.546218+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'65","last_scrub_stamp":"2024-01-23T09:25:33.546039+0000","last_deep_scrub":"30'65","last_deep_scrub_stamp":"2024-01-23T09:25:33.546039+0000","last_clean_scrub_stamp":"2024-01-23T09:25:33.546039+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:24:52.631547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":5816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"30'26","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:27.616354+0000","last_change":"2024-01-23T09:25:27.616474+0000","last_active":"2024-01-23T09:25:27.616354+0000","last_peered":"2024-01-23T09:25:27.616354+0000","last_clean":"2024-01-23T09:25:27.616354+0000","last_became_active":"2024-01-23T08:54:42.195570+0000","last_became_peered":"2024-01-23T08:54:42.195570+0000","last_unstale":"2024-01-23T09:25:27.616354+0000","last_undegraded":"2024-01-23T09:25:27.616354+0000","last_fullsized":"2024-01-23T09:25:27.616354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2024-01-23T09:25:27.616079+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2024-01-23T09:25:27.616079+0000","last_clean_scrub_stamp":"2024-01-23T09:25:27.616079+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:37:35.857113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"30'7","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:31.316560+0000","last_change":"2024-01-23T09:25:31.316620+0000","last_active":"2024-01-23T09:25:31.316560+0000","last_peered":"2024-01-23T09:25:31.316560+0000","last_clean":"2024-01-23T09:25:31.316560+0000","last_became_active":"2024-01-23T08:54:40.678527+0000","last_became_peered":"2024-01-23T08:54:40.678527+0000","last_unstale":"2024-01-23T09:25:31.316560+0000","last_undegraded":"2024-01-23T09:25:31.316560+0000","last_fullsized":"2024-01-23T09:25:31.316560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'7","last_scrub_stamp":"2024-01-23T09:25:31.316404+0000","last_deep_scrub":"30'7","last_deep_scrub_stamp":"2024-01-23T09:25:31.316404+0000","last_clean_scrub_stamp":"2024-01-23T09:25:31.316404+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:59:50.635526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'89","reported_seq":119,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:23:58.537641+0000","last_change":"2024-01-23T08:54:49.719401+0000","last_active":"2024-01-23T09:23:58.537641+0000","last_peered":"2024-01-23T09:23:58.537641+0000","last_clean":"2024-01-23T09:23:58.537641+0000","last_became_active":"2024-01-23T08:54:49.717116+0000","last_became_peered":"2024-01-23T08:54:49.717116+0000","last_unstale":"2024-01-23T09:23:58.537641+0000","last_undegraded":"2024-01-23T09:23:58.537641+0000","last_fullsized":"2024-01-23T09:23:58.537641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:54:48.202185+0000","last_clean_scrub_stamp":"2024-01-23T08:54:48.202185+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":12319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"30'30","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:34.825010+0000","last_change":"2024-01-23T09:25:34.825065+0000","last_active":"2024-01-23T09:25:34.825010+0000","last_peered":"2024-01-23T09:25:34.825010+0000","last_clean":"2024-01-23T09:25:34.825010+0000","last_became_active":"2024-01-23T08:54:42.235116+0000","last_became_peered":"2024-01-23T08:54:42.235116+0000","last_unstale":"2024-01-23T09:25:34.825010+0000","last_undegraded":"2024-01-23T09:25:34.825010+0000","last_fullsized":"2024-01-23T09:25:34.825010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2024-01-23T09:25:34.824851+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2024-01-23T09:25:34.824851+0000","last_clean_scrub_stamp":"2024-01-23T09:25:34.824851+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:23:54.659112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"30'9","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:22.286576+0000","last_change":"2024-01-23T09:25:22.286637+0000","last_active":"2024-01-23T09:25:22.286576+0000","last_peered":"2024-01-23T09:25:22.286576+0000","last_clean":"2024-01-23T09:25:22.286576+0000","last_became_active":"2024-01-23T08:54:40.689433+0000","last_became_peered":"2024-01-23T08:54:40.689433+0000","last_unstale":"2024-01-23T09:25:22.286576+0000","last_undegraded":"2024-01-23T09:25:22.286576+0000","last_fullsized":"2024-01-23T09:25:22.286576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'9","last_scrub_stamp":"2024-01-23T09:25:22.286420+0000","last_deep_scrub":"30'9","last_deep_scrub_stamp":"2024-01-23T09:25:22.286420+0000","last_clean_scrub_stamp":"2024-01-23T09:25:22.286420+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:16:07.705085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"30'515","reported_seq":557,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:34.389344+0000","last_change":"2024-01-23T09:25:34.389419+0000","last_active":"2024-01-23T09:25:34.389344+0000","last_peered":"2024-01-23T09:25:34.389344+0000","last_clean":"2024-01-23T09:25:34.389344+0000","last_became_active":"2024-01-23T08:54:40.686371+0000","last_became_peered":"2024-01-23T08:54:40.686371+0000","last_unstale":"2024-01-23T09:25:34.389344+0000","last_undegraded":"2024-01-23T09:25:34.389344+0000","last_fullsized":"2024-01-23T09:25:34.389344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'515","last_scrub_stamp":"2024-01-23T09:25:34.389185+0000","last_deep_scrub":"30'515","last_deep_scrub_stamp":"2024-01-23T09:25:34.389185+0000","last_clean_scrub_stamp":"2024-01-23T09:25:34.389185+0000","objects_scrubbed":4,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:59:44.145760+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":507,"num_write_kb":4372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"30'22","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:29.577487+0000","last_change":"2024-01-23T09:25:29.577608+0000","last_active":"2024-01-23T09:25:29.577487+0000","last_peered":"2024-01-23T09:25:29.577487+0000","last_clean":"2024-01-23T09:25:29.577487+0000","last_became_active":"2024-01-23T08:54:42.198648+0000","last_became_peered":"2024-01-23T08:54:42.198648+0000","last_unstale":"2024-01-23T09:25:29.577487+0000","last_undegraded":"2024-01-23T09:25:29.577487+0000","last_fullsized":"2024-01-23T09:25:29.577487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'22","last_scrub_stamp":"2024-01-23T09:25:29.577178+0000","last_deep_scrub":"30'22","last_deep_scrub_stamp":"2024-01-23T09:25:29.577178+0000","last_clean_scrub_stamp":"2024-01-23T09:25:29.577178+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:42:50.123598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"30'54","reported_seq":90,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:35.594969+0000","last_change":"2024-01-23T09:25:35.595032+0000","last_active":"2024-01-23T09:25:35.594969+0000","last_peered":"2024-01-23T09:25:35.594969+0000","last_clean":"2024-01-23T09:25:35.594969+0000","last_became_active":"2024-01-23T08:54:49.741692+0000","last_became_peered":"2024-01-23T08:54:49.741692+0000","last_unstale":"2024-01-23T09:25:35.594969+0000","last_undegraded":"2024-01-23T09:25:35.594969+0000","last_fullsized":"2024-01-23T09:25:35.594969+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'54","last_scrub_stamp":"2024-01-23T09:25:35.594790+0000","last_deep_scrub":"30'54","last_deep_scrub_stamp":"2024-01-23T09:25:35.594790+0000","last_clean_scrub_stamp":"2024-01-23T09:25:35.594790+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:00:51.358338+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":4034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"30'587","reported_seq":629,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:23.991738+0000","last_change":"2024-01-23T09:25:23.991776+0000","last_active":"2024-01-23T09:25:23.991738+0000","last_peered":"2024-01-23T09:25:23.991738+0000","last_clean":"2024-01-23T09:25:23.991738+0000","last_became_active":"2024-01-23T08:54:40.686125+0000","last_became_peered":"2024-01-23T08:54:40.686125+0000","last_unstale":"2024-01-23T09:25:23.991738+0000","last_undegraded":"2024-01-23T09:25:23.991738+0000","last_fullsized":"2024-01-23T09:25:23.991738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'587","last_scrub_stamp":"2024-01-23T09:25:23.991649+0000","last_deep_scrub":"30'587","last_deep_scrub_stamp":"2024-01-23T09:25:23.991649+0000","last_clean_scrub_stamp":"2024-01-23T09:25:23.991649+0000","objects_scrubbed":3,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:58:04.050434+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195507,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":4397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"30'19","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:18.732089+0000","last_change":"2024-01-23T09:25:18.732145+0000","last_active":"2024-01-23T09:25:18.732089+0000","last_peered":"2024-01-23T09:25:18.732089+0000","last_clean":"2024-01-23T09:25:18.732089+0000","last_became_active":"2024-01-23T08:54:42.089826+0000","last_became_peered":"2024-01-23T08:54:42.089826+0000","last_unstale":"2024-01-23T09:25:18.732089+0000","last_undegraded":"2024-01-23T09:25:18.732089+0000","last_fullsized":"2024-01-23T09:25:18.732089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2024-01-23T09:25:18.731941+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2024-01-23T09:25:18.731941+0000","last_clean_scrub_stamp":"2024-01-23T09:25:18.731941+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:17:03.716474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"30'96","reported_seq":128,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:32.386285+0000","last_change":"2024-01-23T09:25:32.386349+0000","last_active":"2024-01-23T09:25:32.386285+0000","last_peered":"2024-01-23T09:25:32.386285+0000","last_clean":"2024-01-23T09:25:32.386285+0000","last_became_active":"2024-01-23T08:55:47.747327+0000","last_became_peered":"2024-01-23T08:55:47.747327+0000","last_unstale":"2024-01-23T09:25:32.386285+0000","last_undegraded":"2024-01-23T09:25:32.386285+0000","last_fullsized":"2024-01-23T09:25:32.386285+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'96","last_scrub_stamp":"2024-01-23T09:25:32.386089+0000","last_deep_scrub":"30'96","last_deep_scrub_stamp":"2024-01-23T09:25:32.386089+0000","last_clean_scrub_stamp":"2024-01-23T09:25:32.386089+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:30:47.528329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":8062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"30'35","reported_seq":78,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:23.279552+0000","last_change":"2024-01-23T09:25:23.279617+0000","last_active":"2024-01-23T09:25:23.279552+0000","last_peered":"2024-01-23T09:25:23.279552+0000","last_clean":"2024-01-23T09:25:23.279552+0000","last_became_active":"2024-01-23T08:54:42.227421+0000","last_became_peered":"2024-01-23T08:54:42.227421+0000","last_unstale":"2024-01-23T09:25:23.279552+0000","last_undegraded":"2024-01-23T09:25:23.279552+0000","last_fullsized":"2024-01-23T09:25:23.279552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'35","last_scrub_stamp":"2024-01-23T09:25:23.279386+0000","last_deep_scrub":"30'35","last_deep_scrub_stamp":"2024-01-23T09:25:23.279386+0000","last_clean_scrub_stamp":"2024-01-23T09:25:23.279386+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:09:06.069007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"30'25","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:25.137843+0000","last_change":"2024-01-23T09:25:25.137901+0000","last_active":"2024-01-23T09:25:25.137843+0000","last_peered":"2024-01-23T09:25:25.137843+0000","last_clean":"2024-01-23T09:25:25.137843+0000","last_became_active":"2024-01-23T08:54:42.111635+0000","last_became_peered":"2024-01-23T08:54:42.111635+0000","last_unstale":"2024-01-23T09:25:25.137843+0000","last_undegraded":"2024-01-23T09:25:25.137843+0000","last_fullsized":"2024-01-23T09:25:25.137843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2024-01-23T09:25:25.137689+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2024-01-23T09:25:25.137689+0000","last_clean_scrub_stamp":"2024-01-23T09:25:25.137689+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T21:01:18.975627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"30'28","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:23.464371+0000","last_change":"2024-01-23T09:25:23.464435+0000","last_active":"2024-01-23T09:25:23.464371+0000","last_peered":"2024-01-23T09:25:23.464371+0000","last_clean":"2024-01-23T09:25:23.464371+0000","last_became_active":"2024-01-23T08:54:42.069262+0000","last_became_peered":"2024-01-23T08:54:42.069262+0000","last_unstale":"2024-01-23T09:25:23.464371+0000","last_undegraded":"2024-01-23T09:25:23.464371+0000","last_fullsized":"2024-01-23T09:25:23.464371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2024-01-23T09:25:23.464199+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2024-01-23T09:25:23.464199+0000","last_clean_scrub_stamp":"2024-01-23T09:25:23.464199+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:55:04.847668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"30'23","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:30.830627+0000","last_change":"2024-01-23T09:25:30.830729+0000","last_active":"2024-01-23T09:25:30.830627+0000","last_peered":"2024-01-23T09:25:30.830627+0000","last_clean":"2024-01-23T09:25:30.830627+0000","last_became_active":"2024-01-23T08:54:42.107985+0000","last_became_peered":"2024-01-23T08:54:42.107985+0000","last_unstale":"2024-01-23T09:25:30.830627+0000","last_undegraded":"2024-01-23T09:25:30.830627+0000","last_fullsized":"2024-01-23T09:25:30.830627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'23","last_scrub_stamp":"2024-01-23T09:25:30.830447+0000","last_deep_scrub":"30'23","last_deep_scrub_stamp":"2024-01-23T09:25:30.830447+0000","last_clean_scrub_stamp":"2024-01-23T09:25:30.830447+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:25:34.132683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"30'17","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:27.313048+0000","last_change":"2024-01-23T09:25:27.313160+0000","last_active":"2024-01-23T09:25:27.313048+0000","last_peered":"2024-01-23T09:25:27.313048+0000","last_clean":"2024-01-23T09:25:27.313048+0000","last_became_active":"2024-01-23T08:54:42.227918+0000","last_became_peered":"2024-01-23T08:54:42.227918+0000","last_unstale":"2024-01-23T09:25:27.313048+0000","last_undegraded":"2024-01-23T09:25:27.313048+0000","last_fullsized":"2024-01-23T09:25:27.313048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'17","last_scrub_stamp":"2024-01-23T09:25:27.312785+0000","last_deep_scrub":"30'17","last_deep_scrub_stamp":"2024-01-23T09:25:27.312785+0000","last_clean_scrub_stamp":"2024-01-23T09:25:27.312785+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:35:35.979425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"30'20","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:29.332490+0000","last_change":"2024-01-23T09:25:29.332534+0000","last_active":"2024-01-23T09:25:29.332490+0000","last_peered":"2024-01-23T09:25:29.332490+0000","last_clean":"2024-01-23T09:25:29.332490+0000","last_became_active":"2024-01-23T08:54:42.230615+0000","last_became_peered":"2024-01-23T08:54:42.230615+0000","last_unstale":"2024-01-23T09:25:29.332490+0000","last_undegraded":"2024-01-23T09:25:29.332490+0000","last_fullsized":"2024-01-23T09:25:29.332490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2024-01-23T09:25:29.332367+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2024-01-23T09:25:29.332367+0000","last_clean_scrub_stamp":"2024-01-23T09:25:29.332367+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:48:28.264567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"30'35","reported_seq":78,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:19.164406+0000","last_change":"2024-01-23T09:25:19.164428+0000","last_active":"2024-01-23T09:25:19.164406+0000","last_peered":"2024-01-23T09:25:19.164406+0000","last_clean":"2024-01-23T09:25:19.164406+0000","last_became_active":"2024-01-23T08:54:42.157106+0000","last_became_peered":"2024-01-23T08:54:42.157106+0000","last_unstale":"2024-01-23T09:25:19.164406+0000","last_undegraded":"2024-01-23T09:25:19.164406+0000","last_fullsized":"2024-01-23T09:25:19.164406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'35","last_scrub_stamp":"2024-01-23T09:25:19.164335+0000","last_deep_scrub":"30'35","last_deep_scrub_stamp":"2024-01-23T09:25:19.164335+0000","last_clean_scrub_stamp":"2024-01-23T09:25:19.164335+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:37:22.280160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"30'20","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:29.860882+0000","last_change":"2024-01-23T09:25:29.860941+0000","last_active":"2024-01-23T09:25:29.860882+0000","last_peered":"2024-01-23T09:25:29.860882+0000","last_clean":"2024-01-23T09:25:29.860882+0000","last_became_active":"2024-01-23T08:54:42.092149+0000","last_became_peered":"2024-01-23T08:54:42.092149+0000","last_unstale":"2024-01-23T09:25:29.860882+0000","last_undegraded":"2024-01-23T09:25:29.860882+0000","last_fullsized":"2024-01-23T09:25:29.860882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2024-01-23T09:25:29.860715+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2024-01-23T09:25:29.860715+0000","last_clean_scrub_stamp":"2024-01-23T09:25:29.860715+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:14:16.136437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"30'19","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:25.418771+0000","last_change":"2024-01-23T09:25:25.418829+0000","last_active":"2024-01-23T09:25:25.418771+0000","last_peered":"2024-01-23T09:25:25.418771+0000","last_clean":"2024-01-23T09:25:25.418771+0000","last_became_active":"2024-01-23T08:54:42.069305+0000","last_became_peered":"2024-01-23T08:54:42.069305+0000","last_unstale":"2024-01-23T09:25:25.418771+0000","last_undegraded":"2024-01-23T09:25:25.418771+0000","last_fullsized":"2024-01-23T09:25:25.418771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2024-01-23T09:25:25.418614+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2024-01-23T09:25:25.418614+0000","last_clean_scrub_stamp":"2024-01-23T09:25:25.418614+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:48:33.497499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"30'29","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:21.990519+0000","last_change":"2024-01-23T09:25:21.990640+0000","last_active":"2024-01-23T09:25:21.990519+0000","last_peered":"2024-01-23T09:25:21.990519+0000","last_clean":"2024-01-23T09:25:21.990519+0000","last_became_active":"2024-01-23T08:54:42.157647+0000","last_became_peered":"2024-01-23T08:54:42.157647+0000","last_unstale":"2024-01-23T09:25:21.990519+0000","last_undegraded":"2024-01-23T09:25:21.990519+0000","last_fullsized":"2024-01-23T09:25:21.990519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2024-01-23T09:25:21.990241+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2024-01-23T09:25:21.990241+0000","last_clean_scrub_stamp":"2024-01-23T09:25:21.990241+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:40:57.495321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"30'28","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:20.779075+0000","last_change":"2024-01-23T09:25:20.779137+0000","last_active":"2024-01-23T09:25:20.779075+0000","last_peered":"2024-01-23T09:25:20.779075+0000","last_clean":"2024-01-23T09:25:20.779075+0000","last_became_active":"2024-01-23T08:54:42.118528+0000","last_became_peered":"2024-01-23T08:54:42.118528+0000","last_unstale":"2024-01-23T09:25:20.779075+0000","last_undegraded":"2024-01-23T09:25:20.779075+0000","last_fullsized":"2024-01-23T09:25:20.779075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2024-01-23T09:25:20.778911+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2024-01-23T09:25:20.778911+0000","last_clean_scrub_stamp":"2024-01-23T09:25:20.778911+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:34:41.356473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"30'35","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:28.609037+0000","last_change":"2024-01-23T09:25:28.609099+0000","last_active":"2024-01-23T09:25:28.609037+0000","last_peered":"2024-01-23T09:25:28.609037+0000","last_clean":"2024-01-23T09:25:28.609037+0000","last_became_active":"2024-01-23T08:54:42.196809+0000","last_became_peered":"2024-01-23T08:54:42.196809+0000","last_unstale":"2024-01-23T09:25:28.609037+0000","last_undegraded":"2024-01-23T09:25:28.609037+0000","last_fullsized":"2024-01-23T09:25:28.609037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'35","last_scrub_stamp":"2024-01-23T09:25:28.608872+0000","last_deep_scrub":"30'35","last_deep_scrub_stamp":"2024-01-23T09:25:28.608872+0000","last_clean_scrub_stamp":"2024-01-23T09:25:28.608872+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:06:55.317375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"30'27","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:16.030305+0000","last_change":"2024-01-23T09:25:16.030364+0000","last_active":"2024-01-23T09:25:16.030305+0000","last_peered":"2024-01-23T09:25:16.030305+0000","last_clean":"2024-01-23T09:25:16.030305+0000","last_became_active":"2024-01-23T08:54:42.111207+0000","last_became_peered":"2024-01-23T08:54:42.111207+0000","last_unstale":"2024-01-23T09:25:16.030305+0000","last_undegraded":"2024-01-23T09:25:16.030305+0000","last_fullsized":"2024-01-23T09:25:16.030305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2024-01-23T09:25:16.030126+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2024-01-23T09:25:16.030126+0000","last_clean_scrub_stamp":"2024-01-23T09:25:16.030126+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:06:10.211565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"30'22","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:38.413771+0000","last_change":"2024-01-23T09:25:38.413834+0000","last_active":"2024-01-23T09:25:38.413771+0000","last_peered":"2024-01-23T09:25:38.413771+0000","last_clean":"2024-01-23T09:25:38.413771+0000","last_became_active":"2024-01-23T08:54:42.194562+0000","last_became_peered":"2024-01-23T08:54:42.194562+0000","last_unstale":"2024-01-23T09:25:38.413771+0000","last_undegraded":"2024-01-23T09:25:38.413771+0000","last_fullsized":"2024-01-23T09:25:38.413771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'22","last_scrub_stamp":"2024-01-23T09:25:38.413599+0000","last_deep_scrub":"30'22","last_deep_scrub_stamp":"2024-01-23T09:25:38.413599+0000","last_clean_scrub_stamp":"2024-01-23T09:25:38.413599+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:52:43.449564+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"30'33","reported_seq":75,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:26.141097+0000","last_change":"2024-01-23T09:25:26.141154+0000","last_active":"2024-01-23T09:25:26.141097+0000","last_peered":"2024-01-23T09:25:26.141097+0000","last_clean":"2024-01-23T09:25:26.141097+0000","last_became_active":"2024-01-23T08:54:42.160570+0000","last_became_peered":"2024-01-23T08:54:42.160570+0000","last_unstale":"2024-01-23T09:25:26.141097+0000","last_undegraded":"2024-01-23T09:25:26.141097+0000","last_fullsized":"2024-01-23T09:25:26.141097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'33","last_scrub_stamp":"2024-01-23T09:25:26.140935+0000","last_deep_scrub":"30'33","last_deep_scrub_stamp":"2024-01-23T09:25:26.140935+0000","last_clean_scrub_stamp":"2024-01-23T09:25:26.140935+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:33:21.678118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"30'24","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:22.442061+0000","last_change":"2024-01-23T09:25:22.442117+0000","last_active":"2024-01-23T09:25:22.442061+0000","last_peered":"2024-01-23T09:25:22.442061+0000","last_clean":"2024-01-23T09:25:22.442061+0000","last_became_active":"2024-01-23T08:54:42.114759+0000","last_became_peered":"2024-01-23T08:54:42.114759+0000","last_unstale":"2024-01-23T09:25:22.442061+0000","last_undegraded":"2024-01-23T09:25:22.442061+0000","last_fullsized":"2024-01-23T09:25:22.442061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2024-01-23T09:25:22.441906+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2024-01-23T09:25:22.441906+0000","last_clean_scrub_stamp":"2024-01-23T09:25:22.441906+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:24:41.527414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"30'26","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:26.384589+0000","last_change":"2024-01-23T09:25:26.384646+0000","last_active":"2024-01-23T09:25:26.384589+0000","last_peered":"2024-01-23T09:25:26.384589+0000","last_clean":"2024-01-23T09:25:26.384589+0000","last_became_active":"2024-01-23T08:54:42.149278+0000","last_became_peered":"2024-01-23T08:54:42.149278+0000","last_unstale":"2024-01-23T09:25:26.384589+0000","last_undegraded":"2024-01-23T09:25:26.384589+0000","last_fullsized":"2024-01-23T09:25:26.384589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2024-01-23T09:25:26.384432+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2024-01-23T09:25:26.384432+0000","last_clean_scrub_stamp":"2024-01-23T09:25:26.384432+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:31:19.995387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"30'26","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:20.945012+0000","last_change":"2024-01-23T09:25:20.945121+0000","last_active":"2024-01-23T09:25:20.945012+0000","last_peered":"2024-01-23T09:25:20.945012+0000","last_clean":"2024-01-23T09:25:20.945012+0000","last_became_active":"2024-01-23T08:54:42.109743+0000","last_became_peered":"2024-01-23T08:54:42.109743+0000","last_unstale":"2024-01-23T09:25:20.945012+0000","last_undegraded":"2024-01-23T09:25:20.945012+0000","last_fullsized":"2024-01-23T09:25:20.945012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2024-01-23T09:25:20.944798+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2024-01-23T09:25:20.944798+0000","last_clean_scrub_stamp":"2024-01-23T09:25:20.944798+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:13:13.260134+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"30'25","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:30.374034+0000","last_change":"2024-01-23T09:25:30.374080+0000","last_active":"2024-01-23T09:25:30.374034+0000","last_peered":"2024-01-23T09:25:30.374034+0000","last_clean":"2024-01-23T09:25:30.374034+0000","last_became_active":"2024-01-23T08:54:42.227537+0000","last_became_peered":"2024-01-23T08:54:42.227537+0000","last_unstale":"2024-01-23T09:25:30.374034+0000","last_undegraded":"2024-01-23T09:25:30.374034+0000","last_fullsized":"2024-01-23T09:25:30.374034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2024-01-23T09:25:30.373908+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2024-01-23T09:25:30.373908+0000","last_clean_scrub_stamp":"2024-01-23T09:25:30.373908+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:04:42.128135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"30'33","reported_seq":74,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:24.324555+0000","last_change":"2024-01-23T09:25:24.324612+0000","last_active":"2024-01-23T09:25:24.324555+0000","last_peered":"2024-01-23T09:25:24.324555+0000","last_clean":"2024-01-23T09:25:24.324555+0000","last_became_active":"2024-01-23T08:54:42.224541+0000","last_became_peered":"2024-01-23T08:54:42.224541+0000","last_unstale":"2024-01-23T09:25:24.324555+0000","last_undegraded":"2024-01-23T09:25:24.324555+0000","last_fullsized":"2024-01-23T09:25:24.324555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'33","last_scrub_stamp":"2024-01-23T09:25:24.324395+0000","last_deep_scrub":"30'33","last_deep_scrub_stamp":"2024-01-23T09:25:24.324395+0000","last_clean_scrub_stamp":"2024-01-23T09:25:24.324395+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:06:15.043781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"30'18","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:24.010787+0000","last_change":"2024-01-23T09:25:24.010848+0000","last_active":"2024-01-23T09:25:24.010787+0000","last_peered":"2024-01-23T09:25:24.010787+0000","last_clean":"2024-01-23T09:25:24.010787+0000","last_became_active":"2024-01-23T08:54:42.111043+0000","last_became_peered":"2024-01-23T08:54:42.111043+0000","last_unstale":"2024-01-23T09:25:24.010787+0000","last_undegraded":"2024-01-23T09:25:24.010787+0000","last_fullsized":"2024-01-23T09:25:24.010787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'18","last_scrub_stamp":"2024-01-23T09:25:24.010617+0000","last_deep_scrub":"30'18","last_deep_scrub_stamp":"2024-01-23T09:25:24.010617+0000","last_clean_scrub_stamp":"2024-01-23T09:25:24.010617+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:50:14.452277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"30'19","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:15.052340+0000","last_change":"2024-01-23T09:25:15.052362+0000","last_active":"2024-01-23T09:25:15.052340+0000","last_peered":"2024-01-23T09:25:15.052340+0000","last_clean":"2024-01-23T09:25:15.052340+0000","last_became_active":"2024-01-23T08:54:42.115911+0000","last_became_peered":"2024-01-23T08:54:42.115911+0000","last_unstale":"2024-01-23T09:25:15.052340+0000","last_undegraded":"2024-01-23T09:25:15.052340+0000","last_fullsized":"2024-01-23T09:25:15.052340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2024-01-23T09:25:15.052273+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2024-01-23T09:25:15.052273+0000","last_clean_scrub_stamp":"2024-01-23T09:25:15.052273+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:49:29.534124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"30'33","reported_seq":74,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:28.990077+0000","last_change":"2024-01-23T09:25:28.990184+0000","last_active":"2024-01-23T09:25:28.990077+0000","last_peered":"2024-01-23T09:25:28.990077+0000","last_clean":"2024-01-23T09:25:28.990077+0000","last_became_active":"2024-01-23T08:54:42.157331+0000","last_became_peered":"2024-01-23T08:54:42.157331+0000","last_unstale":"2024-01-23T09:25:28.990077+0000","last_undegraded":"2024-01-23T09:25:28.990077+0000","last_fullsized":"2024-01-23T09:25:28.990077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'33","last_scrub_stamp":"2024-01-23T09:25:28.989874+0000","last_deep_scrub":"30'33","last_deep_scrub_stamp":"2024-01-23T09:25:28.989874+0000","last_clean_scrub_stamp":"2024-01-23T09:25:28.989874+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:00:44.753423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"30'28","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:19.766892+0000","last_change":"2024-01-23T09:25:19.767002+0000","last_active":"2024-01-23T09:25:19.766892+0000","last_peered":"2024-01-23T09:25:19.766892+0000","last_clean":"2024-01-23T09:25:19.766892+0000","last_became_active":"2024-01-23T08:54:42.091726+0000","last_became_peered":"2024-01-23T08:54:42.091726+0000","last_unstale":"2024-01-23T09:25:19.766892+0000","last_undegraded":"2024-01-23T09:25:19.766892+0000","last_fullsized":"2024-01-23T09:25:19.766892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2024-01-23T09:25:19.766650+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2024-01-23T09:25:19.766650+0000","last_clean_scrub_stamp":"2024-01-23T09:25:19.766650+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:37:13.008738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"30'19","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:19.904000+0000","last_change":"2024-01-23T09:25:19.904033+0000","last_active":"2024-01-23T09:25:19.904000+0000","last_peered":"2024-01-23T09:25:19.904000+0000","last_clean":"2024-01-23T09:25:19.904000+0000","last_became_active":"2024-01-23T08:54:42.119847+0000","last_became_peered":"2024-01-23T08:54:42.119847+0000","last_unstale":"2024-01-23T09:25:19.904000+0000","last_undegraded":"2024-01-23T09:25:19.904000+0000","last_fullsized":"2024-01-23T09:25:19.904000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2024-01-23T09:25:19.903905+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2024-01-23T09:25:19.903905+0000","last_clean_scrub_stamp":"2024-01-23T09:25:19.903905+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:09:02.693526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"30'18","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:29.969638+0000","last_change":"2024-01-23T09:25:29.969701+0000","last_active":"2024-01-23T09:25:29.969638+0000","last_peered":"2024-01-23T09:25:29.969638+0000","last_clean":"2024-01-23T09:25:29.969638+0000","last_became_active":"2024-01-23T08:54:42.195743+0000","last_became_peered":"2024-01-23T08:54:42.195743+0000","last_unstale":"2024-01-23T09:25:29.969638+0000","last_undegraded":"2024-01-23T09:25:29.969638+0000","last_fullsized":"2024-01-23T09:25:29.969638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'18","last_scrub_stamp":"2024-01-23T09:25:29.969472+0000","last_deep_scrub":"30'18","last_deep_scrub_stamp":"2024-01-23T09:25:29.969472+0000","last_clean_scrub_stamp":"2024-01-23T09:25:29.969472+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:48:38.048357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"30'24","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:22.229426+0000","last_change":"2024-01-23T09:25:22.229485+0000","last_active":"2024-01-23T09:25:22.229426+0000","last_peered":"2024-01-23T09:25:22.229426+0000","last_clean":"2024-01-23T09:25:22.229426+0000","last_became_active":"2024-01-23T08:54:42.194846+0000","last_became_peered":"2024-01-23T08:54:42.194846+0000","last_unstale":"2024-01-23T09:25:22.229426+0000","last_undegraded":"2024-01-23T09:25:22.229426+0000","last_fullsized":"2024-01-23T09:25:22.229426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2024-01-23T09:25:22.229271+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2024-01-23T09:25:22.229271+0000","last_clean_scrub_stamp":"2024-01-23T09:25:22.229271+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:29:21.231768+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"30'23","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:26.004575+0000","last_change":"2024-01-23T09:25:26.004695+0000","last_active":"2024-01-23T09:25:26.004575+0000","last_peered":"2024-01-23T09:25:26.004575+0000","last_clean":"2024-01-23T09:25:26.004575+0000","last_became_active":"2024-01-23T08:54:42.117735+0000","last_became_peered":"2024-01-23T08:54:42.117735+0000","last_unstale":"2024-01-23T09:25:26.004575+0000","last_undegraded":"2024-01-23T09:25:26.004575+0000","last_fullsized":"2024-01-23T09:25:26.004575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'23","last_scrub_stamp":"2024-01-23T09:25:26.004385+0000","last_deep_scrub":"30'23","last_deep_scrub_stamp":"2024-01-23T09:25:26.004385+0000","last_clean_scrub_stamp":"2024-01-23T09:25:26.004385+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:14:12.280107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"30'16","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:21.201977+0000","last_change":"2024-01-23T09:25:21.202008+0000","last_active":"2024-01-23T09:25:21.201977+0000","last_peered":"2024-01-23T09:25:21.201977+0000","last_clean":"2024-01-23T09:25:21.201977+0000","last_became_active":"2024-01-23T08:54:42.194331+0000","last_became_peered":"2024-01-23T08:54:42.194331+0000","last_unstale":"2024-01-23T09:25:21.201977+0000","last_undegraded":"2024-01-23T09:25:21.201977+0000","last_fullsized":"2024-01-23T09:25:21.201977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'16","last_scrub_stamp":"2024-01-23T09:25:21.201892+0000","last_deep_scrub":"30'16","last_deep_scrub_stamp":"2024-01-23T09:25:21.201892+0000","last_clean_scrub_stamp":"2024-01-23T09:25:21.201892+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:35:54.011678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"30'25","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:32.783776+0000","last_change":"2024-01-23T09:25:32.783834+0000","last_active":"2024-01-23T09:25:32.783776+0000","last_peered":"2024-01-23T09:25:32.783776+0000","last_clean":"2024-01-23T09:25:32.783776+0000","last_became_active":"2024-01-23T08:54:42.196391+0000","last_became_peered":"2024-01-23T08:54:42.196391+0000","last_unstale":"2024-01-23T09:25:32.783776+0000","last_undegraded":"2024-01-23T09:25:32.783776+0000","last_fullsized":"2024-01-23T09:25:32.783776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2024-01-23T09:25:32.783610+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2024-01-23T09:25:32.783610+0000","last_clean_scrub_stamp":"2024-01-23T09:25:32.783610+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:00:48.547158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"30'18","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:33.815827+0000","last_change":"2024-01-23T09:25:33.815889+0000","last_active":"2024-01-23T09:25:33.815827+0000","last_peered":"2024-01-23T09:25:33.815827+0000","last_clean":"2024-01-23T09:25:33.815827+0000","last_became_active":"2024-01-23T08:54:42.229220+0000","last_became_peered":"2024-01-23T08:54:42.229220+0000","last_unstale":"2024-01-23T09:25:33.815827+0000","last_undegraded":"2024-01-23T09:25:33.815827+0000","last_fullsized":"2024-01-23T09:25:33.815827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'18","last_scrub_stamp":"2024-01-23T09:25:33.815658+0000","last_deep_scrub":"30'18","last_deep_scrub_stamp":"2024-01-23T09:25:33.815658+0000","last_clean_scrub_stamp":"2024-01-23T09:25:33.815658+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:15:51.921553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"30'24","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:26.960712+0000","last_change":"2024-01-23T09:25:26.960771+0000","last_active":"2024-01-23T09:25:26.960712+0000","last_peered":"2024-01-23T09:25:26.960712+0000","last_clean":"2024-01-23T09:25:26.960712+0000","last_became_active":"2024-01-23T08:54:42.118233+0000","last_became_peered":"2024-01-23T08:54:42.118233+0000","last_unstale":"2024-01-23T09:25:26.960712+0000","last_undegraded":"2024-01-23T09:25:26.960712+0000","last_fullsized":"2024-01-23T09:25:26.960712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2024-01-23T09:25:26.960547+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2024-01-23T09:25:26.960547+0000","last_clean_scrub_stamp":"2024-01-23T09:25:26.960547+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:24:46.046056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2304,"num_write_kb":252373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2476,"ondisk_log_size":2476,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1536,"ondisk_log_size":1536,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":23189121,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":519,"num_read_kb":542,"num_write":5371,"num_write_kb":25642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":46628864,"data_stored":46378242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4987,"ondisk_log_size":4987,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509825,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29528,"kb_used_data":2512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342312,"statfs":{"total":96636764160,"available":96606527488,"internally_reserved":0,"allocated":2572288,"data_stored":2340721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.89200000000000002,"15min":0.88200000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.46100000000000002},"max":{"1min":1.4039999999999999,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":1.141},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.93500000000000005,"15min":0.91400000000000003},"min":{"1min":0.61799999999999999,"5min":0.56599999999999995,"15min":0.46300000000000002},"max":{"1min":1.3999999999999999,"5min":1.456,"15min":1.456},"last":0.98399999999999999}]},{"osd":1,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.97599999999999998,"15min":0.95499999999999996},"min":{"1min":0.66100000000000003,"5min":0.52900000000000003,"15min":0.49399999999999999},"max":{"1min":1.419,"5min":1.425,"15min":1.754},"last":1.206},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.97499999999999998,"15min":0.97299999999999998},"min":{"1min":0.67900000000000005,"5min":0.54400000000000004,"15min":0.51900000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.597},"last":0.74099999999999999}]},{"osd":2,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.96999999999999997,"15min":0.93400000000000005},"min":{"1min":0.66700000000000004,"5min":0.53000000000000003,"15min":0.47099999999999997},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0369999999999999,"15min":1.014},"min":{"1min":0.73599999999999999,"5min":0.59999999999999998,"15min":0.55000000000000004},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.90200000000000002}]},{"osd":3,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0069999999999999,"15min":0.99099999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.7190000000000001},"last":1.01},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.052,"15min":1.073},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57099999999999995},"max":{"1min":1.587,"5min":1.587,"15min":1.889},"last":0.79300000000000004}]},{"osd":4,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":0.97099999999999997,"15min":0.97199999999999998},"min":{"1min":0.68200000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.645},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.99199999999999999,"15min":0.98999999999999999},"min":{"1min":0.60699999999999998,"5min":0.48899999999999999,"15min":0.46800000000000003},"max":{"1min":1.4259999999999999,"5min":1.621,"15min":1.982},"last":0.68799999999999994}]},{"osd":5,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0760000000000001,"15min":1.0820000000000001},"min":{"1min":0.71099999999999997,"5min":0.63,"15min":0.57299999999999995},"max":{"1min":1.4570000000000001,"5min":1.613,"15min":1.9710000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.115,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.72299999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.8260000000000001},"last":0.82899999999999996}]},{"osd":6,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.147,"15min":1.1399999999999999},"min":{"1min":0.86499999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.613,"5min":1.613,"15min":1.9399999999999999},"last":0.874},{"interface":"front","average":{"1min":1.123,"5min":1.131,"15min":1.1319999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.752,"5min":1.752,"15min":1.883},"last":0.94799999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509824,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38352,"kb_used_data":7176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333488,"statfs":{"total":96636764160,"available":96597491712,"internally_reserved":0,"allocated":7348224,"data_stored":7125746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.89300000000000002,"15min":0.88200000000000001},"min":{"1min":0.62,"5min":0.54300000000000004,"15min":0.501},"max":{"1min":1.212,"5min":1.296,"15min":1.5269999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.98799999999999999,"15min":0.98099999999999998},"min":{"1min":0.59099999999999997,"5min":0.58899999999999997,"15min":0.53100000000000003},"max":{"1min":1.276,"5min":1.552,"15min":1.552},"last":0.90500000000000003}]},{"osd":1,"last update":"Tue Jan 23 09:25:12 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.97999999999999998,"15min":0.96299999999999997},"min":{"1min":0.58799999999999997,"5min":0.51600000000000001,"15min":0.498},"max":{"1min":1.2889999999999999,"5min":1.4019999999999999,"15min":1.413},"last":1.139},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.96199999999999997,"15min":0.93899999999999995},"min":{"1min":0.65700000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2729999999999999,"5min":1.292,"15min":1.542},"last":0.80800000000000005}]},{"osd":2,"last update":"Tue Jan 23 09:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.93899999999999995,"15min":0.91400000000000003},"min":{"1min":0.65900000000000003,"5min":0.58599999999999997,"15min":0.51100000000000001},"max":{"1min":1.3700000000000001,"5min":1.421,"15min":1.46},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0369999999999999,"15min":1.0189999999999999},"min":{"1min":0.69699999999999995,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.1699999999999999}]},{"osd":3,"last update":"Tue Jan 23 09:25:12 2024","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.036,"15min":1.034},"min":{"1min":0.76100000000000001,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3220000000000001,"5min":1.431,"15min":1.677},"last":1.02},{"interface":"front","average":{"1min":1.133,"5min":1.0880000000000001,"15min":1.0529999999999999},"min":{"1min":0.86399999999999999,"5min":0.76100000000000001,"15min":0.49199999999999999},"max":{"1min":1.4670000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.302}]},{"osd":4,"last update":"Tue Jan 23 09:25:12 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.98199999999999998,"15min":0.99199999999999999},"min":{"1min":0.65500000000000003,"5min":0.61799999999999999,"15min":0.48599999999999999},"max":{"1min":1.3300000000000001,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.05},{"interface":"front","average":{"1min":1.073,"5min":1.0209999999999999,"15min":1.01},"min":{"1min":0.64700000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.4490000000000001,"5min":1.468,"15min":1.468},"last":0.85899999999999999}]},{"osd":6,"last update":"Tue Jan 23 09:25:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.0509999999999999,"15min":1.048},"min":{"1min":0.73799999999999999,"5min":0.65900000000000003,"15min":0.55300000000000005},"max":{"1min":1.3799999999999999,"5min":1.4690000000000001,"15min":1.823},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.123,"15min":1.1120000000000001},"min":{"1min":0.91700000000000004,"5min":0.72299999999999998,"15min":0.42599999999999999},"max":{"1min":1.4610000000000001,"5min":1.4930000000000001,"15min":1.641},"last":0.93999999999999995}]},{"osd":7,"last update":"Tue Jan 23 09:25:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.121,"15min":1.1399999999999999},"min":{"1min":0.71899999999999997,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.4139999999999999,"5min":1.518,"15min":1.919},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.294,"5min":1.1879999999999999,"15min":1.175},"min":{"1min":0.874,"5min":0.76500000000000001,"15min":0.67800000000000005},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.637},"last":1.216}]}]},{"osd":4,"up_from":15,"seq":64424509823,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39732,"kb_used_data":8556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332108,"statfs":{"total":96636764160,"available":96596078592,"internally_reserved":0,"allocated":8761344,"data_stored":8522021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.92400000000000004,"15min":0.91300000000000003},"min":{"1min":0.56599999999999995,"5min":0.50700000000000001,"15min":0.46600000000000003},"max":{"1min":1.3129999999999999,"5min":1.3799999999999999,"15min":1.583},"last":1.2},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.95499999999999996,"15min":0.91800000000000004},"min":{"1min":0.60499999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.282,"5min":1.329,"15min":1.5629999999999999},"last":0.88700000000000001}]},{"osd":1,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.97699999999999998,"15min":0.93000000000000005},"min":{"1min":0.74099999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3640000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.94099999999999995,"15min":0.95299999999999996},"min":{"1min":0.66100000000000003,"5min":0.59999999999999998,"15min":0.5},"max":{"1min":1.232,"5min":1.415,"15min":1.415},"last":1.0089999999999999}]},{"osd":2,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.96099999999999997,"15min":0.93700000000000006},"min":{"1min":0.625,"5min":0.56599999999999995,"15min":0.54000000000000004},"max":{"1min":1.3460000000000001,"5min":1.387,"15min":1.387},"last":1.1739999999999999},{"interface":"front","average":{"1min":1,"5min":1.0589999999999999,"15min":1.0329999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.498},"max":{"1min":1.296,"5min":1.411,"15min":1.736},"last":1.1120000000000001}]},{"osd":3,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0009999999999999,"15min":0.98199999999999998},"min":{"1min":0.70199999999999996,"5min":0.58899999999999997,"15min":0.55300000000000005},"max":{"1min":1.3720000000000001,"5min":1.3779999999999999,"15min":1.7509999999999999},"last":1.137},{"interface":"front","average":{"1min":1.101,"5min":1.0840000000000001,"15min":1.0680000000000001},"min":{"1min":0.78800000000000003,"5min":0.77100000000000002,"15min":0.60799999999999998},"max":{"1min":1.349,"5min":1.3859999999999999,"15min":1.482},"last":0.98399999999999999}]},{"osd":5,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.96599999999999997,"15min":0.98299999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3100000000000001,"5min":1.5549999999999999,"15min":1.643},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.98699999999999999,"15min":0.98899999999999999},"min":{"1min":0.64300000000000002,"5min":0.57999999999999996,"15min":0.52300000000000002},"max":{"1min":1.417,"5min":1.4330000000000001,"15min":1.986},"last":1.232}]},{"osd":6,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.0289999999999999,"15min":1.0309999999999999},"min":{"1min":0.64900000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.4279999999999999,"5min":1.446,"15min":1.825},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.139,"5min":1.1160000000000001,"15min":1.1180000000000001},"min":{"1min":0.86599999999999999,"5min":0.77000000000000002,"15min":0.45700000000000002},"max":{"1min":1.373,"5min":1.5049999999999999,"15min":1.7749999999999999},"last":0.94099999999999995}]},{"osd":7,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.0549999999999999,"15min":1.0629999999999999},"min":{"1min":0.72999999999999998,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.573,"5min":1.573,"15min":1.673},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.1950000000000001,"15min":1.173},"min":{"1min":0.94399999999999995,"5min":0.71099999999999997,"15min":0.69399999999999995},"max":{"1min":1.4850000000000001,"5min":1.5369999999999999,"15min":1.5629999999999999},"last":0.71599999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509825,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39696,"kb_used_data":8520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332144,"statfs":{"total":96636764160,"available":96596115456,"internally_reserved":0,"allocated":8724480,"data_stored":8520251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.74299999999999999,"15min":0.72899999999999998},"min":{"1min":0.44600000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.1890000000000001,"5min":1.528,"15min":1.5820000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.877,"15min":0.82499999999999996},"min":{"1min":0.54000000000000004,"5min":0.40200000000000002,"15min":0.248},"max":{"1min":1.534,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":1.0309999999999999}]},{"osd":1,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90800000000000003,"15min":0.88900000000000001},"min":{"1min":0.51900000000000002,"5min":0.42799999999999999,"15min":0.376},"max":{"1min":1.401,"5min":1.974,"15min":1.974},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.995,"5min":0.89800000000000002,"15min":0.88600000000000001},"min":{"1min":0.61399999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.393,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.85499999999999998}]},{"osd":3,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.86299999999999999,"15min":0.85199999999999998},"min":{"1min":0.55800000000000005,"5min":0.36499999999999999,"15min":0.36199999999999999},"max":{"1min":1.7310000000000001,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0549999999999999,"15min":1.0109999999999999},"min":{"1min":0.67100000000000004,"5min":0.38,"15min":0.38},"max":{"1min":1.591,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.70999999999999996}]},{"osd":4,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.1499999999999999,"15min":1.123},"min":{"1min":0.78900000000000003,"5min":0.59699999999999998,"15min":0.55000000000000004},"max":{"1min":1.446,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.23,"5min":1.1559999999999999,"15min":1.153},"min":{"1min":0.82499999999999996,"5min":0.61599999999999999,"15min":0.60399999999999998},"max":{"1min":1.754,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.1379999999999999}]},{"osd":5,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1020000000000001,"15min":1.091},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53700000000000003},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.9379999999999999},"last":1.181},{"interface":"front","average":{"1min":1.26,"5min":1.2430000000000001,"15min":1.2130000000000001},"min":{"1min":0.79300000000000004,"5min":0.68899999999999995,"15min":0.624},"max":{"1min":1.681,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":0.81499999999999995}]},{"osd":6,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.202,"15min":1.198},"min":{"1min":0.71499999999999997,"5min":0.60899999999999999,"15min":0.59499999999999997},"max":{"1min":1.796,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.1919999999999999,"15min":1.175},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.577,"5min":1.6519999999999999,"15min":1.843},"last":1.2809999999999999}]},{"osd":7,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.2849999999999999,"15min":1.262},"min":{"1min":0.79600000000000004,"5min":0.77100000000000002,"15min":0.59499999999999997},"max":{"1min":2,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.401},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.26,"15min":1.2370000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.3540000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509824,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":933888,"data_stored":722685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73599999999999999,"15min":0.72899999999999998},"min":{"1min":0.52100000000000002,"5min":0.36599999999999999,"15min":0.28599999999999998},"max":{"1min":1.107,"5min":1.371,"15min":1.681},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82899999999999996,"15min":0.80500000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.36399999999999999},"max":{"1min":1.2270000000000001,"5min":1.5569999999999999,"15min":2.0049999999999999},"last":0.72799999999999998}]},{"osd":2,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77600000000000002,"15min":0.73399999999999999},"min":{"1min":0.55900000000000005,"5min":0.46600000000000003,"15min":0.375},"max":{"1min":1.218,"5min":1.262,"15min":1.5960000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.96599999999999997,"15min":0.92600000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.30499999999999999},"max":{"1min":1.367,"5min":1.4470000000000001,"15min":1.6919999999999999},"last":1.091}]},{"osd":3,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.97099999999999997,"15min":0.93200000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.40400000000000003},"max":{"1min":1.4099999999999999,"5min":1.569,"15min":1.8069999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.97899999999999998,"15min":0.96299999999999997},"min":{"1min":0.53300000000000003,"5min":0.51200000000000001,"15min":0.35599999999999998},"max":{"1min":1.3680000000000001,"5min":1.657,"15min":2.1589999999999998},"last":0.998}]},{"osd":4,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0840000000000001,"15min":1.077},"min":{"1min":0.80800000000000005,"5min":0.65900000000000003,"15min":0.54300000000000004},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6799999999999999},"last":1.038},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2090000000000001,"15min":1.1759999999999999},"min":{"1min":0.80800000000000005,"5min":0.64000000000000001,"15min":0.50600000000000001},"max":{"1min":1.736,"5min":1.736,"15min":2.2450000000000001},"last":1.288}]},{"osd":5,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.1850000000000001,"15min":1.1699999999999999},"min":{"1min":0.83799999999999997,"5min":0.73899999999999999,"15min":0.63},"max":{"1min":1.7829999999999999,"5min":1.8260000000000001,"15min":2.1110000000000002},"last":1.21},{"interface":"front","average":{"1min":1.232,"5min":1.1990000000000001,"15min":1.1619999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.66200000000000003},"max":{"1min":1.538,"5min":1.802,"15min":1.802},"last":1.169}]},{"osd":6,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.254,"15min":1.236},"min":{"1min":0.79400000000000004,"5min":0.77300000000000002,"15min":0.58699999999999997},"max":{"1min":1.6779999999999999,"5min":1.829,"15min":2.2000000000000002},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2350000000000001,"15min":1.2050000000000001},"min":{"1min":0.82699999999999996,"5min":0.76100000000000001,"15min":0.66700000000000004},"max":{"1min":1.631,"5min":1.857,"15min":1.857},"last":1.339}]},{"osd":7,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.306,"15min":1.282},"min":{"1min":0.84999999999999998,"5min":0.77600000000000002,"15min":0.65500000000000003},"max":{"1min":1.6259999999999999,"5min":1.913,"15min":2.1110000000000002},"last":1.504},{"interface":"front","average":{"1min":1.28,"5min":1.3029999999999999,"15min":1.286},"min":{"1min":0.96799999999999997,"5min":0.90800000000000003,"15min":0.72099999999999997},"max":{"1min":1.883,"5min":1.9279999999999999,"15min":2.238},"last":1.1379999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509824,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":4444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":4550656,"data_stored":4328911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 23 09:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":0.81299999999999994,"15min":0.747},"min":{"1min":0.39300000000000002,"5min":0.32800000000000001,"15min":0.29499999999999998},"max":{"1min":9.5459999999999994,"5min":9.5459999999999994,"15min":9.5459999999999994},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.85099999999999998,"15min":0.83999999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.26500000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":2.21},"last":0.70799999999999996}]},{"osd":2,"last update":"Tue Jan 23 09:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.86599999999999999,"15min":0.80500000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.312},"max":{"1min":5.5199999999999996,"5min":5.5199999999999996,"15min":5.5199999999999996},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.91500000000000004,"15min":0.89700000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.40400000000000003},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":2.1440000000000001},"last":0.90300000000000002}]},{"osd":3,"last update":"Tue Jan 23 09:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.002,"15min":0.93899999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.32200000000000001},"max":{"1min":9.6470000000000002,"5min":9.6470000000000002,"15min":9.6470000000000002},"last":0.97199999999999998},{"interface":"front","average":{"1min":3.391,"5min":1.4690000000000001,"15min":1.1040000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":42.942,"5min":42.942,"15min":42.942},"last":1.077}]},{"osd":4,"last update":"Tue Jan 23 09:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.1060000000000001,"15min":1.1020000000000001},"min":{"1min":0.64800000000000002,"5min":0.51900000000000002,"15min":0.47299999999999998},"max":{"1min":1.407,"5min":1.8979999999999999,"15min":2.3050000000000002},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.1739999999999999,"15min":1.151},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.6619999999999999,"5min":3.6619999999999999,"15min":3.6619999999999999},"last":1.0349999999999999}]},{"osd":5,"last update":"Tue Jan 23 09:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.1830000000000001,"15min":1.137},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.5},"max":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.23,"5min":1.244,"15min":1.2350000000000001},"min":{"1min":0.77000000000000002,"5min":0.67900000000000005,"15min":0.51700000000000002},"max":{"1min":1.76,"5min":1.8460000000000001,"15min":2.1080000000000001},"last":1.0569999999999999}]},{"osd":6,"last update":"Tue Jan 23 09:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.258,"15min":1.2390000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.59599999999999997},"max":{"1min":3.5609999999999999,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.25,"15min":1.2270000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":1.1870000000000001}]},{"osd":7,"last update":"Tue Jan 23 09:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2909999999999999,"15min":1.298},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.54400000000000004},"max":{"1min":1.8879999999999999,"5min":1.98,"15min":2.2160000000000002},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.425,"5min":1.3460000000000001,"15min":1.306},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.57699999999999996},"max":{"1min":4.3330000000000002,"5min":4.3330000000000002,"15min":4.3330000000000002},"last":0.86899999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509826,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47980,"kb_used_data":12644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323860,"statfs":{"total":96636764160,"available":96587632640,"internally_reserved":0,"allocated":12947456,"data_stored":12717118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.755,"15min":0.73699999999999999},"min":{"1min":0.54400000000000004,"5min":0.434,"15min":0.28100000000000003},"max":{"1min":1.1850000000000001,"5min":1.492,"15min":1.514},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.78100000000000003,"15min":0.751},"min":{"1min":0.51800000000000002,"5min":0.45800000000000002,"15min":0.34799999999999998},"max":{"1min":1.155,"5min":1.2450000000000001,"15min":1.641},"last":0.79800000000000004}]},{"osd":1,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.83899999999999997,"15min":0.79700000000000004},"min":{"1min":0.53600000000000003,"5min":0.42099999999999999,"15min":0.309},"max":{"1min":1.0820000000000001,"5min":1.782,"15min":1.782},"last":0.58099999999999996},{"interface":"front","average":{"1min":1.026,"5min":0.95999999999999996,"15min":0.90500000000000003},"min":{"1min":0.70199999999999996,"5min":0.437,"15min":0.32900000000000001},"max":{"1min":1.367,"5min":2.698,"15min":2.698},"last":1.048}]},{"osd":2,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.95899999999999996,"15min":0.91200000000000003},"min":{"1min":0.67600000000000005,"5min":0.54800000000000004,"15min":0.379},"max":{"1min":1.3879999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.012},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.018,"15min":0.96499999999999997},"min":{"1min":0.56100000000000005,"5min":0.49399999999999999,"15min":0.312},"max":{"1min":1.405,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":0.85299999999999998}]},{"osd":4,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.093,"15min":1.0720000000000001},"min":{"1min":0.85399999999999998,"5min":0.624,"15min":0.57099999999999995},"max":{"1min":1.53,"5min":1.53,"15min":1.736},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1439999999999999,"15min":1.1000000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.499},"max":{"1min":1.4419999999999999,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":0.90000000000000002}]},{"osd":5,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1890000000000001,"15min":1.1499999999999999},"min":{"1min":0.873,"5min":0.72199999999999998,"15min":0.51800000000000002},"max":{"1min":1.5800000000000001,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.256,"5min":1.284,"15min":1.24},"min":{"1min":0.88700000000000001,"5min":0.69399999999999995,"15min":0.47999999999999998},"max":{"1min":1.7549999999999999,"5min":2.794,"15min":2.794},"last":1.117}]},{"osd":6,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3160000000000001,"15min":1.2669999999999999},"min":{"1min":0.94499999999999995,"5min":0.77200000000000002,"15min":0.61399999999999999},"max":{"1min":1.877,"5min":2.8730000000000002,"15min":2.8730000000000002},"last":1.163},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.1970000000000001,"15min":1.1859999999999999},"min":{"1min":0.87,"5min":0.68000000000000005,"15min":0.60699999999999998},"max":{"1min":1.577,"5min":1.5880000000000001,"15min":2.3170000000000002},"last":0.95299999999999996}]},{"osd":7,"last update":"Tue Jan 23 09:24:46 2024","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.258,"15min":1.224},"min":{"1min":1.1319999999999999,"5min":0.91100000000000003,"15min":0.68000000000000005},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":2.1960000000000002},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.331,"5min":1.2969999999999999,"15min":1.262},"min":{"1min":1.004,"5min":0.90700000000000003,"15min":0.63400000000000001},"max":{"1min":1.679,"5min":1.9330000000000001,"15min":2.0910000000000002},"last":1.0780000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542528,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48084,"kb_used_data":4428,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94323756,"statfs":{"total":96636764160,"available":96587526144,"internally_reserved":0,"allocated":4534272,"data_stored":4328749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.879,"15min":0.874},"min":{"1min":0.53500000000000003,"5min":0.48099999999999998,"15min":0.44},"max":{"1min":1.2969999999999999,"5min":1.3520000000000001,"15min":1.4199999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.91600000000000004,"15min":0.90200000000000002},"min":{"1min":0.67400000000000004,"5min":0.501,"15min":0.39600000000000002},"max":{"1min":1.4079999999999999,"5min":1.575,"15min":1.575},"last":0.98199999999999998}]},{"osd":1,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.96899999999999997,"15min":0.93700000000000006},"min":{"1min":0.79200000000000004,"5min":0.58899999999999997,"15min":0.55000000000000004},"max":{"1min":1.3089999999999999,"5min":1.3169999999999999,"15min":1.3400000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.995,"5min":1.032,"15min":0.98599999999999999},"min":{"1min":0.70199999999999996,"5min":0.67800000000000005,"15min":0.48399999999999999},"max":{"1min":1.2250000000000001,"5min":1.5209999999999999,"15min":1.548},"last":1.173}]},{"osd":2,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.92300000000000004,"15min":0.92000000000000004},"min":{"1min":0.58699999999999997,"5min":0.502,"15min":0.502},"max":{"1min":1.3460000000000001,"5min":1.484,"15min":2.1219999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":1,"5min":0.95099999999999996,"15min":0.93400000000000005},"min":{"1min":0.63,"5min":0.58599999999999997,"15min":0.46700000000000003},"max":{"1min":1.377,"5min":1.377,"15min":1.429},"last":1.3009999999999999}]},{"osd":3,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.032,"15min":1.0429999999999999},"min":{"1min":0.72399999999999998,"5min":0.72099999999999997,"15min":0.625},"max":{"1min":1.3460000000000001,"5min":1.4390000000000001,"15min":1.4850000000000001},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.0309999999999999,"15min":1.0249999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.53900000000000003},"max":{"1min":1.2949999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.026}]},{"osd":4,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.94999999999999996,"15min":0.95499999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4299999999999999,"5min":1.4419999999999999,"15min":1.518},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.145,"5min":1.103,"15min":1.1020000000000001},"min":{"1min":0.73399999999999999,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.206}]},{"osd":5,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.96099999999999997,"15min":0.95799999999999996},"min":{"1min":0.59999999999999998,"5min":0.54200000000000004,"15min":0.497},"max":{"1min":1.718,"5min":1.718,"15min":1.734},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.147,"15min":1.1399999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.4419999999999999,"5min":1.601,"15min":2.278},"last":1.236}]},{"osd":7,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0600000000000001,"15min":1.048},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.53900000000000003},"max":{"1min":1.4810000000000001,"5min":1.659,"15min":1.659},"last":1.095},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.0940000000000001,"15min":1.0800000000000001},"min":{"1min":0.80400000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.657,"5min":1.657,"15min":1.6599999999999999},"last":1.1279999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4231168,"data_stored":4198008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12627968,"data_stored":12586215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8441856,"data_stored":8391118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6434816,"data_stored":6404475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4214784,"data_stored":4197846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2252800,"data_stored":2209818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-23T09:25:43.321 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:43.321 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:43.321 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:43.322 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:43.322 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:43.322 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-01-23T08:54:48.202185+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=54, tm_sec=48, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=9, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T09:25:43.323 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-01-23T09:25:53.984 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:25:53.988 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:26:03.324 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-23T09:26:03.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.457+0000 7fa98e223640 1 Processor -- start 2024-01-23T09:26:03.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.457+0000 7fa98e223640 1 -- start start 2024-01-23T09:26:03.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.457+0000 7fa98e223640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9880c4820 0x7fa988072260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:03.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.457+0000 7fa98e223640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa988150140 0x7fa988156680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:03.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.457+0000 7fa98e223640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa988156bc0 con 0x7fa9880c4c00 2024-01-23T09:26:03.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.457+0000 7fa98e223640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa98806fc40 con 0x7fa988150140 2024-01-23T09:26:03.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.457+0000 7fa98e223640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98806fee0 con 0x7fa9880c4820 2024-01-23T09:26:03.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.457+0000 7fa986ffd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa9880c4c00 0x7fa98814fa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44282/0 (socket says 172.21.15.46:44282) 2024-01-23T09:26:03.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.457+0000 7fa986ffd640 1 -- 172.21.15.46:0/709188221 learned_addr learned my addr 172.21.15.46:0/709188221 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T09:26:03.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.461+0000 7fa987fff640 1 --2- 172.21.15.46:0/709188221 >> v2:172.21.15.46:3300/0 conn(0x7fa988150140 0x7fa988156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:03.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.461+0000 7fa9877fe640 1 --2- 172.21.15.46:0/709188221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9880c4820 0x7fa988072260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:03.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.465+0000 7fa987fff640 1 -- 172.21.15.46:0/709188221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9880c4820 msgr2=0x7fa988072260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:26:03.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.465+0000 7fa987fff640 1 --2- 172.21.15.46:0/709188221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9880c4820 0x7fa988072260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:03.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.465+0000 7fa987fff640 1 -- 172.21.15.46:0/709188221 >> v1:172.21.15.46:6789/0 conn(0x7fa9880c4c00 legacy=0x7fa98814fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:03.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.465+0000 7fa987fff640 1 -- 172.21.15.46:0/709188221 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9880c2980 con 0x7fa988150140 2024-01-23T09:26:03.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.469+0000 7fa987fff640 1 --2- 172.21.15.46:0/709188221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa988150140 0x7fa988156680 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa980009d90 tx=0x7fa98001f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63f91e8360ceed7 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:03.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.477+0000 7fa9867fc640 1 -- 172.21.15.46:0/709188221 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9800af600 con 0x7fa988150140 2024-01-23T09:26:03.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.477+0000 7fa9867fc640 1 -- 172.21.15.46:0/709188221 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9800ab050 con 0x7fa988150140 2024-01-23T09:26:03.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.477+0000 7fa9867fc640 1 -- 172.21.15.46:0/709188221 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9800af980 con 0x7fa988150140 2024-01-23T09:26:03.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.477+0000 7fa98e223640 1 -- 172.21.15.46:0/709188221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa988150140 msgr2=0x7fa988156680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:03.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.477+0000 7fa98e223640 1 --2- 172.21.15.46:0/709188221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa988150140 0x7fa988156680 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa980009d90 tx=0x7fa98001f130 comp rx=0 tx=0).stop 2024-01-23T09:26:03.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.477+0000 7fa98e223640 1 -- 172.21.15.46:0/709188221 shutdown_connections 2024-01-23T09:26:03.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.477+0000 7fa98e223640 1 --2- 172.21.15.46:0/709188221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa988150140 0x7fa988156680 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:03.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.477+0000 7fa98e223640 1 --2- 172.21.15.46:0/709188221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9880c4820 0x7fa988072260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:03.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.477+0000 7fa98e223640 1 -- 172.21.15.46:0/709188221 >> 172.21.15.46:0/709188221 conn(0x7fa988071740 msgr2=0x7fa988071b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:26:03.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.477+0000 7fa98e223640 1 -- 172.21.15.46:0/709188221 shutdown_connections 2024-01-23T09:26:03.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.477+0000 7fa98e223640 1 -- 172.21.15.46:0/709188221 wait complete. 2024-01-23T09:26:03.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.477+0000 7fa98e223640 1 Processor -- start 2024-01-23T09:26:03.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.477+0000 7fa98e223640 1 -- start start 2024-01-23T09:26:03.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.477+0000 7fa98e223640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9880c4820 0x7fa9881454e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:03.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.477+0000 7fa98e223640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9880c4c00 0x7fa9881515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:03.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.477+0000 7fa98e223640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa988150140 0x7fa988143f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:03.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.477+0000 7fa98e223640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa988148b40 con 0x7fa9880c4c00 2024-01-23T09:26:03.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.477+0000 7fa98e223640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa988149590 con 0x7fa988150140 2024-01-23T09:26:03.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.477+0000 7fa98e223640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa988145050 con 0x7fa9880c4820 2024-01-23T09:26:03.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.481+0000 7fa986ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9880c4c00 0x7fa9881515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:03.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.481+0000 7fa986ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9880c4c00 0x7fa9881515c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37196/0 (socket says 172.21.15.46:37196) 2024-01-23T09:26:03.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.481+0000 7fa986ffd640 1 -- 172.21.15.46:0/3012400391 learned_addr learned my addr 172.21.15.46:0/3012400391 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:26:03.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.481+0000 7fa9877fe640 1 --2- 172.21.15.46:0/3012400391 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9880c4820 0x7fa9881454e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:03.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.481+0000 7fa987fff640 1 --2- 172.21.15.46:0/3012400391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa988150140 0x7fa988143f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:03.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.485+0000 7fa986ffd640 1 -- 172.21.15.46:0/3012400391 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9880c4820 msgr2=0x7fa9881454e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:03.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.485+0000 7fa986ffd640 1 --2- 172.21.15.46:0/3012400391 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9880c4820 0x7fa9881454e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:03.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.485+0000 7fa986ffd640 1 -- 172.21.15.46:0/3012400391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa988150140 msgr2=0x7fa988143f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:03.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.485+0000 7fa986ffd640 1 --2- 172.21.15.46:0/3012400391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa988150140 0x7fa988143f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:03.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.485+0000 7fa986ffd640 1 -- 172.21.15.46:0/3012400391 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa980009a70 con 0x7fa9880c4c00 2024-01-23T09:26:03.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.485+0000 7fa986ffd640 1 --2- 172.21.15.46:0/3012400391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9880c4c00 0x7fa9881515c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00c430 tx=0x7fa97c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:03.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.493+0000 7fa96ffff640 1 -- 172.21.15.46:0/3012400391 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c005cf0 con 0x7fa9880c4c00 2024-01-23T09:26:03.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.493+0000 7fa96ffff640 1 -- 172.21.15.46:0/3012400391 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97c005e50 con 0x7fa9880c4c00 2024-01-23T09:26:03.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.493+0000 7fa96ffff640 1 -- 172.21.15.46:0/3012400391 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c0072f0 con 0x7fa9880c4c00 2024-01-23T09:26:03.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.493+0000 7fa98e223640 1 -- 172.21.15.46:0/3012400391 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa988148d30 con 0x7fa9880c4c00 2024-01-23T09:26:03.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.493+0000 7fa98e223640 1 -- 172.21.15.46:0/3012400391 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa988148fd0 con 0x7fa9880c4c00 2024-01-23T09:26:03.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.493+0000 7fa98e223640 1 -- 172.21.15.46:0/3012400391 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa988144b80 con 0x7fa9880c4c00 2024-01-23T09:26:03.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.789+0000 7fa96ffff640 1 -- 172.21.15.46:0/3012400391 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fa97c007510 con 0x7fa9880c4c00 2024-01-23T09:26:03.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.789+0000 7fa96ffff640 1 --2- 172.21.15.46:0/3012400391 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa974066550 0x7fa974068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:03.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.793+0000 7fa9877fe640 1 --2- 172.21.15.46:0/3012400391 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa974066550 0x7fa974068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:03.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.793+0000 7fa9877fe640 1 --2- 172.21.15.46:0/3012400391 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa974066550 0x7fa974068a10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa978009b60 tx=0x7fa978009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:03.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.829+0000 7fa96ffff640 1 -- 172.21.15.46:0/3012400391 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7fa97c054890 con 0x7fa9880c4c00 2024-01-23T09:26:03.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.829+0000 7fa96ffff640 1 -- 172.21.15.46:0/3012400391 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fa97c050bd0 con 0x7fa9880c4c00 2024-01-23T09:26:04.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:03.997+0000 7fa98e223640 1 -- 172.21.15.46:0/3012400391 --> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa9880c5e70 con 0x7fa974066550 2024-01-23T09:26:04.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.025+0000 7fa96ffff640 1 -- 172.21.15.46:0/3012400391 <== mgr.4107 v2:172.21.15.46:6800/2324478006 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369199 (secure 0 0 0) 0x7fa978011ac0 con 0x7fa974066550 2024-01-23T09:26:04.032 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T09:26:04.036 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-01-23T09:26:04.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.033+0000 7fa98e223640 1 -- 172.21.15.46:0/3012400391 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa974066550 msgr2=0x7fa974068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:04.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.033+0000 7fa98e223640 1 --2- 172.21.15.46:0/3012400391 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa974066550 0x7fa974068a10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa978009b60 tx=0x7fa978009190 comp rx=0 tx=0).stop 2024-01-23T09:26:04.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.033+0000 7fa98e223640 1 -- 172.21.15.46:0/3012400391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9880c4c00 msgr2=0x7fa9881515c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:04.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.033+0000 7fa98e223640 1 --2- 172.21.15.46:0/3012400391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9880c4c00 0x7fa9881515c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00c430 tx=0x7fa97c00c8f0 comp rx=0 tx=0).stop 2024-01-23T09:26:04.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.033+0000 7fa98e223640 1 -- 172.21.15.46:0/3012400391 shutdown_connections 2024-01-23T09:26:04.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.033+0000 7fa98e223640 1 --2- 172.21.15.46:0/3012400391 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fa974066550 0x7fa974068a10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:04.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.033+0000 7fa98e223640 1 --2- 172.21.15.46:0/3012400391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa988150140 0x7fa988143f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:04.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.033+0000 7fa98e223640 1 --2- 172.21.15.46:0/3012400391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9880c4c00 0x7fa9881515c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:04.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.033+0000 7fa98e223640 1 --2- 172.21.15.46:0/3012400391 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9880c4820 0x7fa9881454e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:04.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.033+0000 7fa98e223640 1 -- 172.21.15.46:0/3012400391 >> 172.21.15.46:0/3012400391 conn(0x7fa988071740 msgr2=0x7fa98814f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:26:04.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.033+0000 7fa98e223640 1 -- 172.21.15.46:0/3012400391 shutdown_connections 2024-01-23T09:26:04.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.033+0000 7fa98e223640 1 -- 172.21.15.46:0/3012400391 wait complete. 2024-01-23T09:26:04.057 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":989,"stamp":"2024-01-23T09:26:03.399447+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23779489,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":635,"num_read_kb":642,"num_write":7834,"num_write_kb":280431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9118,"ondisk_log_size":9118,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":306920,"kb_used_data":49192,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754667800,"statfs":{"total":773094113280,"available":772779827200,"internally_reserved":0,"allocated":50372608,"data_stored":48606202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005097"},"pg_stats":[{"pgid":"2.1f","version":"30'628","reported_seq":673,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:20.556054+0000","last_change":"2024-01-23T09:25:20.556054+0000","last_active":"2024-01-23T09:25:20.556054+0000","last_peered":"2024-01-23T09:25:20.556054+0000","last_clean":"2024-01-23T09:25:20.556054+0000","last_became_active":"2024-01-23T08:54:40.660901+0000","last_became_peered":"2024-01-23T08:54:40.660901+0000","last_unstale":"2024-01-23T09:25:20.556054+0000","last_undegraded":"2024-01-23T09:25:20.556054+0000","last_fullsized":"2024-01-23T09:25:20.556054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'628","last_scrub_stamp":"2024-01-23T09:25:20.555726+0000","last_deep_scrub":"30'628","last_deep_scrub_stamp":"2024-01-23T09:25:20.555726+0000","last_clean_scrub_stamp":"2024-01-23T09:25:20.555726+0000","objects_scrubbed":7,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:35:53.365512+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":621,"num_write_kb":4439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"30'17","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:31.790223+0000","last_change":"2024-01-23T09:25:31.790325+0000","last_active":"2024-01-23T09:25:31.790223+0000","last_peered":"2024-01-23T09:25:31.790223+0000","last_clean":"2024-01-23T09:25:31.790223+0000","last_became_active":"2024-01-23T08:54:42.158776+0000","last_became_peered":"2024-01-23T08:54:42.158776+0000","last_unstale":"2024-01-23T09:25:31.790223+0000","last_undegraded":"2024-01-23T09:25:31.790223+0000","last_fullsized":"2024-01-23T09:25:31.790223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'17","last_scrub_stamp":"2024-01-23T09:25:31.790053+0000","last_deep_scrub":"30'17","last_deep_scrub_stamp":"2024-01-23T09:25:31.790053+0000","last_clean_scrub_stamp":"2024-01-23T09:25:31.790053+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:19:53.372142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"30'65","reported_seq":101,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:30.178936+0000","last_change":"2024-01-23T09:25:30.179070+0000","last_active":"2024-01-23T09:25:30.178936+0000","last_peered":"2024-01-23T09:25:30.178936+0000","last_clean":"2024-01-23T09:25:30.178936+0000","last_became_active":"2024-01-23T08:54:49.752077+0000","last_became_peered":"2024-01-23T08:54:49.752077+0000","last_unstale":"2024-01-23T09:25:30.178936+0000","last_undegraded":"2024-01-23T09:25:30.178936+0000","last_fullsized":"2024-01-23T09:25:30.178936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'65","last_scrub_stamp":"2024-01-23T09:25:30.178745+0000","last_deep_scrub":"30'65","last_deep_scrub_stamp":"2024-01-23T09:25:30.178745+0000","last_clean_scrub_stamp":"2024-01-23T09:25:30.178745+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:49:44.660596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":3048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"30'229","reported_seq":274,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:26.944083+0000","last_change":"2024-01-23T09:25:26.944145+0000","last_active":"2024-01-23T09:25:26.944083+0000","last_peered":"2024-01-23T09:25:26.944083+0000","last_clean":"2024-01-23T09:25:26.944083+0000","last_became_active":"2024-01-23T08:54:40.699449+0000","last_became_peered":"2024-01-23T08:54:40.699449+0000","last_unstale":"2024-01-23T09:25:26.944083+0000","last_undegraded":"2024-01-23T09:25:26.944083+0000","last_fullsized":"2024-01-23T09:25:26.944083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'229","last_scrub_stamp":"2024-01-23T09:25:26.943916+0000","last_deep_scrub":"30'229","last_deep_scrub_stamp":"2024-01-23T09:25:26.943916+0000","last_clean_scrub_stamp":"2024-01-23T09:25:26.943916+0000","objects_scrubbed":1,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:42:47.490337+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2084932,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":2149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"30'24","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:28.907752+0000","last_change":"2024-01-23T09:25:28.907752+0000","last_active":"2024-01-23T09:25:28.907752+0000","last_peered":"2024-01-23T09:25:28.907752+0000","last_clean":"2024-01-23T09:25:28.907752+0000","last_became_active":"2024-01-23T08:54:42.091950+0000","last_became_peered":"2024-01-23T08:54:42.091950+0000","last_unstale":"2024-01-23T09:25:28.907752+0000","last_undegraded":"2024-01-23T09:25:28.907752+0000","last_fullsized":"2024-01-23T09:25:28.907752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2024-01-23T09:25:28.907473+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2024-01-23T09:25:28.907473+0000","last_clean_scrub_stamp":"2024-01-23T09:25:28.907473+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:30:44.049714+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"30'80","reported_seq":116,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:28.360476+0000","last_change":"2024-01-23T09:25:28.360542+0000","last_active":"2024-01-23T09:25:28.360476+0000","last_peered":"2024-01-23T09:25:28.360476+0000","last_clean":"2024-01-23T09:25:28.360476+0000","last_became_active":"2024-01-23T08:54:49.746481+0000","last_became_peered":"2024-01-23T08:54:49.746481+0000","last_unstale":"2024-01-23T09:25:28.360476+0000","last_undegraded":"2024-01-23T09:25:28.360476+0000","last_fullsized":"2024-01-23T09:25:28.360476+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'80","last_scrub_stamp":"2024-01-23T09:25:28.360291+0000","last_deep_scrub":"30'80","last_deep_scrub_stamp":"2024-01-23T09:25:28.360291+0000","last_clean_scrub_stamp":"2024-01-23T09:25:28.360291+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:37:36.601326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":5137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"30'25","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:19.079670+0000","last_change":"2024-01-23T09:25:19.079728+0000","last_active":"2024-01-23T09:25:19.079670+0000","last_peered":"2024-01-23T09:25:19.079670+0000","last_clean":"2024-01-23T09:25:19.079670+0000","last_became_active":"2024-01-23T08:54:40.687234+0000","last_became_peered":"2024-01-23T08:54:40.687234+0000","last_unstale":"2024-01-23T09:25:19.079670+0000","last_undegraded":"2024-01-23T09:25:19.079670+0000","last_fullsized":"2024-01-23T09:25:19.079670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2024-01-23T09:25:19.079562+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2024-01-23T09:25:19.079562+0000","last_clean_scrub_stamp":"2024-01-23T09:25:19.079562+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:03:58.729582+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"30'21","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:22.811974+0000","last_change":"2024-01-23T09:25:22.812036+0000","last_active":"2024-01-23T09:25:22.811974+0000","last_peered":"2024-01-23T09:25:22.811974+0000","last_clean":"2024-01-23T09:25:22.811974+0000","last_became_active":"2024-01-23T08:55:47.539657+0000","last_became_peered":"2024-01-23T08:55:47.539657+0000","last_unstale":"2024-01-23T09:25:22.811974+0000","last_undegraded":"2024-01-23T09:25:22.811974+0000","last_fullsized":"2024-01-23T09:25:22.811974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2024-01-23T09:25:22.811804+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2024-01-23T09:25:22.811804+0000","last_clean_scrub_stamp":"2024-01-23T09:25:22.811804+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:26:09.064472+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"30'86","reported_seq":122,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:30.362799+0000","last_change":"2024-01-23T09:25:30.362863+0000","last_active":"2024-01-23T09:25:30.362799+0000","last_peered":"2024-01-23T09:25:30.362799+0000","last_clean":"2024-01-23T09:25:30.362799+0000","last_became_active":"2024-01-23T08:54:49.746474+0000","last_became_peered":"2024-01-23T08:54:49.746474+0000","last_unstale":"2024-01-23T09:25:30.362799+0000","last_undegraded":"2024-01-23T09:25:30.362799+0000","last_fullsized":"2024-01-23T09:25:30.362799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'86","last_scrub_stamp":"2024-01-23T09:25:30.362633+0000","last_deep_scrub":"30'86","last_deep_scrub_stamp":"2024-01-23T09:25:30.362633+0000","last_clean_scrub_stamp":"2024-01-23T09:25:30.362633+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:42:50.909053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":12223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"30'11","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:18.069668+0000","last_change":"2024-01-23T09:25:18.069721+0000","last_active":"2024-01-23T09:25:18.069668+0000","last_peered":"2024-01-23T09:25:18.069668+0000","last_clean":"2024-01-23T09:25:18.069668+0000","last_became_active":"2024-01-23T08:54:40.686903+0000","last_became_peered":"2024-01-23T08:54:40.686903+0000","last_unstale":"2024-01-23T09:25:18.069668+0000","last_undegraded":"2024-01-23T09:25:18.069668+0000","last_fullsized":"2024-01-23T09:25:18.069668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'11","last_scrub_stamp":"2024-01-23T09:25:18.069558+0000","last_deep_scrub":"30'11","last_deep_scrub_stamp":"2024-01-23T09:25:18.069558+0000","last_clean_scrub_stamp":"2024-01-23T09:25:18.069558+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:40:53.574638+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"30'36","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:20.378405+0000","last_change":"2024-01-23T09:25:20.378461+0000","last_active":"2024-01-23T09:25:20.378405+0000","last_peered":"2024-01-23T09:25:20.378405+0000","last_clean":"2024-01-23T09:25:20.378405+0000","last_became_active":"2024-01-23T08:54:42.108182+0000","last_became_peered":"2024-01-23T08:54:42.108182+0000","last_unstale":"2024-01-23T09:25:20.378405+0000","last_undegraded":"2024-01-23T09:25:20.378405+0000","last_fullsized":"2024-01-23T09:25:20.378405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'36","last_scrub_stamp":"2024-01-23T09:25:20.378241+0000","last_deep_scrub":"30'36","last_deep_scrub_stamp":"2024-01-23T09:25:20.378241+0000","last_clean_scrub_stamp":"2024-01-23T09:25:20.378241+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:10:50.365882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"30'61","reported_seq":97,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:31.399126+0000","last_change":"2024-01-23T09:25:31.399175+0000","last_active":"2024-01-23T09:25:31.399126+0000","last_peered":"2024-01-23T09:25:31.399126+0000","last_clean":"2024-01-23T09:25:31.399126+0000","last_became_active":"2024-01-23T08:54:49.746880+0000","last_became_peered":"2024-01-23T08:54:49.746880+0000","last_unstale":"2024-01-23T09:25:31.399126+0000","last_undegraded":"2024-01-23T09:25:31.399126+0000","last_fullsized":"2024-01-23T09:25:31.399126+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'61","last_scrub_stamp":"2024-01-23T09:25:31.399039+0000","last_deep_scrub":"30'61","last_deep_scrub_stamp":"2024-01-23T09:25:31.399039+0000","last_clean_scrub_stamp":"2024-01-23T09:25:31.399039+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:50:21.840699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":7433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"30'19","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:21.422655+0000","last_change":"2024-01-23T09:25:21.422715+0000","last_active":"2024-01-23T09:25:21.422655+0000","last_peered":"2024-01-23T09:25:21.422655+0000","last_clean":"2024-01-23T09:25:21.422655+0000","last_became_active":"2024-01-23T08:54:42.088068+0000","last_became_peered":"2024-01-23T08:54:42.088068+0000","last_unstale":"2024-01-23T09:25:21.422655+0000","last_undegraded":"2024-01-23T09:25:21.422655+0000","last_fullsized":"2024-01-23T09:25:21.422655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2024-01-23T09:25:21.422496+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2024-01-23T09:25:21.422496+0000","last_clean_scrub_stamp":"2024-01-23T09:25:21.422496+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:14:07.698218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"30'674","reported_seq":717,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:28.316499+0000","last_change":"2024-01-23T09:25:28.316572+0000","last_active":"2024-01-23T09:25:28.316499+0000","last_peered":"2024-01-23T09:25:28.316499+0000","last_clean":"2024-01-23T09:25:28.316499+0000","last_became_active":"2024-01-23T08:54:40.611589+0000","last_became_peered":"2024-01-23T08:54:40.611589+0000","last_unstale":"2024-01-23T09:25:28.316499+0000","last_undegraded":"2024-01-23T09:25:28.316499+0000","last_fullsized":"2024-01-23T09:25:28.316499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'674","last_scrub_stamp":"2024-01-23T09:25:28.316338+0000","last_deep_scrub":"30'674","last_deep_scrub_stamp":"2024-01-23T09:25:28.316338+0000","last_clean_scrub_stamp":"2024-01-23T09:25:28.316338+0000","objects_scrubbed":3,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:35:07.859385+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":666,"num_write_kb":4421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'70","reported_seq":107,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:42.422280+0000","last_change":"2024-01-23T09:25:42.422342+0000","last_active":"2024-01-23T09:25:42.422280+0000","last_peered":"2024-01-23T09:25:42.422280+0000","last_clean":"2024-01-23T09:25:42.422280+0000","last_became_active":"2024-01-23T08:54:49.715843+0000","last_became_peered":"2024-01-23T08:54:49.715843+0000","last_unstale":"2024-01-23T09:25:42.422280+0000","last_undegraded":"2024-01-23T09:25:42.422280+0000","last_fullsized":"2024-01-23T09:25:42.422280+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'70","last_scrub_stamp":"2024-01-23T09:25:42.422098+0000","last_deep_scrub":"30'70","last_deep_scrub_stamp":"2024-01-23T09:25:42.422098+0000","last_clean_scrub_stamp":"2024-01-23T09:25:42.422098+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:37:39.066496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":10371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"30'21","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:27.114619+0000","last_change":"2024-01-23T09:25:27.114677+0000","last_active":"2024-01-23T09:25:27.114619+0000","last_peered":"2024-01-23T09:25:27.114619+0000","last_clean":"2024-01-23T09:25:27.114619+0000","last_became_active":"2024-01-23T08:54:42.229547+0000","last_became_peered":"2024-01-23T08:54:42.229547+0000","last_unstale":"2024-01-23T09:25:27.114619+0000","last_undegraded":"2024-01-23T09:25:27.114619+0000","last_fullsized":"2024-01-23T09:25:27.114619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2024-01-23T09:25:27.114448+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2024-01-23T09:25:27.114448+0000","last_clean_scrub_stamp":"2024-01-23T09:25:27.114448+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T21:02:15.627668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"30'6","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:21.239263+0000","last_change":"2024-01-23T09:25:21.239309+0000","last_active":"2024-01-23T09:25:21.239263+0000","last_peered":"2024-01-23T09:25:21.239263+0000","last_clean":"2024-01-23T09:25:21.239263+0000","last_became_active":"2024-01-23T08:54:40.688230+0000","last_became_peered":"2024-01-23T08:54:40.688230+0000","last_unstale":"2024-01-23T09:25:21.239263+0000","last_undegraded":"2024-01-23T09:25:21.239263+0000","last_fullsized":"2024-01-23T09:25:21.239263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'6","last_scrub_stamp":"2024-01-23T09:25:21.239149+0000","last_deep_scrub":"30'6","last_deep_scrub_stamp":"2024-01-23T09:25:21.239149+0000","last_clean_scrub_stamp":"2024-01-23T09:25:21.239149+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:44:15.197898+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"30'94","reported_seq":131,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:31.940004+0000","last_change":"2024-01-23T09:25:31.940071+0000","last_active":"2024-01-23T09:25:31.940004+0000","last_peered":"2024-01-23T09:25:31.940004+0000","last_clean":"2024-01-23T09:25:31.940004+0000","last_became_active":"2024-01-23T08:54:49.747958+0000","last_became_peered":"2024-01-23T08:54:49.747958+0000","last_unstale":"2024-01-23T09:25:31.940004+0000","last_undegraded":"2024-01-23T09:25:31.940004+0000","last_fullsized":"2024-01-23T09:25:31.940004+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'94","last_scrub_stamp":"2024-01-23T09:25:31.939833+0000","last_deep_scrub":"30'94","last_deep_scrub_stamp":"2024-01-23T09:25:31.939833+0000","last_clean_scrub_stamp":"2024-01-23T09:25:31.939833+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:28:57.873112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":8657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"30'23","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:25.558986+0000","last_change":"2024-01-23T09:25:25.559050+0000","last_active":"2024-01-23T09:25:25.558986+0000","last_peered":"2024-01-23T09:25:25.558986+0000","last_clean":"2024-01-23T09:25:25.558986+0000","last_became_active":"2024-01-23T08:54:42.193403+0000","last_became_peered":"2024-01-23T08:54:42.193403+0000","last_unstale":"2024-01-23T09:25:25.558986+0000","last_undegraded":"2024-01-23T09:25:25.558986+0000","last_fullsized":"2024-01-23T09:25:25.558986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'23","last_scrub_stamp":"2024-01-23T09:25:25.558806+0000","last_deep_scrub":"30'23","last_deep_scrub_stamp":"2024-01-23T09:25:25.558806+0000","last_clean_scrub_stamp":"2024-01-23T09:25:25.558806+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:04:05.208827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"30'15","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:22.510214+0000","last_change":"2024-01-23T09:25:22.510295+0000","last_active":"2024-01-23T09:25:22.510214+0000","last_peered":"2024-01-23T09:25:22.510214+0000","last_clean":"2024-01-23T09:25:22.510214+0000","last_became_active":"2024-01-23T08:54:40.688122+0000","last_became_peered":"2024-01-23T08:54:40.688122+0000","last_unstale":"2024-01-23T09:25:22.510214+0000","last_undegraded":"2024-01-23T09:25:22.510214+0000","last_fullsized":"2024-01-23T09:25:22.510214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'15","last_scrub_stamp":"2024-01-23T09:25:22.510026+0000","last_deep_scrub":"30'15","last_deep_scrub_stamp":"2024-01-23T09:25:22.510026+0000","last_clean_scrub_stamp":"2024-01-23T09:25:22.510026+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:06:16.691465+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'73","reported_seq":110,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:29.201149+0000","last_change":"2024-01-23T09:25:29.201213+0000","last_active":"2024-01-23T09:25:29.201149+0000","last_peered":"2024-01-23T09:25:29.201149+0000","last_clean":"2024-01-23T09:25:29.201149+0000","last_became_active":"2024-01-23T08:54:49.737442+0000","last_became_peered":"2024-01-23T08:54:49.737442+0000","last_unstale":"2024-01-23T09:25:29.201149+0000","last_undegraded":"2024-01-23T09:25:29.201149+0000","last_fullsized":"2024-01-23T09:25:29.201149+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'73","last_scrub_stamp":"2024-01-23T09:25:29.200987+0000","last_deep_scrub":"30'73","last_deep_scrub_stamp":"2024-01-23T09:25:29.200987+0000","last_clean_scrub_stamp":"2024-01-23T09:25:29.200987+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:10:06.313584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":10395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"30'19","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:37.383174+0000","last_change":"2024-01-23T09:25:37.383211+0000","last_active":"2024-01-23T09:25:37.383174+0000","last_peered":"2024-01-23T09:25:37.383174+0000","last_clean":"2024-01-23T09:25:37.383174+0000","last_became_active":"2024-01-23T08:54:42.192225+0000","last_became_peered":"2024-01-23T08:54:42.192225+0000","last_unstale":"2024-01-23T09:25:37.383174+0000","last_undegraded":"2024-01-23T09:25:37.383174+0000","last_fullsized":"2024-01-23T09:25:37.383174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2024-01-23T09:25:37.383064+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2024-01-23T09:25:37.383064+0000","last_clean_scrub_stamp":"2024-01-23T09:25:37.383064+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:34:53.112850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"30'8","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:17.020198+0000","last_change":"2024-01-23T09:25:17.020226+0000","last_active":"2024-01-23T09:25:17.020198+0000","last_peered":"2024-01-23T09:25:17.020198+0000","last_clean":"2024-01-23T09:25:17.020198+0000","last_became_active":"2024-01-23T08:54:40.686654+0000","last_became_peered":"2024-01-23T08:54:40.686654+0000","last_unstale":"2024-01-23T09:25:17.020198+0000","last_undegraded":"2024-01-23T09:25:17.020198+0000","last_fullsized":"2024-01-23T09:25:17.020198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'8","last_scrub_stamp":"2024-01-23T09:25:17.020124+0000","last_deep_scrub":"30'8","last_deep_scrub_stamp":"2024-01-23T09:25:17.020124+0000","last_clean_scrub_stamp":"2024-01-23T09:25:17.020124+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:13:09.335460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"30'83","reported_seq":120,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:26.339084+0000","last_change":"2024-01-23T09:25:26.339146+0000","last_active":"2024-01-23T09:25:26.339084+0000","last_peered":"2024-01-23T09:25:26.339084+0000","last_clean":"2024-01-23T09:25:26.339084+0000","last_became_active":"2024-01-23T08:54:49.735971+0000","last_became_peered":"2024-01-23T08:54:49.735971+0000","last_unstale":"2024-01-23T09:25:26.339084+0000","last_undegraded":"2024-01-23T09:25:26.339084+0000","last_fullsized":"2024-01-23T09:25:26.339084+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'83","last_scrub_stamp":"2024-01-23T09:25:26.338846+0000","last_deep_scrub":"30'83","last_deep_scrub_stamp":"2024-01-23T09:25:26.338846+0000","last_clean_scrub_stamp":"2024-01-23T09:25:26.338846+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:04:05.988867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":6293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"30'30","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:26.568153+0000","last_change":"2024-01-23T09:25:26.568265+0000","last_active":"2024-01-23T09:25:26.568153+0000","last_peered":"2024-01-23T09:25:26.568153+0000","last_clean":"2024-01-23T09:25:26.568153+0000","last_became_active":"2024-01-23T08:54:42.195052+0000","last_became_peered":"2024-01-23T08:54:42.195052+0000","last_unstale":"2024-01-23T09:25:26.568153+0000","last_undegraded":"2024-01-23T09:25:26.568153+0000","last_fullsized":"2024-01-23T09:25:26.568153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2024-01-23T09:25:26.567965+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2024-01-23T09:25:26.567965+0000","last_clean_scrub_stamp":"2024-01-23T09:25:26.567965+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:25:41.566911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"30'13","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:35.379910+0000","last_change":"2024-01-23T09:25:35.379982+0000","last_active":"2024-01-23T09:25:35.379910+0000","last_peered":"2024-01-23T09:25:35.379910+0000","last_clean":"2024-01-23T09:25:35.379910+0000","last_became_active":"2024-01-23T08:54:40.693610+0000","last_became_peered":"2024-01-23T08:54:40.693610+0000","last_unstale":"2024-01-23T09:25:35.379910+0000","last_undegraded":"2024-01-23T09:25:35.379910+0000","last_fullsized":"2024-01-23T09:25:35.379910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'13","last_scrub_stamp":"2024-01-23T09:25:35.379738+0000","last_deep_scrub":"30'13","last_deep_scrub_stamp":"2024-01-23T09:25:35.379738+0000","last_clean_scrub_stamp":"2024-01-23T09:25:35.379738+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:11:57.530358+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"30'40","reported_seq":78,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:29.387850+0000","last_change":"2024-01-23T09:25:29.387913+0000","last_active":"2024-01-23T09:25:29.387850+0000","last_peered":"2024-01-23T09:25:29.387850+0000","last_clean":"2024-01-23T09:25:29.387850+0000","last_became_active":"2024-01-23T08:54:49.746792+0000","last_became_peered":"2024-01-23T08:54:49.746792+0000","last_unstale":"2024-01-23T09:25:29.387850+0000","last_undegraded":"2024-01-23T09:25:29.387850+0000","last_fullsized":"2024-01-23T09:25:29.387850+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'40","last_scrub_stamp":"2024-01-23T09:25:29.387684+0000","last_deep_scrub":"30'40","last_deep_scrub_stamp":"2024-01-23T09:25:29.387684+0000","last_clean_scrub_stamp":"2024-01-23T09:25:29.387684+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:06:56.096186+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":6755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"30'21","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:30.569562+0000","last_change":"2024-01-23T09:25:30.569671+0000","last_active":"2024-01-23T09:25:30.569562+0000","last_peered":"2024-01-23T09:25:30.569562+0000","last_clean":"2024-01-23T09:25:30.569562+0000","last_became_active":"2024-01-23T08:54:42.233018+0000","last_became_peered":"2024-01-23T08:54:42.233018+0000","last_unstale":"2024-01-23T09:25:30.569562+0000","last_undegraded":"2024-01-23T09:25:30.569562+0000","last_fullsized":"2024-01-23T09:25:30.569562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2024-01-23T09:25:30.569295+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2024-01-23T09:25:30.569295+0000","last_clean_scrub_stamp":"2024-01-23T09:25:30.569295+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:50:21.010955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"30'339","reported_seq":383,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:23.502230+0000","last_change":"2024-01-23T09:25:23.502356+0000","last_active":"2024-01-23T09:25:23.502230+0000","last_peered":"2024-01-23T09:25:23.502230+0000","last_clean":"2024-01-23T09:25:23.502230+0000","last_became_active":"2024-01-23T08:54:40.689528+0000","last_became_peered":"2024-01-23T08:54:40.689528+0000","last_unstale":"2024-01-23T09:25:23.502230+0000","last_undegraded":"2024-01-23T09:25:23.502230+0000","last_fullsized":"2024-01-23T09:25:23.502230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'339","last_scrub_stamp":"2024-01-23T09:25:23.502022+0000","last_deep_scrub":"30'339","last_deep_scrub_stamp":"2024-01-23T09:25:23.502022+0000","last_clean_scrub_stamp":"2024-01-23T09:25:23.502022+0000","objects_scrubbed":4,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:13:15.817358+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":906,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"30'90","reported_seq":129,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:32.556234+0000","last_change":"2024-01-23T09:25:32.556298+0000","last_active":"2024-01-23T09:25:32.556234+0000","last_peered":"2024-01-23T09:25:32.556234+0000","last_clean":"2024-01-23T09:25:32.556234+0000","last_became_active":"2024-01-23T08:54:49.731414+0000","last_became_peered":"2024-01-23T08:54:49.731414+0000","last_unstale":"2024-01-23T09:25:32.556234+0000","last_undegraded":"2024-01-23T09:25:32.556234+0000","last_fullsized":"2024-01-23T09:25:32.556234+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'90","last_scrub_stamp":"2024-01-23T09:25:32.556059+0000","last_deep_scrub":"30'90","last_deep_scrub_stamp":"2024-01-23T09:25:32.556059+0000","last_clean_scrub_stamp":"2024-01-23T09:25:32.556059+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:14:18.831781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":11197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"30'21","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:25.321652+0000","last_change":"2024-01-23T09:25:25.321652+0000","last_active":"2024-01-23T09:25:25.321652+0000","last_peered":"2024-01-23T09:25:25.321652+0000","last_clean":"2024-01-23T09:25:25.321652+0000","last_became_active":"2024-01-23T08:54:42.227188+0000","last_became_peered":"2024-01-23T08:54:42.227188+0000","last_unstale":"2024-01-23T09:25:25.321652+0000","last_undegraded":"2024-01-23T09:25:25.321652+0000","last_fullsized":"2024-01-23T09:25:25.321652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2024-01-23T09:25:25.321336+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2024-01-23T09:25:25.321336+0000","last_clean_scrub_stamp":"2024-01-23T09:25:25.321336+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:48:05.691281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"30'10","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:30.294168+0000","last_change":"2024-01-23T09:25:30.294229+0000","last_active":"2024-01-23T09:25:30.294168+0000","last_peered":"2024-01-23T09:25:30.294168+0000","last_clean":"2024-01-23T09:25:30.294168+0000","last_became_active":"2024-01-23T08:54:40.657616+0000","last_became_peered":"2024-01-23T08:54:40.657616+0000","last_unstale":"2024-01-23T09:25:30.294168+0000","last_undegraded":"2024-01-23T09:25:30.294168+0000","last_fullsized":"2024-01-23T09:25:30.294168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'10","last_scrub_stamp":"2024-01-23T09:25:30.294038+0000","last_deep_scrub":"30'10","last_deep_scrub_stamp":"2024-01-23T09:25:30.294038+0000","last_clean_scrub_stamp":"2024-01-23T09:25:30.294038+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:42:29.066740+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"30'59","reported_seq":97,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:33.322774+0000","last_change":"2024-01-23T09:25:33.322884+0000","last_active":"2024-01-23T09:25:33.322774+0000","last_peered":"2024-01-23T09:25:33.322774+0000","last_clean":"2024-01-23T09:25:33.322774+0000","last_became_active":"2024-01-23T08:54:49.738579+0000","last_became_peered":"2024-01-23T08:54:49.738579+0000","last_unstale":"2024-01-23T09:25:33.322774+0000","last_undegraded":"2024-01-23T09:25:33.322774+0000","last_fullsized":"2024-01-23T09:25:33.322774+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'59","last_scrub_stamp":"2024-01-23T09:25:33.322594+0000","last_deep_scrub":"30'59","last_deep_scrub_stamp":"2024-01-23T09:25:33.322594+0000","last_clean_scrub_stamp":"2024-01-23T09:25:33.322594+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:21:01.329570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":6541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"30'19","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:24.303129+0000","last_change":"2024-01-23T09:25:24.303188+0000","last_active":"2024-01-23T09:25:24.303129+0000","last_peered":"2024-01-23T09:25:24.303129+0000","last_clean":"2024-01-23T09:25:24.303129+0000","last_became_active":"2024-01-23T08:54:42.227558+0000","last_became_peered":"2024-01-23T08:54:42.227558+0000","last_unstale":"2024-01-23T09:25:24.303129+0000","last_undegraded":"2024-01-23T09:25:24.303129+0000","last_fullsized":"2024-01-23T09:25:24.303129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2024-01-23T09:25:24.302965+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2024-01-23T09:25:24.302965+0000","last_clean_scrub_stamp":"2024-01-23T09:25:24.302965+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:13:16.618301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"30'5","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:25.904322+0000","last_change":"2024-01-23T09:25:25.904322+0000","last_active":"2024-01-23T09:25:25.904322+0000","last_peered":"2024-01-23T09:25:25.904322+0000","last_clean":"2024-01-23T09:25:25.904322+0000","last_became_active":"2024-01-23T08:54:40.696688+0000","last_became_peered":"2024-01-23T08:54:40.696688+0000","last_unstale":"2024-01-23T09:25:25.904322+0000","last_undegraded":"2024-01-23T09:25:25.904322+0000","last_fullsized":"2024-01-23T09:25:25.904322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2024-01-23T09:25:25.904086+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2024-01-23T09:25:25.904086+0000","last_clean_scrub_stamp":"2024-01-23T09:25:25.904086+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:53:06.280459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"30'81","reported_seq":119,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:31.372412+0000","last_change":"2024-01-23T09:25:31.372526+0000","last_active":"2024-01-23T09:25:31.372412+0000","last_peered":"2024-01-23T09:25:31.372412+0000","last_clean":"2024-01-23T09:25:31.372412+0000","last_became_active":"2024-01-23T08:54:49.725830+0000","last_became_peered":"2024-01-23T08:54:49.725830+0000","last_unstale":"2024-01-23T09:25:31.372412+0000","last_undegraded":"2024-01-23T09:25:31.372412+0000","last_fullsized":"2024-01-23T09:25:31.372412+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'81","last_scrub_stamp":"2024-01-23T09:25:31.372229+0000","last_deep_scrub":"30'81","last_deep_scrub_stamp":"2024-01-23T09:25:31.372229+0000","last_clean_scrub_stamp":"2024-01-23T09:25:31.372229+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:42:08.426759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":6498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"30'21","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:27.971107+0000","last_change":"2024-01-23T09:25:27.971107+0000","last_active":"2024-01-23T09:25:27.971107+0000","last_peered":"2024-01-23T09:25:27.971107+0000","last_clean":"2024-01-23T09:25:27.971107+0000","last_became_active":"2024-01-23T08:54:42.149019+0000","last_became_peered":"2024-01-23T08:54:42.149019+0000","last_unstale":"2024-01-23T09:25:27.971107+0000","last_undegraded":"2024-01-23T09:25:27.971107+0000","last_fullsized":"2024-01-23T09:25:27.971107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2024-01-23T09:25:27.970994+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2024-01-23T09:25:27.970994+0000","last_clean_scrub_stamp":"2024-01-23T09:25:27.970994+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:55:09.354462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"30'10","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:33.343361+0000","last_change":"2024-01-23T09:25:33.343361+0000","last_active":"2024-01-23T09:25:33.343361+0000","last_peered":"2024-01-23T09:25:33.343361+0000","last_clean":"2024-01-23T09:25:33.343361+0000","last_became_active":"2024-01-23T08:54:40.679839+0000","last_became_peered":"2024-01-23T08:54:40.679839+0000","last_unstale":"2024-01-23T09:25:33.343361+0000","last_undegraded":"2024-01-23T09:25:33.343361+0000","last_fullsized":"2024-01-23T09:25:33.343361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'10","last_scrub_stamp":"2024-01-23T09:25:33.343004+0000","last_deep_scrub":"30'10","last_deep_scrub_stamp":"2024-01-23T09:25:33.343004+0000","last_clean_scrub_stamp":"2024-01-23T09:25:33.343004+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:10:56.823878+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"30'52","reported_seq":99,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:35.336223+0000","last_change":"2024-01-23T09:25:35.336351+0000","last_active":"2024-01-23T09:25:35.336223+0000","last_peered":"2024-01-23T09:25:35.336223+0000","last_clean":"2024-01-23T09:25:35.336223+0000","last_became_active":"2024-01-23T08:55:47.749227+0000","last_became_peered":"2024-01-23T08:55:47.749227+0000","last_unstale":"2024-01-23T09:25:35.336223+0000","last_undegraded":"2024-01-23T09:25:35.336223+0000","last_fullsized":"2024-01-23T09:25:35.336223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'52","last_scrub_stamp":"2024-01-23T09:25:35.336002+0000","last_deep_scrub":"30'52","last_deep_scrub_stamp":"2024-01-23T09:25:35.336002+0000","last_clean_scrub_stamp":"2024-01-23T09:25:35.336002+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:18:59.173232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":3470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,5],"acting":[6,7,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"30'22","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:22.957687+0000","last_change":"2024-01-23T09:25:22.957801+0000","last_active":"2024-01-23T09:25:22.957687+0000","last_peered":"2024-01-23T09:25:22.957687+0000","last_clean":"2024-01-23T09:25:22.957687+0000","last_became_active":"2024-01-23T08:54:42.108346+0000","last_became_peered":"2024-01-23T08:54:42.108346+0000","last_unstale":"2024-01-23T09:25:22.957687+0000","last_undegraded":"2024-01-23T09:25:22.957687+0000","last_fullsized":"2024-01-23T09:25:22.957687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'22","last_scrub_stamp":"2024-01-23T09:25:22.957427+0000","last_deep_scrub":"30'22","last_deep_scrub_stamp":"2024-01-23T09:25:22.957427+0000","last_clean_scrub_stamp":"2024-01-23T09:25:22.957427+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:22:55.279751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"30'536","reported_seq":1100,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:24.184616+0000","last_change":"2024-01-23T09:25:24.184616+0000","last_active":"2024-01-23T09:25:24.184616+0000","last_peered":"2024-01-23T09:25:24.184616+0000","last_clean":"2024-01-23T09:25:24.184616+0000","last_became_active":"2024-01-23T08:54:40.707841+0000","last_became_peered":"2024-01-23T08:54:40.707841+0000","last_unstale":"2024-01-23T09:25:24.184616+0000","last_undegraded":"2024-01-23T09:25:24.184616+0000","last_fullsized":"2024-01-23T09:25:24.184616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'536","last_scrub_stamp":"2024-01-23T09:25:24.184377+0000","last_deep_scrub":"30'536","last_deep_scrub_stamp":"2024-01-23T09:25:24.184377+0000","last_clean_scrub_stamp":"2024-01-23T09:25:24.184377+0000","objects_scrubbed":4,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:34:44.761939+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123944,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":519,"num_read_kb":542,"num_write":528,"num_write_kb":547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"30'72","reported_seq":110,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:32.327893+0000","last_change":"2024-01-23T09:25:32.327954+0000","last_active":"2024-01-23T09:25:32.327893+0000","last_peered":"2024-01-23T09:25:32.327893+0000","last_clean":"2024-01-23T09:25:32.327893+0000","last_became_active":"2024-01-23T08:54:49.737677+0000","last_became_peered":"2024-01-23T08:54:49.737677+0000","last_unstale":"2024-01-23T09:25:32.327893+0000","last_undegraded":"2024-01-23T09:25:32.327893+0000","last_fullsized":"2024-01-23T09:25:32.327893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'72","last_scrub_stamp":"2024-01-23T09:25:32.327717+0000","last_deep_scrub":"30'72","last_deep_scrub_stamp":"2024-01-23T09:25:32.327717+0000","last_clean_scrub_stamp":"2024-01-23T09:25:32.327717+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:44:10.288444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"30'12","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:26.301543+0000","last_change":"2024-01-23T09:25:26.301543+0000","last_active":"2024-01-23T09:25:26.301543+0000","last_peered":"2024-01-23T09:25:26.301543+0000","last_clean":"2024-01-23T09:25:26.301543+0000","last_became_active":"2024-01-23T08:54:42.227335+0000","last_became_peered":"2024-01-23T08:54:42.227335+0000","last_unstale":"2024-01-23T09:25:26.301543+0000","last_undegraded":"2024-01-23T09:25:26.301543+0000","last_fullsized":"2024-01-23T09:25:26.301543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'12","last_scrub_stamp":"2024-01-23T09:25:26.301320+0000","last_deep_scrub":"30'12","last_deep_scrub_stamp":"2024-01-23T09:25:26.301320+0000","last_clean_scrub_stamp":"2024-01-23T09:25:26.301320+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:47:59.718403+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"30'12","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:32.334994+0000","last_change":"2024-01-23T09:25:32.335057+0000","last_active":"2024-01-23T09:25:32.334994+0000","last_peered":"2024-01-23T09:25:32.334994+0000","last_clean":"2024-01-23T09:25:32.334994+0000","last_became_active":"2024-01-23T08:54:40.679467+0000","last_became_peered":"2024-01-23T08:54:40.679467+0000","last_unstale":"2024-01-23T09:25:32.334994+0000","last_undegraded":"2024-01-23T09:25:32.334994+0000","last_fullsized":"2024-01-23T09:25:32.334994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'12","last_scrub_stamp":"2024-01-23T09:25:32.334832+0000","last_deep_scrub":"30'12","last_deep_scrub_stamp":"2024-01-23T09:25:32.334832+0000","last_clean_scrub_stamp":"2024-01-23T09:25:32.334832+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:49:33.631080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"30'96","reported_seq":134,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:37.867994+0000","last_change":"2024-01-23T09:25:37.868082+0000","last_active":"2024-01-23T09:25:37.867994+0000","last_peered":"2024-01-23T09:25:37.867994+0000","last_clean":"2024-01-23T09:25:37.867994+0000","last_became_active":"2024-01-23T08:54:49.729861+0000","last_became_peered":"2024-01-23T08:54:49.729861+0000","last_unstale":"2024-01-23T09:25:37.867994+0000","last_undegraded":"2024-01-23T09:25:37.867994+0000","last_fullsized":"2024-01-23T09:25:37.867994+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'96","last_scrub_stamp":"2024-01-23T09:25:37.867811+0000","last_deep_scrub":"30'96","last_deep_scrub_stamp":"2024-01-23T09:25:37.867811+0000","last_clean_scrub_stamp":"2024-01-23T09:25:37.867811+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:09:39.201070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":9432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"30'21","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:19.548688+0000","last_change":"2024-01-23T09:25:19.548688+0000","last_active":"2024-01-23T09:25:19.548688+0000","last_peered":"2024-01-23T09:25:19.548688+0000","last_clean":"2024-01-23T09:25:19.548688+0000","last_became_active":"2024-01-23T08:54:42.195555+0000","last_became_peered":"2024-01-23T08:54:42.195555+0000","last_unstale":"2024-01-23T09:25:19.548688+0000","last_undegraded":"2024-01-23T09:25:19.548688+0000","last_fullsized":"2024-01-23T09:25:19.548688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2024-01-23T09:25:19.548477+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2024-01-23T09:25:19.548477+0000","last_clean_scrub_stamp":"2024-01-23T09:25:19.548477+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:09:56.661075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"30'13","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:29.339505+0000","last_change":"2024-01-23T09:25:29.339505+0000","last_active":"2024-01-23T09:25:29.339505+0000","last_peered":"2024-01-23T09:25:29.339505+0000","last_clean":"2024-01-23T09:25:29.339505+0000","last_became_active":"2024-01-23T08:54:40.611932+0000","last_became_peered":"2024-01-23T08:54:40.611932+0000","last_unstale":"2024-01-23T09:25:29.339505+0000","last_undegraded":"2024-01-23T09:25:29.339505+0000","last_fullsized":"2024-01-23T09:25:29.339505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'13","last_scrub_stamp":"2024-01-23T09:25:29.339275+0000","last_deep_scrub":"30'13","last_deep_scrub_stamp":"2024-01-23T09:25:29.339275+0000","last_clean_scrub_stamp":"2024-01-23T09:25:29.339275+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:09:30.672533+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"30'119","reported_seq":199,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:15.768753+0000","last_change":"2024-01-23T09:25:15.768792+0000","last_active":"2024-01-23T09:25:15.768753+0000","last_peered":"2024-01-23T09:25:15.768753+0000","last_clean":"2024-01-23T09:25:15.768753+0000","last_became_active":"2024-01-23T08:54:01.490869+0000","last_became_peered":"2024-01-23T08:54:01.490869+0000","last_unstale":"2024-01-23T09:25:15.768753+0000","last_undegraded":"2024-01-23T09:25:15.768753+0000","last_fullsized":"2024-01-23T09:25:15.768753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'119","last_scrub_stamp":"2024-01-23T09:25:15.768666+0000","last_deep_scrub":"30'119","last_deep_scrub_stamp":"2024-01-23T09:25:15.768666+0000","last_clean_scrub_stamp":"2024-01-23T09:25:15.768666+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:08:16.784078+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"30'73","reported_seq":111,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:40.419101+0000","last_change":"2024-01-23T09:25:40.419162+0000","last_active":"2024-01-23T09:25:40.419101+0000","last_peered":"2024-01-23T09:25:40.419101+0000","last_clean":"2024-01-23T09:25:40.419101+0000","last_became_active":"2024-01-23T08:54:49.715231+0000","last_became_peered":"2024-01-23T08:54:49.715231+0000","last_unstale":"2024-01-23T09:25:40.419101+0000","last_undegraded":"2024-01-23T09:25:40.419101+0000","last_fullsized":"2024-01-23T09:25:40.419101+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'73","last_scrub_stamp":"2024-01-23T09:25:40.418920+0000","last_deep_scrub":"30'73","last_deep_scrub_stamp":"2024-01-23T09:25:40.418920+0000","last_clean_scrub_stamp":"2024-01-23T09:25:40.418920+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:29:42.320868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"30'24","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:19.340644+0000","last_change":"2024-01-23T09:25:19.340701+0000","last_active":"2024-01-23T09:25:19.340644+0000","last_peered":"2024-01-23T09:25:19.340644+0000","last_clean":"2024-01-23T09:25:19.340644+0000","last_became_active":"2024-01-23T08:54:42.088303+0000","last_became_peered":"2024-01-23T08:54:42.088303+0000","last_unstale":"2024-01-23T09:25:19.340644+0000","last_undegraded":"2024-01-23T09:25:19.340644+0000","last_fullsized":"2024-01-23T09:25:19.340644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2024-01-23T09:25:19.340492+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2024-01-23T09:25:19.340492+0000","last_clean_scrub_stamp":"2024-01-23T09:25:19.340492+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:55:17.547212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"30'11","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:23.323144+0000","last_change":"2024-01-23T09:25:23.323267+0000","last_active":"2024-01-23T09:25:23.323144+0000","last_peered":"2024-01-23T09:25:23.323144+0000","last_clean":"2024-01-23T09:25:23.323144+0000","last_became_active":"2024-01-23T08:54:40.689895+0000","last_became_peered":"2024-01-23T08:54:40.689895+0000","last_unstale":"2024-01-23T09:25:23.323144+0000","last_undegraded":"2024-01-23T09:25:23.323144+0000","last_fullsized":"2024-01-23T09:25:23.323144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'11","last_scrub_stamp":"2024-01-23T09:25:23.322980+0000","last_deep_scrub":"30'11","last_deep_scrub_stamp":"2024-01-23T09:25:23.322980+0000","last_clean_scrub_stamp":"2024-01-23T09:25:23.322980+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:51:37.946405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1751,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"30'84","reported_seq":122,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:27.320738+0000","last_change":"2024-01-23T09:25:27.320800+0000","last_active":"2024-01-23T09:25:27.320738+0000","last_peered":"2024-01-23T09:25:27.320738+0000","last_clean":"2024-01-23T09:25:27.320738+0000","last_became_active":"2024-01-23T08:54:49.735777+0000","last_became_peered":"2024-01-23T08:54:49.735777+0000","last_unstale":"2024-01-23T09:25:27.320738+0000","last_undegraded":"2024-01-23T09:25:27.320738+0000","last_fullsized":"2024-01-23T09:25:27.320738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'84","last_scrub_stamp":"2024-01-23T09:25:27.320577+0000","last_deep_scrub":"30'84","last_deep_scrub_stamp":"2024-01-23T09:25:27.320577+0000","last_clean_scrub_stamp":"2024-01-23T09:25:27.320577+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:25:42.319524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":8939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"30'22","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:23.031216+0000","last_change":"2024-01-23T09:25:23.031338+0000","last_active":"2024-01-23T09:25:23.031216+0000","last_peered":"2024-01-23T09:25:23.031216+0000","last_clean":"2024-01-23T09:25:23.031216+0000","last_became_active":"2024-01-23T08:54:42.106757+0000","last_became_peered":"2024-01-23T08:54:42.106757+0000","last_unstale":"2024-01-23T09:25:23.031216+0000","last_undegraded":"2024-01-23T09:25:23.031216+0000","last_fullsized":"2024-01-23T09:25:23.031216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'22","last_scrub_stamp":"2024-01-23T09:25:23.030956+0000","last_deep_scrub":"30'22","last_deep_scrub_stamp":"2024-01-23T09:25:23.030956+0000","last_clean_scrub_stamp":"2024-01-23T09:25:23.030956+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:42:43.577376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"30'8","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:24.955987+0000","last_change":"2024-01-23T09:25:24.956049+0000","last_active":"2024-01-23T09:25:24.955987+0000","last_peered":"2024-01-23T09:25:24.955987+0000","last_clean":"2024-01-23T09:25:24.955987+0000","last_became_active":"2024-01-23T08:54:40.686860+0000","last_became_peered":"2024-01-23T08:54:40.686860+0000","last_unstale":"2024-01-23T09:25:24.955987+0000","last_undegraded":"2024-01-23T09:25:24.955987+0000","last_fullsized":"2024-01-23T09:25:24.955987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'8","last_scrub_stamp":"2024-01-23T09:25:24.955826+0000","last_deep_scrub":"30'8","last_deep_scrub_stamp":"2024-01-23T09:25:24.955826+0000","last_clean_scrub_stamp":"2024-01-23T09:25:24.955826+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:37:33.196861+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'92","reported_seq":129,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:35.873435+0000","last_change":"2024-01-23T09:25:35.873496+0000","last_active":"2024-01-23T09:25:35.873435+0000","last_peered":"2024-01-23T09:25:35.873435+0000","last_clean":"2024-01-23T09:25:35.873435+0000","last_became_active":"2024-01-23T08:54:49.721494+0000","last_became_peered":"2024-01-23T08:54:49.721494+0000","last_unstale":"2024-01-23T09:25:35.873435+0000","last_undegraded":"2024-01-23T09:25:35.873435+0000","last_fullsized":"2024-01-23T09:25:35.873435+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'92","last_scrub_stamp":"2024-01-23T09:25:35.873266+0000","last_deep_scrub":"30'92","last_deep_scrub_stamp":"2024-01-23T09:25:35.873266+0000","last_clean_scrub_stamp":"2024-01-23T09:25:35.873266+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:57:13.966564+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":9285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"30'25","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:25.045168+0000","last_change":"2024-01-23T09:25:25.045228+0000","last_active":"2024-01-23T09:25:25.045168+0000","last_peered":"2024-01-23T09:25:25.045168+0000","last_clean":"2024-01-23T09:25:25.045168+0000","last_became_active":"2024-01-23T08:54:42.117317+0000","last_became_peered":"2024-01-23T08:54:42.117317+0000","last_unstale":"2024-01-23T09:25:25.045168+0000","last_undegraded":"2024-01-23T09:25:25.045168+0000","last_fullsized":"2024-01-23T09:25:25.045168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2024-01-23T09:25:25.044995+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2024-01-23T09:25:25.044995+0000","last_clean_scrub_stamp":"2024-01-23T09:25:25.044995+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:10:55.032636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"30'9","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:21.544601+0000","last_change":"2024-01-23T09:25:21.544675+0000","last_active":"2024-01-23T09:25:21.544601+0000","last_peered":"2024-01-23T09:25:21.544601+0000","last_clean":"2024-01-23T09:25:21.544601+0000","last_became_active":"2024-01-23T08:54:40.681954+0000","last_became_peered":"2024-01-23T08:54:40.681954+0000","last_unstale":"2024-01-23T09:25:21.544601+0000","last_undegraded":"2024-01-23T09:25:21.544601+0000","last_fullsized":"2024-01-23T09:25:21.544601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'9","last_scrub_stamp":"2024-01-23T09:25:21.544421+0000","last_deep_scrub":"30'9","last_deep_scrub_stamp":"2024-01-23T09:25:21.544421+0000","last_clean_scrub_stamp":"2024-01-23T09:25:21.544421+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:54:59.625654+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"30'57","reported_seq":95,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:41.433375+0000","last_change":"2024-01-23T09:25:41.433439+0000","last_active":"2024-01-23T09:25:41.433375+0000","last_peered":"2024-01-23T09:25:41.433375+0000","last_clean":"2024-01-23T09:25:41.433375+0000","last_became_active":"2024-01-23T08:54:49.715917+0000","last_became_peered":"2024-01-23T08:54:49.715917+0000","last_unstale":"2024-01-23T09:25:41.433375+0000","last_undegraded":"2024-01-23T09:25:41.433375+0000","last_fullsized":"2024-01-23T09:25:41.433375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'57","last_scrub_stamp":"2024-01-23T09:25:41.433201+0000","last_deep_scrub":"30'57","last_deep_scrub_stamp":"2024-01-23T09:25:41.433201+0000","last_clean_scrub_stamp":"2024-01-23T09:25:41.433201+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:01:36.427394+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":5210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"30'17","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:20.184250+0000","last_change":"2024-01-23T09:25:20.184307+0000","last_active":"2024-01-23T09:25:20.184250+0000","last_peered":"2024-01-23T09:25:20.184250+0000","last_clean":"2024-01-23T09:25:20.184250+0000","last_became_active":"2024-01-23T08:54:42.155411+0000","last_became_peered":"2024-01-23T08:54:42.155411+0000","last_unstale":"2024-01-23T09:25:20.184250+0000","last_undegraded":"2024-01-23T09:25:20.184250+0000","last_fullsized":"2024-01-23T09:25:20.184250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'17","last_scrub_stamp":"2024-01-23T09:25:20.184069+0000","last_deep_scrub":"30'17","last_deep_scrub_stamp":"2024-01-23T09:25:20.184069+0000","last_clean_scrub_stamp":"2024-01-23T09:25:20.184069+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:09:57.296666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"30'7","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:22.056712+0000","last_change":"2024-01-23T09:25:22.056762+0000","last_active":"2024-01-23T09:25:22.056712+0000","last_peered":"2024-01-23T09:25:22.056712+0000","last_clean":"2024-01-23T09:25:22.056712+0000","last_became_active":"2024-01-23T08:54:40.696128+0000","last_became_peered":"2024-01-23T08:54:40.696128+0000","last_unstale":"2024-01-23T09:25:22.056712+0000","last_undegraded":"2024-01-23T09:25:22.056712+0000","last_fullsized":"2024-01-23T09:25:22.056712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'7","last_scrub_stamp":"2024-01-23T09:25:22.056607+0000","last_deep_scrub":"30'7","last_deep_scrub_stamp":"2024-01-23T09:25:22.056607+0000","last_clean_scrub_stamp":"2024-01-23T09:25:22.056607+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:06:48.765109+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"30'112","reported_seq":150,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:21.806794+0000","last_change":"2024-01-23T09:25:21.806913+0000","last_active":"2024-01-23T09:25:21.806794+0000","last_peered":"2024-01-23T09:25:21.806794+0000","last_clean":"2024-01-23T09:25:21.806794+0000","last_became_active":"2024-01-23T08:54:49.723038+0000","last_became_peered":"2024-01-23T08:54:49.723038+0000","last_unstale":"2024-01-23T09:25:21.806794+0000","last_undegraded":"2024-01-23T09:25:21.806794+0000","last_fullsized":"2024-01-23T09:25:21.806794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'112","last_scrub_stamp":"2024-01-23T09:25:21.806533+0000","last_deep_scrub":"30'112","last_deep_scrub_stamp":"2024-01-23T09:25:21.806533+0000","last_clean_scrub_stamp":"2024-01-23T09:25:21.806533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:09:40.303945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":12618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"30'22","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:24.428684+0000","last_change":"2024-01-23T09:25:24.428743+0000","last_active":"2024-01-23T09:25:24.428684+0000","last_peered":"2024-01-23T09:25:24.428684+0000","last_clean":"2024-01-23T09:25:24.428684+0000","last_became_active":"2024-01-23T08:54:42.149180+0000","last_became_peered":"2024-01-23T08:54:42.149180+0000","last_unstale":"2024-01-23T09:25:24.428684+0000","last_undegraded":"2024-01-23T09:25:24.428684+0000","last_fullsized":"2024-01-23T09:25:24.428684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'22","last_scrub_stamp":"2024-01-23T09:25:24.428505+0000","last_deep_scrub":"30'22","last_deep_scrub_stamp":"2024-01-23T09:25:24.428505+0000","last_clean_scrub_stamp":"2024-01-23T09:25:24.428505+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:00:40.192053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"30'30","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:24.525911+0000","last_change":"2024-01-23T09:25:24.525986+0000","last_active":"2024-01-23T09:25:24.525911+0000","last_peered":"2024-01-23T09:25:24.525911+0000","last_clean":"2024-01-23T09:25:24.525911+0000","last_became_active":"2024-01-23T08:54:40.699246+0000","last_became_peered":"2024-01-23T08:54:40.699246+0000","last_unstale":"2024-01-23T09:25:24.525911+0000","last_undegraded":"2024-01-23T09:25:24.525911+0000","last_fullsized":"2024-01-23T09:25:24.525911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2024-01-23T09:25:24.525762+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2024-01-23T09:25:24.525762+0000","last_clean_scrub_stamp":"2024-01-23T09:25:24.525762+0000","objects_scrubbed":8,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:41:00.030842+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"30'97","reported_seq":133,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:36.862300+0000","last_change":"2024-01-23T09:25:36.862373+0000","last_active":"2024-01-23T09:25:36.862300+0000","last_peered":"2024-01-23T09:25:36.862300+0000","last_clean":"2024-01-23T09:25:36.862300+0000","last_became_active":"2024-01-23T08:54:49.728448+0000","last_became_peered":"2024-01-23T08:54:49.728448+0000","last_unstale":"2024-01-23T09:25:36.862300+0000","last_undegraded":"2024-01-23T09:25:36.862300+0000","last_fullsized":"2024-01-23T09:25:36.862300+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'97","last_scrub_stamp":"2024-01-23T09:25:36.862113+0000","last_deep_scrub":"30'97","last_deep_scrub_stamp":"2024-01-23T09:25:36.862113+0000","last_clean_scrub_stamp":"2024-01-23T09:25:36.862113+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:57:29.954357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":7067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"30'23","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:17.766169+0000","last_change":"2024-01-23T09:25:17.766225+0000","last_active":"2024-01-23T09:25:17.766169+0000","last_peered":"2024-01-23T09:25:17.766169+0000","last_clean":"2024-01-23T09:25:17.766169+0000","last_became_active":"2024-01-23T08:54:42.087328+0000","last_became_peered":"2024-01-23T08:54:42.087328+0000","last_unstale":"2024-01-23T09:25:17.766169+0000","last_undegraded":"2024-01-23T09:25:17.766169+0000","last_fullsized":"2024-01-23T09:25:17.766169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'23","last_scrub_stamp":"2024-01-23T09:25:17.766025+0000","last_deep_scrub":"30'23","last_deep_scrub_stamp":"2024-01-23T09:25:17.766025+0000","last_clean_scrub_stamp":"2024-01-23T09:25:17.766025+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:19:01.754874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"30'13","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:21.058458+0000","last_change":"2024-01-23T09:25:21.058556+0000","last_active":"2024-01-23T09:25:21.058458+0000","last_peered":"2024-01-23T09:25:21.058458+0000","last_clean":"2024-01-23T09:25:21.058458+0000","last_became_active":"2024-01-23T08:54:40.693530+0000","last_became_peered":"2024-01-23T08:54:40.693530+0000","last_unstale":"2024-01-23T09:25:21.058458+0000","last_undegraded":"2024-01-23T09:25:21.058458+0000","last_fullsized":"2024-01-23T09:25:21.058458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'13","last_scrub_stamp":"2024-01-23T09:25:21.058238+0000","last_deep_scrub":"30'13","last_deep_scrub_stamp":"2024-01-23T09:25:21.058238+0000","last_clean_scrub_stamp":"2024-01-23T09:25:21.058238+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:37:29.299273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1169,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"30'73","reported_seq":118,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:38.870563+0000","last_change":"2024-01-23T09:25:38.870629+0000","last_active":"2024-01-23T09:25:38.870563+0000","last_peered":"2024-01-23T09:25:38.870563+0000","last_clean":"2024-01-23T09:25:38.870563+0000","last_became_active":"2024-01-23T08:55:47.749074+0000","last_became_peered":"2024-01-23T08:55:47.749074+0000","last_unstale":"2024-01-23T09:25:38.870563+0000","last_undegraded":"2024-01-23T09:25:38.870563+0000","last_fullsized":"2024-01-23T09:25:38.870563+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'73","last_scrub_stamp":"2024-01-23T09:25:38.870393+0000","last_deep_scrub":"30'73","last_deep_scrub_stamp":"2024-01-23T09:25:38.870393+0000","last_clean_scrub_stamp":"2024-01-23T09:25:38.870393+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:42:37.643094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":8234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,6,4],"acting":[5,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"30'36","reported_seq":78,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:18.293208+0000","last_change":"2024-01-23T09:25:18.293250+0000","last_active":"2024-01-23T09:25:18.293208+0000","last_peered":"2024-01-23T09:25:18.293208+0000","last_clean":"2024-01-23T09:25:18.293208+0000","last_became_active":"2024-01-23T08:54:42.108253+0000","last_became_peered":"2024-01-23T08:54:42.108253+0000","last_unstale":"2024-01-23T09:25:18.293208+0000","last_undegraded":"2024-01-23T09:25:18.293208+0000","last_fullsized":"2024-01-23T09:25:18.293208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'36","last_scrub_stamp":"2024-01-23T09:25:18.293105+0000","last_deep_scrub":"30'36","last_deep_scrub_stamp":"2024-01-23T09:25:18.293105+0000","last_clean_scrub_stamp":"2024-01-23T09:25:18.293105+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:42:38.839525+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"30'14","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:27.348593+0000","last_change":"2024-01-23T09:25:27.348669+0000","last_active":"2024-01-23T09:25:27.348593+0000","last_peered":"2024-01-23T09:25:27.348593+0000","last_clean":"2024-01-23T09:25:27.348593+0000","last_became_active":"2024-01-23T08:54:40.695699+0000","last_became_peered":"2024-01-23T08:54:40.695699+0000","last_unstale":"2024-01-23T09:25:27.348593+0000","last_undegraded":"2024-01-23T09:25:27.348593+0000","last_fullsized":"2024-01-23T09:25:27.348593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'14","last_scrub_stamp":"2024-01-23T09:25:27.348332+0000","last_deep_scrub":"30'14","last_deep_scrub_stamp":"2024-01-23T09:25:27.348332+0000","last_clean_scrub_stamp":"2024-01-23T09:25:27.348332+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:28:53.281611+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"30'63","reported_seq":100,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:34.322970+0000","last_change":"2024-01-23T09:25:34.323031+0000","last_active":"2024-01-23T09:25:34.322970+0000","last_peered":"2024-01-23T09:25:34.322970+0000","last_clean":"2024-01-23T09:25:34.322970+0000","last_became_active":"2024-01-23T08:54:49.739524+0000","last_became_peered":"2024-01-23T08:54:49.739524+0000","last_unstale":"2024-01-23T09:25:34.322970+0000","last_undegraded":"2024-01-23T09:25:34.322970+0000","last_fullsized":"2024-01-23T09:25:34.322970+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'63","last_scrub_stamp":"2024-01-23T09:25:34.322788+0000","last_deep_scrub":"30'63","last_deep_scrub_stamp":"2024-01-23T09:25:34.322788+0000","last_clean_scrub_stamp":"2024-01-23T09:25:34.322788+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:28:12.741373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":7121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"30'26","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:28.360764+0000","last_change":"2024-01-23T09:25:28.360808+0000","last_active":"2024-01-23T09:25:28.360764+0000","last_peered":"2024-01-23T09:25:28.360764+0000","last_clean":"2024-01-23T09:25:28.360764+0000","last_became_active":"2024-01-23T08:54:42.229952+0000","last_became_peered":"2024-01-23T08:54:42.229952+0000","last_unstale":"2024-01-23T09:25:28.360764+0000","last_undegraded":"2024-01-23T09:25:28.360764+0000","last_fullsized":"2024-01-23T09:25:28.360764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2024-01-23T09:25:28.360636+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2024-01-23T09:25:28.360636+0000","last_clean_scrub_stamp":"2024-01-23T09:25:28.360636+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:12:21.904213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"30'20","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:22.177792+0000","last_change":"2024-01-23T09:25:22.177870+0000","last_active":"2024-01-23T09:25:22.177792+0000","last_peered":"2024-01-23T09:25:22.177792+0000","last_clean":"2024-01-23T09:25:22.177792+0000","last_became_active":"2024-01-23T08:54:40.698059+0000","last_became_peered":"2024-01-23T08:54:40.698059+0000","last_unstale":"2024-01-23T09:25:22.177792+0000","last_undegraded":"2024-01-23T09:25:22.177792+0000","last_fullsized":"2024-01-23T09:25:22.177792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2024-01-23T09:25:22.177632+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2024-01-23T09:25:22.177632+0000","last_clean_scrub_stamp":"2024-01-23T09:25:22.177632+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:19:06.166482+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"30'67","reported_seq":103,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:39.453643+0000","last_change":"2024-01-23T09:25:39.453782+0000","last_active":"2024-01-23T09:25:39.453643+0000","last_peered":"2024-01-23T09:25:39.453643+0000","last_clean":"2024-01-23T09:25:39.453643+0000","last_became_active":"2024-01-23T08:54:49.707837+0000","last_became_peered":"2024-01-23T08:54:49.707837+0000","last_unstale":"2024-01-23T09:25:39.453643+0000","last_undegraded":"2024-01-23T09:25:39.453643+0000","last_fullsized":"2024-01-23T09:25:39.453643+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'67","last_scrub_stamp":"2024-01-23T09:25:39.453351+0000","last_deep_scrub":"30'67","last_deep_scrub_stamp":"2024-01-23T09:25:39.453351+0000","last_clean_scrub_stamp":"2024-01-23T09:25:39.453351+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:53:26.994750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":5283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"30'21","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:30.943039+0000","last_change":"2024-01-23T09:25:30.943099+0000","last_active":"2024-01-23T09:25:30.943039+0000","last_peered":"2024-01-23T09:25:30.943039+0000","last_clean":"2024-01-23T09:25:30.943039+0000","last_became_active":"2024-01-23T08:54:42.229252+0000","last_became_peered":"2024-01-23T08:54:42.229252+0000","last_unstale":"2024-01-23T09:25:30.943039+0000","last_undegraded":"2024-01-23T09:25:30.943039+0000","last_fullsized":"2024-01-23T09:25:30.943039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2024-01-23T09:25:30.942872+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2024-01-23T09:25:30.942872+0000","last_clean_scrub_stamp":"2024-01-23T09:25:30.942872+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:31:24.553827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"30'838","reported_seq":881,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:17.160368+0000","last_change":"2024-01-23T09:25:17.160407+0000","last_active":"2024-01-23T09:25:17.160368+0000","last_peered":"2024-01-23T09:25:17.160368+0000","last_clean":"2024-01-23T09:25:17.160368+0000","last_became_active":"2024-01-23T08:54:40.657711+0000","last_became_peered":"2024-01-23T08:54:40.657711+0000","last_unstale":"2024-01-23T09:25:17.160368+0000","last_undegraded":"2024-01-23T09:25:17.160368+0000","last_fullsized":"2024-01-23T09:25:17.160368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'838","last_scrub_stamp":"2024-01-23T09:25:17.160297+0000","last_deep_scrub":"30'838","last_deep_scrub_stamp":"2024-01-23T09:25:17.160297+0000","last_clean_scrub_stamp":"2024-01-23T09:25:17.160297+0000","objects_scrubbed":6,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:26:03.412965+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":833,"num_write_kb":4568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"30'86","reported_seq":123,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:34.561207+0000","last_change":"2024-01-23T09:25:34.561244+0000","last_active":"2024-01-23T09:25:34.561207+0000","last_peered":"2024-01-23T09:25:34.561207+0000","last_clean":"2024-01-23T09:25:34.561207+0000","last_became_active":"2024-01-23T08:54:49.735023+0000","last_became_peered":"2024-01-23T08:54:49.735023+0000","last_unstale":"2024-01-23T09:25:34.561207+0000","last_undegraded":"2024-01-23T09:25:34.561207+0000","last_fullsized":"2024-01-23T09:25:34.561207+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'86","last_scrub_stamp":"2024-01-23T09:25:34.561102+0000","last_deep_scrub":"30'86","last_deep_scrub_stamp":"2024-01-23T09:25:34.561102+0000","last_clean_scrub_stamp":"2024-01-23T09:25:34.561102+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:55:15.944571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":9278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"30'25","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:36.389455+0000","last_change":"2024-01-23T09:25:36.389522+0000","last_active":"2024-01-23T09:25:36.389455+0000","last_peered":"2024-01-23T09:25:36.389455+0000","last_clean":"2024-01-23T09:25:36.389455+0000","last_became_active":"2024-01-23T08:54:42.153735+0000","last_became_peered":"2024-01-23T08:54:42.153735+0000","last_unstale":"2024-01-23T09:25:36.389455+0000","last_undegraded":"2024-01-23T09:25:36.389455+0000","last_fullsized":"2024-01-23T09:25:36.389455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2024-01-23T09:25:36.389290+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2024-01-23T09:25:36.389290+0000","last_clean_scrub_stamp":"2024-01-23T09:25:36.389290+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:41:39.923379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"30'364","reported_seq":406,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:23.221748+0000","last_change":"2024-01-23T09:25:23.221812+0000","last_active":"2024-01-23T09:25:23.221748+0000","last_peered":"2024-01-23T09:25:23.221748+0000","last_clean":"2024-01-23T09:25:23.221748+0000","last_became_active":"2024-01-23T08:54:40.701827+0000","last_became_peered":"2024-01-23T08:54:40.701827+0000","last_unstale":"2024-01-23T09:25:23.221748+0000","last_undegraded":"2024-01-23T09:25:23.221748+0000","last_fullsized":"2024-01-23T09:25:23.221748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'364","last_scrub_stamp":"2024-01-23T09:25:23.221601+0000","last_deep_scrub":"30'364","last_deep_scrub_stamp":"2024-01-23T09:25:23.221601+0000","last_clean_scrub_stamp":"2024-01-23T09:25:23.221601+0000","objects_scrubbed":4,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:59:57.030217+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"30'124","reported_seq":161,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:25.319246+0000","last_change":"2024-01-23T09:25:25.319306+0000","last_active":"2024-01-23T09:25:25.319246+0000","last_peered":"2024-01-23T09:25:25.319246+0000","last_clean":"2024-01-23T09:25:25.319246+0000","last_became_active":"2024-01-23T08:54:49.735765+0000","last_became_peered":"2024-01-23T08:54:49.735765+0000","last_unstale":"2024-01-23T09:25:25.319246+0000","last_undegraded":"2024-01-23T09:25:25.319246+0000","last_fullsized":"2024-01-23T09:25:25.319246+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'124","last_scrub_stamp":"2024-01-23T09:25:25.319086+0000","last_deep_scrub":"30'124","last_deep_scrub_stamp":"2024-01-23T09:25:25.319086+0000","last_clean_scrub_stamp":"2024-01-23T09:25:25.319086+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:41:00.824166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":11379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"30'28","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:27.923358+0000","last_change":"2024-01-23T09:25:27.923415+0000","last_active":"2024-01-23T09:25:27.923358+0000","last_peered":"2024-01-23T09:25:27.923358+0000","last_clean":"2024-01-23T09:25:27.923358+0000","last_became_active":"2024-01-23T08:54:42.070703+0000","last_became_peered":"2024-01-23T08:54:42.070703+0000","last_unstale":"2024-01-23T09:25:27.923358+0000","last_undegraded":"2024-01-23T09:25:27.923358+0000","last_fullsized":"2024-01-23T09:25:27.923358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2024-01-23T09:25:27.923206+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2024-01-23T09:25:27.923206+0000","last_clean_scrub_stamp":"2024-01-23T09:25:27.923206+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:50:18.364866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"30'8","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:20.069341+0000","last_change":"2024-01-23T09:25:20.069379+0000","last_active":"2024-01-23T09:25:20.069341+0000","last_peered":"2024-01-23T09:25:20.069341+0000","last_clean":"2024-01-23T09:25:20.069341+0000","last_became_active":"2024-01-23T08:54:40.687656+0000","last_became_peered":"2024-01-23T08:54:40.687656+0000","last_unstale":"2024-01-23T09:25:20.069341+0000","last_undegraded":"2024-01-23T09:25:20.069341+0000","last_fullsized":"2024-01-23T09:25:20.069341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'8","last_scrub_stamp":"2024-01-23T09:25:20.069266+0000","last_deep_scrub":"30'8","last_deep_scrub_stamp":"2024-01-23T09:25:20.069266+0000","last_clean_scrub_stamp":"2024-01-23T09:25:20.069266+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:25:35.068212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'70","reported_seq":107,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:28.161290+0000","last_change":"2024-01-23T09:25:28.161436+0000","last_active":"2024-01-23T09:25:28.161290+0000","last_peered":"2024-01-23T09:25:28.161290+0000","last_clean":"2024-01-23T09:25:28.161290+0000","last_became_active":"2024-01-23T08:54:49.728191+0000","last_became_peered":"2024-01-23T08:54:49.728191+0000","last_unstale":"2024-01-23T09:25:28.161290+0000","last_undegraded":"2024-01-23T09:25:28.161290+0000","last_fullsized":"2024-01-23T09:25:28.161290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'70","last_scrub_stamp":"2024-01-23T09:25:28.160951+0000","last_deep_scrub":"30'70","last_deep_scrub_stamp":"2024-01-23T09:25:28.160951+0000","last_clean_scrub_stamp":"2024-01-23T09:25:28.160951+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:37:31.276776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":6489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"30'28","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:18.151732+0000","last_change":"2024-01-23T09:25:18.151755+0000","last_active":"2024-01-23T09:25:18.151732+0000","last_peered":"2024-01-23T09:25:18.151732+0000","last_clean":"2024-01-23T09:25:18.151732+0000","last_became_active":"2024-01-23T08:54:42.153539+0000","last_became_peered":"2024-01-23T08:54:42.153539+0000","last_unstale":"2024-01-23T09:25:18.151732+0000","last_undegraded":"2024-01-23T09:25:18.151732+0000","last_fullsized":"2024-01-23T09:25:18.151732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2024-01-23T09:25:18.151656+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2024-01-23T09:25:18.151656+0000","last_clean_scrub_stamp":"2024-01-23T09:25:18.151656+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:37:55.811976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"30'13","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:16.762509+0000","last_change":"2024-01-23T09:25:16.762573+0000","last_active":"2024-01-23T09:25:16.762509+0000","last_peered":"2024-01-23T09:25:16.762509+0000","last_clean":"2024-01-23T09:25:16.762509+0000","last_became_active":"2024-01-23T08:54:40.682765+0000","last_became_peered":"2024-01-23T08:54:40.682765+0000","last_unstale":"2024-01-23T09:25:16.762509+0000","last_undegraded":"2024-01-23T09:25:16.762509+0000","last_fullsized":"2024-01-23T09:25:16.762509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'13","last_scrub_stamp":"2024-01-23T09:25:16.762362+0000","last_deep_scrub":"30'13","last_deep_scrub_stamp":"2024-01-23T09:25:16.762362+0000","last_clean_scrub_stamp":"2024-01-23T09:25:16.762362+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:53:52.249532+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"30'72","reported_seq":109,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:31.528792+0000","last_change":"2024-01-23T09:25:31.528858+0000","last_active":"2024-01-23T09:25:31.528792+0000","last_peered":"2024-01-23T09:25:31.528792+0000","last_clean":"2024-01-23T09:25:31.528792+0000","last_became_active":"2024-01-23T08:54:49.724121+0000","last_became_peered":"2024-01-23T08:54:49.724121+0000","last_unstale":"2024-01-23T09:25:31.528792+0000","last_undegraded":"2024-01-23T09:25:31.528792+0000","last_fullsized":"2024-01-23T09:25:31.528792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'72","last_scrub_stamp":"2024-01-23T09:25:31.528632+0000","last_deep_scrub":"30'72","last_deep_scrub_stamp":"2024-01-23T09:25:31.528632+0000","last_clean_scrub_stamp":"2024-01-23T09:25:31.528632+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:11:01.516274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":8509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"30'65","reported_seq":104,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:33.546218+0000","last_change":"2024-01-23T09:25:33.546285+0000","last_active":"2024-01-23T09:25:33.546218+0000","last_peered":"2024-01-23T09:25:33.546218+0000","last_clean":"2024-01-23T09:25:33.546218+0000","last_became_active":"2024-01-23T08:54:49.732632+0000","last_became_peered":"2024-01-23T08:54:49.732632+0000","last_unstale":"2024-01-23T09:25:33.546218+0000","last_undegraded":"2024-01-23T09:25:33.546218+0000","last_fullsized":"2024-01-23T09:25:33.546218+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'65","last_scrub_stamp":"2024-01-23T09:25:33.546039+0000","last_deep_scrub":"30'65","last_deep_scrub_stamp":"2024-01-23T09:25:33.546039+0000","last_clean_scrub_stamp":"2024-01-23T09:25:33.546039+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:24:52.631547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":5816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"30'26","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:27.616354+0000","last_change":"2024-01-23T09:25:27.616474+0000","last_active":"2024-01-23T09:25:27.616354+0000","last_peered":"2024-01-23T09:25:27.616354+0000","last_clean":"2024-01-23T09:25:27.616354+0000","last_became_active":"2024-01-23T08:54:42.195570+0000","last_became_peered":"2024-01-23T08:54:42.195570+0000","last_unstale":"2024-01-23T09:25:27.616354+0000","last_undegraded":"2024-01-23T09:25:27.616354+0000","last_fullsized":"2024-01-23T09:25:27.616354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2024-01-23T09:25:27.616079+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2024-01-23T09:25:27.616079+0000","last_clean_scrub_stamp":"2024-01-23T09:25:27.616079+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:37:35.857113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"30'7","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:31.316560+0000","last_change":"2024-01-23T09:25:31.316620+0000","last_active":"2024-01-23T09:25:31.316560+0000","last_peered":"2024-01-23T09:25:31.316560+0000","last_clean":"2024-01-23T09:25:31.316560+0000","last_became_active":"2024-01-23T08:54:40.678527+0000","last_became_peered":"2024-01-23T08:54:40.678527+0000","last_unstale":"2024-01-23T09:25:31.316560+0000","last_undegraded":"2024-01-23T09:25:31.316560+0000","last_fullsized":"2024-01-23T09:25:31.316560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'7","last_scrub_stamp":"2024-01-23T09:25:31.316404+0000","last_deep_scrub":"30'7","last_deep_scrub_stamp":"2024-01-23T09:25:31.316404+0000","last_clean_scrub_stamp":"2024-01-23T09:25:31.316404+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:59:50.635526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"30'89","reported_seq":127,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:43.459270+0000","last_change":"2024-01-23T09:25:43.459334+0000","last_active":"2024-01-23T09:25:43.459270+0000","last_peered":"2024-01-23T09:25:43.459270+0000","last_clean":"2024-01-23T09:25:43.459270+0000","last_became_active":"2024-01-23T08:54:49.717116+0000","last_became_peered":"2024-01-23T08:54:49.717116+0000","last_unstale":"2024-01-23T09:25:43.459270+0000","last_undegraded":"2024-01-23T09:25:43.459270+0000","last_fullsized":"2024-01-23T09:25:43.459270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'89","last_scrub_stamp":"2024-01-23T09:25:43.459080+0000","last_deep_scrub":"30'89","last_deep_scrub_stamp":"2024-01-23T09:25:43.459080+0000","last_clean_scrub_stamp":"2024-01-23T09:25:43.459080+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:22:25.977917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":12319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"30'30","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:34.825010+0000","last_change":"2024-01-23T09:25:34.825065+0000","last_active":"2024-01-23T09:25:34.825010+0000","last_peered":"2024-01-23T09:25:34.825010+0000","last_clean":"2024-01-23T09:25:34.825010+0000","last_became_active":"2024-01-23T08:54:42.235116+0000","last_became_peered":"2024-01-23T08:54:42.235116+0000","last_unstale":"2024-01-23T09:25:34.825010+0000","last_undegraded":"2024-01-23T09:25:34.825010+0000","last_fullsized":"2024-01-23T09:25:34.825010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'30","last_scrub_stamp":"2024-01-23T09:25:34.824851+0000","last_deep_scrub":"30'30","last_deep_scrub_stamp":"2024-01-23T09:25:34.824851+0000","last_clean_scrub_stamp":"2024-01-23T09:25:34.824851+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:23:54.659112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"30'9","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:22.286576+0000","last_change":"2024-01-23T09:25:22.286637+0000","last_active":"2024-01-23T09:25:22.286576+0000","last_peered":"2024-01-23T09:25:22.286576+0000","last_clean":"2024-01-23T09:25:22.286576+0000","last_became_active":"2024-01-23T08:54:40.689433+0000","last_became_peered":"2024-01-23T08:54:40.689433+0000","last_unstale":"2024-01-23T09:25:22.286576+0000","last_undegraded":"2024-01-23T09:25:22.286576+0000","last_fullsized":"2024-01-23T09:25:22.286576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'9","last_scrub_stamp":"2024-01-23T09:25:22.286420+0000","last_deep_scrub":"30'9","last_deep_scrub_stamp":"2024-01-23T09:25:22.286420+0000","last_clean_scrub_stamp":"2024-01-23T09:25:22.286420+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:16:07.705085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"30'515","reported_seq":557,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:34.389344+0000","last_change":"2024-01-23T09:25:34.389419+0000","last_active":"2024-01-23T09:25:34.389344+0000","last_peered":"2024-01-23T09:25:34.389344+0000","last_clean":"2024-01-23T09:25:34.389344+0000","last_became_active":"2024-01-23T08:54:40.686371+0000","last_became_peered":"2024-01-23T08:54:40.686371+0000","last_unstale":"2024-01-23T09:25:34.389344+0000","last_undegraded":"2024-01-23T09:25:34.389344+0000","last_fullsized":"2024-01-23T09:25:34.389344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'515","last_scrub_stamp":"2024-01-23T09:25:34.389185+0000","last_deep_scrub":"30'515","last_deep_scrub_stamp":"2024-01-23T09:25:34.389185+0000","last_clean_scrub_stamp":"2024-01-23T09:25:34.389185+0000","objects_scrubbed":4,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:59:44.145760+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":507,"num_write_kb":4372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"30'22","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:29.577487+0000","last_change":"2024-01-23T09:25:29.577608+0000","last_active":"2024-01-23T09:25:29.577487+0000","last_peered":"2024-01-23T09:25:29.577487+0000","last_clean":"2024-01-23T09:25:29.577487+0000","last_became_active":"2024-01-23T08:54:42.198648+0000","last_became_peered":"2024-01-23T08:54:42.198648+0000","last_unstale":"2024-01-23T09:25:29.577487+0000","last_undegraded":"2024-01-23T09:25:29.577487+0000","last_fullsized":"2024-01-23T09:25:29.577487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'22","last_scrub_stamp":"2024-01-23T09:25:29.577178+0000","last_deep_scrub":"30'22","last_deep_scrub_stamp":"2024-01-23T09:25:29.577178+0000","last_clean_scrub_stamp":"2024-01-23T09:25:29.577178+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:42:50.123598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"30'54","reported_seq":90,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:35.594969+0000","last_change":"2024-01-23T09:25:35.595032+0000","last_active":"2024-01-23T09:25:35.594969+0000","last_peered":"2024-01-23T09:25:35.594969+0000","last_clean":"2024-01-23T09:25:35.594969+0000","last_became_active":"2024-01-23T08:54:49.741692+0000","last_became_peered":"2024-01-23T08:54:49.741692+0000","last_unstale":"2024-01-23T09:25:35.594969+0000","last_undegraded":"2024-01-23T09:25:35.594969+0000","last_fullsized":"2024-01-23T09:25:35.594969+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'54","last_scrub_stamp":"2024-01-23T09:25:35.594790+0000","last_deep_scrub":"30'54","last_deep_scrub_stamp":"2024-01-23T09:25:35.594790+0000","last_clean_scrub_stamp":"2024-01-23T09:25:35.594790+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:00:51.358338+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":4034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"30'587","reported_seq":629,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:23.991738+0000","last_change":"2024-01-23T09:25:23.991776+0000","last_active":"2024-01-23T09:25:23.991738+0000","last_peered":"2024-01-23T09:25:23.991738+0000","last_clean":"2024-01-23T09:25:23.991738+0000","last_became_active":"2024-01-23T08:54:40.686125+0000","last_became_peered":"2024-01-23T08:54:40.686125+0000","last_unstale":"2024-01-23T09:25:23.991738+0000","last_undegraded":"2024-01-23T09:25:23.991738+0000","last_fullsized":"2024-01-23T09:25:23.991738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'587","last_scrub_stamp":"2024-01-23T09:25:23.991649+0000","last_deep_scrub":"30'587","last_deep_scrub_stamp":"2024-01-23T09:25:23.991649+0000","last_clean_scrub_stamp":"2024-01-23T09:25:23.991649+0000","objects_scrubbed":3,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:58:04.050434+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195507,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":4397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"30'19","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:18.732089+0000","last_change":"2024-01-23T09:25:18.732145+0000","last_active":"2024-01-23T09:25:18.732089+0000","last_peered":"2024-01-23T09:25:18.732089+0000","last_clean":"2024-01-23T09:25:18.732089+0000","last_became_active":"2024-01-23T08:54:42.089826+0000","last_became_peered":"2024-01-23T08:54:42.089826+0000","last_unstale":"2024-01-23T09:25:18.732089+0000","last_undegraded":"2024-01-23T09:25:18.732089+0000","last_fullsized":"2024-01-23T09:25:18.732089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2024-01-23T09:25:18.731941+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2024-01-23T09:25:18.731941+0000","last_clean_scrub_stamp":"2024-01-23T09:25:18.731941+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:17:03.716474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"30'96","reported_seq":129,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:32.386349+0000","last_change":"2024-01-23T09:25:32.386349+0000","last_active":"2024-01-23T09:25:32.386349+0000","last_peered":"2024-01-23T09:25:32.386349+0000","last_clean":"2024-01-23T09:25:32.386349+0000","last_became_active":"2024-01-23T08:55:47.747327+0000","last_became_peered":"2024-01-23T08:55:47.747327+0000","last_unstale":"2024-01-23T09:25:32.386349+0000","last_undegraded":"2024-01-23T09:25:32.386349+0000","last_fullsized":"2024-01-23T09:25:32.386349+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'96","last_scrub_stamp":"2024-01-23T09:25:32.386089+0000","last_deep_scrub":"30'96","last_deep_scrub_stamp":"2024-01-23T09:25:32.386089+0000","last_clean_scrub_stamp":"2024-01-23T09:25:32.386089+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:30:47.528329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":8062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"30'35","reported_seq":79,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:23.279617+0000","last_change":"2024-01-23T09:25:23.279617+0000","last_active":"2024-01-23T09:25:23.279617+0000","last_peered":"2024-01-23T09:25:23.279617+0000","last_clean":"2024-01-23T09:25:23.279617+0000","last_became_active":"2024-01-23T08:54:42.227421+0000","last_became_peered":"2024-01-23T08:54:42.227421+0000","last_unstale":"2024-01-23T09:25:23.279617+0000","last_undegraded":"2024-01-23T09:25:23.279617+0000","last_fullsized":"2024-01-23T09:25:23.279617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'35","last_scrub_stamp":"2024-01-23T09:25:23.279386+0000","last_deep_scrub":"30'35","last_deep_scrub_stamp":"2024-01-23T09:25:23.279386+0000","last_clean_scrub_stamp":"2024-01-23T09:25:23.279386+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:09:06.069007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"30'25","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:25.137901+0000","last_change":"2024-01-23T09:25:25.137901+0000","last_active":"2024-01-23T09:25:25.137901+0000","last_peered":"2024-01-23T09:25:25.137901+0000","last_clean":"2024-01-23T09:25:25.137901+0000","last_became_active":"2024-01-23T08:54:42.111635+0000","last_became_peered":"2024-01-23T08:54:42.111635+0000","last_unstale":"2024-01-23T09:25:25.137901+0000","last_undegraded":"2024-01-23T09:25:25.137901+0000","last_fullsized":"2024-01-23T09:25:25.137901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2024-01-23T09:25:25.137689+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2024-01-23T09:25:25.137689+0000","last_clean_scrub_stamp":"2024-01-23T09:25:25.137689+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T21:01:18.975627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"30'28","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:23.464435+0000","last_change":"2024-01-23T09:25:23.464435+0000","last_active":"2024-01-23T09:25:23.464435+0000","last_peered":"2024-01-23T09:25:23.464435+0000","last_clean":"2024-01-23T09:25:23.464435+0000","last_became_active":"2024-01-23T08:54:42.069262+0000","last_became_peered":"2024-01-23T08:54:42.069262+0000","last_unstale":"2024-01-23T09:25:23.464435+0000","last_undegraded":"2024-01-23T09:25:23.464435+0000","last_fullsized":"2024-01-23T09:25:23.464435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2024-01-23T09:25:23.464199+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2024-01-23T09:25:23.464199+0000","last_clean_scrub_stamp":"2024-01-23T09:25:23.464199+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:55:04.847668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"30'23","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:30.830627+0000","last_change":"2024-01-23T09:25:30.830729+0000","last_active":"2024-01-23T09:25:30.830627+0000","last_peered":"2024-01-23T09:25:30.830627+0000","last_clean":"2024-01-23T09:25:30.830627+0000","last_became_active":"2024-01-23T08:54:42.107985+0000","last_became_peered":"2024-01-23T08:54:42.107985+0000","last_unstale":"2024-01-23T09:25:30.830627+0000","last_undegraded":"2024-01-23T09:25:30.830627+0000","last_fullsized":"2024-01-23T09:25:30.830627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'23","last_scrub_stamp":"2024-01-23T09:25:30.830447+0000","last_deep_scrub":"30'23","last_deep_scrub_stamp":"2024-01-23T09:25:30.830447+0000","last_clean_scrub_stamp":"2024-01-23T09:25:30.830447+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:25:34.132683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"30'17","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:27.313048+0000","last_change":"2024-01-23T09:25:27.313160+0000","last_active":"2024-01-23T09:25:27.313048+0000","last_peered":"2024-01-23T09:25:27.313048+0000","last_clean":"2024-01-23T09:25:27.313048+0000","last_became_active":"2024-01-23T08:54:42.227918+0000","last_became_peered":"2024-01-23T08:54:42.227918+0000","last_unstale":"2024-01-23T09:25:27.313048+0000","last_undegraded":"2024-01-23T09:25:27.313048+0000","last_fullsized":"2024-01-23T09:25:27.313048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'17","last_scrub_stamp":"2024-01-23T09:25:27.312785+0000","last_deep_scrub":"30'17","last_deep_scrub_stamp":"2024-01-23T09:25:27.312785+0000","last_clean_scrub_stamp":"2024-01-23T09:25:27.312785+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:35:35.979425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"30'20","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:29.332490+0000","last_change":"2024-01-23T09:25:29.332534+0000","last_active":"2024-01-23T09:25:29.332490+0000","last_peered":"2024-01-23T09:25:29.332490+0000","last_clean":"2024-01-23T09:25:29.332490+0000","last_became_active":"2024-01-23T08:54:42.230615+0000","last_became_peered":"2024-01-23T08:54:42.230615+0000","last_unstale":"2024-01-23T09:25:29.332490+0000","last_undegraded":"2024-01-23T09:25:29.332490+0000","last_fullsized":"2024-01-23T09:25:29.332490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2024-01-23T09:25:29.332367+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2024-01-23T09:25:29.332367+0000","last_clean_scrub_stamp":"2024-01-23T09:25:29.332367+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:48:28.264567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"30'35","reported_seq":78,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:19.164406+0000","last_change":"2024-01-23T09:25:19.164428+0000","last_active":"2024-01-23T09:25:19.164406+0000","last_peered":"2024-01-23T09:25:19.164406+0000","last_clean":"2024-01-23T09:25:19.164406+0000","last_became_active":"2024-01-23T08:54:42.157106+0000","last_became_peered":"2024-01-23T08:54:42.157106+0000","last_unstale":"2024-01-23T09:25:19.164406+0000","last_undegraded":"2024-01-23T09:25:19.164406+0000","last_fullsized":"2024-01-23T09:25:19.164406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'35","last_scrub_stamp":"2024-01-23T09:25:19.164335+0000","last_deep_scrub":"30'35","last_deep_scrub_stamp":"2024-01-23T09:25:19.164335+0000","last_clean_scrub_stamp":"2024-01-23T09:25:19.164335+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:37:22.280160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"30'20","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:29.860882+0000","last_change":"2024-01-23T09:25:29.860941+0000","last_active":"2024-01-23T09:25:29.860882+0000","last_peered":"2024-01-23T09:25:29.860882+0000","last_clean":"2024-01-23T09:25:29.860882+0000","last_became_active":"2024-01-23T08:54:42.092149+0000","last_became_peered":"2024-01-23T08:54:42.092149+0000","last_unstale":"2024-01-23T09:25:29.860882+0000","last_undegraded":"2024-01-23T09:25:29.860882+0000","last_fullsized":"2024-01-23T09:25:29.860882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2024-01-23T09:25:29.860715+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2024-01-23T09:25:29.860715+0000","last_clean_scrub_stamp":"2024-01-23T09:25:29.860715+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:14:16.136437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"30'19","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:25.418771+0000","last_change":"2024-01-23T09:25:25.418829+0000","last_active":"2024-01-23T09:25:25.418771+0000","last_peered":"2024-01-23T09:25:25.418771+0000","last_clean":"2024-01-23T09:25:25.418771+0000","last_became_active":"2024-01-23T08:54:42.069305+0000","last_became_peered":"2024-01-23T08:54:42.069305+0000","last_unstale":"2024-01-23T09:25:25.418771+0000","last_undegraded":"2024-01-23T09:25:25.418771+0000","last_fullsized":"2024-01-23T09:25:25.418771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2024-01-23T09:25:25.418614+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2024-01-23T09:25:25.418614+0000","last_clean_scrub_stamp":"2024-01-23T09:25:25.418614+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:48:33.497499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"30'29","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:21.990519+0000","last_change":"2024-01-23T09:25:21.990640+0000","last_active":"2024-01-23T09:25:21.990519+0000","last_peered":"2024-01-23T09:25:21.990519+0000","last_clean":"2024-01-23T09:25:21.990519+0000","last_became_active":"2024-01-23T08:54:42.157647+0000","last_became_peered":"2024-01-23T08:54:42.157647+0000","last_unstale":"2024-01-23T09:25:21.990519+0000","last_undegraded":"2024-01-23T09:25:21.990519+0000","last_fullsized":"2024-01-23T09:25:21.990519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'29","last_scrub_stamp":"2024-01-23T09:25:21.990241+0000","last_deep_scrub":"30'29","last_deep_scrub_stamp":"2024-01-23T09:25:21.990241+0000","last_clean_scrub_stamp":"2024-01-23T09:25:21.990241+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:40:57.495321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"30'28","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:20.779075+0000","last_change":"2024-01-23T09:25:20.779137+0000","last_active":"2024-01-23T09:25:20.779075+0000","last_peered":"2024-01-23T09:25:20.779075+0000","last_clean":"2024-01-23T09:25:20.779075+0000","last_became_active":"2024-01-23T08:54:42.118528+0000","last_became_peered":"2024-01-23T08:54:42.118528+0000","last_unstale":"2024-01-23T09:25:20.779075+0000","last_undegraded":"2024-01-23T09:25:20.779075+0000","last_fullsized":"2024-01-23T09:25:20.779075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2024-01-23T09:25:20.778911+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2024-01-23T09:25:20.778911+0000","last_clean_scrub_stamp":"2024-01-23T09:25:20.778911+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:34:41.356473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"30'35","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:28.609037+0000","last_change":"2024-01-23T09:25:28.609099+0000","last_active":"2024-01-23T09:25:28.609037+0000","last_peered":"2024-01-23T09:25:28.609037+0000","last_clean":"2024-01-23T09:25:28.609037+0000","last_became_active":"2024-01-23T08:54:42.196809+0000","last_became_peered":"2024-01-23T08:54:42.196809+0000","last_unstale":"2024-01-23T09:25:28.609037+0000","last_undegraded":"2024-01-23T09:25:28.609037+0000","last_fullsized":"2024-01-23T09:25:28.609037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'35","last_scrub_stamp":"2024-01-23T09:25:28.608872+0000","last_deep_scrub":"30'35","last_deep_scrub_stamp":"2024-01-23T09:25:28.608872+0000","last_clean_scrub_stamp":"2024-01-23T09:25:28.608872+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:06:55.317375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"30'27","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:16.030305+0000","last_change":"2024-01-23T09:25:16.030364+0000","last_active":"2024-01-23T09:25:16.030305+0000","last_peered":"2024-01-23T09:25:16.030305+0000","last_clean":"2024-01-23T09:25:16.030305+0000","last_became_active":"2024-01-23T08:54:42.111207+0000","last_became_peered":"2024-01-23T08:54:42.111207+0000","last_unstale":"2024-01-23T09:25:16.030305+0000","last_undegraded":"2024-01-23T09:25:16.030305+0000","last_fullsized":"2024-01-23T09:25:16.030305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'27","last_scrub_stamp":"2024-01-23T09:25:16.030126+0000","last_deep_scrub":"30'27","last_deep_scrub_stamp":"2024-01-23T09:25:16.030126+0000","last_clean_scrub_stamp":"2024-01-23T09:25:16.030126+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:06:10.211565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"30'22","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:38.413771+0000","last_change":"2024-01-23T09:25:38.413834+0000","last_active":"2024-01-23T09:25:38.413771+0000","last_peered":"2024-01-23T09:25:38.413771+0000","last_clean":"2024-01-23T09:25:38.413771+0000","last_became_active":"2024-01-23T08:54:42.194562+0000","last_became_peered":"2024-01-23T08:54:42.194562+0000","last_unstale":"2024-01-23T09:25:38.413771+0000","last_undegraded":"2024-01-23T09:25:38.413771+0000","last_fullsized":"2024-01-23T09:25:38.413771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'22","last_scrub_stamp":"2024-01-23T09:25:38.413599+0000","last_deep_scrub":"30'22","last_deep_scrub_stamp":"2024-01-23T09:25:38.413599+0000","last_clean_scrub_stamp":"2024-01-23T09:25:38.413599+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:52:43.449564+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"30'33","reported_seq":75,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:26.141097+0000","last_change":"2024-01-23T09:25:26.141154+0000","last_active":"2024-01-23T09:25:26.141097+0000","last_peered":"2024-01-23T09:25:26.141097+0000","last_clean":"2024-01-23T09:25:26.141097+0000","last_became_active":"2024-01-23T08:54:42.160570+0000","last_became_peered":"2024-01-23T08:54:42.160570+0000","last_unstale":"2024-01-23T09:25:26.141097+0000","last_undegraded":"2024-01-23T09:25:26.141097+0000","last_fullsized":"2024-01-23T09:25:26.141097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'33","last_scrub_stamp":"2024-01-23T09:25:26.140935+0000","last_deep_scrub":"30'33","last_deep_scrub_stamp":"2024-01-23T09:25:26.140935+0000","last_clean_scrub_stamp":"2024-01-23T09:25:26.140935+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:33:21.678118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"30'24","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:22.442061+0000","last_change":"2024-01-23T09:25:22.442117+0000","last_active":"2024-01-23T09:25:22.442061+0000","last_peered":"2024-01-23T09:25:22.442061+0000","last_clean":"2024-01-23T09:25:22.442061+0000","last_became_active":"2024-01-23T08:54:42.114759+0000","last_became_peered":"2024-01-23T08:54:42.114759+0000","last_unstale":"2024-01-23T09:25:22.442061+0000","last_undegraded":"2024-01-23T09:25:22.442061+0000","last_fullsized":"2024-01-23T09:25:22.442061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2024-01-23T09:25:22.441906+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2024-01-23T09:25:22.441906+0000","last_clean_scrub_stamp":"2024-01-23T09:25:22.441906+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:24:41.527414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"30'26","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:26.384589+0000","last_change":"2024-01-23T09:25:26.384646+0000","last_active":"2024-01-23T09:25:26.384589+0000","last_peered":"2024-01-23T09:25:26.384589+0000","last_clean":"2024-01-23T09:25:26.384589+0000","last_became_active":"2024-01-23T08:54:42.149278+0000","last_became_peered":"2024-01-23T08:54:42.149278+0000","last_unstale":"2024-01-23T09:25:26.384589+0000","last_undegraded":"2024-01-23T09:25:26.384589+0000","last_fullsized":"2024-01-23T09:25:26.384589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2024-01-23T09:25:26.384432+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2024-01-23T09:25:26.384432+0000","last_clean_scrub_stamp":"2024-01-23T09:25:26.384432+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:31:19.995387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"30'26","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:20.945012+0000","last_change":"2024-01-23T09:25:20.945121+0000","last_active":"2024-01-23T09:25:20.945012+0000","last_peered":"2024-01-23T09:25:20.945012+0000","last_clean":"2024-01-23T09:25:20.945012+0000","last_became_active":"2024-01-23T08:54:42.109743+0000","last_became_peered":"2024-01-23T08:54:42.109743+0000","last_unstale":"2024-01-23T09:25:20.945012+0000","last_undegraded":"2024-01-23T09:25:20.945012+0000","last_fullsized":"2024-01-23T09:25:20.945012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'26","last_scrub_stamp":"2024-01-23T09:25:20.944798+0000","last_deep_scrub":"30'26","last_deep_scrub_stamp":"2024-01-23T09:25:20.944798+0000","last_clean_scrub_stamp":"2024-01-23T09:25:20.944798+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:13:13.260134+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"30'25","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:30.374034+0000","last_change":"2024-01-23T09:25:30.374080+0000","last_active":"2024-01-23T09:25:30.374034+0000","last_peered":"2024-01-23T09:25:30.374034+0000","last_clean":"2024-01-23T09:25:30.374034+0000","last_became_active":"2024-01-23T08:54:42.227537+0000","last_became_peered":"2024-01-23T08:54:42.227537+0000","last_unstale":"2024-01-23T09:25:30.374034+0000","last_undegraded":"2024-01-23T09:25:30.374034+0000","last_fullsized":"2024-01-23T09:25:30.374034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2024-01-23T09:25:30.373908+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2024-01-23T09:25:30.373908+0000","last_clean_scrub_stamp":"2024-01-23T09:25:30.373908+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:04:42.128135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"30'33","reported_seq":74,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:24.324555+0000","last_change":"2024-01-23T09:25:24.324612+0000","last_active":"2024-01-23T09:25:24.324555+0000","last_peered":"2024-01-23T09:25:24.324555+0000","last_clean":"2024-01-23T09:25:24.324555+0000","last_became_active":"2024-01-23T08:54:42.224541+0000","last_became_peered":"2024-01-23T08:54:42.224541+0000","last_unstale":"2024-01-23T09:25:24.324555+0000","last_undegraded":"2024-01-23T09:25:24.324555+0000","last_fullsized":"2024-01-23T09:25:24.324555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'33","last_scrub_stamp":"2024-01-23T09:25:24.324395+0000","last_deep_scrub":"30'33","last_deep_scrub_stamp":"2024-01-23T09:25:24.324395+0000","last_clean_scrub_stamp":"2024-01-23T09:25:24.324395+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:06:15.043781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"30'18","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:24.010787+0000","last_change":"2024-01-23T09:25:24.010848+0000","last_active":"2024-01-23T09:25:24.010787+0000","last_peered":"2024-01-23T09:25:24.010787+0000","last_clean":"2024-01-23T09:25:24.010787+0000","last_became_active":"2024-01-23T08:54:42.111043+0000","last_became_peered":"2024-01-23T08:54:42.111043+0000","last_unstale":"2024-01-23T09:25:24.010787+0000","last_undegraded":"2024-01-23T09:25:24.010787+0000","last_fullsized":"2024-01-23T09:25:24.010787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'18","last_scrub_stamp":"2024-01-23T09:25:24.010617+0000","last_deep_scrub":"30'18","last_deep_scrub_stamp":"2024-01-23T09:25:24.010617+0000","last_clean_scrub_stamp":"2024-01-23T09:25:24.010617+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:50:14.452277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"30'19","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:15.052340+0000","last_change":"2024-01-23T09:25:15.052362+0000","last_active":"2024-01-23T09:25:15.052340+0000","last_peered":"2024-01-23T09:25:15.052340+0000","last_clean":"2024-01-23T09:25:15.052340+0000","last_became_active":"2024-01-23T08:54:42.115911+0000","last_became_peered":"2024-01-23T08:54:42.115911+0000","last_unstale":"2024-01-23T09:25:15.052340+0000","last_undegraded":"2024-01-23T09:25:15.052340+0000","last_fullsized":"2024-01-23T09:25:15.052340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2024-01-23T09:25:15.052273+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2024-01-23T09:25:15.052273+0000","last_clean_scrub_stamp":"2024-01-23T09:25:15.052273+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:49:29.534124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"30'33","reported_seq":74,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:28.990077+0000","last_change":"2024-01-23T09:25:28.990184+0000","last_active":"2024-01-23T09:25:28.990077+0000","last_peered":"2024-01-23T09:25:28.990077+0000","last_clean":"2024-01-23T09:25:28.990077+0000","last_became_active":"2024-01-23T08:54:42.157331+0000","last_became_peered":"2024-01-23T08:54:42.157331+0000","last_unstale":"2024-01-23T09:25:28.990077+0000","last_undegraded":"2024-01-23T09:25:28.990077+0000","last_fullsized":"2024-01-23T09:25:28.990077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'33","last_scrub_stamp":"2024-01-23T09:25:28.989874+0000","last_deep_scrub":"30'33","last_deep_scrub_stamp":"2024-01-23T09:25:28.989874+0000","last_clean_scrub_stamp":"2024-01-23T09:25:28.989874+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:00:44.753423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"30'28","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:19.766892+0000","last_change":"2024-01-23T09:25:19.767002+0000","last_active":"2024-01-23T09:25:19.766892+0000","last_peered":"2024-01-23T09:25:19.766892+0000","last_clean":"2024-01-23T09:25:19.766892+0000","last_became_active":"2024-01-23T08:54:42.091726+0000","last_became_peered":"2024-01-23T08:54:42.091726+0000","last_unstale":"2024-01-23T09:25:19.766892+0000","last_undegraded":"2024-01-23T09:25:19.766892+0000","last_fullsized":"2024-01-23T09:25:19.766892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2024-01-23T09:25:19.766650+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2024-01-23T09:25:19.766650+0000","last_clean_scrub_stamp":"2024-01-23T09:25:19.766650+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:37:13.008738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"30'19","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:19.904000+0000","last_change":"2024-01-23T09:25:19.904033+0000","last_active":"2024-01-23T09:25:19.904000+0000","last_peered":"2024-01-23T09:25:19.904000+0000","last_clean":"2024-01-23T09:25:19.904000+0000","last_became_active":"2024-01-23T08:54:42.119847+0000","last_became_peered":"2024-01-23T08:54:42.119847+0000","last_unstale":"2024-01-23T09:25:19.904000+0000","last_undegraded":"2024-01-23T09:25:19.904000+0000","last_fullsized":"2024-01-23T09:25:19.904000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2024-01-23T09:25:19.903905+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2024-01-23T09:25:19.903905+0000","last_clean_scrub_stamp":"2024-01-23T09:25:19.903905+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:09:02.693526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"30'18","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:29.969638+0000","last_change":"2024-01-23T09:25:29.969701+0000","last_active":"2024-01-23T09:25:29.969638+0000","last_peered":"2024-01-23T09:25:29.969638+0000","last_clean":"2024-01-23T09:25:29.969638+0000","last_became_active":"2024-01-23T08:54:42.195743+0000","last_became_peered":"2024-01-23T08:54:42.195743+0000","last_unstale":"2024-01-23T09:25:29.969638+0000","last_undegraded":"2024-01-23T09:25:29.969638+0000","last_fullsized":"2024-01-23T09:25:29.969638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'18","last_scrub_stamp":"2024-01-23T09:25:29.969472+0000","last_deep_scrub":"30'18","last_deep_scrub_stamp":"2024-01-23T09:25:29.969472+0000","last_clean_scrub_stamp":"2024-01-23T09:25:29.969472+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:48:38.048357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"30'24","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:22.229426+0000","last_change":"2024-01-23T09:25:22.229485+0000","last_active":"2024-01-23T09:25:22.229426+0000","last_peered":"2024-01-23T09:25:22.229426+0000","last_clean":"2024-01-23T09:25:22.229426+0000","last_became_active":"2024-01-23T08:54:42.194846+0000","last_became_peered":"2024-01-23T08:54:42.194846+0000","last_unstale":"2024-01-23T09:25:22.229426+0000","last_undegraded":"2024-01-23T09:25:22.229426+0000","last_fullsized":"2024-01-23T09:25:22.229426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2024-01-23T09:25:22.229271+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2024-01-23T09:25:22.229271+0000","last_clean_scrub_stamp":"2024-01-23T09:25:22.229271+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:29:21.231768+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"30'23","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:26.004575+0000","last_change":"2024-01-23T09:25:26.004695+0000","last_active":"2024-01-23T09:25:26.004575+0000","last_peered":"2024-01-23T09:25:26.004575+0000","last_clean":"2024-01-23T09:25:26.004575+0000","last_became_active":"2024-01-23T08:54:42.117735+0000","last_became_peered":"2024-01-23T08:54:42.117735+0000","last_unstale":"2024-01-23T09:25:26.004575+0000","last_undegraded":"2024-01-23T09:25:26.004575+0000","last_fullsized":"2024-01-23T09:25:26.004575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'23","last_scrub_stamp":"2024-01-23T09:25:26.004385+0000","last_deep_scrub":"30'23","last_deep_scrub_stamp":"2024-01-23T09:25:26.004385+0000","last_clean_scrub_stamp":"2024-01-23T09:25:26.004385+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:14:12.280107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"30'16","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:21.201977+0000","last_change":"2024-01-23T09:25:21.202008+0000","last_active":"2024-01-23T09:25:21.201977+0000","last_peered":"2024-01-23T09:25:21.201977+0000","last_clean":"2024-01-23T09:25:21.201977+0000","last_became_active":"2024-01-23T08:54:42.194331+0000","last_became_peered":"2024-01-23T08:54:42.194331+0000","last_unstale":"2024-01-23T09:25:21.201977+0000","last_undegraded":"2024-01-23T09:25:21.201977+0000","last_fullsized":"2024-01-23T09:25:21.201977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'16","last_scrub_stamp":"2024-01-23T09:25:21.201892+0000","last_deep_scrub":"30'16","last_deep_scrub_stamp":"2024-01-23T09:25:21.201892+0000","last_clean_scrub_stamp":"2024-01-23T09:25:21.201892+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:35:54.011678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"30'25","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:32.783834+0000","last_change":"2024-01-23T09:25:32.783834+0000","last_active":"2024-01-23T09:25:32.783834+0000","last_peered":"2024-01-23T09:25:32.783834+0000","last_clean":"2024-01-23T09:25:32.783834+0000","last_became_active":"2024-01-23T08:54:42.196391+0000","last_became_peered":"2024-01-23T08:54:42.196391+0000","last_unstale":"2024-01-23T09:25:32.783834+0000","last_undegraded":"2024-01-23T09:25:32.783834+0000","last_fullsized":"2024-01-23T09:25:32.783834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2024-01-23T09:25:32.783610+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2024-01-23T09:25:32.783610+0000","last_clean_scrub_stamp":"2024-01-23T09:25:32.783610+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:00:48.547158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"30'18","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:33.815889+0000","last_change":"2024-01-23T09:25:33.815889+0000","last_active":"2024-01-23T09:25:33.815889+0000","last_peered":"2024-01-23T09:25:33.815889+0000","last_clean":"2024-01-23T09:25:33.815889+0000","last_became_active":"2024-01-23T08:54:42.229220+0000","last_became_peered":"2024-01-23T08:54:42.229220+0000","last_unstale":"2024-01-23T09:25:33.815889+0000","last_undegraded":"2024-01-23T09:25:33.815889+0000","last_fullsized":"2024-01-23T09:25:33.815889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'18","last_scrub_stamp":"2024-01-23T09:25:33.815658+0000","last_deep_scrub":"30'18","last_deep_scrub_stamp":"2024-01-23T09:25:33.815658+0000","last_clean_scrub_stamp":"2024-01-23T09:25:33.815658+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:15:51.921553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"30'24","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-01-23T09:25:26.960771+0000","last_change":"2024-01-23T09:25:26.960771+0000","last_active":"2024-01-23T09:25:26.960771+0000","last_peered":"2024-01-23T09:25:26.960771+0000","last_clean":"2024-01-23T09:25:26.960771+0000","last_became_active":"2024-01-23T08:54:42.118233+0000","last_became_peered":"2024-01-23T08:54:42.118233+0000","last_unstale":"2024-01-23T09:25:26.960771+0000","last_undegraded":"2024-01-23T09:25:26.960771+0000","last_fullsized":"2024-01-23T09:25:26.960771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2024-01-23T09:25:26.960547+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2024-01-23T09:25:26.960547+0000","last_clean_scrub_stamp":"2024-01-23T09:25:26.960547+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:24:46.046056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2304,"num_write_kb":252373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2476,"ondisk_log_size":2476,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1536,"ondisk_log_size":1536,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":23189121,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":519,"num_read_kb":542,"num_write":5371,"num_write_kb":25642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":46628864,"data_stored":46378242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4987,"ondisk_log_size":4987,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509829,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29528,"kb_used_data":2512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342312,"statfs":{"total":96636764160,"available":96606527488,"internally_reserved":0,"allocated":2572288,"data_stored":2340721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.89200000000000002,"15min":0.88200000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.46100000000000002},"max":{"1min":1.4039999999999999,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.93500000000000005,"15min":0.91400000000000003},"min":{"1min":0.61799999999999999,"5min":0.56599999999999995,"15min":0.46300000000000002},"max":{"1min":1.3999999999999999,"5min":1.456,"15min":1.456},"last":1.252}]},{"osd":1,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.97599999999999998,"15min":0.95499999999999996},"min":{"1min":0.66100000000000003,"5min":0.52900000000000003,"15min":0.49399999999999999},"max":{"1min":1.419,"5min":1.425,"15min":1.754},"last":1.2889999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.97499999999999998,"15min":0.97299999999999998},"min":{"1min":0.67900000000000005,"5min":0.54400000000000004,"15min":0.51900000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.597},"last":0.76700000000000002}]},{"osd":2,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.96999999999999997,"15min":0.93400000000000005},"min":{"1min":0.66700000000000004,"5min":0.53000000000000003,"15min":0.47099999999999997},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.871},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0369999999999999,"15min":1.014},"min":{"1min":0.73599999999999999,"5min":0.59999999999999998,"15min":0.55000000000000004},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.1459999999999999}]},{"osd":3,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0069999999999999,"15min":0.99099999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.7190000000000001},"last":1.202},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.052,"15min":1.073},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57099999999999995},"max":{"1min":1.587,"5min":1.587,"15min":1.889},"last":1.014}]},{"osd":4,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":0.97099999999999997,"15min":0.97199999999999998},"min":{"1min":0.68200000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.645},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.99199999999999999,"15min":0.98999999999999999},"min":{"1min":0.60699999999999998,"5min":0.48899999999999999,"15min":0.46800000000000003},"max":{"1min":1.4259999999999999,"5min":1.621,"15min":1.982},"last":1.048}]},{"osd":5,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0760000000000001,"15min":1.0820000000000001},"min":{"1min":0.71099999999999997,"5min":0.63,"15min":0.57299999999999995},"max":{"1min":1.4570000000000001,"5min":1.613,"15min":1.9710000000000001},"last":1.347},{"interface":"front","average":{"1min":1.115,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.72299999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.8260000000000001},"last":0.96599999999999997}]},{"osd":6,"last update":"Tue Jan 23 09:25:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.147,"15min":1.1399999999999999},"min":{"1min":0.86499999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.613,"5min":1.613,"15min":1.9399999999999999},"last":1.111},{"interface":"front","average":{"1min":1.123,"5min":1.131,"15min":1.1319999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.752,"5min":1.752,"15min":1.883},"last":1.321}]}]},{"osd":5,"up_from":15,"seq":64424509828,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38352,"kb_used_data":7176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333488,"statfs":{"total":96636764160,"available":96597491712,"internally_reserved":0,"allocated":7348224,"data_stored":7125746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.89300000000000002,"15min":0.88200000000000001},"min":{"1min":0.62,"5min":0.54300000000000004,"15min":0.501},"max":{"1min":1.212,"5min":1.296,"15min":1.5269999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.98799999999999999,"15min":0.98099999999999998},"min":{"1min":0.59099999999999997,"5min":0.58899999999999997,"15min":0.53100000000000003},"max":{"1min":1.276,"5min":1.552,"15min":1.552},"last":0.96999999999999997}]},{"osd":1,"last update":"Tue Jan 23 09:25:12 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.97999999999999998,"15min":0.96299999999999997},"min":{"1min":0.58799999999999997,"5min":0.51600000000000001,"15min":0.498},"max":{"1min":1.2889999999999999,"5min":1.4019999999999999,"15min":1.413},"last":1.3260000000000001},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.96199999999999997,"15min":0.93899999999999995},"min":{"1min":0.65700000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2729999999999999,"5min":1.292,"15min":1.542},"last":0.752}]},{"osd":2,"last update":"Tue Jan 23 09:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.93899999999999995,"15min":0.91400000000000003},"min":{"1min":0.65900000000000003,"5min":0.58599999999999997,"15min":0.51100000000000001},"max":{"1min":1.3700000000000001,"5min":1.421,"15min":1.46},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0369999999999999,"15min":1.0189999999999999},"min":{"1min":0.69699999999999995,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.0289999999999999}]},{"osd":3,"last update":"Tue Jan 23 09:25:12 2024","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.036,"15min":1.034},"min":{"1min":0.76100000000000001,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3220000000000001,"5min":1.431,"15min":1.677},"last":1.079},{"interface":"front","average":{"1min":1.133,"5min":1.0880000000000001,"15min":1.0529999999999999},"min":{"1min":0.86399999999999999,"5min":0.76100000000000001,"15min":0.49199999999999999},"max":{"1min":1.4670000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.1759999999999999}]},{"osd":4,"last update":"Tue Jan 23 09:25:12 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.98199999999999998,"15min":0.99199999999999999},"min":{"1min":0.65500000000000003,"5min":0.61799999999999999,"15min":0.48599999999999999},"max":{"1min":1.3300000000000001,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.073,"5min":1.0209999999999999,"15min":1.01},"min":{"1min":0.64700000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.4490000000000001,"5min":1.468,"15min":1.468},"last":1.125}]},{"osd":6,"last update":"Tue Jan 23 09:25:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.0509999999999999,"15min":1.048},"min":{"1min":0.73799999999999999,"5min":0.65900000000000003,"15min":0.55300000000000005},"max":{"1min":1.3799999999999999,"5min":1.4690000000000001,"15min":1.823},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.123,"15min":1.1120000000000001},"min":{"1min":0.91700000000000004,"5min":0.72299999999999998,"15min":0.42599999999999999},"max":{"1min":1.4610000000000001,"5min":1.4930000000000001,"15min":1.641},"last":1.365}]},{"osd":7,"last update":"Tue Jan 23 09:25:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.121,"15min":1.1399999999999999},"min":{"1min":0.71899999999999997,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.4139999999999999,"5min":1.518,"15min":1.919},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.294,"5min":1.1879999999999999,"15min":1.175},"min":{"1min":0.874,"5min":0.76500000000000001,"15min":0.67800000000000005},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.637},"last":1.292}]}]},{"osd":4,"up_from":15,"seq":64424509827,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39732,"kb_used_data":8556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332108,"statfs":{"total":96636764160,"available":96596078592,"internally_reserved":0,"allocated":8761344,"data_stored":8522021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.92400000000000004,"15min":0.91300000000000003},"min":{"1min":0.56599999999999995,"5min":0.50700000000000001,"15min":0.46600000000000003},"max":{"1min":1.3129999999999999,"5min":1.3799999999999999,"15min":1.583},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.95499999999999996,"15min":0.91800000000000004},"min":{"1min":0.60499999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.282,"5min":1.329,"15min":1.5629999999999999},"last":1.224}]},{"osd":1,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.97699999999999998,"15min":0.93000000000000005},"min":{"1min":0.74099999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3640000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.94099999999999995,"15min":0.95299999999999996},"min":{"1min":0.66100000000000003,"5min":0.59999999999999998,"15min":0.5},"max":{"1min":1.232,"5min":1.415,"15min":1.415},"last":1.341}]},{"osd":2,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.96099999999999997,"15min":0.93700000000000006},"min":{"1min":0.625,"5min":0.56599999999999995,"15min":0.54000000000000004},"max":{"1min":1.3460000000000001,"5min":1.387,"15min":1.387},"last":0.96799999999999997},{"interface":"front","average":{"1min":1,"5min":1.0589999999999999,"15min":1.0329999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.498},"max":{"1min":1.296,"5min":1.411,"15min":1.736},"last":1.1850000000000001}]},{"osd":3,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0009999999999999,"15min":0.98199999999999998},"min":{"1min":0.70199999999999996,"5min":0.58899999999999997,"15min":0.55300000000000005},"max":{"1min":1.3720000000000001,"5min":1.3779999999999999,"15min":1.7509999999999999},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.0840000000000001,"15min":1.0680000000000001},"min":{"1min":0.78800000000000003,"5min":0.77100000000000002,"15min":0.60799999999999998},"max":{"1min":1.349,"5min":1.3859999999999999,"15min":1.482},"last":1.3640000000000001}]},{"osd":5,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.96599999999999997,"15min":0.98299999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3100000000000001,"5min":1.5549999999999999,"15min":1.643},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.98699999999999999,"15min":0.98899999999999999},"min":{"1min":0.64300000000000002,"5min":0.57999999999999996,"15min":0.52300000000000002},"max":{"1min":1.417,"5min":1.4330000000000001,"15min":1.986},"last":1.1339999999999999}]},{"osd":6,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.0289999999999999,"15min":1.0309999999999999},"min":{"1min":0.64900000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.4279999999999999,"5min":1.446,"15min":1.825},"last":1.256},{"interface":"front","average":{"1min":1.139,"5min":1.1160000000000001,"15min":1.1180000000000001},"min":{"1min":0.86599999999999999,"5min":0.77000000000000002,"15min":0.45700000000000002},"max":{"1min":1.373,"5min":1.5049999999999999,"15min":1.7749999999999999},"last":0.995}]},{"osd":7,"last update":"Tue Jan 23 09:25:05 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.0549999999999999,"15min":1.0629999999999999},"min":{"1min":0.72999999999999998,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.573,"5min":1.573,"15min":1.673},"last":1.29},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.1950000000000001,"15min":1.173},"min":{"1min":0.94399999999999995,"5min":0.71099999999999997,"15min":0.69399999999999995},"max":{"1min":1.4850000000000001,"5min":1.5369999999999999,"15min":1.5629999999999999},"last":1.3149999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509829,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39696,"kb_used_data":8520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332144,"statfs":{"total":96636764160,"available":96596115456,"internally_reserved":0,"allocated":8724480,"data_stored":8520251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.74299999999999999,"15min":0.72899999999999998},"min":{"1min":0.44600000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.1890000000000001,"5min":1.528,"15min":1.5820000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.877,"15min":0.82499999999999996},"min":{"1min":0.54000000000000004,"5min":0.40200000000000002,"15min":0.248},"max":{"1min":1.534,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":1.113}]},{"osd":1,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90800000000000003,"15min":0.88900000000000001},"min":{"1min":0.51900000000000002,"5min":0.42799999999999999,"15min":0.376},"max":{"1min":1.401,"5min":1.974,"15min":1.974},"last":1.2589999999999999},{"interface":"front","average":{"1min":0.995,"5min":0.89800000000000002,"15min":0.88600000000000001},"min":{"1min":0.61399999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.393,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":0.78100000000000003}]},{"osd":3,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.86299999999999999,"15min":0.85199999999999998},"min":{"1min":0.55800000000000005,"5min":0.36499999999999999,"15min":0.36199999999999999},"max":{"1min":1.7310000000000001,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":1},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0549999999999999,"15min":1.0109999999999999},"min":{"1min":0.67100000000000004,"5min":0.38,"15min":0.38},"max":{"1min":1.591,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.0609999999999999}]},{"osd":4,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.1499999999999999,"15min":1.123},"min":{"1min":0.78900000000000003,"5min":0.59699999999999998,"15min":0.55000000000000004},"max":{"1min":1.446,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.496},{"interface":"front","average":{"1min":1.23,"5min":1.1559999999999999,"15min":1.153},"min":{"1min":0.82499999999999996,"5min":0.61599999999999999,"15min":0.60399999999999998},"max":{"1min":1.754,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.2290000000000001}]},{"osd":5,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1020000000000001,"15min":1.091},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53700000000000003},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.9379999999999999},"last":1.163},{"interface":"front","average":{"1min":1.26,"5min":1.2430000000000001,"15min":1.2130000000000001},"min":{"1min":0.79300000000000004,"5min":0.68899999999999995,"15min":0.624},"max":{"1min":1.681,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.605}]},{"osd":6,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.202,"15min":1.198},"min":{"1min":0.71499999999999997,"5min":0.60899999999999999,"15min":0.59499999999999997},"max":{"1min":1.796,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.546},{"interface":"front","average":{"1min":1.2,"5min":1.1919999999999999,"15min":1.175},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.577,"5min":1.6519999999999999,"15min":1.843},"last":1.3540000000000001}]},{"osd":7,"last update":"Tue Jan 23 09:24:59 2024","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.2849999999999999,"15min":1.262},"min":{"1min":0.79600000000000004,"5min":0.77100000000000002,"15min":0.59499999999999997},"max":{"1min":2,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.26,"15min":1.2370000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.454}]}]},{"osd":1,"up_from":15,"seq":64424509828,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":933888,"data_stored":722685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73599999999999999,"15min":0.72899999999999998},"min":{"1min":0.52100000000000002,"5min":0.36599999999999999,"15min":0.28599999999999998},"max":{"1min":1.107,"5min":1.371,"15min":1.681},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82899999999999996,"15min":0.80500000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.36399999999999999},"max":{"1min":1.2270000000000001,"5min":1.5569999999999999,"15min":2.0049999999999999},"last":0.92500000000000004}]},{"osd":2,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77600000000000002,"15min":0.73399999999999999},"min":{"1min":0.55900000000000005,"5min":0.46600000000000003,"15min":0.375},"max":{"1min":1.218,"5min":1.262,"15min":1.5960000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.96599999999999997,"15min":0.92600000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.30499999999999999},"max":{"1min":1.367,"5min":1.4470000000000001,"15min":1.6919999999999999},"last":0.81000000000000005}]},{"osd":3,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.97099999999999997,"15min":0.93200000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.40400000000000003},"max":{"1min":1.4099999999999999,"5min":1.569,"15min":1.8069999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.97899999999999998,"15min":0.96299999999999997},"min":{"1min":0.53300000000000003,"5min":0.51200000000000001,"15min":0.35599999999999998},"max":{"1min":1.3680000000000001,"5min":1.657,"15min":2.1589999999999998},"last":0.67900000000000005}]},{"osd":4,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0840000000000001,"15min":1.077},"min":{"1min":0.80800000000000005,"5min":0.65900000000000003,"15min":0.54300000000000004},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6799999999999999},"last":1.077},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2090000000000001,"15min":1.1759999999999999},"min":{"1min":0.80800000000000005,"5min":0.64000000000000001,"15min":0.50600000000000001},"max":{"1min":1.736,"5min":1.736,"15min":2.2450000000000001},"last":0.95799999999999996}]},{"osd":5,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.1850000000000001,"15min":1.1699999999999999},"min":{"1min":0.83799999999999997,"5min":0.73899999999999999,"15min":0.63},"max":{"1min":1.7829999999999999,"5min":1.8260000000000001,"15min":2.1110000000000002},"last":1.288},{"interface":"front","average":{"1min":1.232,"5min":1.1990000000000001,"15min":1.1619999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.66200000000000003},"max":{"1min":1.538,"5min":1.802,"15min":1.802},"last":0.99399999999999999}]},{"osd":6,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.254,"15min":1.236},"min":{"1min":0.79400000000000004,"5min":0.77300000000000002,"15min":0.58699999999999997},"max":{"1min":1.6779999999999999,"5min":1.829,"15min":2.2000000000000002},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2350000000000001,"15min":1.2050000000000001},"min":{"1min":0.82699999999999996,"5min":0.76100000000000001,"15min":0.66700000000000004},"max":{"1min":1.631,"5min":1.857,"15min":1.857},"last":1.2450000000000001}]},{"osd":7,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.306,"15min":1.282},"min":{"1min":0.84999999999999998,"5min":0.77600000000000002,"15min":0.65500000000000003},"max":{"1min":1.6259999999999999,"5min":1.913,"15min":2.1110000000000002},"last":1.222},{"interface":"front","average":{"1min":1.28,"5min":1.3029999999999999,"15min":1.286},"min":{"1min":0.96799999999999997,"5min":0.90800000000000003,"15min":0.72099999999999997},"max":{"1min":1.883,"5min":1.9279999999999999,"15min":2.238},"last":1.351}]}]},{"osd":0,"up_from":15,"seq":64424509828,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":4444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":4550656,"data_stored":4328911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 23 09:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":0.81299999999999994,"15min":0.747},"min":{"1min":0.39300000000000002,"5min":0.32800000000000001,"15min":0.29499999999999998},"max":{"1min":9.5459999999999994,"5min":9.5459999999999994,"15min":9.5459999999999994},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.85099999999999998,"15min":0.83999999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.26500000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":2.21},"last":0.748}]},{"osd":2,"last update":"Tue Jan 23 09:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.86599999999999999,"15min":0.80500000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.312},"max":{"1min":5.5199999999999996,"5min":5.5199999999999996,"15min":5.5199999999999996},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.91500000000000004,"15min":0.89700000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.40400000000000003},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":2.1440000000000001},"last":1.071}]},{"osd":3,"last update":"Tue Jan 23 09:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.002,"15min":0.93899999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.32200000000000001},"max":{"1min":9.6470000000000002,"5min":9.6470000000000002,"15min":9.6470000000000002},"last":0.69299999999999995},{"interface":"front","average":{"1min":3.391,"5min":1.4690000000000001,"15min":1.1040000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":42.942,"5min":42.942,"15min":42.942},"last":0.92400000000000004}]},{"osd":4,"last update":"Tue Jan 23 09:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.1060000000000001,"15min":1.1020000000000001},"min":{"1min":0.64800000000000002,"5min":0.51900000000000002,"15min":0.47299999999999998},"max":{"1min":1.407,"5min":1.8979999999999999,"15min":2.3050000000000002},"last":1.228},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.1739999999999999,"15min":1.151},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.6619999999999999,"5min":3.6619999999999999,"15min":3.6619999999999999},"last":1.1799999999999999}]},{"osd":5,"last update":"Tue Jan 23 09:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.1830000000000001,"15min":1.137},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.5},"max":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.23,"5min":1.244,"15min":1.2350000000000001},"min":{"1min":0.77000000000000002,"5min":0.67900000000000005,"15min":0.51700000000000002},"max":{"1min":1.76,"5min":1.8460000000000001,"15min":2.1080000000000001},"last":1.3660000000000001}]},{"osd":6,"last update":"Tue Jan 23 09:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.258,"15min":1.2390000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.59599999999999997},"max":{"1min":3.5609999999999999,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.25,"15min":1.2270000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":1.4379999999999999}]},{"osd":7,"last update":"Tue Jan 23 09:25:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2909999999999999,"15min":1.298},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.54400000000000004},"max":{"1min":1.8879999999999999,"5min":1.98,"15min":2.2160000000000002},"last":1.488},{"interface":"front","average":{"1min":1.425,"5min":1.3460000000000001,"15min":1.306},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.57699999999999996},"max":{"1min":4.3330000000000002,"5min":4.3330000000000002,"15min":4.3330000000000002},"last":1.401}]}]},{"osd":3,"up_from":15,"seq":64424509830,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47980,"kb_used_data":12644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323860,"statfs":{"total":96636764160,"available":96587632640,"internally_reserved":0,"allocated":12947456,"data_stored":12717118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.75800000000000001,"15min":0.73799999999999999},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.2150000000000001,"5min":1.387,"15min":1.514},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.77500000000000002,"15min":0.748},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.0489999999999999,"5min":1.2450000000000001,"15min":1.641},"last":0.59899999999999998}]},{"osd":1,"last update":"Tue Jan 23 09:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.83499999999999996,"15min":0.79700000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.309},"max":{"1min":1.177,"5min":1.782,"15min":1.782},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.95699999999999996,"15min":0.90100000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.32900000000000001},"max":{"1min":1.0549999999999999,"5min":2.698,"15min":2.698},"last":0.81499999999999995}]},{"osd":2,"last update":"Tue Jan 23 09:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.94699999999999995,"15min":0.91100000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.145,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":0.89700000000000002,"5min":1.018,"15min":0.96199999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.312},"max":{"1min":1.341,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":1}]},{"osd":4,"last update":"Tue Jan 23 09:25:50 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.071,"15min":1.0669999999999999},"min":{"1min":0.74099999999999999,"5min":0.624,"15min":0.58999999999999997},"max":{"1min":1.3979999999999999,"5min":1.53,"15min":1.736},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.032,"5min":1.1319999999999999,"15min":1.0980000000000001},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.499},"max":{"1min":1.504,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":0.94499999999999995}]},{"osd":5,"last update":"Tue Jan 23 09:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.1799999999999999,"15min":1.1499999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.51800000000000002},"max":{"1min":1.4419999999999999,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.2789999999999999,"15min":1.2330000000000001},"min":{"1min":0.72699999999999998,"5min":0.69399999999999995,"15min":0.47999999999999998},"max":{"1min":1.651,"5min":2.794,"15min":2.794},"last":1.534}]},{"osd":6,"last update":"Tue Jan 23 09:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.3029999999999999,"15min":1.2569999999999999},"min":{"1min":0.80900000000000005,"5min":0.79600000000000004,"15min":0.61399999999999999},"max":{"1min":1.591,"5min":2.8730000000000002,"15min":2.8730000000000002},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1879999999999999,"15min":1.1839999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.60699999999999998},"max":{"1min":1.585,"5min":1.5880000000000001,"15min":2.3170000000000002},"last":1.0589999999999999}]},{"osd":7,"last update":"Tue Jan 23 09:25:50 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.2569999999999999,"15min":1.22},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.68000000000000005},"max":{"1min":1.474,"5min":1.6279999999999999,"15min":2.1960000000000002},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.2789999999999999,"15min":1.256},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5800000000000001,"5min":1.9330000000000001,"15min":2.0910000000000002},"last":1.129}]}]},{"osd":6,"up_from":14,"seq":60129542533,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48084,"kb_used_data":4428,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94323756,"statfs":{"total":96636764160,"available":96587526144,"internally_reserved":0,"allocated":4534272,"data_stored":4328749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.879,"15min":0.874},"min":{"1min":0.53500000000000003,"5min":0.48099999999999998,"15min":0.44},"max":{"1min":1.2969999999999999,"5min":1.3520000000000001,"15min":1.4199999999999999},"last":1.2070000000000001},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.91600000000000004,"15min":0.90200000000000002},"min":{"1min":0.67400000000000004,"5min":0.501,"15min":0.39600000000000002},"max":{"1min":1.4079999999999999,"5min":1.575,"15min":1.575},"last":0.745}]},{"osd":1,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.96899999999999997,"15min":0.93700000000000006},"min":{"1min":0.79200000000000004,"5min":0.58899999999999997,"15min":0.55000000000000004},"max":{"1min":1.3089999999999999,"5min":1.3169999999999999,"15min":1.3400000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.995,"5min":1.032,"15min":0.98599999999999999},"min":{"1min":0.70199999999999996,"5min":0.67800000000000005,"15min":0.48399999999999999},"max":{"1min":1.2250000000000001,"5min":1.5209999999999999,"15min":1.548},"last":1.1579999999999999}]},{"osd":2,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.92300000000000004,"15min":0.92000000000000004},"min":{"1min":0.58699999999999997,"5min":0.502,"15min":0.502},"max":{"1min":1.3460000000000001,"5min":1.484,"15min":2.1219999999999999},"last":1.254},{"interface":"front","average":{"1min":1,"5min":0.95099999999999996,"15min":0.93400000000000005},"min":{"1min":0.63,"5min":0.58599999999999997,"15min":0.46700000000000003},"max":{"1min":1.377,"5min":1.377,"15min":1.429},"last":0.64300000000000002}]},{"osd":3,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.032,"15min":1.0429999999999999},"min":{"1min":0.72399999999999998,"5min":0.72099999999999997,"15min":0.625},"max":{"1min":1.3460000000000001,"5min":1.4390000000000001,"15min":1.4850000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.081,"5min":1.0309999999999999,"15min":1.0249999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.53900000000000003},"max":{"1min":1.2949999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.93100000000000005}]},{"osd":4,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.94999999999999996,"15min":0.95499999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4299999999999999,"5min":1.4419999999999999,"15min":1.518},"last":1.014},{"interface":"front","average":{"1min":1.145,"5min":1.103,"15min":1.1020000000000001},"min":{"1min":0.73399999999999999,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.89300000000000002}]},{"osd":5,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.96099999999999997,"15min":0.95799999999999996},"min":{"1min":0.59999999999999998,"5min":0.54200000000000004,"15min":0.497},"max":{"1min":1.718,"5min":1.718,"15min":1.734},"last":0.58699999999999997},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.147,"15min":1.1399999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.4419999999999999,"5min":1.601,"15min":2.278},"last":1.109}]},{"osd":7,"last update":"Tue Jan 23 09:25:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0600000000000001,"15min":1.048},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.53900000000000003},"max":{"1min":1.4810000000000001,"5min":1.659,"15min":1.659},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.0940000000000001,"15min":1.0800000000000001},"min":{"1min":0.80400000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.657,"5min":1.657,"15min":1.6599999999999999},"last":0.76900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4231168,"data_stored":4198008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12627968,"data_stored":12586215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8441856,"data_stored":8391118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6434816,"data_stored":6404475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4214784,"data_stored":4197846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2252800,"data_stored":2209818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-23T09:26:04.066 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-01-23T09:26:04.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.229+0000 7f5d5bb04640 1 Processor -- start 2024-01-23T09:26:04.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.229+0000 7f5d5bb04640 1 -- start start 2024-01-23T09:26:04.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.229+0000 7f5d5bb04640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d540c2d90 0x7f5d540c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:04.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.229+0000 7f5d5bb04640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d5415e8c0 con 0x7f5d54157ec0 2024-01-23T09:26:04.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.229+0000 7f5d5bb04640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d5415dcb0 con 0x7f5d5406c2a0 2024-01-23T09:26:04.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.229+0000 7f5d5bb04640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d540c24d0 con 0x7f5d540c2d90 2024-01-23T09:26:04.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.229+0000 7f5d598a0640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5d54157ec0 0x7f5d540ccd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44292/0 (socket says 172.21.15.46:44292) 2024-01-23T09:26:04.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.229+0000 7f5d598a0640 1 -- 172.21.15.46:0/2125084555 learned_addr learned my addr 172.21.15.46:0/2125084555 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T09:26:04.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.233+0000 7f5d5889e640 1 -- 172.21.15.46:0/2125084555 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 799470364 0 0) 0x7f5d5415e8c0 con 0x7f5d54157ec0 2024-01-23T09:26:04.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.233+0000 7f5d5889e640 1 -- 172.21.15.46:0/2125084555 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d40003530 con 0x7f5d54157ec0 2024-01-23T09:26:04.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.237+0000 7f5d5889e640 1 -- 172.21.15.46:0/2125084555 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 62131515 0 0) 0x7f5d40003530 con 0x7f5d54157ec0 2024-01-23T09:26:04.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.237+0000 7f5d5889e640 1 -- 172.21.15.46:0/2125084555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d540c2d90 msgr2=0x7f5d540c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:26:04.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.237+0000 7f5d5889e640 1 --2- 172.21.15.46:0/2125084555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d540c2d90 0x7f5d540c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:04.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.237+0000 7f5d5889e640 1 -- 172.21.15.46:0/2125084555 >> v1:172.21.15.175:6789/0 conn(0x7f5d5406c2a0 legacy=0x7f5d5406c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:26:04.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.237+0000 7f5d5889e640 1 -- 172.21.15.46:0/2125084555 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5415df90 con 0x7f5d54157ec0 2024-01-23T09:26:04.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.237+0000 7f5d5889e640 1 -- 172.21.15.46:0/2125084555 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466917103 0 0) 0x7f5d4c001a00 con 0x7f5d54157ec0 2024-01-23T09:26:04.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.237+0000 7f5d5889e640 1 -- 172.21.15.46:0/2125084555 >> v1:172.21.15.46:6789/0 conn(0x7f5d54157ec0 legacy=0x7f5d540ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:04.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.237+0000 7f5d5889e640 1 --2- 172.21.15.46:0/2125084555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d40003a20 0x7f5d40003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:04.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.237+0000 7f5d5889e640 1 --2- 172.21.15.46:0/2125084555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d540c2d90 0x7f5d400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:04.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.237+0000 7f5d5889e640 1 --2- 172.21.15.46:0/2125084555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d40004e30 0x7f5d4000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:04.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.237+0000 7f5d5889e640 1 -- 172.21.15.46:0/2125084555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d400055b0 con 0x7f5d40004e30 2024-01-23T09:26:04.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.237+0000 7f5d5889e640 1 -- 172.21.15.46:0/2125084555 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4000bed0 con 0x7f5d40003a20 2024-01-23T09:26:04.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.237+0000 7f5d5889e640 1 -- 172.21.15.46:0/2125084555 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4000c010 con 0x7f5d540c2d90 2024-01-23T09:26:04.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.245+0000 7f5d5a0a1640 1 --2- 172.21.15.46:0/2125084555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d40004e30 0x7f5d4000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:04.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.249+0000 7f5d5a0a1640 1 -- 172.21.15.46:0/2125084555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d540c2d90 msgr2=0x7f5d400047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:26:04.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.249+0000 7f5d5a0a1640 1 --2- 172.21.15.46:0/2125084555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d540c2d90 0x7f5d400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:04.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.249+0000 7f5d5a0a1640 1 -- 172.21.15.46:0/2125084555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d40003a20 msgr2=0x7f5d40003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:26:04.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.249+0000 7f5d5a0a1640 1 --2- 172.21.15.46:0/2125084555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d40003a20 0x7f5d40003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:04.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.249+0000 7f5d5a0a1640 1 -- 172.21.15.46:0/2125084555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d40003530 con 0x7f5d40004e30 2024-01-23T09:26:04.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.253+0000 7f5d5a0a1640 1 --2- 172.21.15.46:0/2125084555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d40004e30 0x7f5d4000b990 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5d500098c0 tx=0x7f5d5001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a06985946028c7 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:04.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.257+0000 7f5d5889e640 1 -- 172.21.15.46:0/2125084555 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d500ab600 con 0x7f5d40004e30 2024-01-23T09:26:04.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.257+0000 7f5d5889e640 1 -- 172.21.15.46:0/2125084555 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d500a7050 con 0x7f5d40004e30 2024-01-23T09:26:04.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.257+0000 7f5d5889e640 1 -- 172.21.15.46:0/2125084555 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d500aba00 con 0x7f5d40004e30 2024-01-23T09:26:04.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.257+0000 7f5d5bb04640 1 -- 172.21.15.46:0/2125084555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d40004e30 msgr2=0x7f5d4000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:04.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.257+0000 7f5d5bb04640 1 --2- 172.21.15.46:0/2125084555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d40004e30 0x7f5d4000b990 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5d500098c0 tx=0x7f5d5001c380 comp rx=0 tx=0).stop 2024-01-23T09:26:04.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.257+0000 7f5d5a0a1640 1 -- 172.21.15.46:0/2125084555 reap_dead start 2024-01-23T09:26:04.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.257+0000 7f5d5bb04640 1 -- 172.21.15.46:0/2125084555 shutdown_connections 2024-01-23T09:26:04.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.257+0000 7f5d5bb04640 1 -- 172.21.15.46:0/2125084555 >> 172.21.15.46:0/2125084555 conn(0x7f5d5406a660 msgr2=0x7f5d5406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:26:04.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.257+0000 7f5d5bb04640 1 -- 172.21.15.46:0/2125084555 shutdown_connections 2024-01-23T09:26:04.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.257+0000 7f5d5bb04640 1 -- 172.21.15.46:0/2125084555 wait complete. 2024-01-23T09:26:04.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.261+0000 7f5d5bb04640 1 Processor -- start 2024-01-23T09:26:04.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.261+0000 7f5d5bb04640 1 -- start start 2024-01-23T09:26:04.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.261+0000 7f5d5bb04640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d54159400 0x7f5d541597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:04.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.261+0000 7f5d5bb04640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d541582d0 0x7f5d541501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:04.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.261+0000 7f5d5bb04640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d54152b70 0x7f5d541506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:04.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.261+0000 7f5d5bb04640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d540c54f0 con 0x7f5d54159400 2024-01-23T09:26:04.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.261+0000 7f5d5bb04640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d54151020 con 0x7f5d541582d0 2024-01-23T09:26:04.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.261+0000 7f5d5bb04640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5415ab00 con 0x7f5d54152b70 2024-01-23T09:26:04.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.261+0000 7f5d598a0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d54159400 0x7f5d541597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:04.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.261+0000 7f5d598a0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d54159400 0x7f5d541597e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37214/0 (socket says 172.21.15.46:37214) 2024-01-23T09:26:04.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.261+0000 7f5d598a0640 1 -- 172.21.15.46:0/2875119567 learned_addr learned my addr 172.21.15.46:0/2875119567 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:26:04.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.265+0000 7f5d598a0640 1 -- 172.21.15.46:0/2875119567 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d54152b70 msgr2=0x7f5d541506e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:04.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.265+0000 7f5d598a0640 1 --2- 172.21.15.46:0/2875119567 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d54152b70 0x7f5d541506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:04.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.265+0000 7f5d598a0640 1 -- 172.21.15.46:0/2875119567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d541582d0 msgr2=0x7f5d541501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:04.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.265+0000 7f5d598a0640 1 --2- 172.21.15.46:0/2875119567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d541582d0 0x7f5d541501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:04.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.265+0000 7f5d598a0640 1 -- 172.21.15.46:0/2875119567 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d54159d20 con 0x7f5d54159400 2024-01-23T09:26:04.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.269+0000 7f5d598a0640 1 --2- 172.21.15.46:0/2875119567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d54159400 0x7f5d541597e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c0020a0 tx=0x7f5d4c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:04.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.273+0000 7f5d4a7fc640 1 -- 172.21.15.46:0/2875119567 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c0070d0 con 0x7f5d54159400 2024-01-23T09:26:04.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.273+0000 7f5d4a7fc640 1 -- 172.21.15.46:0/2875119567 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4c007230 con 0x7f5d54159400 2024-01-23T09:26:04.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.273+0000 7f5d5bb04640 1 -- 172.21.15.46:0/2875119567 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d5415ada0 con 0x7f5d54159400 2024-01-23T09:26:04.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.273+0000 7f5d4a7fc640 1 -- 172.21.15.46:0/2875119567 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c007600 con 0x7f5d54159400 2024-01-23T09:26:04.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.273+0000 7f5d5bb04640 1 -- 172.21.15.46:0/2875119567 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d54151270 con 0x7f5d54159400 2024-01-23T09:26:04.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.273+0000 7f5d5bb04640 1 -- 172.21.15.46:0/2875119567 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d54074340 con 0x7f5d54159400 2024-01-23T09:26:04.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.293+0000 7f5d4a7fc640 1 -- 172.21.15.46:0/2875119567 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5d4c007760 con 0x7f5d54159400 2024-01-23T09:26:04.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.293+0000 7f5d4a7fc640 1 --2- 172.21.15.46:0/2875119567 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5d38066580 0x7f5d38068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:04.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.293+0000 7f5d5909f640 1 --2- 172.21.15.46:0/2875119567 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5d38066580 0x7f5d38068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:04.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.297+0000 7f5d5909f640 1 --2- 172.21.15.46:0/2875119567 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5d38066580 0x7f5d38068a40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5d44007fd0 tx=0x7f5d440079a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:04.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.301+0000 7f5d4a7fc640 1 -- 172.21.15.46:0/2875119567 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f5d4c01ee50 con 0x7f5d54159400 2024-01-23T09:26:04.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.621+0000 7f5d4a7fc640 1 -- 172.21.15.46:0/2875119567 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5d4c051970 con 0x7f5d54159400 2024-01-23T09:26:04.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.801+0000 7f5d5bb04640 1 -- 172.21.15.46:0/2875119567 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f5d540b2ed0 con 0x7f5d54159400 2024-01-23T09:26:04.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.945+0000 7f5d4a7fc640 1 -- 172.21.15.46:0/2875119567 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f5d4c0180c0 con 0x7f5d54159400 2024-01-23T09:26:04.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.945+0000 7f5d4a7fc640 1 -- 172.21.15.46:0/2875119567 <== mon.0 v2:172.21.15.46:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5d4c0556b0 con 0x7f5d54159400 2024-01-23T09:26:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.949+0000 7f5d5bb04640 1 -- 172.21.15.46:0/2875119567 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5d38066580 msgr2=0x7f5d38068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.949+0000 7f5d5bb04640 1 --2- 172.21.15.46:0/2875119567 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5d38066580 0x7f5d38068a40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5d44007fd0 tx=0x7f5d440079a0 comp rx=0 tx=0).stop 2024-01-23T09:26:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.949+0000 7f5d5bb04640 1 -- 172.21.15.46:0/2875119567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d54159400 msgr2=0x7f5d541597e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.949+0000 7f5d5bb04640 1 --2- 172.21.15.46:0/2875119567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d54159400 0x7f5d541597e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c0020a0 tx=0x7f5d4c00a430 comp rx=0 tx=0).stop 2024-01-23T09:26:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.949+0000 7f5d5bb04640 1 -- 172.21.15.46:0/2875119567 shutdown_connections 2024-01-23T09:26:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.949+0000 7f5d5bb04640 1 --2- 172.21.15.46:0/2875119567 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d54152b70 0x7f5d541506e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.949+0000 7f5d5bb04640 1 --2- 172.21.15.46:0/2875119567 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5d38066580 0x7f5d38068a40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.949+0000 7f5d5bb04640 1 --2- 172.21.15.46:0/2875119567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d541582d0 0x7f5d541501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.949+0000 7f5d5bb04640 1 --2- 172.21.15.46:0/2875119567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d54159400 0x7f5d541597e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.949+0000 7f5d5bb04640 1 -- 172.21.15.46:0/2875119567 >> 172.21.15.46:0/2875119567 conn(0x7f5d5406a660 msgr2=0x7f5d5415c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:26:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.949+0000 7f5d5bb04640 1 -- 172.21.15.46:0/2875119567 shutdown_connections 2024-01-23T09:26:04.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:04.949+0000 7f5d5bb04640 1 -- 172.21.15.46:0/2875119567 wait complete. 2024-01-23T09:26:04.984 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-23T09:26:04.985 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-23T09:26:05.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.117+0000 7f6c02b10640 1 Processor -- start 2024-01-23T09:26:05.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.117+0000 7f6c02b10640 1 -- start start 2024-01-23T09:26:05.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.117+0000 7f6c02b10640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6bfc0c51e0 0x7f6bfc0c6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:05.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.117+0000 7f6c02b10640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6bfc0c55c0 0x7f6bfc0c2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:05.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.117+0000 7f6c02b10640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bfc156310 con 0x7f6bfc0c5e50 2024-01-23T09:26:05.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.117+0000 7f6c02b10640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bfc156f90 con 0x7f6bfc0c51e0 2024-01-23T09:26:05.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.117+0000 7f6c02b10640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bfc1565f0 con 0x7f6bfc0c55c0 2024-01-23T09:26:05.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.117+0000 7f6c008ac640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6bfc0c51e0 0x7f6bfc0c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:05.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.117+0000 7f6c008ac640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6bfc0c51e0 0x7f6bfc0c6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37222/0 (socket says 172.21.15.46:37222) 2024-01-23T09:26:05.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.117+0000 7f6c008ac640 1 -- 172.21.15.46:0/1523195035 learned_addr learned my addr 172.21.15.46:0/1523195035 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:26:05.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.121+0000 7f6c008ac640 1 -- 172.21.15.46:0/1523195035 >> v2:172.21.15.175:3300/0 conn(0x7f6bfc0c55c0 msgr2=0x7f6bfc0c2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:26:05.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.121+0000 7f6c008ac640 1 --2- 172.21.15.46:0/1523195035 >> v2:172.21.15.175:3300/0 conn(0x7f6bfc0c55c0 0x7f6bfc0c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:05.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.121+0000 7f6c008ac640 1 -- 172.21.15.46:0/1523195035 >> v1:172.21.15.175:6789/0 conn(0x7f6bfc0c5e50 legacy=0x7f6bfc14fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:26:05.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.121+0000 7f6c008ac640 1 -- 172.21.15.46:0/1523195035 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bfc1568d0 con 0x7f6bfc0c51e0 2024-01-23T09:26:05.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.125+0000 7f6c008ac640 1 --2- 172.21.15.46:0/1523195035 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bfc0c51e0 0x7f6bfc0c6360 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc0c4e80 tx=0x7f6bec01ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89a0cea11273a5e server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:05.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.129+0000 7f6bfb7fe640 1 -- 172.21.15.46:0/1523195035 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec0a89b0 con 0x7f6bfc0c51e0 2024-01-23T09:26:05.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.129+0000 7f6bfb7fe640 1 -- 172.21.15.46:0/1523195035 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6bec0a8b10 con 0x7f6bfc0c51e0 2024-01-23T09:26:05.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.129+0000 7f6bfb7fe640 1 -- 172.21.15.46:0/1523195035 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec0b0440 con 0x7f6bfc0c51e0 2024-01-23T09:26:05.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.129+0000 7f6c02b10640 1 -- 172.21.15.46:0/1523195035 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bfc0c51e0 msgr2=0x7f6bfc0c6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:05.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.129+0000 7f6c02b10640 1 --2- 172.21.15.46:0/1523195035 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bfc0c51e0 0x7f6bfc0c6360 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc0c4e80 tx=0x7f6bec01ecb0 comp rx=0 tx=0).stop 2024-01-23T09:26:05.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.129+0000 7f6c02b10640 1 -- 172.21.15.46:0/1523195035 shutdown_connections 2024-01-23T09:26:05.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.129+0000 7f6c02b10640 1 --2- 172.21.15.46:0/1523195035 >> v2:172.21.15.175:3300/0 conn(0x7f6bfc0c55c0 0x7f6bfc0c2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:05.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.129+0000 7f6c02b10640 1 --2- 172.21.15.46:0/1523195035 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bfc0c51e0 0x7f6bfc0c6360 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:05.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.129+0000 7f6c02b10640 1 -- 172.21.15.46:0/1523195035 >> 172.21.15.46:0/1523195035 conn(0x7f6bfc0cbb60 msgr2=0x7f6bfc0c7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:26:05.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.129+0000 7f6c02b10640 1 -- 172.21.15.46:0/1523195035 shutdown_connections 2024-01-23T09:26:05.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.129+0000 7f6c02b10640 1 -- 172.21.15.46:0/1523195035 wait complete. 2024-01-23T09:26:05.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.133+0000 7f6c02b10640 1 Processor -- start 2024-01-23T09:26:05.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.133+0000 7f6c02b10640 1 -- start start 2024-01-23T09:26:05.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.133+0000 7f6c02b10640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bfc0c51e0 0x7f6bfc145790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:05.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.133+0000 7f6c02b10640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6bfc0c55c0 0x7f6bfc0c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:05.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.133+0000 7f6c02b10640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bfc0c5e50 0x7f6bfc144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:05.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.133+0000 7f6c02b10640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc145300 con 0x7f6bfc0c51e0 2024-01-23T09:26:05.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.133+0000 7f6c02b10640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc0c2630 con 0x7f6bfc0c5e50 2024-01-23T09:26:05.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.133+0000 7f6c02b10640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc144cf0 con 0x7f6bfc0c55c0 2024-01-23T09:26:05.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.133+0000 7f6c008ac640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bfc0c51e0 0x7f6bfc145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:05.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.133+0000 7f6c008ac640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bfc0c51e0 0x7f6bfc145790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37228/0 (socket says 172.21.15.46:37228) 2024-01-23T09:26:05.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.133+0000 7f6c008ac640 1 -- 172.21.15.46:0/4075521652 learned_addr learned my addr 172.21.15.46:0/4075521652 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:26:05.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.133+0000 7f6c010ad640 1 --2- 172.21.15.46:0/4075521652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bfc0c5e50 0x7f6bfc144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:05.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.133+0000 7f6bfbfff640 1 --2- 172.21.15.46:0/4075521652 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6bfc0c55c0 0x7f6bfc0c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:05.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.137+0000 7f6c008ac640 1 -- 172.21.15.46:0/4075521652 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6bfc0c55c0 msgr2=0x7f6bfc0c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:05.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.137+0000 7f6c008ac640 1 --2- 172.21.15.46:0/4075521652 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6bfc0c55c0 0x7f6bfc0c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:05.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.137+0000 7f6c008ac640 1 -- 172.21.15.46:0/4075521652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bfc0c5e50 msgr2=0x7f6bfc144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:05.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.137+0000 7f6c008ac640 1 --2- 172.21.15.46:0/4075521652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bfc0c5e50 0x7f6bfc144050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:05.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.137+0000 7f6c008ac640 1 -- 172.21.15.46:0/4075521652 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bec0094d0 con 0x7f6bfc0c51e0 2024-01-23T09:26:05.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.141+0000 7f6c008ac640 1 --2- 172.21.15.46:0/4075521652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bfc0c51e0 0x7f6bfc145790 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6bec01c8e0 tx=0x7f6bec01ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:05.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.141+0000 7f6bf97fa640 1 -- 172.21.15.46:0/4075521652 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec0b0ea0 con 0x7f6bfc0c51e0 2024-01-23T09:26:05.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.141+0000 7f6bf97fa640 1 -- 172.21.15.46:0/4075521652 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6bec0b9410 con 0x7f6bfc0c51e0 2024-01-23T09:26:05.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.141+0000 7f6bf97fa640 1 -- 172.21.15.46:0/4075521652 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec0b9800 con 0x7f6bfc0c51e0 2024-01-23T09:26:05.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.145+0000 7f6c02b10640 1 -- 172.21.15.46:0/4075521652 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bfc14da40 con 0x7f6bfc0c51e0 2024-01-23T09:26:05.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.145+0000 7f6c02b10640 1 -- 172.21.15.46:0/4075521652 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bfc144f90 con 0x7f6bfc0c51e0 2024-01-23T09:26:05.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.145+0000 7f6c02b10640 1 -- 172.21.15.46:0/4075521652 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bfc074340 con 0x7f6bfc0c51e0 2024-01-23T09:26:05.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.453+0000 7f6bf97fa640 1 -- 172.21.15.46:0/4075521652 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f6bec0b7040 con 0x7f6bfc0c51e0 2024-01-23T09:26:05.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.453+0000 7f6bf97fa640 1 --2- 172.21.15.46:0/4075521652 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6bdc066550 0x7f6bdc068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:05.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.453+0000 7f6bfbfff640 1 --2- 172.21.15.46:0/4075521652 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6bdc066550 0x7f6bdc068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:05.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.457+0000 7f6bfbfff640 1 --2- 172.21.15.46:0/4075521652 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6bdc066550 0x7f6bdc068a10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc140e50 tx=0x7f6be4009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:05.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.493+0000 7f6bf97fa640 1 -- 172.21.15.46:0/4075521652 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f6bec0f3630 con 0x7f6bfc0c51e0 2024-01-23T09:26:05.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.493+0000 7f6bf97fa640 1 -- 172.21.15.46:0/4075521652 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f6bec0ef970 con 0x7f6bfc0c51e0 2024-01-23T09:26:05.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.709+0000 7f6c02b10640 1 -- 172.21.15.46:0/4075521652 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6bfc074340 con 0x7f6bfc0c51e0 2024-01-23T09:26:05.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.749+0000 7f6bf97fa640 1 -- 172.21.15.46:0/4075521652 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6584 (secure 0 0 0) 0x7f6bec0b5020 con 0x7f6bfc0c51e0 2024-01-23T09:26:05.754 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T09:26:05.754 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4208,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/397511399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":397511399},{"type":"v1","addr":"172.21.15.175:6835","nonce":397511399}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-23T08:54:42.028655+0000","modified":"2024-01-23T08:55:33.028425+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4242,"mds_1":4239,"mds_2":4234,"mds_3":4228,"mds_4":4214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4214":{"gid":4214,"name":"c","rank":4,"incarnation":17,"state":"up:active","state_seq":21,"addr":"172.21.15.46:6835/1620040020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1620040020},{"type":"v1","addr":"172.21.15.46:6835","nonce":1620040020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4228":{"gid":4228,"name":"b","rank":3,"incarnation":15,"state":"up:active","state_seq":20,"addr":"172.21.15.175:6833/2714415350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2714415350},{"type":"v1","addr":"172.21.15.175:6833","nonce":2714415350}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4234":{"gid":4234,"name":"f","rank":2,"incarnation":13,"state":"up:active","state_seq":19,"addr":"172.21.15.175:6837/3103300888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3103300888},{"type":"v1","addr":"172.21.15.175:6837","nonce":3103300888}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4239":{"gid":4239,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6837/338965660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":338965660},{"type":"v1","addr":"172.21.15.46:6837","nonce":338965660}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4242":{"gid":4242,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":9,"addr":"172.21.15.46:6839/1889172114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1889172114},{"type":"v1","addr":"172.21.15.46:6839","nonce":1889172114}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-23T09:26:05.754 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 18 2024-01-23T09:26:05.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.753+0000 7f6c02b10640 1 -- 172.21.15.46:0/4075521652 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6bdc066550 msgr2=0x7f6bdc068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:05.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.753+0000 7f6c02b10640 1 --2- 172.21.15.46:0/4075521652 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6bdc066550 0x7f6bdc068a10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc140e50 tx=0x7f6be4009060 comp rx=0 tx=0).stop 2024-01-23T09:26:05.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.753+0000 7f6c02b10640 1 -- 172.21.15.46:0/4075521652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bfc0c51e0 msgr2=0x7f6bfc145790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:05.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.753+0000 7f6c02b10640 1 --2- 172.21.15.46:0/4075521652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bfc0c51e0 0x7f6bfc145790 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6bec01c8e0 tx=0x7f6bec01ba50 comp rx=0 tx=0).stop 2024-01-23T09:26:05.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.753+0000 7f6c02b10640 1 -- 172.21.15.46:0/4075521652 shutdown_connections 2024-01-23T09:26:05.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.753+0000 7f6c02b10640 1 --2- 172.21.15.46:0/4075521652 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f6bdc066550 0x7f6bdc068a10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:05.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.753+0000 7f6c02b10640 1 --2- 172.21.15.46:0/4075521652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bfc0c5e50 0x7f6bfc144050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:05.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.753+0000 7f6c02b10640 1 --2- 172.21.15.46:0/4075521652 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6bfc0c55c0 0x7f6bfc0c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:05.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.753+0000 7f6c02b10640 1 --2- 172.21.15.46:0/4075521652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bfc0c51e0 0x7f6bfc145790 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:05.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.753+0000 7f6c02b10640 1 -- 172.21.15.46:0/4075521652 >> 172.21.15.46:0/4075521652 conn(0x7f6bfc0cbb60 msgr2=0x7f6bfc1548a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:26:05.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.753+0000 7f6c02b10640 1 -- 172.21.15.46:0/4075521652 shutdown_connections 2024-01-23T09:26:05.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.753+0000 7f6c02b10640 1 -- 172.21.15.46:0/4075521652 wait complete. 2024-01-23T09:26:05.775 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-23T09:26:05.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.893+0000 7f471b7cb640 1 Processor -- start 2024-01-23T09:26:05.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.893+0000 7f471b7cb640 1 -- start start 2024-01-23T09:26:05.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.893+0000 7f471b7cb640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4714153960 0x7f47140c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:05.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.893+0000 7f471b7cb640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f471415d610 0x7f47140c4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:05.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.893+0000 7f471b7cb640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4714159740 con 0x7f47140c3de0 2024-01-23T09:26:05.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.893+0000 7f471b7cb640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4714153d40 con 0x7f4714153960 2024-01-23T09:26:05.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.893+0000 7f471b7cb640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47141599e0 con 0x7f471415d610 2024-01-23T09:26:05.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.893+0000 7f4719d68640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f471415d610 0x7f47140c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:05.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.893+0000 7f4719d68640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f471415d610 0x7f47140c4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:60272/0 (socket says 172.21.15.46:60272) 2024-01-23T09:26:05.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.893+0000 7f4719d68640 1 -- 172.21.15.46:0/3053580741 learned_addr learned my addr 172.21.15.46:0/3053580741 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:26:05.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.901+0000 7f4719d68640 1 -- 172.21.15.46:0/3053580741 >> v2:172.21.15.46:3300/0 conn(0x7f4714153960 msgr2=0x7f47140c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:26:05.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.901+0000 7f4719d68640 1 --2- 172.21.15.46:0/3053580741 >> v2:172.21.15.46:3300/0 conn(0x7f4714153960 0x7f47140c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:05.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.901+0000 7f4719d68640 1 -- 172.21.15.46:0/3053580741 >> v1:172.21.15.46:6789/0 conn(0x7f47140c3de0 legacy=0x7f471415cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:26:05.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.901+0000 7f4719d68640 1 -- 172.21.15.46:0/3053580741 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4714159cc0 con 0x7f471415d610 2024-01-23T09:26:05.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.905+0000 7f4719d68640 1 --2- 172.21.15.46:0/3053580741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f471415d610 0x7f47140c4220 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f471408c2c0 tx=0x7f470c01f180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8dce8ae42ec92ee8 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:05.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.917+0000 7f4707fff640 1 -- 172.21.15.46:0/3053580741 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470c0af400 con 0x7f471415d610 2024-01-23T09:26:05.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.917+0000 7f4707fff640 1 -- 172.21.15.46:0/3053580741 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f470c0ab050 con 0x7f471415d610 2024-01-23T09:26:05.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.917+0000 7f4707fff640 1 -- 172.21.15.46:0/3053580741 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470c0af7a0 con 0x7f471415d610 2024-01-23T09:26:05.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.917+0000 7f471b7cb640 1 -- 172.21.15.46:0/3053580741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f471415d610 msgr2=0x7f47140c4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:05.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.917+0000 7f471b7cb640 1 --2- 172.21.15.46:0/3053580741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f471415d610 0x7f47140c4220 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f471408c2c0 tx=0x7f470c01f180 comp rx=0 tx=0).stop 2024-01-23T09:26:05.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.917+0000 7f471b7cb640 1 -- 172.21.15.46:0/3053580741 shutdown_connections 2024-01-23T09:26:05.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.917+0000 7f471b7cb640 1 --2- 172.21.15.46:0/3053580741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f471415d610 0x7f47140c4220 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:05.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.917+0000 7f471b7cb640 1 --2- 172.21.15.46:0/3053580741 >> v2:172.21.15.46:3300/0 conn(0x7f4714153960 0x7f47140c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:05.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.917+0000 7f471b7cb640 1 -- 172.21.15.46:0/3053580741 >> 172.21.15.46:0/3053580741 conn(0x7f471408afa0 msgr2=0x7f471408b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:26:05.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.917+0000 7f471b7cb640 1 -- 172.21.15.46:0/3053580741 shutdown_connections 2024-01-23T09:26:05.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.917+0000 7f471b7cb640 1 -- 172.21.15.46:0/3053580741 wait complete. 2024-01-23T09:26:05.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.921+0000 7f471b7cb640 1 Processor -- start 2024-01-23T09:26:05.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.921+0000 7f471b7cb640 1 -- start start 2024-01-23T09:26:05.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.921+0000 7f471b7cb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47140c3de0 0x7f471414a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:05.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.921+0000 7f471b7cb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4714153960 0x7f47141e2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:05.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.921+0000 7f471b7cb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f471415d610 0x7f47141e3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:05.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.921+0000 7f471b7cb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47141e2b00 con 0x7f471415d610 2024-01-23T09:26:05.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.921+0000 7f471b7cb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471414cf50 con 0x7f4714153960 2024-01-23T09:26:05.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.921+0000 7f471b7cb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47141e55f0 con 0x7f47140c3de0 2024-01-23T09:26:05.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.921+0000 7f4719567640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47140c3de0 0x7f471414a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:05.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.921+0000 7f4718d66640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4714153960 0x7f47141e2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:05.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.921+0000 7f4719567640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47140c3de0 0x7f471414a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:51714/0 (socket says 172.21.15.46:51714) 2024-01-23T09:26:05.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.921+0000 7f4719567640 1 -- 172.21.15.46:0/2449511478 learned_addr learned my addr 172.21.15.46:0/2449511478 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:26:05.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.925+0000 7f4719d68640 1 --2- 172.21.15.46:0/2449511478 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f471415d610 0x7f47141e3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:05.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.929+0000 7f4719d68640 1 -- 172.21.15.46:0/2449511478 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47140c3de0 msgr2=0x7f471414a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:05.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.929+0000 7f4719d68640 1 --2- 172.21.15.46:0/2449511478 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47140c3de0 0x7f471414a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:05.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.929+0000 7f4719d68640 1 -- 172.21.15.46:0/2449511478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4714153960 msgr2=0x7f47141e2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:05.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.929+0000 7f4719d68640 1 --2- 172.21.15.46:0/2449511478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4714153960 0x7f47141e2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:05.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.929+0000 7f4719d68640 1 -- 172.21.15.46:0/2449511478 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f470c009b30 con 0x7f471415d610 2024-01-23T09:26:05.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.933+0000 7f4719d68640 1 --2- 172.21.15.46:0/2449511478 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f471415d610 0x7f47141e3460 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4714159b20 tx=0x7f470c01bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:05.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.937+0000 7f4705ffb640 1 -- 172.21.15.46:0/2449511478 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470c0afd40 con 0x7f471415d610 2024-01-23T09:26:05.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.937+0000 7f4705ffb640 1 -- 172.21.15.46:0/2449511478 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f470c0b9410 con 0x7f471415d610 2024-01-23T09:26:05.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.937+0000 7f4705ffb640 1 -- 172.21.15.46:0/2449511478 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470c0afea0 con 0x7f471415d610 2024-01-23T09:26:05.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.937+0000 7f471b7cb640 1 -- 172.21.15.46:0/2449511478 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f471414c6f0 con 0x7f471415d610 2024-01-23T09:26:05.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.937+0000 7f471b7cb640 1 -- 172.21.15.46:0/2449511478 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f471414cc70 con 0x7f471415d610 2024-01-23T09:26:05.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:05.941+0000 7f471b7cb640 1 -- 172.21.15.46:0/2449511478 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47141e2c40 con 0x7f471415d610 2024-01-23T09:26:06.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.209+0000 7f4705ffb640 1 -- 172.21.15.46:0/2449511478 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f470c0b6070 con 0x7f471415d610 2024-01-23T09:26:06.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.209+0000 7f4705ffb640 1 --2- 172.21.15.46:0/2449511478 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f46f8066550 0x7f46f8068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:06.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.209+0000 7f4719567640 1 --2- 172.21.15.46:0/2449511478 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f46f8066550 0x7f46f8068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:06.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.209+0000 7f4719567640 1 --2- 172.21.15.46:0/2449511478 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f46f8066550 0x7f46f8068a10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4710009a50 tx=0x7f4710009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:06.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.233+0000 7f4705ffb640 1 -- 172.21.15.46:0/2449511478 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f470c0f36e0 con 0x7f471415d610 2024-01-23T09:26:06.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.233+0000 7f4705ffb640 1 -- 172.21.15.46:0/2449511478 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f470c0efa20 con 0x7f471415d610 2024-01-23T09:26:06.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.445+0000 7f471b7cb640 1 -- 172.21.15.46:0/2449511478 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47141e2c40 con 0x7f471415d610 2024-01-23T09:26:06.513 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:32:43.858 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:26:06.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.545+0000 7f4705ffb640 1 -- 172.21.15.46:0/2449511478 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6584 (secure 0 0 0) 0x7f47141e2c40 con 0x7f471415d610 2024-01-23T09:26:06.551 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T09:26:06.551 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4208,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/397511399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":397511399},{"type":"v1","addr":"172.21.15.175:6835","nonce":397511399}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-23T08:54:42.028655+0000","modified":"2024-01-23T08:55:33.028425+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4242,"mds_1":4239,"mds_2":4234,"mds_3":4228,"mds_4":4214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4214":{"gid":4214,"name":"c","rank":4,"incarnation":17,"state":"up:active","state_seq":21,"addr":"172.21.15.46:6835/1620040020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1620040020},{"type":"v1","addr":"172.21.15.46:6835","nonce":1620040020}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4228":{"gid":4228,"name":"b","rank":3,"incarnation":15,"state":"up:active","state_seq":20,"addr":"172.21.15.175:6833/2714415350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2714415350},{"type":"v1","addr":"172.21.15.175:6833","nonce":2714415350}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4234":{"gid":4234,"name":"f","rank":2,"incarnation":13,"state":"up:active","state_seq":19,"addr":"172.21.15.175:6837/3103300888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3103300888},{"type":"v1","addr":"172.21.15.175:6837","nonce":3103300888}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4239":{"gid":4239,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":18,"addr":"172.21.15.46:6837/338965660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":338965660},{"type":"v1","addr":"172.21.15.46:6837","nonce":338965660}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4242":{"gid":4242,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":9,"addr":"172.21.15.46:6839/1889172114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1889172114},{"type":"v1","addr":"172.21.15.46:6839","nonce":1889172114}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-23T09:26:06.551 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 18 2024-01-23T09:26:06.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.549+0000 7f471b7cb640 1 -- 172.21.15.46:0/2449511478 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f46f8066550 msgr2=0x7f46f8068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:06.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.549+0000 7f471b7cb640 1 --2- 172.21.15.46:0/2449511478 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f46f8066550 0x7f46f8068a10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4710009a50 tx=0x7f4710009210 comp rx=0 tx=0).stop 2024-01-23T09:26:06.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.549+0000 7f471b7cb640 1 -- 172.21.15.46:0/2449511478 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f471415d610 msgr2=0x7f47141e3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:06.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.549+0000 7f471b7cb640 1 --2- 172.21.15.46:0/2449511478 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f471415d610 0x7f47141e3460 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4714159b20 tx=0x7f470c01bf20 comp rx=0 tx=0).stop 2024-01-23T09:26:06.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.549+0000 7f471b7cb640 1 -- 172.21.15.46:0/2449511478 shutdown_connections 2024-01-23T09:26:06.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.549+0000 7f471b7cb640 1 --2- 172.21.15.46:0/2449511478 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f471415d610 0x7f47141e3460 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:06.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.549+0000 7f471b7cb640 1 --2- 172.21.15.46:0/2449511478 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f46f8066550 0x7f46f8068a10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:06.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.549+0000 7f471b7cb640 1 --2- 172.21.15.46:0/2449511478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4714153960 0x7f47141e2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:06.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.549+0000 7f471b7cb640 1 --2- 172.21.15.46:0/2449511478 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47140c3de0 0x7f471414a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:06.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.549+0000 7f471b7cb640 1 -- 172.21.15.46:0/2449511478 >> 172.21.15.46:0/2449511478 conn(0x7f471408afa0 msgr2=0x7f47140cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:26:06.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.549+0000 7f471b7cb640 1 -- 172.21.15.46:0/2449511478 shutdown_connections 2024-01-23T09:26:06.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.549+0000 7f471b7cb640 1 -- 172.21.15.46:0/2449511478 wait complete. 2024-01-23T09:26:06.560 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:32:43.906 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:26:06.579 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-23T09:26:06.664 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:32:43.950 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:26:06.673 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:32:43.959 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:26:06.674 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:32:43.959 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:26:06.678 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:32:43.964 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:26:06.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.701+0000 7f4429e51640 1 Processor -- start 2024-01-23T09:26:06.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.701+0000 7f4429e51640 1 -- start start 2024-01-23T09:26:06.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.701+0000 7f4429e51640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f44240c83c0 0x7f44240c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:06.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.701+0000 7f4429e51640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f44240c2c20 0x7f442415cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:06.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.701+0000 7f4429e51640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44240c3090 con 0x7f44241538f0 2024-01-23T09:26:06.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.701+0000 7f4429e51640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4424070460 con 0x7f44240c2c20 2024-01-23T09:26:06.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.701+0000 7f4429e51640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f442406f950 con 0x7f44240c83c0 2024-01-23T09:26:06.707 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:32:44.053 27237== Warning: unimplemented fcntl command: 1036 2024-01-23T09:26:06.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.709+0000 7f4423fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f44240c2c20 0x7f442415cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:06.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.709+0000 7f4423fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f44240c2c20 0x7f442415cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37250/0 (socket says 172.21.15.46:37250) 2024-01-23T09:26:06.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.709+0000 7f4423fff640 1 -- 172.21.15.46:0/1280044922 learned_addr learned my addr 172.21.15.46:0/1280044922 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:26:06.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.721+0000 7f4423fff640 1 -- 172.21.15.46:0/1280044922 >> v2:172.21.15.175:3300/0 conn(0x7f44240c83c0 msgr2=0x7f44240c6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:26:06.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.721+0000 7f4423fff640 1 --2- 172.21.15.46:0/1280044922 >> v2:172.21.15.175:3300/0 conn(0x7f44240c83c0 0x7f44240c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:06.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.721+0000 7f4423fff640 1 -- 172.21.15.46:0/1280044922 >> v1:172.21.15.46:6789/0 conn(0x7f44241538f0 legacy=0x7f44240c1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:06.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.721+0000 7f4423fff640 1 -- 172.21.15.46:0/1280044922 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442406fbc0 con 0x7f44240c2c20 2024-01-23T09:26:06.805 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:32:44.091 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:26:06.808 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:32:44.093 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:26:06.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:06.977+0000 7f4423fff640 1 --2- 172.21.15.46:0/1280044922 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44240c2c20 0x7f442415cf90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f442406f040 tx=0x7f441c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c9b4a68dc12db8 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:07.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.309+0000 7f44227fc640 1 -- 172.21.15.46:0/1280044922 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c0a5860 con 0x7f44240c2c20 2024-01-23T09:26:07.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.309+0000 7f44227fc640 1 -- 172.21.15.46:0/1280044922 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f441c0a59c0 con 0x7f44240c2c20 2024-01-23T09:26:07.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.309+0000 7f44227fc640 1 -- 172.21.15.46:0/1280044922 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c0a5d70 con 0x7f44240c2c20 2024-01-23T09:26:07.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.309+0000 7f4429e51640 1 -- 172.21.15.46:0/1280044922 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44240c2c20 msgr2=0x7f442415cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:07.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.309+0000 7f4429e51640 1 --2- 172.21.15.46:0/1280044922 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44240c2c20 0x7f442415cf90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f442406f040 tx=0x7f441c01c9a0 comp rx=0 tx=0).stop 2024-01-23T09:26:07.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.309+0000 7f4429e51640 1 -- 172.21.15.46:0/1280044922 shutdown_connections 2024-01-23T09:26:07.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.309+0000 7f4429e51640 1 --2- 172.21.15.46:0/1280044922 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44240c2c20 0x7f442415cf90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:07.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.309+0000 7f4429e51640 1 --2- 172.21.15.46:0/1280044922 >> v2:172.21.15.175:3300/0 conn(0x7f44240c83c0 0x7f44240c6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:07.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.309+0000 7f4429e51640 1 -- 172.21.15.46:0/1280044922 >> 172.21.15.46:0/1280044922 conn(0x7f44240cbe70 msgr2=0x7f44240cc280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:26:07.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.309+0000 7f4429e51640 1 -- 172.21.15.46:0/1280044922 shutdown_connections 2024-01-23T09:26:07.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.309+0000 7f4429e51640 1 -- 172.21.15.46:0/1280044922 wait complete. 2024-01-23T09:26:07.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.309+0000 7f4429e51640 1 Processor -- start 2024-01-23T09:26:07.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.313+0000 7f4429e51640 1 -- start start 2024-01-23T09:26:07.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.313+0000 7f4429e51640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44240c2c20 0x7f44241446b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:07.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.313+0000 7f4429e51640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44240c83c0 0x7f44240cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:07.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.313+0000 7f4429e51640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44241538f0 0x7f44241f5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:07.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.313+0000 7f4429e51640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44240cb7c0 con 0x7f44241538f0 2024-01-23T09:26:07.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.313+0000 7f4429e51640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44240cac40 con 0x7f44240c83c0 2024-01-23T09:26:07.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.313+0000 7f4429e51640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44240ca630 con 0x7f44240c2c20 2024-01-23T09:26:07.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.317+0000 7f44237fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44240c2c20 0x7f44241446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:07.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.317+0000 7f4423fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44241538f0 0x7f44241f5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:07.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.317+0000 7f44237fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44240c2c20 0x7f44241446b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.46:51730/0 (socket says 172.21.15.46:51730) 2024-01-23T09:26:07.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.317+0000 7f44237fe640 1 -- 172.21.15.46:0/3007051844 learned_addr learned my addr 172.21.15.46:0/3007051844 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:26:07.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.325+0000 7f4423fff640 1 -- 172.21.15.46:0/3007051844 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44240c2c20 msgr2=0x7f44241446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:07.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.325+0000 7f4423fff640 1 --2- 172.21.15.46:0/3007051844 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44240c2c20 0x7f44241446b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:07.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.325+0000 7f4423fff640 1 -- 172.21.15.46:0/3007051844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44240c83c0 msgr2=0x7f44240cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:07.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.325+0000 7f4423fff640 1 --2- 172.21.15.46:0/3007051844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44240c83c0 0x7f44240cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:07.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.325+0000 7f4423fff640 1 -- 172.21.15.46:0/3007051844 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441c009b30 con 0x7f44241538f0 2024-01-23T09:26:07.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.337+0000 7f4423fff640 1 --2- 172.21.15.46:0/3007051844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44241538f0 0x7f44241f5ad0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f441c0ab000 tx=0x7f441c019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:07.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.345+0000 7f440bfff640 1 -- 172.21.15.46:0/3007051844 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c009250 con 0x7f44241538f0 2024-01-23T09:26:07.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.345+0000 7f440bfff640 1 -- 172.21.15.46:0/3007051844 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f441c0b8680 con 0x7f44241538f0 2024-01-23T09:26:07.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.345+0000 7f440bfff640 1 -- 172.21.15.46:0/3007051844 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c0b8a70 con 0x7f44241538f0 2024-01-23T09:26:07.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.345+0000 7f4429e51640 1 -- 172.21.15.46:0/3007051844 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44240cb9f0 con 0x7f44241538f0 2024-01-23T09:26:07.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.345+0000 7f4429e51640 1 -- 172.21.15.46:0/3007051844 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44240ca8d0 con 0x7f44241538f0 2024-01-23T09:26:07.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.345+0000 7f4429e51640 1 -- 172.21.15.46:0/3007051844 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44240cadb0 con 0x7f44241538f0 2024-01-23T09:26:07.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.369+0000 7f440bfff640 1 -- 172.21.15.46:0/3007051844 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f441c0b8bd0 con 0x7f44241538f0 2024-01-23T09:26:07.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.373+0000 7f440bfff640 1 --2- 172.21.15.46:0/3007051844 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4410066550 0x7f4410068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:07.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.373+0000 7f44237fe640 1 --2- 172.21.15.46:0/3007051844 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4410066550 0x7f4410068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:07.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.373+0000 7f44237fe640 1 --2- 172.21.15.46:0/3007051844 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4410066550 0x7f4410068a10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4414007fd0 tx=0x7f4414009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:07.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.373+0000 7f440bfff640 1 -- 172.21.15.46:0/3007051844 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f441c0f1270 con 0x7f44241538f0 2024-01-23T09:26:07.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.673+0000 7f440bfff640 1 -- 172.21.15.46:0/3007051844 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f441c0eceb0 con 0x7f44241538f0 2024-01-23T09:26:07.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:07.849+0000 7f4429e51640 1 -- 172.21.15.46:0/3007051844 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4424074340 con 0x7f44241538f0 2024-01-23T09:26:08.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.053+0000 7f440bfff640 1 -- 172.21.15.46:0/3007051844 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18552 (secure 0 0 0) 0x7f441c0f04d0 con 0x7f44241538f0 2024-01-23T09:26:08.058 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-23T09:26:08.058 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":30,"fsid":"fdbdd393-f422-45ae-a488-2bbb0163e580","created":"2024-01-23T08:53:36.942515+0000","modified":"2024-01-23T08:55:46.483867+0000","last_up_change":"2024-01-23T08:53:57.198113+0000","last_in_change":"2024-01-23T08:53:47.852614+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-23T08:53:59.340853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-23T08:54:38.278770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-23T08:54:40.216521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-23T08:54:47.311079+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f32c3d7d-e32a-42d8-b55f-db874d915a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6818","nonce":2681790976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6821","nonce":2681790976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6825","nonce":2681790976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2681790976},{"type":"v1","addr":"172.21.15.46:6823","nonce":2681790976}]},"public_addr":"172.21.15.46:6818/2681790976","cluster_addr":"172.21.15.46:6821/2681790976","heartbeat_back_addr":"172.21.15.46:6825/2681790976","heartbeat_front_addr":"172.21.15.46:6823/2681790976","state":["exists","up"]},{"osd":1,"uuid":"6f3b6bd2-bbea-4d08-84d5-4407363b5eb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6803","nonce":3679152623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6805","nonce":3679152623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6809","nonce":3679152623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3679152623},{"type":"v1","addr":"172.21.15.46:6807","nonce":3679152623}]},"public_addr":"172.21.15.46:6803/3679152623","cluster_addr":"172.21.15.46:6805/3679152623","heartbeat_back_addr":"172.21.15.46:6809/3679152623","heartbeat_front_addr":"172.21.15.46:6807/3679152623","state":["exists","up"]},{"osd":2,"uuid":"8f110727-31e7-4f69-926b-c87481d4d28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6811","nonce":3869652274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6813","nonce":3869652274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6820","nonce":3869652274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3869652274},{"type":"v1","addr":"172.21.15.46:6815","nonce":3869652274}]},"public_addr":"172.21.15.46:6811/3869652274","cluster_addr":"172.21.15.46:6813/3869652274","heartbeat_back_addr":"172.21.15.46:6820/3869652274","heartbeat_front_addr":"172.21.15.46:6815/3869652274","state":["exists","up"]},{"osd":3,"uuid":"3aa7527d-0463-4373-b9c7-e6b507a7987f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6827","nonce":4168860822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6829","nonce":4168860822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6833","nonce":4168860822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4168860822},{"type":"v1","addr":"172.21.15.46:6831","nonce":4168860822}]},"public_addr":"172.21.15.46:6827/4168860822","cluster_addr":"172.21.15.46:6829/4168860822","heartbeat_back_addr":"172.21.15.46:6833/4168860822","heartbeat_front_addr":"172.21.15.46:6831/4168860822","state":["exists","up"]},{"osd":4,"uuid":"eb47a1e5-9f26-465f-b188-87c6eed63c2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6805","nonce":3115257412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6808","nonce":3115257412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6815","nonce":3115257412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3115257412},{"type":"v1","addr":"172.21.15.175:6812","nonce":3115257412}]},"public_addr":"172.21.15.175:6805/3115257412","cluster_addr":"172.21.15.175:6808/3115257412","heartbeat_back_addr":"172.21.15.175:6815/3115257412","heartbeat_front_addr":"172.21.15.175:6812/3115257412","state":["exists","up"]},{"osd":5,"uuid":"34048409-998c-44f3-a29d-dcad7a6c917b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6818","nonce":3146473948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6822","nonce":3146473948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6831","nonce":3146473948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3146473948},{"type":"v1","addr":"172.21.15.175:6826","nonce":3146473948}]},"public_addr":"172.21.15.175:6818/3146473948","cluster_addr":"172.21.15.175:6822/3146473948","heartbeat_back_addr":"172.21.15.175:6831/3146473948","heartbeat_front_addr":"172.21.15.175:6826/3146473948","state":["exists","up"]},{"osd":6,"uuid":"f5d45d3f-9af3-44a1-a730-c260ed1654b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6801","nonce":4161180058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6804","nonce":4161180058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6814","nonce":4161180058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":4161180058},{"type":"v1","addr":"172.21.15.175:6809","nonce":4161180058}]},"public_addr":"172.21.15.175:6801/4161180058","cluster_addr":"172.21.15.175:6804/4161180058","heartbeat_back_addr":"172.21.15.175:6814/4161180058","heartbeat_front_addr":"172.21.15.175:6809/4161180058","state":["exists","up"]},{"osd":7,"uuid":"16d12e53-2ad3-4b5c-a789-22b45056fd9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6819","nonce":2670236415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6823","nonce":2670236415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6830","nonce":2670236415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":2670236415},{"type":"v1","addr":"172.21.15.175:6827","nonce":2670236415}]},"public_addr":"172.21.15.175:6819/2670236415","cluster_addr":"172.21.15.175:6823/2670236415","heartbeat_back_addr":"172.21.15.175:6830/2670236415","heartbeat_front_addr":"172.21.15.175:6827/2670236415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.847037+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.765547+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.716122+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.874628+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.786580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.924885+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:52.285635+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T08:53:53.898130+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":0,"to":7}]},{"pgid":"4.4","mappings":[{"from":3,"to":5}]},{"pgid":"4.17","mappings":[{"from":1,"to":0}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T09:26:08.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.057+0000 7f4429e51640 1 -- 172.21.15.46:0/3007051844 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4410066550 msgr2=0x7f4410068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:08.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.057+0000 7f4429e51640 1 --2- 172.21.15.46:0/3007051844 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4410066550 0x7f4410068a10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4414007fd0 tx=0x7f4414009040 comp rx=0 tx=0).stop 2024-01-23T09:26:08.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.057+0000 7f4429e51640 1 -- 172.21.15.46:0/3007051844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44241538f0 msgr2=0x7f44241f5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:08.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.057+0000 7f4429e51640 1 --2- 172.21.15.46:0/3007051844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44241538f0 0x7f44241f5ad0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f441c0ab000 tx=0x7f441c019740 comp rx=0 tx=0).stop 2024-01-23T09:26:08.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.057+0000 7f4429e51640 1 -- 172.21.15.46:0/3007051844 shutdown_connections 2024-01-23T09:26:08.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.057+0000 7f4429e51640 1 --2- 172.21.15.46:0/3007051844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f44241538f0 0x7f44241f5ad0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:08.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.057+0000 7f4429e51640 1 --2- 172.21.15.46:0/3007051844 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f4410066550 0x7f4410068a10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:08.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.057+0000 7f4429e51640 1 --2- 172.21.15.46:0/3007051844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44240c83c0 0x7f44240cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:08.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.057+0000 7f4429e51640 1 --2- 172.21.15.46:0/3007051844 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f44240c2c20 0x7f44241446b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:08.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.057+0000 7f4429e51640 1 -- 172.21.15.46:0/3007051844 >> 172.21.15.46:0/3007051844 conn(0x7f44240cbe70 msgr2=0x7f4424149b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:26:08.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.057+0000 7f4429e51640 1 -- 172.21.15.46:0/3007051844 shutdown_connections 2024-01-23T09:26:08.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.057+0000 7f4429e51640 1 -- 172.21.15.46:0/3007051844 wait complete. 2024-01-23T09:26:08.087 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-23T09:26:08.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.213+0000 7f93dc838640 1 Processor -- start 2024-01-23T09:26:08.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.213+0000 7f93dc838640 1 -- start start 2024-01-23T09:26:08.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.213+0000 7f93dc838640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f93d80c7f30 0x7f93d806da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:08.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.213+0000 7f93dc838640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93d806dfd0 0x7f93d8151190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:08.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.213+0000 7f93dc838640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f93d80c8310 0x7f93d81516d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:08.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.213+0000 7f93dc838640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d815a9d0 con 0x7f93d80c7f30 2024-01-23T09:26:08.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.213+0000 7f93dc838640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d81573e0 con 0x7f93d80c8310 2024-01-23T09:26:08.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.213+0000 7f93dc838640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d81576a0 con 0x7f93d806dfd0 2024-01-23T09:26:08.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.217+0000 7f93d659c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f93d80c7f30 0x7f93d806da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:08.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.217+0000 7f93d659c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f93d80c7f30 0x7f93d806da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37266/0 (socket says 172.21.15.46:37266) 2024-01-23T09:26:08.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.217+0000 7f93d659c640 1 -- 172.21.15.46:0/831290070 learned_addr learned my addr 172.21.15.46:0/831290070 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:26:08.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.217+0000 7f93cffff640 1 --2- 172.21.15.46:0/831290070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93d806dfd0 0x7f93d8151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:08.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.217+0000 7f93d6d9d640 1 --2- 172.21.15.46:0/831290070 >> v2:172.21.15.175:3300/0 conn(0x7f93d80c8310 0x7f93d81516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:08.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.221+0000 7f93d659c640 1 -- 172.21.15.46:0/831290070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93d806dfd0 msgr2=0x7f93d8151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:26:08.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.221+0000 7f93d659c640 1 --2- 172.21.15.46:0/831290070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93d806dfd0 0x7f93d8151190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:08.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.221+0000 7f93d659c640 1 -- 172.21.15.46:0/831290070 >> v2:172.21.15.175:3300/0 conn(0x7f93d80c8310 msgr2=0x7f93d81516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:26:08.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.221+0000 7f93d659c640 1 --2- 172.21.15.46:0/831290070 >> v2:172.21.15.175:3300/0 conn(0x7f93d80c8310 0x7f93d81516d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:08.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.221+0000 7f93d659c640 1 -- 172.21.15.46:0/831290070 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d8157980 con 0x7f93d80c7f30 2024-01-23T09:26:08.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.221+0000 7f93d659c640 1 --2- 172.21.15.46:0/831290070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93d80c7f30 0x7f93d806da90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f93d80c2890 tx=0x7f93c801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46a3a22127450f98 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:08.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.225+0000 7f93d5d9b640 1 -- 172.21.15.46:0/831290070 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c80a89b0 con 0x7f93d80c7f30 2024-01-23T09:26:08.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.229+0000 7f93d5d9b640 1 -- 172.21.15.46:0/831290070 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f93c80a8b10 con 0x7f93d80c7f30 2024-01-23T09:26:08.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.229+0000 7f93d5d9b640 1 -- 172.21.15.46:0/831290070 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c80b0440 con 0x7f93d80c7f30 2024-01-23T09:26:08.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.229+0000 7f93dc838640 1 -- 172.21.15.46:0/831290070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93d80c7f30 msgr2=0x7f93d806da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:08.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.229+0000 7f93dc838640 1 --2- 172.21.15.46:0/831290070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93d80c7f30 0x7f93d806da90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f93d80c2890 tx=0x7f93c801ecf0 comp rx=0 tx=0).stop 2024-01-23T09:26:08.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.229+0000 7f93dc838640 1 -- 172.21.15.46:0/831290070 shutdown_connections 2024-01-23T09:26:08.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.229+0000 7f93dc838640 1 --2- 172.21.15.46:0/831290070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93d806dfd0 0x7f93d8151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:08.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.229+0000 7f93dc838640 1 --2- 172.21.15.46:0/831290070 >> v2:172.21.15.175:3300/0 conn(0x7f93d80c8310 0x7f93d81516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:08.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.229+0000 7f93dc838640 1 --2- 172.21.15.46:0/831290070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93d80c7f30 0x7f93d806da90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:08.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.229+0000 7f93dc838640 1 -- 172.21.15.46:0/831290070 >> 172.21.15.46:0/831290070 conn(0x7f93d806aa60 msgr2=0x7f93d806ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:26:08.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.229+0000 7f93dc838640 1 -- 172.21.15.46:0/831290070 shutdown_connections 2024-01-23T09:26:08.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.229+0000 7f93dc838640 1 -- 172.21.15.46:0/831290070 wait complete. 2024-01-23T09:26:08.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.233+0000 7f93dc838640 1 Processor -- start 2024-01-23T09:26:08.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.233+0000 7f93dc838640 1 -- start start 2024-01-23T09:26:08.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.233+0000 7f93dc838640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93d806dfd0 0x7f93d81ed780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:08.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.233+0000 7f93dc838640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93d80c7f30 0x7f93d80c3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:08.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.233+0000 7f93dc838640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93d80c8310 0x7f93d814c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:08.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.233+0000 7f93dc838640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d814d880 con 0x7f93d80c8310 2024-01-23T09:26:08.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.233+0000 7f93dc838640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d80c4850 con 0x7f93d80c7f30 2024-01-23T09:26:08.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.233+0000 7f93dc838640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d80c4b30 con 0x7f93d806dfd0 2024-01-23T09:26:08.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.233+0000 7f93d6d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93d80c8310 0x7f93d814c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:08.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.233+0000 7f93d6d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93d80c8310 0x7f93d814c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37280/0 (socket says 172.21.15.46:37280) 2024-01-23T09:26:08.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.233+0000 7f93d6d9d640 1 -- 172.21.15.46:0/3535294522 learned_addr learned my addr 172.21.15.46:0/3535294522 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:26:08.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.233+0000 7f93d659c640 1 --2- 172.21.15.46:0/3535294522 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93d806dfd0 0x7f93d81ed780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:08.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.233+0000 7f93cffff640 1 --2- 172.21.15.46:0/3535294522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93d80c7f30 0x7f93d80c3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:08.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.237+0000 7f93d6d9d640 1 -- 172.21.15.46:0/3535294522 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93d806dfd0 msgr2=0x7f93d81ed780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:08.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.237+0000 7f93d6d9d640 1 --2- 172.21.15.46:0/3535294522 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93d806dfd0 0x7f93d81ed780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:08.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.237+0000 7f93d6d9d640 1 -- 172.21.15.46:0/3535294522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93d80c7f30 msgr2=0x7f93d80c3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:08.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.237+0000 7f93d6d9d640 1 --2- 172.21.15.46:0/3535294522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93d80c7f30 0x7f93d80c3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:08.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.237+0000 7f93d6d9d640 1 -- 172.21.15.46:0/3535294522 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c80094d0 con 0x7f93d80c8310 2024-01-23T09:26:08.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.241+0000 7f93d6d9d640 1 --2- 172.21.15.46:0/3535294522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93d80c8310 0x7f93d814c940 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f93d000efc0 tx=0x7f93d000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:08.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.241+0000 7f93ceffd640 1 -- 172.21.15.46:0/3535294522 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d0009ba0 con 0x7f93d80c8310 2024-01-23T09:26:08.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.241+0000 7f93dc838640 1 -- 172.21.15.46:0/3535294522 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d80c4e10 con 0x7f93d80c8310 2024-01-23T09:26:08.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.241+0000 7f93dc838640 1 -- 172.21.15.46:0/3535294522 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d80c2e10 con 0x7f93d80c8310 2024-01-23T09:26:08.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.245+0000 7f93dc838640 1 -- 172.21.15.46:0/3535294522 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d80c2990 con 0x7f93d80c8310 2024-01-23T09:26:08.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.453+0000 7f93ceffd640 1 -- 172.21.15.46:0/3535294522 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f93d000f040 con 0x7f93d80c8310 2024-01-23T09:26:08.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.561+0000 7f93ceffd640 1 -- 172.21.15.46:0/3535294522 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d00146a0 con 0x7f93d80c8310 2024-01-23T09:26:08.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.561+0000 7f93ceffd640 1 -- 172.21.15.46:0/3535294522 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f93d0014840 con 0x7f93d80c8310 2024-01-23T09:26:08.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.565+0000 7f93ceffd640 1 --2- 172.21.15.46:0/3535294522 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f93b8066500 0x7f93b80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:08.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.565+0000 7f93d659c640 1 --2- 172.21.15.46:0/3535294522 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f93b8066500 0x7f93b80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:08.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.565+0000 7f93d659c640 1 --2- 172.21.15.46:0/3535294522 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f93b8066500 0x7f93b80689c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f93c80b2000 tx=0x7f93c8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:08.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.601+0000 7f93ceffd640 1 -- 172.21.15.46:0/3535294522 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6576+0+0 (secure 0 0 0) 0x7f93d00560b0 con 0x7f93d80c8310 2024-01-23T09:26:08.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.601+0000 7f93ceffd640 1 -- 172.21.15.46:0/3535294522 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f93d0052360 con 0x7f93d80c8310 2024-01-23T09:26:08.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:08.809+0000 7f93dc838640 1 -- 172.21.15.46:0/3535294522 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f93d80c2990 con 0x7f93d80c8310 2024-01-23T09:26:09.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.165+0000 7f93ceffd640 1 -- 172.21.15.46:0/3535294522 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7f93d80c2990 con 0x7f93d80c8310 2024-01-23T09:26:09.172 INFO:teuthology.orchestra.run.smithi046.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-23T09:26:09.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.173+0000 7f93dc838640 1 -- 172.21.15.46:0/3535294522 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f93b8066500 msgr2=0x7f93b80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:09.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.173+0000 7f93dc838640 1 --2- 172.21.15.46:0/3535294522 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f93b8066500 0x7f93b80689c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f93c80b2000 tx=0x7f93c8009040 comp rx=0 tx=0).stop 2024-01-23T09:26:09.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.173+0000 7f93dc838640 1 -- 172.21.15.46:0/3535294522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93d80c8310 msgr2=0x7f93d814c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:09.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.173+0000 7f93dc838640 1 --2- 172.21.15.46:0/3535294522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93d80c8310 0x7f93d814c940 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f93d000efc0 tx=0x7f93d000c490 comp rx=0 tx=0).stop 2024-01-23T09:26:09.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.173+0000 7f93dc838640 1 -- 172.21.15.46:0/3535294522 shutdown_connections 2024-01-23T09:26:09.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.173+0000 7f93dc838640 1 --2- 172.21.15.46:0/3535294522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93d80c8310 0x7f93d814c940 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:09.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.173+0000 7f93dc838640 1 --2- 172.21.15.46:0/3535294522 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f93b8066500 0x7f93b80689c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:09.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.173+0000 7f93dc838640 1 --2- 172.21.15.46:0/3535294522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93d80c7f30 0x7f93d80c3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:09.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.173+0000 7f93dc838640 1 --2- 172.21.15.46:0/3535294522 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93d806dfd0 0x7f93d81ed780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:09.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.173+0000 7f93dc838640 1 -- 172.21.15.46:0/3535294522 >> 172.21.15.46:0/3535294522 conn(0x7f93d806aa60 msgr2=0x7f93d80c6070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:26:09.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.173+0000 7f93dc838640 1 -- 172.21.15.46:0/3535294522 shutdown_connections 2024-01-23T09:26:09.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.173+0000 7f93dc838640 1 -- 172.21.15.46:0/3535294522 wait complete. 2024-01-23T09:26:09.202 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-23T09:26:09.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.337+0000 7f8d38af5640 1 Processor -- start 2024-01-23T09:26:09.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.337+0000 7f8d38af5640 1 -- start start 2024-01-23T09:26:09.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.337+0000 7f8d38af5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d340728a0 0x7f8d340c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:09.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.337+0000 7f8d38af5640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d3406ca80 con 0x7f8d34153860 2024-01-23T09:26:09.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.337+0000 7f8d38af5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d340c3fa0 con 0x7f8d3406c5b0 2024-01-23T09:26:09.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.337+0000 7f8d38af5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3415db50 con 0x7f8d340728a0 2024-01-23T09:26:09.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.337+0000 7f8d3259c640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8d34153860 0x7f8d34159520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44312/0 (socket says 172.21.15.46:44312) 2024-01-23T09:26:09.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.337+0000 7f8d3259c640 1 -- 172.21.15.46:0/2047701685 learned_addr learned my addr 172.21.15.46:0/2047701685 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T09:26:09.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.341+0000 7f8d3159a640 1 -- 172.21.15.46:0/2047701685 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2247161564 0 0) 0x7f8d3406ca80 con 0x7f8d34153860 2024-01-23T09:26:09.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.341+0000 7f8d3159a640 1 -- 172.21.15.46:0/2047701685 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d1c003530 con 0x7f8d34153860 2024-01-23T09:26:09.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.345+0000 7f8d32d9d640 1 --2- 172.21.15.46:0/2047701685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d340728a0 0x7f8d340c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:09.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.345+0000 7f8d3159a640 1 -- 172.21.15.46:0/2047701685 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 207947459 0 0) 0x7f8d1c003530 con 0x7f8d34153860 2024-01-23T09:26:09.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.345+0000 7f8d3159a640 1 -- 172.21.15.46:0/2047701685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d340728a0 msgr2=0x7f8d340c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:26:09.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.345+0000 7f8d3159a640 1 --2- 172.21.15.46:0/2047701685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d340728a0 0x7f8d340c4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:09.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.345+0000 7f8d3159a640 1 -- 172.21.15.46:0/2047701685 >> v1:172.21.15.175:6789/0 conn(0x7f8d3406c5b0 legacy=0x7f8d34159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:26:09.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.345+0000 7f8d3159a640 1 -- 172.21.15.46:0/2047701685 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d340c4280 con 0x7f8d34153860 2024-01-23T09:26:09.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.345+0000 7f8d3159a640 1 -- 172.21.15.46:0/2047701685 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 466917103 0 0) 0x7f8d240016a0 con 0x7f8d34153860 2024-01-23T09:26:09.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.345+0000 7f8d3159a640 1 -- 172.21.15.46:0/2047701685 >> v1:172.21.15.46:6789/0 conn(0x7f8d34153860 legacy=0x7f8d34159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:09.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.345+0000 7f8d3159a640 1 --2- 172.21.15.46:0/2047701685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d1c003a20 0x7f8d1c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:09.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.345+0000 7f8d3159a640 1 --2- 172.21.15.46:0/2047701685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d340728a0 0x7f8d1c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:09.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.345+0000 7f8d3159a640 1 --2- 172.21.15.46:0/2047701685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d1c004de0 0x7f8d1c005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:09.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.345+0000 7f8d3159a640 1 -- 172.21.15.46:0/2047701685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3415db50 con 0x7f8d1c003a20 2024-01-23T09:26:09.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.345+0000 7f8d3159a640 1 -- 172.21.15.46:0/2047701685 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c00bcb0 con 0x7f8d1c004de0 2024-01-23T09:26:09.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.345+0000 7f8d3159a640 1 -- 172.21.15.46:0/2047701685 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c00be70 con 0x7f8d340728a0 2024-01-23T09:26:09.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.349+0000 7f8d3259c640 1 --2- 172.21.15.46:0/2047701685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d1c003a20 0x7f8d1c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:09.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.349+0000 7f8d3259c640 1 -- 172.21.15.46:0/2047701685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d340728a0 msgr2=0x7f8d1c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:26:09.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.349+0000 7f8d3259c640 1 --2- 172.21.15.46:0/2047701685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d340728a0 0x7f8d1c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:09.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.349+0000 7f8d3259c640 1 -- 172.21.15.46:0/2047701685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d1c004de0 msgr2=0x7f8d1c005260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:26:09.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.349+0000 7f8d3259c640 1 --2- 172.21.15.46:0/2047701685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d1c004de0 0x7f8d1c005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:09.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.349+0000 7f8d3259c640 1 -- 172.21.15.46:0/2047701685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d340c4280 con 0x7f8d1c003a20 2024-01-23T09:26:09.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.353+0000 7f8d3259c640 1 --2- 172.21.15.46:0/2047701685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d1c003a20 0x7f8d1c003e20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8d2400c260 tx=0x7f8d2401f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e08cdf6aff35c0c server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:09.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.357+0000 7f8d3159a640 1 -- 172.21.15.46:0/2047701685 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d24005ae0 con 0x7f8d1c003a20 2024-01-23T09:26:09.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.357+0000 7f8d3159a640 1 -- 172.21.15.46:0/2047701685 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8d240ab070 con 0x7f8d1c003a20 2024-01-23T09:26:09.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.357+0000 7f8d3159a640 1 -- 172.21.15.46:0/2047701685 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d24007070 con 0x7f8d1c003a20 2024-01-23T09:26:09.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.361+0000 7f8d38af5640 1 -- 172.21.15.46:0/2047701685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d1c003a20 msgr2=0x7f8d1c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:09.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.361+0000 7f8d38af5640 1 --2- 172.21.15.46:0/2047701685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d1c003a20 0x7f8d1c003e20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8d2400c260 tx=0x7f8d2401f3f0 comp rx=0 tx=0).stop 2024-01-23T09:26:09.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.361+0000 7f8d32d9d640 1 -- 172.21.15.46:0/2047701685 reap_dead start 2024-01-23T09:26:09.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.361+0000 7f8d38af5640 1 -- 172.21.15.46:0/2047701685 shutdown_connections 2024-01-23T09:26:09.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.361+0000 7f8d38af5640 1 -- 172.21.15.46:0/2047701685 >> 172.21.15.46:0/2047701685 conn(0x7f8d3408b600 msgr2=0x7f8d34071d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:26:09.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.361+0000 7f8d38af5640 1 -- 172.21.15.46:0/2047701685 shutdown_connections 2024-01-23T09:26:09.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.361+0000 7f8d38af5640 1 -- 172.21.15.46:0/2047701685 wait complete. 2024-01-23T09:26:09.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.361+0000 7f8d38af5640 1 Processor -- start 2024-01-23T09:26:09.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.361+0000 7f8d38af5640 1 -- start start 2024-01-23T09:26:09.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.361+0000 7f8d38af5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d1c003a20 0x7f8d34143df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:09.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.361+0000 7f8d38af5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d340b3dc0 0x7f8d340b2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:09.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.361+0000 7f8d38af5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d340b2dd0 0x7f8d340cb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:09.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.361+0000 7f8d38af5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d341545a0 con 0x7f8d340b3dc0 2024-01-23T09:26:09.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.361+0000 7f8d38af5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d340b2400 con 0x7f8d1c003a20 2024-01-23T09:26:09.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.361+0000 7f8d38af5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d34155440 con 0x7f8d340b2dd0 2024-01-23T09:26:09.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.361+0000 7f8d31d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d340b3dc0 0x7f8d340b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:09.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.365+0000 7f8d31d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d340b3dc0 0x7f8d340b2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37308/0 (socket says 172.21.15.46:37308) 2024-01-23T09:26:09.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.365+0000 7f8d31d9b640 1 -- 172.21.15.46:0/1494991108 learned_addr learned my addr 172.21.15.46:0/1494991108 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:26:09.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.365+0000 7f8d32d9d640 1 --2- 172.21.15.46:0/1494991108 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d340b2dd0 0x7f8d340cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:09.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.365+0000 7f8d31d9b640 1 -- 172.21.15.46:0/1494991108 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d340b2dd0 msgr2=0x7f8d340cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:09.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.365+0000 7f8d31d9b640 1 --2- 172.21.15.46:0/1494991108 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d340b2dd0 0x7f8d340cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:09.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.365+0000 7f8d31d9b640 1 -- 172.21.15.46:0/1494991108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d1c003a20 msgr2=0x7f8d34143df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:09.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.369+0000 7f8d31d9b640 1 --2- 172.21.15.46:0/1494991108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d1c003a20 0x7f8d34143df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:09.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.369+0000 7f8d31d9b640 1 -- 172.21.15.46:0/1494991108 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d340b3250 con 0x7f8d340b3dc0 2024-01-23T09:26:09.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.369+0000 7f8d31d9b640 1 --2- 172.21.15.46:0/1494991108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d340b3dc0 0x7f8d340b2890 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8d2800c440 tx=0x7f8d2800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:09.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.373+0000 7f8d22ffd640 1 -- 172.21.15.46:0/1494991108 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d28005480 con 0x7f8d340b3dc0 2024-01-23T09:26:09.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.373+0000 7f8d22ffd640 1 -- 172.21.15.46:0/1494991108 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8d28003600 con 0x7f8d340b3dc0 2024-01-23T09:26:09.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.373+0000 7f8d38af5640 1 -- 172.21.15.46:0/1494991108 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d34157190 con 0x7f8d340b3dc0 2024-01-23T09:26:09.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.373+0000 7f8d22ffd640 1 -- 172.21.15.46:0/1494991108 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d280039b0 con 0x7f8d340b3dc0 2024-01-23T09:26:09.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.373+0000 7f8d38af5640 1 -- 172.21.15.46:0/1494991108 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d34157430 con 0x7f8d340b3dc0 2024-01-23T09:26:09.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.377+0000 7f8d38af5640 1 -- 172.21.15.46:0/1494991108 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d34074340 con 0x7f8d340b3dc0 2024-01-23T09:26:09.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.393+0000 7f8d22ffd640 1 -- 172.21.15.46:0/1494991108 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f8d28003b10 con 0x7f8d340b3dc0 2024-01-23T09:26:09.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.397+0000 7f8d22ffd640 1 --2- 172.21.15.46:0/1494991108 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8d14066530 0x7f8d140689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:09.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.397+0000 7f8d3259c640 1 --2- 172.21.15.46:0/1494991108 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8d14066530 0x7f8d140689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:09.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.397+0000 7f8d3259c640 1 --2- 172.21.15.46:0/1494991108 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8d14066530 0x7f8d140689f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8d240af000 tx=0x7f8d24001960 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:09.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.501+0000 7f8d22ffd640 1 -- 172.21.15.46:0/1494991108 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7006+0+0 (secure 0 0 0) 0x7f8d28054870 con 0x7f8d340b3dc0 2024-01-23T09:26:09.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.669+0000 7f8d22ffd640 1 -- 172.21.15.46:0/1494991108 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f8d28050bb0 con 0x7f8d340b3dc0 2024-01-23T09:26:09.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:09.873+0000 7f8d38af5640 1 -- 172.21.15.46:0/1494991108 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8d340b25b0 con 0x7f8d340b3dc0 2024-01-23T09:26:10.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:10.901+0000 7f8d22ffd640 1 -- 172.21.15.46:0/1494991108 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8d340b25b0 con 0x7f8d340b3dc0 2024-01-23T09:26:10.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:10.905+0000 7f8d38af5640 1 -- 172.21.15.46:0/1494991108 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8d14066530 msgr2=0x7f8d140689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:10.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:10.905+0000 7f8d38af5640 1 --2- 172.21.15.46:0/1494991108 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8d14066530 0x7f8d140689f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8d240af000 tx=0x7f8d24001960 comp rx=0 tx=0).stop 2024-01-23T09:26:10.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:10.905+0000 7f8d38af5640 1 -- 172.21.15.46:0/1494991108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d340b3dc0 msgr2=0x7f8d340b2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:10.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:10.905+0000 7f8d38af5640 1 --2- 172.21.15.46:0/1494991108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d340b3dc0 0x7f8d340b2890 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8d2800c440 tx=0x7f8d2800c900 comp rx=0 tx=0).stop 2024-01-23T09:26:10.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:10.905+0000 7f8d38af5640 1 -- 172.21.15.46:0/1494991108 shutdown_connections 2024-01-23T09:26:10.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:10.905+0000 7f8d38af5640 1 --2- 172.21.15.46:0/1494991108 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d340b2dd0 0x7f8d340cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:10.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:10.905+0000 7f8d38af5640 1 --2- 172.21.15.46:0/1494991108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d340b3dc0 0x7f8d340b2890 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:10.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:10.905+0000 7f8d38af5640 1 --2- 172.21.15.46:0/1494991108 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f8d14066530 0x7f8d140689f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:10.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:10.905+0000 7f8d38af5640 1 --2- 172.21.15.46:0/1494991108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d1c003a20 0x7f8d34143df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:10.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:10.905+0000 7f8d38af5640 1 -- 172.21.15.46:0/1494991108 >> 172.21.15.46:0/1494991108 conn(0x7f8d3408b600 msgr2=0x7f8d3414fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:26:10.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:10.905+0000 7f8d38af5640 1 -- 172.21.15.46:0/1494991108 shutdown_connections 2024-01-23T09:26:10.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:10.905+0000 7f8d38af5640 1 -- 172.21.15.46:0/1494991108 wait complete. 2024-01-23T09:26:10.930 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-23T09:26:11.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.037+0000 7f84b6152640 1 Processor -- start 2024-01-23T09:26:11.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.037+0000 7f84b6152640 1 -- start start 2024-01-23T09:26:11.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.037+0000 7f84b6152640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84b014d1b0 0x7f84b00c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:11.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.037+0000 7f84b6152640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f84b00c8e80 0x7f84b0159870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:11.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.037+0000 7f84b6152640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b0156ae0 con 0x7f84b00c0e90 2024-01-23T09:26:11.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.037+0000 7f84b6152640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b006f0d0 con 0x7f84b00c8e80 2024-01-23T09:26:11.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.037+0000 7f84b6152640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b0156280 con 0x7f84b014d1b0 2024-01-23T09:26:11.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.081+0000 7f84affff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f84b00c8e80 0x7f84b0159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:11.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.085+0000 7f84affff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f84b00c8e80 0x7f84b0159870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:60366/0 (socket says 172.21.15.46:60366) 2024-01-23T09:26:11.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.085+0000 7f84affff640 1 -- 172.21.15.46:0/1874085845 learned_addr learned my addr 172.21.15.46:0/1874085845 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:26:11.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.089+0000 7f84affff640 1 -- 172.21.15.46:0/1874085845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84b014d1b0 msgr2=0x7f84b00c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:26:11.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.089+0000 7f84affff640 1 --2- 172.21.15.46:0/1874085845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84b014d1b0 0x7f84b00c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:11.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.089+0000 7f84affff640 1 -- 172.21.15.46:0/1874085845 >> v1:172.21.15.175:6789/0 conn(0x7f84b00c0e90 legacy=0x7f84b00c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:26:11.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.089+0000 7f84affff640 1 -- 172.21.15.46:0/1874085845 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b0159db0 con 0x7f84b00c8e80 2024-01-23T09:26:11.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.093+0000 7f84affff640 1 --2- 172.21.15.46:0/1874085845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84b00c8e80 0x7f84b0159870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f84a8009e50 tx=0x7f84a801c9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=868c676b3d83fb7c server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:11.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.097+0000 7f84ae7fc640 1 -- 172.21.15.46:0/1874085845 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a80a5850 con 0x7f84b00c8e80 2024-01-23T09:26:11.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.097+0000 7f84ae7fc640 1 -- 172.21.15.46:0/1874085845 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f84a80a59b0 con 0x7f84b00c8e80 2024-01-23T09:26:11.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.097+0000 7f84b6152640 1 -- 172.21.15.46:0/1874085845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84b00c8e80 msgr2=0x7f84b0159870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:11.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.097+0000 7f84b6152640 1 --2- 172.21.15.46:0/1874085845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84b00c8e80 0x7f84b0159870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f84a8009e50 tx=0x7f84a801c9d0 comp rx=0 tx=0).stop 2024-01-23T09:26:11.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.097+0000 7f84b6152640 1 -- 172.21.15.46:0/1874085845 shutdown_connections 2024-01-23T09:26:11.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.097+0000 7f84b6152640 1 --2- 172.21.15.46:0/1874085845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84b00c8e80 0x7f84b0159870 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:11.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.097+0000 7f84b6152640 1 --2- 172.21.15.46:0/1874085845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84b014d1b0 0x7f84b00c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:11.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.097+0000 7f84b6152640 1 -- 172.21.15.46:0/1874085845 >> 172.21.15.46:0/1874085845 conn(0x7f84b0072450 msgr2=0x7f84b006fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:26:11.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.101+0000 7f84b6152640 1 -- 172.21.15.46:0/1874085845 shutdown_connections 2024-01-23T09:26:11.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.101+0000 7f84b6152640 1 -- 172.21.15.46:0/1874085845 wait complete. 2024-01-23T09:26:11.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.101+0000 7f84b6152640 1 Processor -- start 2024-01-23T09:26:11.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.101+0000 7f84b6152640 1 -- start start 2024-01-23T09:26:11.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.101+0000 7f84b6152640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84b00c0e90 0x7f84b01f0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:11.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.101+0000 7f84b6152640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84b00c8e80 0x7f84b0141760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:11.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.101+0000 7f84b6152640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84b014d1b0 0x7f84b0155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:11.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.101+0000 7f84b6152640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b01f13f0 con 0x7f84b014d1b0 2024-01-23T09:26:11.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.101+0000 7f84b6152640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b014d5f0 con 0x7f84b00c0e90 2024-01-23T09:26:11.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.101+0000 7f84b6152640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b01409a0 con 0x7f84b00c8e80 2024-01-23T09:26:11.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.105+0000 7f84affff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84b014d1b0 0x7f84b0155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:11.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.105+0000 7f84affff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84b014d1b0 0x7f84b0155520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37316/0 (socket says 172.21.15.46:37316) 2024-01-23T09:26:11.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.105+0000 7f84affff640 1 -- 172.21.15.46:0/951633429 learned_addr learned my addr 172.21.15.46:0/951633429 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:26:11.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.105+0000 7f84af7fe640 1 --2- 172.21.15.46:0/951633429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84b00c0e90 0x7f84b01f0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:11.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.109+0000 7f84affff640 1 -- 172.21.15.46:0/951633429 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84b00c8e80 msgr2=0x7f84b0141760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:11.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.109+0000 7f84affff640 1 --2- 172.21.15.46:0/951633429 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84b00c8e80 0x7f84b0141760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:11.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.109+0000 7f84affff640 1 -- 172.21.15.46:0/951633429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84b00c0e90 msgr2=0x7f84b01f0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:11.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.109+0000 7f84affff640 1 --2- 172.21.15.46:0/951633429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84b00c0e90 0x7f84b01f0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:11.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.109+0000 7f84affff640 1 -- 172.21.15.46:0/951633429 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a8009b30 con 0x7f84b014d1b0 2024-01-23T09:26:11.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.113+0000 7f84affff640 1 --2- 172.21.15.46:0/951633429 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84b014d1b0 0x7f84b0155520 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f84a801d270 tx=0x7f84a8019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:11.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.117+0000 7f8497fff640 1 -- 172.21.15.46:0/951633429 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a80bd070 con 0x7f84b014d1b0 2024-01-23T09:26:11.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.117+0000 7f8497fff640 1 -- 172.21.15.46:0/951633429 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f84a8003d30 con 0x7f84b014d1b0 2024-01-23T09:26:11.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.117+0000 7f84b6152640 1 -- 172.21.15.46:0/951633429 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b0140c40 con 0x7f84b014d1b0 2024-01-23T09:26:11.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.117+0000 7f8497fff640 1 -- 172.21.15.46:0/951633429 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a8003ea0 con 0x7f84b014d1b0 2024-01-23T09:26:11.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.117+0000 7f84b6152640 1 -- 172.21.15.46:0/951633429 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b014db20 con 0x7f84b014d1b0 2024-01-23T09:26:11.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.121+0000 7f84b6152640 1 -- 172.21.15.46:0/951633429 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b00c97b0 con 0x7f84b014d1b0 2024-01-23T09:26:11.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.145+0000 7f8497fff640 1 -- 172.21.15.46:0/951633429 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f84a80042a0 con 0x7f84b014d1b0 2024-01-23T09:26:11.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.145+0000 7f8497fff640 1 --2- 172.21.15.46:0/951633429 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f849c066500 0x7f849c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:11.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.145+0000 7f84af7fe640 1 --2- 172.21.15.46:0/951633429 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f849c066500 0x7f849c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:11.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.145+0000 7f84af7fe640 1 --2- 172.21.15.46:0/951633429 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f849c066500 0x7f849c0689c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f84a00098f0 tx=0x7f84a0006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:11.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.405+0000 7f8497fff640 1 -- 172.21.15.46:0/951633429 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7006+0+0 (secure 0 0 0) 0x7f84a80f1340 con 0x7f84b014d1b0 2024-01-23T09:26:11.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.405+0000 7f8497fff640 1 -- 172.21.15.46:0/951633429 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f84a80ecf80 con 0x7f84b014d1b0 2024-01-23T09:26:11.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:11.601+0000 7f84b6152640 1 -- 172.21.15.46:0/951633429 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f84b00c97b0 con 0x7f84b014d1b0 2024-01-23T09:26:12.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.717+0000 7f8497fff640 1 -- 172.21.15.46:0/951633429 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v32) v1 ==== 181+0+0 (secure 0 0 0) 0x7f84a80f05a0 con 0x7f84b014d1b0 2024-01-23T09:26:12.722 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' removed 2024-01-23T09:26:12.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.721+0000 7f84b6152640 1 -- 172.21.15.46:0/951633429 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f849c066500 msgr2=0x7f849c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:12.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.721+0000 7f84b6152640 1 --2- 172.21.15.46:0/951633429 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f849c066500 0x7f849c0689c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f84a00098f0 tx=0x7f84a0006f90 comp rx=0 tx=0).stop 2024-01-23T09:26:12.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.721+0000 7f84b6152640 1 -- 172.21.15.46:0/951633429 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84b014d1b0 msgr2=0x7f84b0155520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:12.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.721+0000 7f84b6152640 1 --2- 172.21.15.46:0/951633429 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84b014d1b0 0x7f84b0155520 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f84a801d270 tx=0x7f84a8019770 comp rx=0 tx=0).stop 2024-01-23T09:26:12.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.721+0000 7f84b6152640 1 -- 172.21.15.46:0/951633429 shutdown_connections 2024-01-23T09:26:12.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.721+0000 7f84b6152640 1 --2- 172.21.15.46:0/951633429 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84b014d1b0 0x7f84b0155520 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:12.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.721+0000 7f84b6152640 1 --2- 172.21.15.46:0/951633429 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84b00c8e80 0x7f84b0141760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:12.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.721+0000 7f84b6152640 1 --2- 172.21.15.46:0/951633429 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f849c066500 0x7f849c0689c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:12.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.721+0000 7f84b6152640 1 --2- 172.21.15.46:0/951633429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84b00c0e90 0x7f84b01f0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:12.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.721+0000 7f84b6152640 1 -- 172.21.15.46:0/951633429 >> 172.21.15.46:0/951633429 conn(0x7f84b0072450 msgr2=0x7f84b014bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:26:12.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.721+0000 7f84b6152640 1 -- 172.21.15.46:0/951633429 shutdown_connections 2024-01-23T09:26:12.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.721+0000 7f84b6152640 1 -- 172.21.15.46:0/951633429 wait complete. 2024-01-23T09:26:12.758 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-23T09:26:12.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.885+0000 7f552641b640 1 Processor -- start 2024-01-23T09:26:12.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.885+0000 7f552641b640 1 -- start start 2024-01-23T09:26:12.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.889+0000 7f552641b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55201517a0 0x7f55200c1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:12.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.889+0000 7f552641b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5520070af0 0x7f5520070f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:12.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.889+0000 7f552641b640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55200c8cf0 con 0x7f552015b330 2024-01-23T09:26:12.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.889+0000 7f552641b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5520151b80 con 0x7f5520070af0 2024-01-23T09:26:12.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.889+0000 7f552641b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55200c2270 con 0x7f55201517a0 2024-01-23T09:26:12.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.889+0000 7f55177fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f552015b330 0x7f55200c9a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39054/0 (socket says 172.21.15.46:39054) 2024-01-23T09:26:12.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.889+0000 7f55177fe640 1 -- 172.21.15.46:0/295798458 learned_addr learned my addr 172.21.15.46:0/295798458 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-23T09:26:12.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.889+0000 7f551ffff640 1 --2- 172.21.15.46:0/295798458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55201517a0 0x7f55200c1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:12.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.889+0000 7f55249b8640 1 --2- 172.21.15.46:0/295798458 >> v2:172.21.15.175:3300/0 conn(0x7f5520070af0 0x7f5520070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:12.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.893+0000 7f551f7fe640 1 -- 172.21.15.46:0/295798458 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1868611739 0 0) 0x7f55200c8cf0 con 0x7f552015b330 2024-01-23T09:26:12.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.893+0000 7f551f7fe640 1 -- 172.21.15.46:0/295798458 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f550c003530 con 0x7f552015b330 2024-01-23T09:26:12.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.893+0000 7f55249b8640 1 -- 172.21.15.46:0/295798458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55201517a0 msgr2=0x7f55200c1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:26:12.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.893+0000 7f55249b8640 1 --2- 172.21.15.46:0/295798458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55201517a0 0x7f55200c1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:12.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.893+0000 7f55249b8640 1 -- 172.21.15.46:0/295798458 >> v1:172.21.15.46:6789/0 conn(0x7f552015b330 legacy=0x7f55200c9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:12.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.893+0000 7f55249b8640 1 -- 172.21.15.46:0/295798458 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55200c7ba0 con 0x7f5520070af0 2024-01-23T09:26:12.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.901+0000 7f55249b8640 1 --2- 172.21.15.46:0/295798458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5520070af0 0x7f5520070f20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5518009d90 tx=0x7f551801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d37d8cd861840b6 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:12.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.905+0000 7f551f7fe640 1 -- 172.21.15.46:0/295798458 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55180a5a10 con 0x7f5520070af0 2024-01-23T09:26:12.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.905+0000 7f551f7fe640 1 -- 172.21.15.46:0/295798458 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f55180a5b70 con 0x7f5520070af0 2024-01-23T09:26:12.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.905+0000 7f551f7fe640 1 -- 172.21.15.46:0/295798458 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55180ad440 con 0x7f5520070af0 2024-01-23T09:26:12.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.905+0000 7f552641b640 1 -- 172.21.15.46:0/295798458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5520070af0 msgr2=0x7f5520070f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:12.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.905+0000 7f552641b640 1 --2- 172.21.15.46:0/295798458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5520070af0 0x7f5520070f20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5518009d90 tx=0x7f551801c950 comp rx=0 tx=0).stop 2024-01-23T09:26:12.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.905+0000 7f552641b640 1 -- 172.21.15.46:0/295798458 shutdown_connections 2024-01-23T09:26:12.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.905+0000 7f552641b640 1 --2- 172.21.15.46:0/295798458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5520070af0 0x7f5520070f20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:12.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.905+0000 7f552641b640 1 --2- 172.21.15.46:0/295798458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55201517a0 0x7f55200c1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:12.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.905+0000 7f552641b640 1 -- 172.21.15.46:0/295798458 >> 172.21.15.46:0/295798458 conn(0x7f552006a660 msgr2=0x7f552006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:26:12.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.905+0000 7f552641b640 1 -- 172.21.15.46:0/295798458 shutdown_connections 2024-01-23T09:26:12.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.905+0000 7f552641b640 1 -- 172.21.15.46:0/295798458 wait complete. 2024-01-23T09:26:12.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.909+0000 7f552641b640 1 Processor -- start 2024-01-23T09:26:12.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.909+0000 7f552641b640 1 -- start start 2024-01-23T09:26:12.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.909+0000 7f552641b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5520070af0 0x7f55201419e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:12.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.909+0000 7f552641b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55201517a0 0x7f55201428a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:12.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.909+0000 7f552641b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f552015b330 0x7f5520142de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:12.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.909+0000 7f552641b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55200cd820 con 0x7f5520070af0 2024-01-23T09:26:12.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.909+0000 7f552641b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5520154dd0 con 0x7f55201517a0 2024-01-23T09:26:12.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.909+0000 7f552641b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5520140450 con 0x7f552015b330 2024-01-23T09:26:12.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.909+0000 7f551ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5520070af0 0x7f55201419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:12.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.909+0000 7f551ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5520070af0 0x7f55201419e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53416/0 (socket says 172.21.15.46:53416) 2024-01-23T09:26:12.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.909+0000 7f551ffff640 1 -- 172.21.15.46:0/2971811131 learned_addr learned my addr 172.21.15.46:0/2971811131 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:26:12.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.909+0000 7f55177fe640 1 --2- 172.21.15.46:0/2971811131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55201517a0 0x7f55201428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:12.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.909+0000 7f55249b8640 1 --2- 172.21.15.46:0/2971811131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f552015b330 0x7f5520142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:12.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.913+0000 7f551ffff640 1 -- 172.21.15.46:0/2971811131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f552015b330 msgr2=0x7f5520142de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:12.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.913+0000 7f551ffff640 1 --2- 172.21.15.46:0/2971811131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f552015b330 0x7f5520142de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:12.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.913+0000 7f551ffff640 1 -- 172.21.15.46:0/2971811131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55201517a0 msgr2=0x7f55201428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:12.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.913+0000 7f551ffff640 1 --2- 172.21.15.46:0/2971811131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55201517a0 0x7f55201428a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:12.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.913+0000 7f551ffff640 1 -- 172.21.15.46:0/2971811131 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5518009a70 con 0x7f5520070af0 2024-01-23T09:26:12.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.917+0000 7f551ffff640 1 --2- 172.21.15.46:0/2971811131 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5520070af0 0x7f55201419e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f551000e960 tx=0x7f551000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:12.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.921+0000 7f551d7fa640 1 -- 172.21.15.46:0/2971811131 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5510009690 con 0x7f5520070af0 2024-01-23T09:26:12.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.921+0000 7f551d7fa640 1 -- 172.21.15.46:0/2971811131 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f551000ca00 con 0x7f5520070af0 2024-01-23T09:26:12.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.921+0000 7f551d7fa640 1 -- 172.21.15.46:0/2971811131 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551000cd90 con 0x7f5520070af0 2024-01-23T09:26:12.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.925+0000 7f552641b640 1 -- 172.21.15.46:0/2971811131 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5520141f20 con 0x7f5520070af0 2024-01-23T09:26:12.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.925+0000 7f552641b640 1 -- 172.21.15.46:0/2971811131 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5520140940 con 0x7f5520070af0 2024-01-23T09:26:12.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.925+0000 7f552641b640 1 -- 172.21.15.46:0/2971811131 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55200b02e0 con 0x7f5520070af0 2024-01-23T09:26:12.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.945+0000 7f551d7fa640 1 -- 172.21.15.46:0/2971811131 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7f5510013470 con 0x7f5520070af0 2024-01-23T09:26:12.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.945+0000 7f551d7fa640 1 --2- 172.21.15.46:0/2971811131 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5500066580 0x7f5500068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:12.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.945+0000 7f55177fe640 1 --2- 172.21.15.46:0/2971811131 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5500066580 0x7f5500068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:12.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.945+0000 7f55177fe640 1 --2- 172.21.15.46:0/2971811131 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5500066580 0x7f5500068a40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f55200b2e50 tx=0x7f5508009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:12.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:12.949+0000 7f551d7fa640 1 -- 172.21.15.46:0/2971811131 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6568+0+0 (secure 0 0 0) 0x7f5510055890 con 0x7f5520070af0 2024-01-23T09:26:13.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:13.249+0000 7f551d7fa640 1 -- 172.21.15.46:0/2971811131 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7f5510051b40 con 0x7f5520070af0 2024-01-23T09:26:13.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:13.429+0000 7f552641b640 1 -- 172.21.15.46:0/2971811131 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5520074340 con 0x7f5520070af0 2024-01-23T09:26:14.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.645+0000 7f551d7fa640 1 -- 172.21.15.46:0/2971811131 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v33) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5510021020 con 0x7f5520070af0 2024-01-23T09:26:14.649 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' removed 2024-01-23T09:26:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.645+0000 7f552641b640 1 -- 172.21.15.46:0/2971811131 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5500066580 msgr2=0x7f5500068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.645+0000 7f552641b640 1 --2- 172.21.15.46:0/2971811131 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5500066580 0x7f5500068a40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f55200b2e50 tx=0x7f5508009040 comp rx=0 tx=0).stop 2024-01-23T09:26:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.645+0000 7f552641b640 1 -- 172.21.15.46:0/2971811131 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5520070af0 msgr2=0x7f55201419e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.645+0000 7f552641b640 1 --2- 172.21.15.46:0/2971811131 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5520070af0 0x7f55201419e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f551000e960 tx=0x7f551000ee20 comp rx=0 tx=0).stop 2024-01-23T09:26:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.649+0000 7f552641b640 1 -- 172.21.15.46:0/2971811131 shutdown_connections 2024-01-23T09:26:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.649+0000 7f552641b640 1 --2- 172.21.15.46:0/2971811131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f552015b330 0x7f5520142de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.649+0000 7f552641b640 1 --2- 172.21.15.46:0/2971811131 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7f5500066580 0x7f5500068a40 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.649+0000 7f552641b640 1 --2- 172.21.15.46:0/2971811131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55201517a0 0x7f55201428a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.649+0000 7f552641b640 1 --2- 172.21.15.46:0/2971811131 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5520070af0 0x7f55201419e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.649+0000 7f552641b640 1 -- 172.21.15.46:0/2971811131 >> 172.21.15.46:0/2971811131 conn(0x7f552006a660 msgr2=0x7f552006aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:26:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.649+0000 7f552641b640 1 -- 172.21.15.46:0/2971811131 shutdown_connections 2024-01-23T09:26:14.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.649+0000 7f552641b640 1 -- 172.21.15.46:0/2971811131 wait complete. 2024-01-23T09:26:14.679 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-01-23T09:26:14.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.809+0000 7fde5662f640 1 Processor -- start 2024-01-23T09:26:14.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.809+0000 7fde5662f640 1 -- start start 2024-01-23T09:26:14.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.809+0000 7fde5662f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde500ce370 0x7fde500ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:14.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.809+0000 7fde5662f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fde500cd250 0x7fde500cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:14.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.809+0000 7fde5662f640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fde500cb8a0 0x7fde500cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:14.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.809+0000 7fde5662f640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde500cec90 con 0x7fde500cb8a0 2024-01-23T09:26:14.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.809+0000 7fde5662f640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde500ce150 con 0x7fde500cd250 2024-01-23T09:26:14.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.809+0000 7fde5662f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde501598a0 con 0x7fde500ce370 2024-01-23T09:26:14.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.809+0000 7fde4f7fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fde500cd250 0x7fde500cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:14.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.809+0000 7fde54bcc640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fde500cb8a0 0x7fde500cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:14.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.809+0000 7fde4ffff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde500ce370 0x7fde500ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:14.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.809+0000 7fde4f7fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fde500cd250 0x7fde500cd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.46:53696/0 (socket says 172.21.15.46:53696) 2024-01-23T09:26:14.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.809+0000 7fde4f7fe640 1 -- 172.21.15.46:0/2506007599 learned_addr learned my addr 172.21.15.46:0/2506007599 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:26:14.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.813+0000 7fde54bcc640 1 -- 172.21.15.46:0/2506007599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde500ce370 msgr2=0x7fde500ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:26:14.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.813+0000 7fde54bcc640 1 --2- 172.21.15.46:0/2506007599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde500ce370 0x7fde500ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:14.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.813+0000 7fde54bcc640 1 -- 172.21.15.46:0/2506007599 >> v2:172.21.15.175:3300/0 conn(0x7fde500cd250 msgr2=0x7fde500cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T09:26:14.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.813+0000 7fde54bcc640 1 --2- 172.21.15.46:0/2506007599 >> v2:172.21.15.175:3300/0 conn(0x7fde500cd250 0x7fde500cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:14.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.813+0000 7fde54bcc640 1 -- 172.21.15.46:0/2506007599 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde50153ed0 con 0x7fde500cb8a0 2024-01-23T09:26:14.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.817+0000 7fde54bcc640 1 --2- 172.21.15.46:0/2506007599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde500cb8a0 0x7fde500cbd00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fde50067ef0 tx=0x7fde4801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3fe8b6888ef77f server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:14.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.825+0000 7fde4effd640 1 -- 172.21.15.46:0/2506007599 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde480a5880 con 0x7fde500cb8a0 2024-01-23T09:26:14.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.825+0000 7fde4effd640 1 -- 172.21.15.46:0/2506007599 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fde480a59e0 con 0x7fde500cb8a0 2024-01-23T09:26:14.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.825+0000 7fde4effd640 1 -- 172.21.15.46:0/2506007599 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde480a5d90 con 0x7fde500cb8a0 2024-01-23T09:26:14.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.825+0000 7fde5662f640 1 -- 172.21.15.46:0/2506007599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde500cb8a0 msgr2=0x7fde500cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:14.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.825+0000 7fde5662f640 1 --2- 172.21.15.46:0/2506007599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde500cb8a0 0x7fde500cbd00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fde50067ef0 tx=0x7fde4801c910 comp rx=0 tx=0).stop 2024-01-23T09:26:14.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.825+0000 7fde5662f640 1 -- 172.21.15.46:0/2506007599 shutdown_connections 2024-01-23T09:26:14.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.825+0000 7fde5662f640 1 --2- 172.21.15.46:0/2506007599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde500cb8a0 0x7fde500cbd00 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:14.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.825+0000 7fde5662f640 1 --2- 172.21.15.46:0/2506007599 >> v2:172.21.15.175:3300/0 conn(0x7fde500cd250 0x7fde500cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:14.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.825+0000 7fde5662f640 1 --2- 172.21.15.46:0/2506007599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde500ce370 0x7fde500ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:14.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.825+0000 7fde5662f640 1 -- 172.21.15.46:0/2506007599 >> 172.21.15.46:0/2506007599 conn(0x7fde500b09c0 msgr2=0x7fde500b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:26:14.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.825+0000 7fde5662f640 1 -- 172.21.15.46:0/2506007599 shutdown_connections 2024-01-23T09:26:14.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.825+0000 7fde5662f640 1 -- 172.21.15.46:0/2506007599 wait complete. 2024-01-23T09:26:14.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.825+0000 7fde5662f640 1 Processor -- start 2024-01-23T09:26:14.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.825+0000 7fde5662f640 1 -- start start 2024-01-23T09:26:14.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.829+0000 7fde5662f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde500cb8a0 0x7fde5015b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:14.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.829+0000 7fde5662f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde500cd250 0x7fde50152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:14.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.829+0000 7fde5662f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde500ce370 0x7fde5014f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:14.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.829+0000 7fde5662f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde501f2390 con 0x7fde500cb8a0 2024-01-23T09:26:14.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.829+0000 7fde5662f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde50151630 con 0x7fde500ce370 2024-01-23T09:26:14.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.829+0000 7fde5662f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde501f2650 con 0x7fde500cd250 2024-01-23T09:26:14.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.829+0000 7fde4ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde500cb8a0 0x7fde5015b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:14.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.829+0000 7fde4ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde500cb8a0 0x7fde5015b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53436/0 (socket says 172.21.15.46:53436) 2024-01-23T09:26:14.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.829+0000 7fde4ffff640 1 -- 172.21.15.46:0/2416908644 learned_addr learned my addr 172.21.15.46:0/2416908644 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-23T09:26:14.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.829+0000 7fde54bcc640 1 --2- 172.21.15.46:0/2416908644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde500ce370 0x7fde5014f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:14.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.829+0000 7fde4f7fe640 1 --2- 172.21.15.46:0/2416908644 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde500cd250 0x7fde50152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:14.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.833+0000 7fde4ffff640 1 -- 172.21.15.46:0/2416908644 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde500cd250 msgr2=0x7fde50152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:14.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.833+0000 7fde4ffff640 1 --2- 172.21.15.46:0/2416908644 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde500cd250 0x7fde50152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:14.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.833+0000 7fde4ffff640 1 -- 172.21.15.46:0/2416908644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde500ce370 msgr2=0x7fde5014f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:14.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.833+0000 7fde4ffff640 1 --2- 172.21.15.46:0/2416908644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde500ce370 0x7fde5014f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:14.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.833+0000 7fde4ffff640 1 -- 172.21.15.46:0/2416908644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde48009a70 con 0x7fde500cb8a0 2024-01-23T09:26:14.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.837+0000 7fde4ffff640 1 --2- 172.21.15.46:0/2416908644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde500cb8a0 0x7fde5015b300 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fde4000e930 tx=0x7fde4000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:14.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.841+0000 7fde4cff9640 1 -- 172.21.15.46:0/2416908644 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde40009690 con 0x7fde500cb8a0 2024-01-23T09:26:14.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.841+0000 7fde4cff9640 1 -- 172.21.15.46:0/2416908644 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fde4000ca00 con 0x7fde500cb8a0 2024-01-23T09:26:14.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.841+0000 7fde4cff9640 1 -- 172.21.15.46:0/2416908644 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4000cd90 con 0x7fde500cb8a0 2024-01-23T09:26:14.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.841+0000 7fde5662f640 1 -- 172.21.15.46:0/2416908644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde501f2930 con 0x7fde500cb8a0 2024-01-23T09:26:14.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.841+0000 7fde5662f640 1 -- 172.21.15.46:0/2416908644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde501f2ef0 con 0x7fde500cb8a0 2024-01-23T09:26:14.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:14.841+0000 7fde5662f640 1 -- 172.21.15.46:0/2416908644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde5006d570 con 0x7fde500cb8a0 2024-01-23T09:26:15.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:15.137+0000 7fde4cff9640 1 -- 172.21.15.46:0/2416908644 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 85819+0+0 (secure 0 0 0) 0x7fde40013470 con 0x7fde500cb8a0 2024-01-23T09:26:15.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:15.141+0000 7fde4cff9640 1 --2- 172.21.15.46:0/2416908644 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fde3c066580 0x7fde3c068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T09:26:15.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:15.141+0000 7fde4f7fe640 1 --2- 172.21.15.46:0/2416908644 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fde3c066580 0x7fde3c068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T09:26:15.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:15.141+0000 7fde4f7fe640 1 --2- 172.21.15.46:0/2416908644 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fde3c066580 0x7fde3c068a40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fde500af3f0 tx=0x7fde44009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T09:26:15.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:15.165+0000 7fde4cff9640 1 -- 172.21.15.46:0/2416908644 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6125+0+0 (secure 0 0 0) 0x7fde400559c0 con 0x7fde500cb8a0 2024-01-23T09:26:15.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:15.165+0000 7fde4cff9640 1 -- 172.21.15.46:0/2416908644 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173234 (secure 0 0 0) 0x7fde40051c70 con 0x7fde500cb8a0 2024-01-23T09:26:15.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:15.341+0000 7fde5662f640 1 -- 172.21.15.46:0/2416908644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fde500b4e10 con 0x7fde500cb8a0 2024-01-23T09:26:15.690 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-01-23T09:26:15.690 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-01-23T09:26:15.690 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2024-01-23T09:26:15.690 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-01-23T09:26:15.690 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2024-01-23T09:26:15.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:15.721+0000 7fde4cff9640 1 -- 172.21.15.46:0/2416908644 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v34) v1 ==== 178+0+0 (secure 0 0 0) 0x7fde40021070 con 0x7fde500cb8a0 2024-01-23T09:26:15.726 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data_ec' removed 2024-01-23T09:26:15.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:15.725+0000 7fde5662f640 1 -- 172.21.15.46:0/2416908644 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fde3c066580 msgr2=0x7fde3c068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:15.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:15.725+0000 7fde5662f640 1 --2- 172.21.15.46:0/2416908644 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fde3c066580 0x7fde3c068a40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fde500af3f0 tx=0x7fde44009240 comp rx=0 tx=0).stop 2024-01-23T09:26:15.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:15.725+0000 7fde5662f640 1 -- 172.21.15.46:0/2416908644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde500cb8a0 msgr2=0x7fde5015b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T09:26:15.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:15.725+0000 7fde5662f640 1 --2- 172.21.15.46:0/2416908644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde500cb8a0 0x7fde5015b300 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fde4000e930 tx=0x7fde4000edf0 comp rx=0 tx=0).stop 2024-01-23T09:26:15.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:15.725+0000 7fde5662f640 1 -- 172.21.15.46:0/2416908644 shutdown_connections 2024-01-23T09:26:15.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:15.725+0000 7fde5662f640 1 --2- 172.21.15.46:0/2416908644 >> [v2:172.21.15.46:6800/2324478006,v1:172.21.15.46:6801/2324478006] conn(0x7fde3c066580 0x7fde3c068a40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:15.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:15.725+0000 7fde5662f640 1 --2- 172.21.15.46:0/2416908644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde500ce370 0x7fde5014f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:15.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:15.725+0000 7fde5662f640 1 --2- 172.21.15.46:0/2416908644 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde500cd250 0x7fde50152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:15.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:15.725+0000 7fde5662f640 1 --2- 172.21.15.46:0/2416908644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde500cb8a0 0x7fde5015b300 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T09:26:15.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:15.725+0000 7fde5662f640 1 -- 172.21.15.46:0/2416908644 >> 172.21.15.46:0/2416908644 conn(0x7fde500b09c0 msgr2=0x7fde50157b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T09:26:15.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:15.725+0000 7fde5662f640 1 -- 172.21.15.46:0/2416908644 shutdown_connections 2024-01-23T09:26:15.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-23T09:26:15.725+0000 7fde5662f640 1 -- 172.21.15.46:0/2416908644 wait complete. 2024-01-23T09:26:15.760 INFO:teuthology.misc:Shutting down mds daemons... 2024-01-23T09:26:15.760 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-23T09:26:15.760 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T09:26:15.760 INFO:tasks.ceph.mds.a:Stopped 2024-01-23T09:26:15.760 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-23T09:26:15.760 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T09:26:15.760 INFO:tasks.ceph.mds.c:Stopped 2024-01-23T09:26:15.760 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-01-23T09:26:15.761 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T09:26:15.761 INFO:tasks.ceph.mds.e:Stopped 2024-01-23T09:26:15.761 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-23T09:26:15.761 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T09:26:15.761 INFO:tasks.ceph.mds.b:Stopped 2024-01-23T09:26:15.761 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-23T09:26:15.761 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T09:26:15.810 INFO:tasks.ceph.mds.d.smithi175.stderr:2024-01-23T09:26:15.775+0000 b9ce640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i d (PID: 32830) UID: 0 2024-01-23T09:26:15.811 INFO:tasks.ceph.mds.d.smithi175.stderr:2024-01-23T09:26:15.783+0000 b9ce640 -1 mds.d *** got signal Terminated *** 2024-01-23T09:26:21.864 INFO:tasks.ceph.mds.d:Stopped 2024-01-23T09:26:21.864 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-01-23T09:26:21.864 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T09:26:21.864 INFO:tasks.ceph.mds.f:Stopped 2024-01-23T09:26:21.864 INFO:teuthology.misc:Shutting down osd daemons... 2024-01-23T09:26:21.865 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-01-23T09:26:21.865 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T09:26:21.866 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-01-23T09:26:21.861+0000 7fc1932bb640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 27429) UID: 0 2024-01-23T09:26:21.866 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-01-23T09:26:21.861+0000 7fc1932bb640 -1 osd.0 35 *** Got signal Terminated *** 2024-01-23T09:26:22.000 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-01-23T09:26:22.000 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~6s 2024-01-23T09:26:22.000 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-01-23T09:26:22.000 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-01-23T09:26:22.000 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e has been restored 2024-01-23T09:26:22.000 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-01-23T09:26:24.106 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:26:24.108 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:26:27.967 INFO:tasks.ceph.osd.0:Stopped 2024-01-23T09:26:27.968 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-01-23T09:26:27.968 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T09:26:27.969 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-01-23T09:26:27.969+0000 7f5c28d3b640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 27431) UID: 0 2024-01-23T09:26:27.969 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-01-23T09:26:27.969+0000 7f5c28d3b640 -1 osd.1 36 *** Got signal Terminated *** 2024-01-23T09:26:28.210 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-01-23T09:26:28.210 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2024-01-23T09:26:28.210 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-01-23T09:26:34.069 INFO:tasks.ceph.osd.1:Stopped 2024-01-23T09:26:34.070 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-01-23T09:26:34.070 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T09:26:34.071 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-01-23T09:26:34.065+0000 7f071402a640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 27433) UID: 0 2024-01-23T09:26:34.071 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-01-23T09:26:34.065+0000 7f071402a640 -1 osd.2 38 *** Got signal Terminated *** 2024-01-23T09:26:34.319 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-01-23T09:26:34.319 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-01-23T09:26:40.172 INFO:tasks.ceph.osd.2:Stopped 2024-01-23T09:26:40.172 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-01-23T09:26:40.172 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T09:26:40.173 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-01-23T09:26:40.169+0000 7f1366cba640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 27435) UID: 0 2024-01-23T09:26:40.173 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-01-23T09:26:40.169+0000 7f1366cba640 -1 osd.3 39 *** Got signal Terminated *** 2024-01-23T09:26:40.328 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-01-23T09:26:40.328 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-01-23T09:26:46.236 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-01-23T09:26:46.236 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-01-23T09:26:46.274 INFO:tasks.ceph.osd.3:Stopped 2024-01-23T09:26:46.274 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-01-23T09:26:46.274 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T09:26:46.275 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-01-23T09:26:46.278+0000 7f7468c46640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 27648) UID: 0 2024-01-23T09:26:46.276 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-01-23T09:26:46.278+0000 7f7468c46640 -1 osd.4 40 *** Got signal Terminated *** 2024-01-23T09:26:52.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-01-23T09:26:52.044 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-01-23T09:26:52.376 INFO:tasks.ceph.osd.4:Stopped 2024-01-23T09:26:52.377 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-01-23T09:26:52.377 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T09:26:52.378 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-01-23T09:26:52.382+0000 7ff7a10a2640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 27650) UID: 0 2024-01-23T09:26:52.378 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-01-23T09:26:52.382+0000 7ff7a10a2640 -1 osd.5 41 *** Got signal Terminated *** 2024-01-23T09:26:54.179 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:26:54.182 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:26:57.750 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-01-23T09:26:57.750 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-01-23T09:26:58.478 INFO:tasks.ceph.osd.5:Stopped 2024-01-23T09:26:58.479 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-01-23T09:26:58.479 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T09:26:58.480 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-01-23T09:26:58.482+0000 7fedf7dc7640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 27652) UID: 0 2024-01-23T09:26:58.480 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-01-23T09:26:58.482+0000 7fedf7dc7640 -1 osd.6 42 *** Got signal Terminated *** 2024-01-23T09:27:03.355 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-01-23T09:27:03.355 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-01-23T09:27:04.581 INFO:tasks.ceph.osd.6:Stopped 2024-01-23T09:27:04.581 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-01-23T09:27:04.581 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T09:27:04.582 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-01-23T09:27:04.586+0000 7ffaa8155640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 27654) UID: 0 2024-01-23T09:27:04.583 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-01-23T09:27:04.586+0000 7ffaa8155640 -1 osd.7 42 *** Got signal Terminated *** 2024-01-23T09:27:08.860 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-01-23T09:27:08.860 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-01-23T09:27:10.683 INFO:tasks.ceph.osd.7:Stopped 2024-01-23T09:27:10.683 INFO:teuthology.misc:Shutting down mgr daemons... 2024-01-23T09:27:10.684 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-01-23T09:27:10.684 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T09:27:10.685 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-23T09:27:10.684+0000 7f738cb25640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mgr -f --cluster ceph -i y (PID: 27239) UID: 0 2024-01-23T09:27:10.686 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-23T09:27:10.684+0000 7f738cb25640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-01-23T09:27:10.730 INFO:tasks.ceph.mgr.y:Stopped 2024-01-23T09:27:10.731 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-01-23T09:27:10.731 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T09:27:10.758 INFO:tasks.ceph.mgr.x:Stopped 2024-01-23T09:27:10.758 INFO:teuthology.misc:Shutting down mon daemons... 2024-01-23T09:27:10.758 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-01-23T09:27:10.758 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T09:27:10.794 INFO:tasks.ceph.mon.a.smithi046.stderr:2024-01-23T09:27:10.776+0000 a369640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 27234) UID: 0 2024-01-23T09:27:10.795 INFO:tasks.ceph.mon.a.smithi046.stderr:2024-01-23T09:27:10.776+0000 a369640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-01-23T09:27:14.163 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-01-23T09:27:24.233 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:27:24.236 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:27:54.280 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:27:54.283 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:28:03.982 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:34:41.268 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:28:03.991 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:34:41.277 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:28:04.030 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:34:41.315 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:28:04.037 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:34:41.323 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:28:04.109 INFO:tasks.ceph.mon.b.smithi175.stderr:==00:00:34:41.395 27330== Warning: unimplemented fcntl command: 1036 2024-01-23T09:28:04.110 INFO:tasks.ceph.mon.c.smithi175.stderr:==00:00:34:41.396 27332== Warning: unimplemented fcntl command: 1036 2024-01-23T09:28:24.327 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:28:24.330 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:28:54.374 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:28:54.377 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:29:24.466 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:29:24.469 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:29:54.521 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:29:54.524 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:30:24.574 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:30:24.577 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:30:54.627 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:30:54.631 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:31:24.881 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:31:24.885 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:31:54.953 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:31:54.956 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:32:09.831 INFO:tasks.ceph:Checking cluster log for badness... 2024-01-23T09:32:09.831 DEBUG:teuthology.orchestra.run.smithi046:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2024-01-23T09:32:09.847 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi046.front.sepia.ceph.com 2024-01-23T09:32:09.848 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-01-23T09:32:10.076 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi046.front.sepia.ceph.com 2024-01-23T09:32:10.076 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-01-23T09:32:10.248 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi046.front.sepia.ceph.com 2024-01-23T09:32:10.248 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-01-23T09:32:10.431 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi046.front.sepia.ceph.com 2024-01-23T09:32:10.431 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-01-23T09:32:10.606 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi175.front.sepia.ceph.com 2024-01-23T09:32:10.606 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-01-23T09:32:10.799 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi175.front.sepia.ceph.com 2024-01-23T09:32:10.799 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-01-23T09:32:10.978 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi175.front.sepia.ceph.com 2024-01-23T09:32:10.978 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-01-23T09:32:11.110 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi175.front.sepia.ceph.com 2024-01-23T09:32:11.111 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-01-23T09:32:11.235 INFO:tasks.ceph:Archiving mon data... 2024-01-23T09:32:11.236 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-01-22_19:46:51-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7527402/data/mon.a.tgz 2024-01-23T09:32:11.236 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-01-23T09:32:11.241 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.QJlgzqvi4D 2024-01-23T09:32:11.242 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.QJlgzqvi4D 2024-01-23T09:32:11.371 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.QJlgzqvi4D 2024-01-23T09:32:11.432 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.QJlgzqvi4D is 331KB 2024-01-23T09:32:11.489 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.QJlgzqvi4D 2024-01-23T09:32:11.494 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-01-22_19:46:51-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7527402/data/mon.b.tgz 2024-01-23T09:32:11.494 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2024-01-23T09:32:11.500 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.aasBHqSJBG 2024-01-23T09:32:11.500 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.aasBHqSJBG 2024-01-23T09:32:11.618 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.aasBHqSJBG 2024-01-23T09:32:11.677 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.aasBHqSJBG is 321KB 2024-01-23T09:32:11.736 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.aasBHqSJBG 2024-01-23T09:32:11.741 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-01-22_19:46:51-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7527402/data/mon.c.tgz 2024-01-23T09:32:11.742 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2024-01-23T09:32:11.790 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.1FVvfD7Mih 2024-01-23T09:32:11.791 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.1FVvfD7Mih 2024-01-23T09:32:11.911 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.1FVvfD7Mih 2024-01-23T09:32:11.977 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.1FVvfD7Mih is 321KB 2024-01-23T09:32:12.037 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.1FVvfD7Mih 2024-01-23T09:32:12.045 INFO:tasks.ceph:Cleaning ceph cluster... 2024-01-23T09:32:12.045 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-23T09:32:12.047 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-23T09:32:12.461 ERROR:teuthology.util.scanner:Premature end of data in tag valgrindoutput line 3, line 50, column 1 (, line 50) 2024-01-23T09:32:12.467 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions 2024-01-23T09:32:12.712 ERROR:teuthology.util.scanner:Premature end of data in tag valgrindoutput line 3, line 50, column 1 (, line 50) 2024-01-23T09:32:12.722 ERROR:teuthology.util.scanner:Premature end of data in tag valgrindoutput line 3, line 50, column 1 (, line 50) 2024-01-23T09:32:12.726 INFO:tasks.ceph:Archiving crash dumps... 2024-01-23T09:32:12.727 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-01-22_19:46:51-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7527402/remote/smithi046/crash 2024-01-23T09:32:12.728 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-23T09:32:12.741 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-01-22_19:46:51-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7527402/remote/smithi175/crash 2024-01-23T09:32:12.742 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-23T09:32:12.755 INFO:tasks.ceph:Shutting down logrotate 2024-01-23T09:32:12.756 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:32:12.789 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-23T09:32:12.846 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-23T09:32:12.882 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-23T09:32:12.895 INFO:tasks.ceph:Compressing logs... 2024-01-23T09:32:12.895 DEBUG:teuthology.orchestra.run.smithi046:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-23T09:32:12.925 DEBUG:teuthology.orchestra.run.smithi175:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-23T09:32:12.946 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37065.log 2024-01-23T09:32:12.947 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37195.log 2024-01-23T09:32:12.947 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.37065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32828.log 2024-01-23T09:32:12.947 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.37195.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37065.log.gz 2024-01-23T09:32:12.947 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34148.log 2024-01-23T09:32:12.947 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.32828.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-01-23T09:32:12.948 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37195.log.gz 2024-01-23T09:32:12.969 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27522.log 2024-01-23T09:32:12.969 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-01-23T09:32:12.969 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-01-23T09:32:12.970 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.27522.log: /var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27547.log 2024-01-23T09:32:12.970 INFO:teuthology.orchestra.run.smithi175.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.27522.log.gz 2024-01-23T09:32:12.970 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27498.log 2024-01-23T09:32:12.970 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27571.log 2024-01-23T09:32:12.970 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.27547.log: /var/log/ceph/ceph-client.admin.27498.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-01-23T09:32:12.970 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.27571.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27498.log.gz 2024-01-23T09:32:12.970 INFO:teuthology.orchestra.run.smithi175.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.27547.log.gz 2024-01-23T09:32:12.970 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27442.log 2024-01-23T09:32:12.970 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.27571.log.gz 2024-01-23T09:32:12.970 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-01-23T09:32:12.970 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-client.admin.27442.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-01-23T09:32:12.970 INFO:teuthology.orchestra.run.smithi175.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.27442.log.gz 2024-01-23T09:32:12.970 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-23T09:32:12.971 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27619.log 2024-01-23T09:32:12.971 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27595.log 2024-01-23T09:32:12.971 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.27619.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-01-23T09:32:12.971 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.27595.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.27619.log.gz 2024-01-23T09:32:12.971 INFO:teuthology.orchestra.run.smithi175.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27595.log.gz 2024-01-23T09:32:12.971 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-23T09:32:12.971 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-01-23T09:32:12.975 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34148.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32828.log.gz 2024-01-23T09:32:12.975 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36287.log 2024-01-23T09:32:12.975 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34148.log.gz 2024-01-23T09:32:12.975 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose --/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.32537.log 2024-01-23T09:32:12.975 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35670.log 2024-01-23T09:32:12.976 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36287.log.gz 2024-01-23T09:32:12.976 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.32537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35181.log 2024-01-23T09:32:12.976 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36516.log 2024-01-23T09:32:12.976 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.35670.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32537.log.gz 2024-01-23T09:32:12.976 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.35181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33782.log 2024-01-23T09:32:12.976 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35181.log.gz 2024-01-23T09:32:12.976 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32774.log 2024-01-23T09:32:12.976 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36568.log 2024-01-23T09:32:12.976 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36516.log.gz 2024-01-23T09:32:12.976 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.33782.log: /var/log/ceph/ceph-client.admin.32774.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-01-23T09:32:12.976 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36568.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33782.log.gz 2024-01-23T09:32:12.976 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32774.log.gz 2024-01-23T09:32:12.976 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32959.log 2024-01-23T09:32:12.977 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36568.log.gz 2024-01-23T09:32:12.977 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34027.log 2024-01-23T09:32:12.977 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35103.log 2024-01-23T09:32:12.977 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.32959.log: /var/log/ceph/ceph-client.admin.34027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32988.log 2024-01-23T09:32:12.977 INFO:teuthology.orchestra.run.smithi046.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.32959.log.gz 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34027.log.gz 2024-01-23T09:32:12.977 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.35103.log: 2024-01-23T09:32:12.977 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32907.log 2024-01-23T09:32:12.977 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35103.log.gz 2024-01-23T09:32:12.977 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.32988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35389.log 2024-01-23T09:32:12.977 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32988.log.gz 2024-01-23T09:32:12.977 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32719.log 2024-01-23T09:32:12.977 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.32907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33725.log 2024-01-23T09:32:12.977 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.35389.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.32907.log.gz/var/log/ceph/ceph-client.admin.32719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37117.log 2024-01-23T09:32:12.978 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-01-23T09:32:12.978 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32719.log.gz/var/log/ceph/ceph-client.admin.33725.log: 2024-01-23T09:32:12.978 INFO:teuthology.orchestra.run.smithi046.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.35389.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32747.log 2024-01-23T09:32:12.978 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-01-23T09:32:12.978 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33725.log.gz 2024-01-23T09:32:12.978 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34341.log 2024-01-23T09:32:12.978 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.37117.log: /var/log/ceph/ceph-client.admin.32747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32501.log 2024-01-23T09:32:12.978 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34341.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37117.log.gz 2024-01-23T09:32:12.978 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34587.log 2024-01-23T09:32:12.978 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32747.log.gz 2024-01-23T09:32:12.978 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34341.log.gz 2024-01-23T09:32:12.978 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33922.log 2024-01-23T09:32:12.978 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.32501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32566.log 2024-01-23T09:32:12.978 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34587.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32501.log.gz 2024-01-23T09:32:12.979 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.33922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35337.log 2024-01-23T09:32:12.979 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34587.log.gz 2024-01-23T09:32:12.979 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36490.log 2024-01-23T09:32:12.979 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33922.log.gz 2024-01-23T09:32:12.979 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.32566.log: /var/log/ceph/ceph-client.admin.35337.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36412.log 2024-01-23T09:32:12.979 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32566.log.gz 2024-01-23T09:32:12.979 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-01-23T09:32:12.979 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36490.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.35337.log.gz 2024-01-23T09:32:12.979 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34869.log 2024-01-23T09:32:12.979 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36490.log.gz 2024-01-23T09:32:12.979 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36412.log.gz 2024-01-23T09:32:12.979 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36698.log 2024-01-23T09:32:12.979 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34355.log 2024-01-23T09:32:12.979 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34869.log: /var/log/ceph/ceph-client.admin.36698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35051.log 2024-01-23T09:32:12.979 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9%/var/log/ceph/ceph-client.admin.34355.log: -- replaced with /var/log/ceph/ceph-client.admin.34869.log.gz 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36698.log.gz 2024-01-23T09:32:12.980 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-01-23T09:32:12.980 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34355.log.gz 2024-01-23T09:32:12.980 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-01-23T09:32:12.980 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36776.log 2024-01-23T09:32:12.980 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.35051.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33407.log 2024-01-23T09:32:12.980 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35051.log.gz 2024-01-23T09:32:12.980 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36776.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36776.log.gz 2024-01-23T09:32:12.980 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34730.log 2024-01-23T09:32:12.980 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.33407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34001.log 2024-01-23T09:32:12.980 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34730.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34730.log.gz 2024-01-23T09:32:12.980 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33049.log 2024-01-23T09:32:12.980 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34001.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34001.log.gz 2024-01-23T09:32:12.980 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34973.log 2024-01-23T09:32:12.980 INFO:teuthology.orchestra.run.smithi046.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.33407.log.gz 2024-01-23T09:32:12.981 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.33049.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33049.log.gz 2024-01-23T09:32:12.981 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34553.log 2024-01-23T09:32:12.981 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33075.log 2024-01-23T09:32:12.981 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34553.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34973.log.gz 2024-01-23T09:32:12.981 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34553.log.gz 2024-01-23T09:32:12.981 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34382.log 2024-01-23T09:32:12.981 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.33075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36078.log 2024-01-23T09:32:12.981 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33075.log.gz/var/log/ceph/ceph-client.admin.34382.log: 2024-01-23T09:32:12.981 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34382.log.gz 2024-01-23T09:32:12.981 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34947.log 2024-01-23T09:32:12.981 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33019.log 2024-01-23T09:32:12.981 INFO:teuthology.orchestra.run.smithi046.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36078.log.gz 2024-01-23T09:32:12.981 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37013.log 2024-01-23T09:32:12.981 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34947.log.gz 2024-01-23T09:32:12.982 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.33019.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33019.log.gz 2024-01-23T09:32:12.982 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34159.log 2024-01-23T09:32:12.982 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.37013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36438.log 2024-01-23T09:32:12.982 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37013.log.gz/var/log/ceph/ceph-client.admin.34159.log: 2024-01-23T09:32:12.982 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36464.log 2024-01-23T09:32:12.982 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34159.log.gz 2024-01-23T09:32:12.982 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36438.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36438.log.gz 2024-01-23T09:32:12.986 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph.audit.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-23T09:32:12.986 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2024-01-23T09:32:12.986 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mds.d.log: 93.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-23T09:32:12.986 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.f.log 2024-01-23T09:32:12.987 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/valgrind/mon.c.log: 55.0% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2024-01-23T09:32:12.987 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.b.log 2024-01-23T09:32:12.987 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/valgrind/mds.f.log: 95.5% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2024-01-23T09:32:12.987 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.d.log 2024-01-23T09:32:12.987 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/valgrind/mds.b.log: 92.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-01-23T09:32:12.987 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2024-01-23T09:32:12.987 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/valgrind/mds.d.log: 57.8% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz 2024-01-23T09:32:12.987 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-01-23T09:32:12.987 INFO:teuthology.orchestra.run.smithi175.stderr: 95.4% -- replaced with /var/log/ceph/valgrind/mds.b.log.gz 2024-01-23T09:32:12.987 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-01-23T09:32:12.987 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/valgrind/mon.b.log: /var/log/ceph/ceph-mds.b.log: 54.9% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2024-01-23T09:32:12.987 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-01-23T09:32:12.990 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35025.log 2024-01-23T09:32:12.991 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36464.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36464.log.gz 2024-01-23T09:32:12.991 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37169.log 2024-01-23T09:32:12.991 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.35025.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35025.log.gz 2024-01-23T09:32:12.991 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34327.log 2024-01-23T09:32:12.991 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.37169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35129.log 2024-01-23T09:32:12.991 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9%/var/log/ceph/ceph-client.admin.34327.log: -- replaced with /var/log/ceph/ceph-client.admin.37169.log.gz 2024-01-23T09:32:12.991 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34327.log.gz 2024-01-23T09:32:12.991 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36724.log 2024-01-23T09:32:12.991 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33808.log 2024-01-23T09:32:12.991 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.35129.log: /var/log/ceph/ceph-client.admin.36724.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35129.log.gz 2024-01-23T09:32:12.991 INFO:teuthology.orchestra.run.smithi046.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36724.log.gz 2024-01-23T09:32:12.991 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34406.log 2024-01-23T09:32:12.991 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36750.log 2024-01-23T09:32:12.992 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.33808.log: /var/log/ceph/ceph-client.admin.34406.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33808.log.gz 2024-01-23T09:32:12.992 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34406.log.gz 2024-01-23T09:32:12.992 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-01-23T09:32:12.992 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27551.log 2024-01-23T09:32:12.992 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36750.log: /var/log/ceph/ceph-osd.3.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36750.log.gz 2024-01-23T09:32:12.992 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34580.log 2024-01-23T09:32:12.992 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.27551.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.27551.log.gz 2024-01-23T09:32:12.992 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34765.log 2024-01-23T09:32:12.992 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34580.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34580.log.gz 2024-01-23T09:32:12.994 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mon.b.log: 95.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-01-23T09:32:12.994 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27467.log 2024-01-23T09:32:12.995 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34999.log 2024-01-23T09:32:12.995 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34765.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34765.log.gz 2024-01-23T09:32:12.995 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35077.log 2024-01-23T09:32:12.995 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34999.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34999.log.gz 2024-01-23T09:32:12.995 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36156.log 2024-01-23T09:32:12.996 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.35077.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35077.log.gz 2024-01-23T09:32:12.996 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33281.log 2024-01-23T09:32:12.997 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36156.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36156.log.gz 2024-01-23T09:32:12.997 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33594.log 2024-01-23T09:32:12.997 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.33281.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33281.log.gz 2024-01-23T09:32:12.997 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34155.log 2024-01-23T09:32:12.998 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.33594.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33594.log.gz 2024-01-23T09:32:12.999 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.27467.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.27467.log.gz 2024-01-23T09:32:12.999 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35550.log 2024-01-23T09:32:13.000 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34155.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34155.log.gz 2024-01-23T09:32:13.000 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32627.log 2024-01-23T09:32:13.001 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.35550.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35550.log.gz 2024-01-23T09:32:13.001 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34843.log 2024-01-23T09:32:13.002 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.32627.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32627.log.gz 2024-01-23T09:32:13.002 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36672.log 2024-01-23T09:32:13.003 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34843.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34843.log.gz 2024-01-23T09:32:13.003 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36620.log 2024-01-23T09:32:13.004 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36672.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36672.log.gz 2024-01-23T09:32:13.005 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33621.log 2024-01-23T09:32:13.006 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36620.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36620.log.gz 2024-01-23T09:32:13.006 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34895.log 2024-01-23T09:32:13.007 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.33621.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33621.log.gz 2024-01-23T09:32:13.007 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36854.log 2024-01-23T09:32:13.008 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34895.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34895.log.gz 2024-01-23T09:32:13.009 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36594.log 2024-01-23T09:32:13.010 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36854.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36854.log.gz 2024-01-23T09:32:13.010 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35207.log 2024-01-23T09:32:13.011 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36594.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36594.log.gz 2024-01-23T09:32:13.011 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33153.log 2024-01-23T09:32:13.012 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.35207.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35207.log.gz 2024-01-23T09:32:13.012 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33127.log 2024-01-23T09:32:13.013 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.33153.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33153.log.gz 2024-01-23T09:32:13.014 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-01-23T09:32:13.015 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.33127.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33127.log.gz 2024-01-23T09:32:13.015 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36261.log 2024-01-23T09:32:13.024 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33888.log 2024-01-23T09:32:13.025 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36261.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36261.log.gz 2024-01-23T09:32:13.036 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36342.log 2024-01-23T09:32:13.037 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.33888.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33888.log.gz 2024-01-23T09:32:13.037 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33490.log 2024-01-23T09:32:13.038 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36342.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36342.log.gz 2024-01-23T09:32:13.050 INFO:teuthology.orchestra.run.smithi175.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-01-23T09:32:13.052 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34053.log 2024-01-23T09:32:13.053 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.33490.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33490.log.gz 2024-01-23T09:32:13.060 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34154.log 2024-01-23T09:32:13.061 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34053.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34053.log.gz 2024-01-23T09:32:13.067 INFO:teuthology.orchestra.run.smithi175.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-01-23T09:32:13.072 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34151.log 2024-01-23T09:32:13.073 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34154.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.34154.log.gz 2024-01-23T09:32:13.084 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34354.log 2024-01-23T09:32:13.085 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34151.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34151.log.gz 2024-01-23T09:32:13.096 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36316.log 2024-01-23T09:32:13.097 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34354.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34354.log.gz 2024-01-23T09:32:13.108 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34156.log 2024-01-23T09:32:13.109 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36316.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36316.log.gz 2024-01-23T09:32:13.109 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37039.log 2024-01-23T09:32:13.110 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34156.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34156.log.gz 2024-01-23T09:32:13.110 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36182.log 2024-01-23T09:32:13.111 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.37039.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37039.log.gz 2024-01-23T09:32:13.111 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34358.log 2024-01-23T09:32:13.112 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36182.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36182.log.gz 2024-01-23T09:32:13.112 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35439.log 2024-01-23T09:32:13.113 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34358.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34358.log.gz 2024-01-23T09:32:13.113 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34079.log 2024-01-23T09:32:13.115 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.35439.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.35439.log.gz 2024-01-23T09:32:13.115 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27440.log 2024-01-23T09:32:13.116 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34079.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34079.log.gz 2024-01-23T09:32:13.116 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-23T09:32:13.117 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.27440.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.27440.log.gz 2024-01-23T09:32:13.117 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36963.log 2024-01-23T09:32:13.122 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.log: 87.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-23T09:32:13.123 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37143.log 2024-01-23T09:32:13.123 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36963.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36963.log.gz 2024-01-23T09:32:13.123 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33205.log 2024-01-23T09:32:13.124 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.37143.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37143.log.gz 2024-01-23T09:32:13.124 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36235.log 2024-01-23T09:32:13.125 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.33205.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33205.log.gz 2024-01-23T09:32:13.125 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34145.log 2024-01-23T09:32:13.129 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36235.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36235.log.gz 2024-01-23T09:32:13.129 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33862.log 2024-01-23T09:32:13.129 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34145.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34145.log.gz 2024-01-23T09:32:13.129 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33836.log 2024-01-23T09:32:13.129 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.33862.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33862.log.gz 2024-01-23T09:32:13.129 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35235.log 2024-01-23T09:32:13.130 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.33836.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33836.log.gz 2024-01-23T09:32:13.130 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33751.log 2024-01-23T09:32:13.130 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.35235.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35235.log.gz 2024-01-23T09:32:13.131 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34638.log 2024-01-23T09:32:13.131 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.33751.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33751.log.gz 2024-01-23T09:32:13.131 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34147.log 2024-01-23T09:32:13.132 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34638.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34638.log.gz 2024-01-23T09:32:13.133 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27241.log 2024-01-23T09:32:13.133 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34147.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34147.log.gz 2024-01-23T09:32:13.134 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35155.log 2024-01-23T09:32:13.135 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.27241.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.27241.log.gz 2024-01-23T09:32:13.136 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32933.log 2024-01-23T09:32:13.136 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.35155.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35155.log.gz 2024-01-23T09:32:13.136 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33231.log 2024-01-23T09:32:13.137 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.32933.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32933.log.gz 2024-01-23T09:32:13.137 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36386.log 2024-01-23T09:32:13.138 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.33231.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.33231.log.gz 2024-01-23T09:32:13.139 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36130.log 2024-01-23T09:32:13.139 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36386.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36386.log.gz 2024-01-23T09:32:13.140 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-23T09:32:13.140 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36130.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36130.log.gz 2024-01-23T09:32:13.141 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-01-23T09:32:13.142 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.audit.log: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-23T09:32:13.142 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36906.log 2024-01-23T09:32:13.156 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35489.log 2024-01-23T09:32:13.157 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36906.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36906.log.gz 2024-01-23T09:32:13.164 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36802.log 2024-01-23T09:32:13.165 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.35489.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.35489.log.gz 2024-01-23T09:32:13.172 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-01-23T09:32:13.172 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36802.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36802.log.gz 2024-01-23T09:32:13.180 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32881.log 2024-01-23T09:32:13.188 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36987.log 2024-01-23T09:32:13.188 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.32881.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32881.log.gz 2024-01-23T09:32:13.209 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34769.log 2024-01-23T09:32:13.209 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36987.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36987.log.gz 2024-01-23T09:32:13.220 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34682.log 2024-01-23T09:32:13.221 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34769.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34769.log.gz 2024-01-23T09:32:13.223 INFO:teuthology.orchestra.run.smithi046.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-01-23T09:32:13.232 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32800.log 2024-01-23T09:32:13.232 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34682.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34682.log.gz 2024-01-23T09:32:13.248 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33975.log 2024-01-23T09:32:13.249 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.32800.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32800.log.gz 2024-01-23T09:32:13.258 INFO:teuthology.orchestra.run.smithi046.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-01-23T09:32:13.258 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35261.log 2024-01-23T09:32:13.259 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.33975.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33975.log.gz 2024-01-23T09:32:13.260 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/client.0.log 2024-01-23T09:32:13.261 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.35261.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35261.log.gz 2024-01-23T09:32:13.261 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 2024-01-23T09:32:13.262 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/valgrind/client.0.log: 77.9% -- replaced with /var/log/ceph/valgrind/client.0.log.gz 2024-01-23T09:32:13.262 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2024-01-23T09:32:13.265 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/valgrind/mds.a.log: 95.3% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2024-01-23T09:32:13.266 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2024-01-23T09:32:13.266 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/valgrind/mon.a.log: 55.0% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2024-01-23T09:32:13.267 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.e.log 2024-01-23T09:32:13.272 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/valgrind/mds.c.log: 95.3% -- replaced with /var/log/ceph/valgrind/mds.c.log.gz 2024-01-23T09:32:13.272 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36104.log 2024-01-23T09:32:13.274 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/valgrind/mds.e.log: 95.3% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 2024-01-23T09:32:13.274 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36050.log 2024-01-23T09:32:13.276 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36104.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36104.log.gz 2024-01-23T09:32:13.276 INFO:teuthology.orchestra.run.smithi046.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-01-23T09:32:13.276 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33568.log 2024-01-23T09:32:13.276 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36880.log 2024-01-23T09:32:13.278 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.33568.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36050.log.gz 2024-01-23T09:32:13.279 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33568.log.gz 2024-01-23T09:32:13.279 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33516.log 2024-01-23T09:32:13.279 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33179.log 2024-01-23T09:32:13.279 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.33516.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36880.log.gz 2024-01-23T09:32:13.279 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33673.log 2024-01-23T09:32:13.279 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33516.log.gz 2024-01-23T09:32:13.279 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.33179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36209.log 2024-01-23T09:32:13.279 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.33673.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33179.log.gz 2024-01-23T09:32:13.282 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33542.log 2024-01-23T09:32:13.282 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33673.log.gz 2024-01-23T09:32:13.282 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37091.log 2024-01-23T09:32:13.282 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36209.log.gz/var/log/ceph/ceph-client.admin.33542.log: 2024-01-23T09:32:13.282 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33699.log 2024-01-23T09:32:13.282 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33542.log.gz 2024-01-23T09:32:13.282 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.37091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33647.log 2024-01-23T09:32:13.283 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2%/var/log/ceph/ceph-client.admin.33699.log: -- replaced with /var/log/ceph/ceph-client.admin.37091.log.gz 2024-01-23T09:32:13.283 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33699.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34105.log 2024-01-23T09:32:13.283 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-01-23T09:32:13.283 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.33647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36935.log 2024-01-23T09:32:13.283 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34105.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33647.log.gz 2024-01-23T09:32:13.286 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22433.log 2024-01-23T09:32:13.287 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34105.log.gz 2024-01-23T09:32:13.287 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32855.log 2024-01-23T09:32:13.287 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36935.log.gz/var/log/ceph/ceph.tmp-client.admin.22433.log: 2024-01-23T09:32:13.287 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22433.log.gz 2024-01-23T09:32:13.287 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34783.log 2024-01-23T09:32:13.287 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.32855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34577.log 2024-01-23T09:32:13.287 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34783.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32855.log.gz 2024-01-23T09:32:13.287 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34783.log.gz 2024-01-23T09:32:13.287 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34322.log 2024-01-23T09:32:13.287 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36542.log 2024-01-23T09:32:13.287 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34322.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34577.log.gz 2024-01-23T09:32:13.287 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34322.log.gz 2024-01-23T09:32:13.287 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-01-23T09:32:13.287 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34921.log 2024-01-23T09:32:13.289 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6%/var/log/ceph/ceph-mds.e.log: -- replaced with /var/log/ceph/ceph-client.admin.36542.log.gz 2024-01-23T09:32:13.289 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36828.log 2024-01-23T09:32:13.289 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34921.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34921.log.gz 2024-01-23T09:32:13.289 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35287.log 2024-01-23T09:32:13.290 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36828.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36828.log.gz 2024-01-23T09:32:13.290 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34678.log 2024-01-23T09:32:13.291 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.35287.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.35287.log.gz 2024-01-23T09:32:13.291 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33101.log 2024-01-23T09:32:13.292 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34678.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34678.log.gz 2024-01-23T09:32:13.293 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33464.log 2024-01-23T09:32:13.293 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.33101.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33101.log.gz 2024-01-23T09:32:13.294 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33948.log 2024-01-23T09:32:13.295 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.33464.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33464.log.gz 2024-01-23T09:32:13.295 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36646.log 2024-01-23T09:32:13.296 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.33948.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33948.log.gz 2024-01-23T09:32:13.297 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.36646.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36646.log.gz 2024-01-23T09:32:13.544 INFO:teuthology.orchestra.run.smithi175.stderr:gzip: /var/log/ceph/ceph-mon.c.log: file size changed while zipping 2024-01-23T09:32:13.544 INFO:teuthology.orchestra.run.smithi175.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-01-23T09:32:13.804 INFO:teuthology.orchestra.run.smithi175.stderr:gzip: /var/log/ceph/ceph-mon.b.log: file size changed while zipping 2024-01-23T09:32:13.804 INFO:teuthology.orchestra.run.smithi175.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-01-23T09:32:14.502 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/ceph-mon.a.log: file size changed while zipping 2024-01-23T09:32:14.523 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-01-23T09:32:14.985 INFO:teuthology.orchestra.run.smithi175.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-01-23T09:32:15.209 INFO:teuthology.orchestra.run.smithi046.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-01-23T09:32:15.314 INFO:teuthology.orchestra.run.smithi175.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-01-23T09:32:15.729 INFO:teuthology.orchestra.run.smithi046.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-01-23T09:32:15.750 INFO:teuthology.orchestra.run.smithi175.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-01-23T09:32:15.752 INFO:teuthology.orchestra.run.smithi175.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-01-23T09:32:15.754 INFO:teuthology.orchestra.run.smithi175.stderr: 2024-01-23T09:32:15.754 INFO:teuthology.orchestra.run.smithi175.stderr:real 0m2.813s 2024-01-23T09:32:15.754 INFO:teuthology.orchestra.run.smithi175.stderr:user 0m11.227s 2024-01-23T09:32:15.754 INFO:teuthology.orchestra.run.smithi175.stderr:sys 0m0.348s 2024-01-23T09:32:16.335 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-01-23T09:32:16.581 INFO:teuthology.orchestra.run.smithi046.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-01-23T09:32:16.802 INFO:teuthology.orchestra.run.smithi046.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-01-23T09:32:18.709 INFO:teuthology.orchestra.run.smithi046.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.0.35670.log.gz 2024-01-23T09:32:21.632 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~5s 2024-01-23T09:32:23.367 INFO:teuthology.orchestra.run.smithi046.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-01-23T09:32:23.368 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-01-23T09:32:23.368 INFO:teuthology.orchestra.run.smithi046.stderr:real 0m10.441s 2024-01-23T09:32:23.368 INFO:teuthology.orchestra.run.smithi046.stderr:user 0m29.491s 2024-01-23T09:32:23.368 INFO:teuthology.orchestra.run.smithi046.stderr:sys 0m0.938s 2024-01-23T09:32:23.369 INFO:tasks.ceph:Archiving logs... 2024-01-23T09:32:23.369 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-01-22_19:46:51-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7527402/remote/smithi046/log 2024-01-23T09:32:23.370 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-23T09:32:26.818 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-01-22_19:46:51-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7527402/remote/smithi175/log 2024-01-23T09:32:26.819 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-23T09:32:26.900 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~11s 2024-01-23T09:32:28.330 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/github.com_cbodley_ceph_9db6bac5568c8be6cfd98da20bd2b62582f0776f/qa/tasks/ceph.py", line 329, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_cbodley_ceph_9db6bac5568c8be6cfd98da20bd2b62582f0776f/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_cbodley_ceph_9db6bac5568c8be6cfd98da20bd2b62582f0776f/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_cbodley_ceph_9db6bac5568c8be6cfd98da20bd2b62582f0776f/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_cbodley_ceph_9db6bac5568c8be6cfd98da20bd2b62582f0776f/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions 2024-01-23T09:32:28.331 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-01-23T09:32:28.343 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_cbodley_ceph_9db6bac5568c8be6cfd98da20bd2b62582f0776f/qa/tasks/ceph.py", line 329, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_cbodley_ceph_9db6bac5568c8be6cfd98da20bd2b62582f0776f/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_cbodley_ceph_9db6bac5568c8be6cfd98da20bd2b62582f0776f/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_cbodley_ceph_9db6bac5568c8be6cfd98da20bd2b62582f0776f/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_cbodley_ceph_9db6bac5568c8be6cfd98da20bd2b62582f0776f/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions 2024-01-23T09:32:28.344 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-01-23T09:32:28.344 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-23T09:32:28.346 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-23T09:32:28.421 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-01-23T09:32:28.433 INFO:teuthology.task.clock:Checking final clock skew... 2024-01-23T09:32:28.433 DEBUG:teuthology.orchestra.run.smithi046:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-23T09:32:28.435 DEBUG:teuthology.orchestra.run.smithi175:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-23T09:32:28.447 INFO:teuthology.orchestra.run.smithi046.stdout: remote refid st t when poll reach delay offset jitter 2024-01-23T09:32:28.447 INFO:teuthology.orchestra.run.smithi046.stdout:============================================================================== 2024-01-23T09:32:28.447 INFO:teuthology.orchestra.run.smithi046.stdout:*hv01.front.sepi 44.4.53.2 2 u 52 64 377 0.069 -1.066 0.132 2024-01-23T09:32:28.447 INFO:teuthology.orchestra.run.smithi046.stdout:+hv02.front.sepi 63.231.80.2 3 u 54 64 377 0.090 +0.638 0.070 2024-01-23T09:32:28.447 INFO:teuthology.orchestra.run.smithi046.stdout:+hv03.front.sepi 74.6.168.72 3 u 22 64 377 0.078 -0.344 0.121 2024-01-23T09:32:28.447 INFO:teuthology.orchestra.run.smithi046.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-01-23T09:32:28.448 INFO:teuthology.orchestra.run.smithi175.stdout: remote refid st t when poll reach delay offset jitter 2024-01-23T09:32:28.449 INFO:teuthology.orchestra.run.smithi175.stdout:============================================================================== 2024-01-23T09:32:28.449 INFO:teuthology.orchestra.run.smithi175.stdout:*hv01.front.sepi 44.4.53.2 2 u 34 128 377 0.198 -3.453 1.353 2024-01-23T09:32:28.449 INFO:teuthology.orchestra.run.smithi175.stdout:+hv02.front.sepi 63.231.80.2 3 u 123 128 377 0.194 -3.401 0.833 2024-01-23T09:32:28.449 INFO:teuthology.orchestra.run.smithi175.stdout:+hv03.front.sepi 74.6.168.72 3 u 109 128 377 0.132 -4.392 0.620 2024-01-23T09:32:28.449 INFO:teuthology.orchestra.run.smithi175.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-01-23T09:32:28.450 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-01-23T09:32:28.464 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-01-23T09:32:28.465 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-01-23T09:32:28.497 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-01-23T09:32:28.530 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-01-23T09:32:28.564 INFO:teuthology.task.internal:Duration was 3339.893360 seconds 2024-01-23T09:32:28.564 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-01-23T09:32:28.598 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-01-23T09:32:28.598 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-23T09:32:28.600 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-23T09:32:28.637 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-01-23T09:32:28.637 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi046.front.sepia.ceph.com 2024-01-23T09:32:28.638 DEBUG:teuthology.orchestra.run.smithi046:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-23T09:32:28.690 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi175.front.sepia.ceph.com 2024-01-23T09:32:28.690 DEBUG:teuthology.orchestra.run.smithi175:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-23T09:32:28.700 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-01-23T09:32:28.701 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-23T09:32:28.733 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-23T09:32:28.770 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-01-23T09:32:28.771 DEBUG:teuthology.orchestra.run.smithi046:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-23T09:32:28.805 DEBUG:teuthology.orchestra.run.smithi175:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-23T09:32:28.873 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-01-23T09:32:28.887 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-01-23T09:32:28.887 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-23T09:32:28.898 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-23T09:32:28.909 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-01-23T09:32:28.953 DEBUG:teuthology.orchestra.run.smithi046:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-23T09:32:28.955 DEBUG:teuthology.orchestra.run.smithi175:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-23T09:32:28.964 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = core 2024-01-23T09:32:28.967 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = core 2024-01-23T09:32:28.995 DEBUG:teuthology.orchestra.run.smithi046:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-23T09:32:29.024 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-23T09:32:29.025 DEBUG:teuthology.orchestra.run.smithi175:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-23T09:32:29.041 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-23T09:32:29.042 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-01-23T09:32:29.052 INFO:teuthology.task.internal:Transferring archived files... 2024-01-23T09:32:29.053 DEBUG:teuthology.misc:Transferring archived files from smithi046:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-01-22_19:46:51-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7527402/remote/smithi046 2024-01-23T09:32:29.053 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-23T09:32:29.089 DEBUG:teuthology.misc:Transferring archived files from smithi175:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-01-22_19:46:51-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7527402/remote/smithi175 2024-01-23T09:32:29.089 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-23T09:32:29.109 INFO:teuthology.task.internal:Removing archive directory... 2024-01-23T09:32:29.109 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-23T09:32:29.129 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-23T09:32:29.155 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-01-23T09:32:29.168 INFO:teuthology.task.internal:Not uploading archives. 2024-01-23T09:32:29.168 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-01-23T09:32:29.224 INFO:teuthology.task.internal:Tidying up after the test... 2024-01-23T09:32:29.227 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-23T09:32:29.230 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-23T09:32:29.234 INFO:teuthology.orchestra.run.smithi046.stdout: 655473 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 23 09:32 /home/ubuntu/cephtest 2024-01-23T09:32:29.235 INFO:teuthology.orchestra.run.smithi175.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 23 09:32 /home/ubuntu/cephtest 2024-01-23T09:32:29.237 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-01-23T09:32:29.256 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-01-23T09:32:29.291 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions 2024-01-23T09:32:29.291 INFO:teuthology.nuke:Checking targets against current locks 2024-01-23T09:32:29.319 DEBUG:teuthology.nuke:shortname: smithi046 2024-01-23T09:32:29.319 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-23T09:32:29.345 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-01-22_19:46:51-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7527402', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-23 08:27:40.841995', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOBg1hcnBuGx7jM7i325dTMohQb3/NxqEgH4TkiCDEurU1rMgwiIew0H5aqftIlUd8slseNALE2EVbg4l2VAyuw='} 2024-01-23T09:32:29.347 DEBUG:teuthology.nuke:shortname: smithi175 2024-01-23T09:32:29.347 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-23T09:32:29.371 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-01-22_19:46:51-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7527402', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-23 08:27:40.843736', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMs8YH4mKA99SvOyE1azd3KjV93HQxKIp4TgOO8kSIy+8wn9J4vdlCcOL9MZ5gC7XzKUJI7bOrtMI6hyrXJj/3c='} 2024-01-23T09:32:29.398 INFO:teuthology.orchestra.console.smithi046:Power off 2024-01-23T09:32:29.398 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T09:32:29.425 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off 2024-01-23T09:32:29.425 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T09:32:29.441 INFO:teuthology.orchestra.console.smithi175:Power off 2024-01-23T09:32:29.441 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T09:32:29.454 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2024-01-23T09:32:29.463 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2024-01-23T09:32:29.463 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T09:32:29.488 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2024-01-23T09:32:32.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~16s 2024-01-23T09:32:33.455 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T09:32:33.489 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T09:32:33.566 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2024-01-23T09:32:33.601 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2024-01-23T09:32:37.104 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~21s 2024-01-23T09:32:37.104 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-01-23T09:32:37.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-01-23T09:32:37.568 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T09:32:37.603 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T09:32:37.679 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2024-01-23T09:32:37.715 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2024-01-23T09:32:37.815 INFO:teuthology.orchestra.console.smithi175:Power off completed 2024-01-23T09:32:41.680 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T09:32:41.791 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2024-01-23T09:32:41.892 INFO:teuthology.orchestra.console.smithi046:Power off completed 2024-01-23T09:32:41.997 INFO:teuthology.run:Summary data: description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} duration: 3339.8933601379395 failure_reason: 'valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions' flavor: default owner: scheduled_cbodley@teuthology status: fail success: false 2024-01-23T09:32:41.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T09:32:42.085 INFO:teuthology.run:FAIL